[pylucene-dev] PyLucene in CherryPy

[Julien Anguenot]

Hi,

Catalin Constantin wrote:
> Hi there,
> 
> i just downloaded NXLucene and i can't find any "multi thread" bubu.
> it uses twisted to run the XML RPC server but there is no:
> threads.deferToThread or anything like that.
> 
> the twisted "server" by default handles one request after another.
> till the first one is finished the 2nd one is put on hold.
> 
> it would be nice to share with us how is the multi thread handled.

There's a PyLucene.PythonThread thread pool for aysnc write operations
here :
http://svn.nuxeo.org/trac/pub/browser/NXLucene/trunk/src/nxlucene/threadpool.py

For the searches, I found the use of Defered slower than when the main
thread is replying for sync requestes. Though, as I said, we are still
optimizing and trying out different implementation for the server. The
twisted defered experimentation I did is here :

http://svn.nuxeo.org/trac/pub/browser/NXLucene/branches/twisteddeferred

I still need to investigate this some more.

> for eg: i tried with twisted, and each time i deferred to Thread i got
> a core dump (Cause of gcj and co.).
> i also tried to replace the "threads" in twisted with PythonThread but
> any request was hanging the server.

Same as always : what are the PyLucene tests saying ? and what about the
NXLucene ones on your box ? (c.f README.txt). That's the first place to
investigate. If you got core dumps then I believe the PyLucene libs are
not well installed on your box.

> import threading
> threading.Thread = PythonThread

It's done over there in the tac file. See :
http://svn.nuxeo.org/trac/pub/browser/NXLucene/trunk/etc/service.tac

Cheers,

	J.


> Wednesday, June 28, 2006, 3:57:45 AM, Julien Anguenot wrote:
>> NXLucene is *standalone* (not Zope related !) multi-threaded
>> Lucene-based text indexing server using Twisted and PyLucene. It may be
>> of interest in your case, I don't know.
> 
> 


-- 
Julien Anguenot | Nuxeo R&D (Paris, France)
Open Source ECM - www.nuxeo.com
CPS Platform - http://www.cps-project.org
Mobile: +33 (0) 6 72 57 57 66

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 252 bytes
Desc: OpenPGP digital signature
Url : http://lists.osafoundation.org/pipermail/pylucene-dev/attachments/20060628/e97b2356/signature.pgp