[pylucene-dev] PyLucene benchmarks
vajda at osafoundation.org
Wed Dec 1 16:18:25 PST 2004
> Huh. I use pre-compiled binaries of the lib on Linux box. That means I
> will not able to have segment file more that 2Gb, right?..
> I have like 1.5Gb already ;-)
Yes, that is correct as long as you use an FSDirectory.
You could use a DbDirectory instead, which is implemented on top of Berkeley
DB and you'd then get real transactions, real locking, and, I suppose, better
large file support. PyLucene binaries built with DbDirectory support are also
to be found on the pylucene server. They're named with -db-.
Currently, the -db- binaries are built with Berkeley DB 4.2.52 but the source
also supports building them with the very latest, recently released, version
The current FSDirectory size limitation is not a limitation of FSDirectory but
of the libgcj java runtime file implementation. That limitation is lifted with
the upcoming gcc/gcj/libgcj 4.0 release.
More information about the pylucene-dev