[pylucene-dev] PyLucene benchmarks

[Andi Vajda]

> Huh. I use pre-compiled binaries of the lib on Linux box. That means I
> will not able to have segment file more that 2Gb, right?..
> I have like 1.5Gb already ;-)

Yes, that is correct as long as you use an FSDirectory.

You could use a DbDirectory instead, which is implemented on top of Berkeley 
DB and you'd then get real transactions, real locking, and, I suppose, better 
large file support. PyLucene binaries built with DbDirectory support are also 
to be found on the pylucene server. They're named with -db-.

Currently, the -db- binaries are built with Berkeley DB 4.2.52 but the source 
also supports building them with the very latest, recently released, version 
4.3.21.

The current FSDirectory size limitation is not a limitation of FSDirectory but 
of the libgcj java runtime file implementation. That limitation is lifted with 
the upcoming gcc/gcj/libgcj 4.0 release.

Andi..