[pylucene-dev] Large index files: Sort leads to "GC Warning: Repeated allocation of very large block"

[Andi Vajda]

On Tue, 18 Dec 2007, Marc Weeber wrote:

> Is there a way to a) be more prudent on the memory usage or b) another more 
> memory efficient (and without warnings) way of getting the cooccurrence info?

Yes, you might have better luck at controlling and watching memory usage by 
switching to a regular Java VM, switching to the JCC flavor of PyLucene.

     http://svn.osafoundation.org/pylucene/trunk/jcc

The gcj flavor is on its way to deprecation as the open source Java energies 
seem to be moving to openjdk, away from gcj.

If you'd like to stick with gcj, you might want to ask java at gcc.gnu.org 
about memory use and control.

Andi..