[pylucene-dev] control memory leaks during indexing.

Andi Vajda vajda at osafoundation.org
Tue Jul 22 02:28:37 PDT 2008


On Jul 22, 2008, at 9:14, "Antony Joseph" <antonyjoseph89 at gmail.com>  
wrote:

> Hi all,
>
> I am using Lucene 2.3.1 and JCC 1.6 to create an index of my python- 
> based application(for searching).
> Everything is working fine.After some time(3 hours later) i found my  
> python memory consumptions is grown to high
> when i started the applcaition(indexing) the  python consumption is  
> 40 mb , after 3 hours the python consumption shows 140mb . The  
> process crashes with a [Python] MemoryError.the performance of  
> Indexing become poor and memory leaks.
>
> please help me to solve the problem.

First, get the latest PyLucene 2.3.2 with JCC 1.9 (source tarball from http://pylucene.osafoundation.org 
).

Then, consider increasing the Java VM's memory limits (see README and  
the parameters to initVM()), 140 Mb for a long indexing session is  
rather small. It might be good to ask on java-user at lucene.apache.org  
about memory use patterns as well.

Andi..

>
>
>
> Thanks
> Antony
>
>
>
>
> _______________________________________________
> pylucene-dev mailing list
> pylucene-dev at osafoundation.org
> http://lists.osafoundation.org/mailman/listinfo/pylucene-dev


More information about the pylucene-dev mailing list