[pylucene-dev] control memory leaks during indexing.
vajda at osafoundation.org
Tue Jul 22 02:28:37 PDT 2008
On Jul 22, 2008, at 9:14, "Antony Joseph" <antonyjoseph89 at gmail.com>
> Hi all,
> I am using Lucene 2.3.1 and JCC 1.6 to create an index of my python-
> based application(for searching).
> Everything is working fine.After some time(3 hours later) i found my
> python memory consumptions is grown to high
> when i started the applcaition(indexing) the python consumption is
> 40 mb , after 3 hours the python consumption shows 140mb . The
> process crashes with a [Python] MemoryError.the performance of
> Indexing become poor and memory leaks.
> please help me to solve the problem.
First, get the latest PyLucene 2.3.2 with JCC 1.9 (source tarball from http://pylucene.osafoundation.org
Then, consider increasing the Java VM's memory limits (see README and
the parameters to initVM()), 140 Mb for a long indexing session is
rather small. It might be good to ask on java-user at lucene.apache.org
about memory use patterns as well.
> pylucene-dev mailing list
> pylucene-dev at osafoundation.org
More information about the pylucene-dev