[pylucene-dev] creating new Fragmenter

[Andi Vajda]

On Wed, 22 Nov 2006, Andi Vajda wrote:

> I should have a Fragmenter extension point later today...

I just released a new source tarball to

   http://downloads.osafoundation.org/PyLucene/src/PyLucene-src-2.0.0-5.tar.gz

built from the latest in Java Lucene and that supports implementing the 
highlighter package's Fragmenter interface from Python as is done below:

class NullFragmenter(object):
    def start(self, text):
        pass
    def isNewFragment(self, token):
        return False

highlighter.setTextFragmenter(NullFragmenter())

Andi..