[Dev] interesting blog entry I found
Mike Taylor
bear at code-bear.com
Thu May 5 23:31:20 PDT 2005
This was an interesting blog entry I read today:
http://ralphm.net/blog/2005/04/29/new_aggregator
What struck me was the part where he says:
<quote>
Instead of the built-in, synchronous, feed fetching support in Feed
Parser, I wrote a fetcher using Twisted Web for fetching the pages
asynchronously and handling the HTTP result codes. I ended up writing a
custom class that mimics the interface of Feed Parser's build-in
fetcher because I needed to inject the received headers into the feed
parsing code. For example, Feed Parser can rewrite relative links in
the HTML found in the feed's items. Among other pointers, it uses the
received HTTP headers for this. Objects of this custom class are
created from the retrieved feed and headers.
</quote>
This may be an interesting way to get rid of the issue where zaobao
pulls all of the feeds at one time. But I'm also thinking that the
code could be used by any part of Chandler that needs to regularly pull
from a web page.
anywho, just an FYI in case anyone else finds it interesting :)
---
Bear
http://code-bear.com
Open Source Applications Foundation (OSAF)
http://www.osafoundation.org
PGP Fingerprint = 9996 719F 973D B11B E111 D770 9331 E822 40B3 CD29
-------------- next part --------------
A non-text attachment was scrubbed...
Name: PGP.sig
Type: application/pgp-signature
Size: 186 bytes
Desc: This is a digitally signed message part
Url : http://lists.osafoundation.org/pipermail/dev/attachments/20050506/37ad625b/PGP.bin
More information about the Dev
mailing list