[Dev] interesting blog entry I found

Mike Taylor bear at code-bear.com
Thu May 5 23:31:20 PDT 2005


This was an interesting blog entry I read today: 
http://ralphm.net/blog/2005/04/29/new_aggregator

What struck me was the part where he says:

<quote>
Instead of the built-in, synchronous, feed fetching support in Feed 
Parser, I wrote a fetcher using Twisted Web for fetching the pages 
asynchronously and handling the HTTP result codes. I ended up writing a 
custom class that mimics the interface of Feed Parser's build-in 
fetcher because I needed to inject the received headers into the feed 
parsing code. For example, Feed Parser can rewrite relative links in 
the HTML found in the feed's items. Among other pointers, it uses the 
received HTTP headers for this. Objects of this custom class are 
created from the retrieved feed and headers.
</quote>

This may be an interesting way to get rid of the issue where zaobao 
pulls all of the feeds at one time.  But I'm also thinking that the 
code could be used by any part of Chandler that needs to regularly pull 
from a web page.

anywho, just an FYI in case anyone else finds it interesting :)

---
Bear
http://code-bear.com

Open Source Applications Foundation (OSAF)
http://www.osafoundation.org

PGP Fingerprint = 9996 719F 973D B11B E111  D770 9331 E822 40B3 CD29

-------------- next part --------------
A non-text attachment was scrubbed...
Name: PGP.sig
Type: application/pgp-signature
Size: 186 bytes
Desc: This is a digitally signed message part
Url : http://lists.osafoundation.org/pipermail/dev/attachments/20050506/37ad625b/PGP.bin


More information about the Dev mailing list