{ "attachments": [], "comments_archived": true, "date": "2003-09-02T04:22:53.000Z", "layout": "post", "title": "Using web services and XSLT to scrape RSS from HTML", "wordpress_id": 472, "wordpress_slug": "xsl-scraper", "wordpress_url": "http://www.decafbad.com/blog/?p=472", "year": "2003", "month": "09", "day": "02", "isDir": true, "slug": "xsl-scraper", "type": "entry", "postName": "2003-09-02-xsl-scraper", "html": "

\nAfter tinkering a bit with\nweb services and XSLT-based scraping\nlast week for generating RSS from HTML, I ripped out some work I was\ndoing for a Java-based scraper I'd started\nworking on last year and\nthrew together a kit of XSLT files that does most everything I was trying\nto do.\n

\nI'm calling this kit XslScraper, and there's further blurbage and download links\navaiable in the Wiki. Check it out. I've got shell scripts to run the stuff\nfrom as a cron job, and CGI scripts to run it all from web services.\n

\nFor quick gratification, check out these feeds:\n

\n\n\n

\n\n\n\n\n\n

shortname=xsl_scraper

\n

Archived Comments

\n\n\n\n
\n\n\n", "body": "

\r\n

\r\nAfter tinkering a bit with\r\nweb services and XSLT-based scraping\r\nlast week for generating RSS from HTML, I ripped out some work I was\r\ndoing for a Java-based scraper I'd started\r\nworking on last year and\r\nthrew together a kit of XSLT files that does most everything I was trying\r\nto do.\r\n

\r\nI'm calling this kit XslScraper, and there's further blurbage and download links\r\navaiable in the Wiki. Check it out. I've got shell scripts to run the stuff\r\nfrom as a cron job, and CGI scripts to run it all from web services.\r\n

\r\nFor quick gratification, check out these feeds:\r\n

\r\n

\r\n\r\nshortname=xsl_scraper\r\n\r\n
\r\n

Archived Comments

\r\n \r\n \r\n \r\n
\r\n ", "parentPath": "./content/posts/archives/2003/2003-09-02-xsl-scraper", "path": "2003/09/02/xsl-scraper", "thumbnail": "http://www.decafbad.com/images/xml.gif", "summary": "After tinkering a bit with\nweb services and XSLT-based scraping\nlast week for generating RSS from HTML, I ripped out some work I was\ndoing for a Java-based scraper I'd started\nworking on last year and\nthrew together a kit of XSLT files that does most everything I was trying\nto do.\n\nI'm calling this kit XslScraper, and there's further blurbage and download links\navaiable in the Wiki. Check it out. I've got shell scripts to run the stuff\nfrom as a cron job, and CGI scripts to run it all from web services.\n\nFor quick gratification, check out these feeds:\n\n - The Nation (using Bill Humphries' XSL) \n\n - KurzweilAI.net\n\n - J-List -- You've got a friend in Japan!\n\n - New JOBS at the University of Michigan (By Job Family)", "needsBuild": true, "prevPostPath": "2003/08/31/switched-to-jvds", "prevPostTitle": "Switching to a JVDS server", "nextPostPath": "2003/09/02/cl-to-rss", "nextPostTitle": "ChangeLog to RSS web service" }