{ "attachments": [], "comments_archived": true, "date": "2004-04-30T13:06:11.000Z", "excerpt": "I went a little nuts tonight with shell scripting.", "layout": "post", "tags": [ "colophon" ], "title": "Fun with shell scripting", "wordpress_id": 517, "wordpress_slug": "fun-with-shell-scripting", "wordpress_url": "http://www.decafbad.com/blog/?p=517", "year": "2004", "month": "04", "day": "30", "isDir": false, "slug": "fun-with-shell-scripting", "type": "entry", "postName": "2004-04-30-fun-with-shell-scripting", "html": "

I went a little nuts tonight with shell scripting. It started off with a few innocent bits of cat and grep piped together. But then I invited trouble started using sed. Pretty soon, I was bringing in cut and sort and uniq. I knew I was doomed when I made the whole mess start emailing me with sendmail.

\n

Oh, but then I went completely off the deep end. I looked up RSS 3.0, since that's so much easier to generate on the fly. I started producing that with a little help from echo and awk. From there, I whipped up a quick v3.0 to v0.91 converter so I could get something my aggregator could understand.

\n

It was all a very iterative process down a slippery slope of geekiness, and the resulting scripts are nothing that I'd've designed as such from scratch. But, one thing led to another, and now I've got a nightly report emailed to me of pages that have gone 404 and 500, and an RSS feed of referers to boot.

\n

I'm sure it looks like completely braindead work, but it was fun!

\n

Archived Comments

\n\n\n\n
\n\n\n", "body": "I went a little nuts tonight with shell scripting. It started off with a few innocent bits of [`cat`][cat] and [`grep`][grep] piped together. But then I invited trouble [started using][parse_log] [`sed`][sed]. Pretty soon, I was bringing in [`cut`][cut] and [`sort`][sort] and [`uniq`][uniq]. I knew I was doomed when I made the whole mess [start emailing me][mail400report] with [`sendmail`][sendmail]. \r\n\r\nOh, but then I went completely off the deep end. I looked up [RSS 3.0][rss30], since that's so much easier to generate on the fly. I started producing that with a little help from [`echo`][echo] and [`awk`][awk]. From there, I whipped up [a quick v3.0 to v0.91 converter][rss300to091] so I could get something [my aggregator][dbagg2] could understand.\r\n\r\nIt was all a very iterative process down a slippery slope of geekiness, and the resulting scripts are nothing that I'd've designed as such from scratch. But, one thing led to another, and now I've got a [nightly report emailed][mail400report] to me of pages that have gone 404 and 500, and an [RSS feed of referers][referrers_rss] to boot.\r\n\r\nI'm sure it looks like completely braindead work, but it was fun! \r\n\r\n[echo]: http://www.rt.com/man/echo.1.html\r\n[awk]: http://www.rt.com/man/awk.1.html\r\n[sendmail]: http://www.rt.com/man/sendmail.8.html\r\n[cat]: http://www.rt.com/man/cat.1.html\r\n[grep]: http://www.rt.com/man/grep.1.html\r\n[sed]: http://www.rt.com/man/sed.1.html\r\n[cut]: http://www.rt.com/man/cut.1.html\r\n[sort]: http://www.rt.com/man/sort.1.html\r\n[uniq]: http://www.rt.com/man/uniq.1.html\r\n[referrers_rss]: http://www.decafbad.com/cvs/*checkout*/www.decafbad.com/bin/gen_referer_feed.sh\r\n[dbagg2]: http://www.decafbad.com/cvs/dbagg2/\r\n[rss300to091]: http://www.decafbad.com/cvs/*checkout*/www.decafbad.com/bin/rss300to091.py\r\n[parse_log]: http://www.decafbad.com/cvs/*checkout*/www.decafbad.com/bin/parse_access_log\r\n[mail400report]: http://www.decafbad.com/cvs/*checkout*/www.decafbad.com/bin/mail_500_400_report.sh\r\n[rss30]: http://www.aaronsw.com/2002/rss30\r\n\r\n
\r\n

Archived Comments

\r\n \r\n \r\n \r\n
\r\n ", "parentPath": "./content/posts/archives/2004", "path": "2004/04/30/fun-with-shell-scripting", "needsBuild": true, "prevPostPath": "2004/04/29/has-it-been-quiet", "prevPostTitle": "Has it been quiet?", "nextPostPath": "2004/05/02/feed-validation-confusion", "nextPostTitle": "Feed validation confusion" }