[Haifux] [Haifux Meeting] Crawling in Lightning
dag at cs.technion.ac.il
Sun Feb 10 09:47:42 MSK 2008
OK, this sounds interesting, but what about the other side.
How do a web muster can block all those crawlers?
(I prefer a mail answer since I can't come to the lecture)
I am looking for old Vinyl record.
If you have any that you don't need please mail me
----- Original Message -----
From: "Eli Billauer" <eli at billauer.co.il>
To: "Haifa linux club" <haifux at haifux.org>
Cc: "linux-il" <linux-il at cs.huji.ac.il>
Sent: Saturday, February 09, 2008 3:15 PM
Subject: [Haifux Meeting] Crawling in Lightning
> Next Monday, 11th of February, at 18:30 the Haifa Linux Club, will gather
> for a lightning talk session
> Crawling in Lightning
> This is a show-me-the-source meeting, during which several one-liners and
> scripts will be presented. The core subject is methods for interacting
> with HTTP web servers ("faking Firefox") in order to fetch information,
> vote automatically in polls etc.
> This meeting consists of several short talks, by several speakers (*). The
> agenda is as follows, 5-10 minutes per item (subject to change):
> * A very short introduction to HTTP (mainly showing a typical session
> * GET
> * wget
> * curl
> * A script in Python with exception handling
> * A short script in Python for fetching mp3's
> * Perl script to rip image galleries (LWP) with cookie handling for login
> * A Ruby script
> * Perl: Using the POST method to vote automatically
> * A Perl/Tk GUI script helping in developing crawlers
> (*) It turned out that there is more interest than experience in the field
> among Haifuxers. As a result, more than one of the items above will be
> delivered by yours truly.
> We meet in Taub building, room 6. For location information see:
> Attendance is free, and you are all invited!
> Future Lectures:
> Tapping into the Fountain of CPUs---On Operating System Support for
> Programmable Devices, by Muli Ben-Yehuda, 25/2/2008
> We are always interested in hearing your talks and ideas. If you wish to
> give a talk, hold a discussion, or just plan some event Haifux might be
> interested in, please contact us at webmaster at haifux.org
> To unsubscribe, send mail to linux-il-request at cs.huji.ac.il with
> the word "unsubscribe" in the message body, e.g., run the command
> echo unsubscribe | mail linux-il-request at cs.huji.ac.il
More information about the Haifux