[Haifux] [Haifux Meeting] Crawling in Lightning

Eli Billauer eli at billauer.co.il
Sat Feb 9 16:15:45 MSK 2008


Next Monday, 11th of February, at 18:30 the Haifa Linux Club, will 
gather for a lightning talk session

             Crawling in Lightning

Abstract

This is a show-me-the-source meeting, during which several one-liners 
and scripts will be presented. The core subject is methods for 
interacting with HTTP web servers ("faking Firefox") in order to fetch 
information, vote automatically in polls etc.

This meeting consists of several short talks, by several speakers (*). 
The agenda is as follows, 5-10 minutes per item (subject to change):

* A very short introduction to HTTP (mainly showing a typical session 
transcript)
* GET
* wget
* curl
* A script in Python with exception handling
* A short script in Python for fetching mp3's
* Perl script to rip image galleries (LWP) with cookie handling for login
* A Ruby script
* Perl: Using the POST method to vote automatically
* A Perl/Tk GUI script helping in developing crawlers

(*) It turned out that there is more interest than experience in the 
field among Haifuxers. As a result, more than one of the items above 
will be delivered by yours truly.

======================================================

We meet in Taub building, room 6. For location information see:
http://www.haifux.org/where.html

Attendance is free, and you are all invited!

======================================================

Future Lectures:

Tapping into the Fountain of CPUs---On Operating System Support for 
Programmable Devices, by Muli Ben-Yehuda, 25/2/2008

======================================================

We are always interested in hearing your talks and ideas. If you wish to 
give a talk, hold a discussion, or just plan some event Haifux might be 
interested in, please contact us at webmaster at haifux.org





More information about the Haifux mailing list