[Libevent-users] [OT] craigslist: libevent programmer wanted

[Garth Patil]

http://sfbay.craigslist.org/pen/cpg/472325599.html

libevent programmer wanted (san mateo)
Reply to: gigs-472325599 at craigslist.org
Date: 2007-11-07, 8:33PM PST


I'm guessing if you clicked on this link, you probably know what
libevent is, and you're probably more than proficient in C. I have a
small project for someone who has previous experience with libevent,
and _understands_ HTTP (not just what it is, but has good experience
on the protocol layer). The project is to build a blazingly fast HTTP
client for lots of parallel requests. Here is a short description:

*Build a daemon with libevent that:
1. watches a directory called "request"
2. when a new file arrives in "request", load the file (format below)
3. augment the content with the appropriate headers
4. makes the HTTP request
5. upon success, write the contents of the response to a file of the
same name, in a directory called "result"
6. upon failure, write an error message to a file of the same name, in
a directory called "error"

*The program should:
- be written in C
- use libevent for filesystem events
- use libevent for the HTTP request event loop
- support most of HTTP/1.1, especially chunking
- allow at least 5000 concurrent requests without breaking a sweat
- NOT BLOCK ON ANY STEP

*File format:
hostname

http headers

http body
EOF

*Example file:
www.monkey.org

POST /banana HTTP/1.1
Content-Type: text/xml

<?xml version="1.0" ?>
<monkey>
<food>banana</food>
</monkey>
EOF

By the way, someone already has a good start on this in a image
grabbing program called crawl (http://monkey.org/~provos/crawl/). If
anyone is up to this, please send me an email and tell me what you
want in terms of compensation.
Thanks!