Job Queue Implementation For Python

Do you know/use any distributed job queue for python? Can you share links or tools

Solution 1:

Pyres is a resque clone built in python. Resque is used by Github as their message queue. Both use Redis as the queue backend and provide a web-based monitoring application.

http://binarydud.github.com/pyres/intro.html

Solution 2:

In addition to multiprocessing there's also the Celery project, if you're using Django.

Solution 3:

There's also "bucker" by Sylvain Hellegouarch which you can find here:

• http://trac.defuze.org/wiki/bucker

It describes itself like this:

• bucker is a queue system that supports multiple storage for the queue (memcached, Amazon SQS for now) and is driven by XML messages sent over a TCP connections between a client and the queue server.

Solution 4:

Look at beanstalkd

Solution 5:

redqueue? It's implemented in python+tornado framework, speaks memcached protocol and is optionally persistent into log files. Currently it is also able to behave like beanstalkd, the reserve/delete way in memcache protocol as well.

REDQUEUE