Skip to content

Commit 5ebcc1a

Browse files
mattmakaimattmakai
committed
adding task queue resources
1 parent f38fc43 commit 5ebcc1a

File tree

3 files changed

+73
-23
lines changed

3 files changed

+73
-23
lines changed

‎feeds/all.atom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
<?xml version="1.0" encoding="utf-8"?>
2-
<feed xmlns="http://www.w3.org/2005/Atom"><title>Matt Makai</title><link href="http://www.fullstackpython.com/" rel="alternate"></link><link href="http://www.fullstackpython.com/feeds/all.atom.xml" rel="self"></link><id>http://www.fullstackpython.com/</id><updated>2014-03-23T18:45:18Z</updated></feed>
2+
<feed xmlns="http://www.w3.org/2005/Atom"><title>Matt Makai</title><link href="http://www.fullstackpython.com/" rel="alternate"></link><link href="http://www.fullstackpython.com/feeds/all.atom.xml" rel="self"></link><id>http://www.fullstackpython.com/</id><updated>2014-03-24T09:21:31Z</updated></feed>

‎source/content/pages/15-task-queues/1501-task-queues.markdown‎

Lines changed: 31 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -21,18 +21,36 @@ most common types of jobs for task queues include
2121
15 minutes
2222

2323

24-
## Task Queue resources
25-
The [Celery](http://www.celeryproject.org/) distributed task queue is the
26-
most commonly used Python library for handling asynchronous tasks and
27-
scheduling.
28-
29-
[Queues.io](http://queues.io/) is a collection of task queue systems with
30-
short summaries for each one. The task queues are not all compatible with
31-
Python but ones that work with it are tagged with the "Python" keyword.
32-
33-
The [RQ (Redis Queue)](http://python-rq.org/) is a simple Python
34-
library for queueing jobs and processing them in the background with workers.
35-
It is backed by Redis and it is designed to have a low barrier to entry.
36-
It should be integrated in your web stack easily.
24+
## Task queue projects
25+
* The [Celery](http://www.celeryproject.org/) distributed task queue is the
26+
most commonly used Python library for handling asynchronous tasks and
27+
scheduling.
28+
29+
* The [RQ (Redis Queue)](http://python-rq.org/) is a simple Python
30+
library for queueing jobs and processing them in the background with workers.
31+
It is backed by Redis and it is designed to have a low barrier to entry.
32+
It should be integrated in your web stack easily.
33+
34+
* [Taskmaster](https://github.com/dcramer/taskmaster) is a lightweight simple
35+
distributed queue for handling large volumes of one-off tasks.
36+
37+
38+
## Task queue resources
39+
* [Distributing work without Celery](http://justcramer.com/2012/05/04/distributing-work-without-celery/)
40+
provides a scenario in which Celery and RabbitMQ are not the right tool
41+
for scheduling asynchronous jobs.
42+
43+
* [Queues.io](http://queues.io/) is a collection of task queue systems with
44+
short summaries for each one. The task queues are not all compatible with
45+
Python but ones that work with it are tagged with the "Python" keyword.
46+
47+
* [Why Task Queues](http://www.slideshare.net/bryanhelmig/task-queues-comorichweb-12962619)
48+
is a presentation for what task queues are and why they are needed.
49+
50+
* [How to use Celery with RabbitMQ](https://www.digitalocean.com/community/articles/how-to-use-celery-with-rabbitmq-to-queue-tasks-on-an-ubuntu-vps)
51+
is a detail walkthrough for using these tools on an Ubuntu VPS.
52+
53+
* Heroku has a clear walkthrough for using
54+
[RQ for background tasks](https://devcenter.heroku.com/articles/python-rq).
3755

3856

‎task-queues.html‎

Lines changed: 41 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -95,17 +95,49 @@ <h1>Task queues</h1>
9595
15 minutes</p>
9696
</li>
9797
</ul>
98-
<h2>Task Queue resources</h2>
98+
<h2>Task queue projects</h2>
99+
<ul>
100+
<li>
99101
<p>The <a href="http://www.celeryproject.org/">Celery</a> distributed task queue is the
100-
most commonly used Python library for handling asynchronous tasks and
101-
scheduling.</p>
102-
<p><a href="http://queues.io/">Queues.io</a> is a collection of task queue systems with
103-
short summaries for each one. The task queues are not all compatible with
104-
Python but ones that work with it are tagged with the "Python" keyword.</p>
102+
most commonly used Python library for handling asynchronous tasks and
103+
scheduling.</p>
104+
</li>
105+
<li>
105106
<p>The <a href="http://python-rq.org/">RQ (Redis Queue)</a> is a simple Python
106-
library for queueing jobs and processing them in the background with workers.
107-
It is backed by Redis and it is designed to have a low barrier to entry.
108-
It should be integrated in your web stack easily.</p>
107+
library for queueing jobs and processing them in the background with workers.
108+
It is backed by Redis and it is designed to have a low barrier to entry.
109+
It should be integrated in your web stack easily.</p>
110+
</li>
111+
<li>
112+
<p><a href="https://github.com/dcramer/taskmaster">Taskmaster</a> is a lightweight simple
113+
distributed queue for handling large volumes of one-off tasks. </p>
114+
</li>
115+
</ul>
116+
<h2>Task queue resources</h2>
117+
<ul>
118+
<li>
119+
<p><a href="http://justcramer.com/2012/05/04/distributing-work-without-celery/">Distributing work without Celery</a>
120+
provides a scenario in which Celery and RabbitMQ are not the right tool
121+
for scheduling asynchronous jobs.</p>
122+
</li>
123+
<li>
124+
<p><a href="http://queues.io/">Queues.io</a> is a collection of task queue systems with
125+
short summaries for each one. The task queues are not all compatible with
126+
Python but ones that work with it are tagged with the "Python" keyword.</p>
127+
</li>
128+
<li>
129+
<p><a href="http://www.slideshare.net/bryanhelmig/task-queues-comorichweb-12962619">Why Task Queues</a>
130+
is a presentation for what task queues are and why they are needed. </p>
131+
</li>
132+
<li>
133+
<p><a href="https://www.digitalocean.com/community/articles/how-to-use-celery-with-rabbitmq-to-queue-tasks-on-an-ubuntu-vps">How to use Celery with RabbitMQ</a>
134+
is a detail walkthrough for using these tools on an Ubuntu VPS.</p>
135+
</li>
136+
<li>
137+
<p>Heroku has a clear walkthrough for using
138+
<a href="https://devcenter.heroku.com/articles/python-rq">RQ for background tasks</a>.</p>
139+
</li>
140+
</ul>
109141
<br/>
110142
Next read the
111143
<a href="/api-integration.html">api integration</a> section.

0 commit comments

Comments
 (0)