Celery on Caktus Group

Getting Started with Dagster

Mon, 09 Dec 2024 23:00:00 +0000

Recently, Caktus has been using Tailscale to manage VPN connections between Android tablets and a central server. We wanted to report on the devices connected to the network using the Tailscale API. While we could use tools like Celery to fetch data from the API and load it into a database—given its widespread use in the Django ecosystem—we also wanted to explore other options.

How to Use Celery for Scheduling Tasks

Wed, 11 Aug 2021 18:14:40 +0000

There are multiple ways to schedule tasks in your Django app, but there are some advantages to using Celery. It’s supported, scales well, and works nicely with Django. Given its wide use, there are also lots of resources for learning more about it, and once learned, that knowledge is likely to be useful on other projects.

How to Schedule Tasks Using Celery Beat in a Container

Thu, 14 May 2020 12:30:00 +0000

When running services in a container, changes to files can be discarded at any time, but the Celery beat default scheduler keeps its state in a file.

Don't keep important data in your Celery queue

Tue, 18 Oct 2016 19:53:34 +0000

The Celery library (previous posts) makes it as easy to schedule a task to run later as calling a function. Just change:

PyCoder's Weekly: Caktus Included in Top Projects and Articles of 2014

Fri, 16 Jan 2015 20:02:09 +0000

The weekly Python e-mail newsletter, Pycoder’s Weekly included Caktus Developer Dan Poirier’s post, Celery in Production on their list of the best articles and projects of 2014! Take a look at their list and be sure to revisit Dan’s post.

Celery in Production

Mon, 29 Sep 2014 12:00:00 +0000

(Thanks to Mark Lavin for significant contributions to this post.)

In a previous post, we introduced using Celery to schedule tasks.

In this post, we address things you might need to consider when planning how to deploy Celery in production.

PyOhio Recap: Celery with Python

Mon, 11 Aug 2014 11:07:39 +0000

Caleb Smith recently gave a talk, “Intro to Celery,” at PyOhio (video below). Celery is a pretty popular topic for us here at Caktus. We use it often in our client work and find it very handy. So we were happy Caleb was out in the world, promoting its use. We sat down with him to hear more about PyOhio and Celery.

Getting Started Scheduling Tasks with Celery

Mon, 23 Jun 2014 11:00:00 +0000

UPDATE: A newer version of this blog post is available for Celery Version 5.0.x.

Getting Started Using Celery for Scheduling Tasks

Many Django applications can make good use of being able to schedule work, either periodically or just not blocking the request thread.

Using strace to Debug Stuck Celery Tasks

Wed, 30 Oct 2013 19:56:31 +0000

Celery is a great tool for background task processing in Django. We use it in a lot of the custom web apps we build at Caktus, and it's quickly becoming the standard for all variety of task scheduling work loads, from simple to highly complex.

Using Django and Celery with Amazon SQS

Mon, 19 Dec 2011 16:26:48 +0000

Amazon's Simple Queue Service (SQS) is a relatively new offering in the family of Amazon Web Services (AWS). It's also an appealing one, because it proposes to quickly and easily replace a common component of the stack in a typical web application, thereby obviating the need to run a separate queue server like RabbitMQ. While RabbitMQ — the typical favorite for Celery users — is not necessarily difficult to install or maintain, removing it from the stack of a web application means one less component that might fail, offloading that service to AWS — especially for applications with a small to moderate queue volume — might prove financially advantageous.

An alternative RapidSMS router implementation (with Celery!)

Mon, 18 Jul 2011 18:00:00 +0000

We've been using RapidSMS, a Django-powered SMS framework, more and more frequently here at Caktus. It's evolved a lot over the past year-- from being reworked to feel more like a Django app, to merging the rapidsms-core-dev and rapidsms-contrib-apps-dev repositories into a single codebase (no more submodules!), to finally becoming installable via pypi. The "new core" is in a great state now and is much easier to work with. However, one particular aspect of RapidSMS, the route process, has always been complicated and confusing to deal with. Tobias began the conversation on this issue after returning from a 6-week long UNICEF project in Zambia. He summarized the route process like so: