Celery Tasks Not Being Processed

Question

I'm trying to process some tasks using celery, and I'm not having too much luck. I'm running celeryd and celerybeat as daemons. I have a `tasks.py` file that look like this with a simple app and task defined: ``` from celery import Celery app = Celery('tasks', broker='amqp://user:pass@hostname:5672/vhostname') @app.task def process_file(f): # do some stuff # and log results ``` And this file is referenced from another file `process.py` I use to monitor for file changes that looks like: ``` from tasks import process_file file_name = '/file/to/process' result = process_file.delay(file_name) result.get() ``` And with that little code, celery is unable to see tasks and process them. I can execute similar code in the python interpreter and celery processes them: ``` py >>> from tasks import process_file py >>> process_file.delay('/file/to/process') <AsyncResult: 8af23a4e-3f26-469c-8eee-e646b9d28c7b> ``` When I run the tasks from the interpreter however, `beat.log` and `worker1.log` don't s…

Accepted Answer

So I figured out my issue here by running celery from the cli instead of as a daemon, enabling me to see more detailed output of errors that happened. I did this by running:

```
user@hostname   /opt/dirwithpyfiles $ su celery
celery@hostname /opt/dirwithpyfiles $ celery -A tasks worker --loglevel=info
```

There I could see that a permissions issue was happening as the `celery` user that did not happen when I ran the commands from the python interpreter as my normal user. I fixed this by changing the permissions of `/file/to/process` so that both users could read from it.

Celery Tasks Not Being Processed

Solution

Problem