Where should I put the Celery configuration file?
The celery documentation helpfully gives an example of a configuration file, but it is less clear on where to put this file, or how to ensure that the worker reads this config file when it boots.
celery.py defines an object of type celery.Celery called app, which is what I use to decorate all my tasks. All of the tasks are in /myproj/tasks/.
My directory structure is a bit like this:
/myproj/celery.py
/celeryconfig.py # my settings
/tasks/ # tasks go here
Is there something I can put into celery.py which makes it load the celeryconfig.py file, or do I need to specify it on the worker command-line arguments?
Here's what my config file looks like right now:
## Broker settings.
broker_url = "pyamqp://admin:ypass@mq:5672"
# List of modules to import when the Celery worker starts.
imports = ('stoneid.tasks',)
python celery
asked Nov 15 '18 at 11:36
Salim FadhleySalim Fadhley
1,32121831
add a comment |
The celery documentation helpfully gives an example of a configuration file, but it is less clear on where to put this file, or how to ensure that the worker reads this config file when it boots.
celery.py defines an object of type celery.Celery called app, which is what I use to decorate all my tasks. All of the tasks are in /myproj/tasks/.
My directory structure is a bit like this:
/myproj/celery.py
/celeryconfig.py # my settings
/tasks/ # tasks go here
Is there something I can put into celery.py which makes it load the celeryconfig.py file, or do I need to specify it on the worker command-line arguments?
Here's what my config file looks like right now:
## Broker settings.
broker_url = "pyamqp://admin:ypass@mq:5672"
# List of modules to import when the Celery worker starts.
imports = ('stoneid.tasks',)
python celery
asked Nov 15 '18 at 11:36
Salim FadhleySalim Fadhley
1,32121831
add a comment |
The celery documentation helpfully gives an example of a configuration file, but it is less clear on where to put this file, or how to ensure that the worker reads this config file when it boots.
celery.py defines an object of type celery.Celery called app, which is what I use to decorate all my tasks. All of the tasks are in /myproj/tasks/.
My directory structure is a bit like this:
/myproj/celery.py
/celeryconfig.py # my settings
/tasks/ # tasks go here
Is there something I can put into celery.py which makes it load the celeryconfig.py file, or do I need to specify it on the worker command-line arguments?
Here's what my config file looks like right now:
## Broker settings.
broker_url = "pyamqp://admin:ypass@mq:5672"
# List of modules to import when the Celery worker starts.
imports = ('stoneid.tasks',)
python celery
asked Nov 15 '18 at 11:36
Salim FadhleySalim Fadhley
1,32121831
The celery documentation helpfully gives an example of a configuration file, but it is less clear on where to put this file, or how to ensure that the worker reads this config file when it boots.
celery.py defines an object of type celery.Celery called app, which is what I use to decorate all my tasks. All of the tasks are in /myproj/tasks/.
My directory structure is a bit like this:
/myproj/celery.py
/celeryconfig.py # my settings
/tasks/ # tasks go here
Is there something I can put into celery.py which makes it load the celeryconfig.py file, or do I need to specify it on the worker command-line arguments?
Here's what my config file looks like right now:
## Broker settings.
broker_url = "pyamqp://admin:ypass@mq:5672"
# List of modules to import when the Celery worker starts.
imports = ('stoneid.tasks',)
python celery
python celery
asked Nov 15 '18 at 11:36
Salim FadhleySalim Fadhley
1,32121831
asked Nov 15 '18 at 11:36
Salim FadhleySalim Fadhley
1,32121831
asked Nov 15 '18 at 11:36
Salim FadhleySalim Fadhley
1,32121831
asked Nov 15 '18 at 11:36
Salim FadhleySalim Fadhley
1,32121831
asked Nov 15 '18 at 11:36
Salim FadhleySalim Fadhley
1,32121831
1,32121831
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
After reading your question, I have understood that you are confused about where to keep the config file and how to import those.
Celery has many ways to load config file. One of those is config_from_object.
That will be a simple python file and consist of celery configs.
For your example celeryconfig.py will consists:
CELERY_BROKER_URL = 'redis://localhost:6379'
CELERY_RESULT_BACKEND = 'redis://localhost:6379'
and celery.py will contains below code.
app = Celery('myproj')
default_config = 'myproj.celeryconfig'
app.config_from_object(default_config)
If you follow above instruction, you do not need to pass conf via command line.
answered Nov 16 '18 at 15:09
Saiful AzadSaiful Azad
4371518
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53318596%2fwhere-should-i-put-the-celery-configuration-file%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
After reading your question, I have understood that you are confused about where to keep the config file and how to import those.
Celery has many ways to load config file. One of those is config_from_object.
That will be a simple python file and consist of celery configs.
For your example celeryconfig.py will consists:
CELERY_BROKER_URL = 'redis://localhost:6379'
CELERY_RESULT_BACKEND = 'redis://localhost:6379'
and celery.py will contains below code.
app = Celery('myproj')
default_config = 'myproj.celeryconfig'
app.config_from_object(default_config)
If you follow above instruction, you do not need to pass conf via command line.
answered Nov 16 '18 at 15:09
Saiful AzadSaiful Azad
4371518
add a comment |
After reading your question, I have understood that you are confused about where to keep the config file and how to import those.
Celery has many ways to load config file. One of those is config_from_object.
That will be a simple python file and consist of celery configs.
For your example celeryconfig.py will consists:
CELERY_BROKER_URL = 'redis://localhost:6379'
CELERY_RESULT_BACKEND = 'redis://localhost:6379'
and celery.py will contains below code.
app = Celery('myproj')
default_config = 'myproj.celeryconfig'
app.config_from_object(default_config)
If you follow above instruction, you do not need to pass conf via command line.
answered Nov 16 '18 at 15:09
Saiful AzadSaiful Azad
4371518
add a comment |
After reading your question, I have understood that you are confused about where to keep the config file and how to import those.
Celery has many ways to load config file. One of those is config_from_object.
That will be a simple python file and consist of celery configs.
For your example celeryconfig.py will consists:
CELERY_BROKER_URL = 'redis://localhost:6379'
CELERY_RESULT_BACKEND = 'redis://localhost:6379'
and celery.py will contains below code.
app = Celery('myproj')
default_config = 'myproj.celeryconfig'
app.config_from_object(default_config)
If you follow above instruction, you do not need to pass conf via command line.
answered Nov 16 '18 at 15:09
Saiful AzadSaiful Azad
4371518
After reading your question, I have understood that you are confused about where to keep the config file and how to import those.
Celery has many ways to load config file. One of those is config_from_object.
That will be a simple python file and consist of celery configs.
For your example celeryconfig.py will consists:
CELERY_BROKER_URL = 'redis://localhost:6379'
CELERY_RESULT_BACKEND = 'redis://localhost:6379'
and celery.py will contains below code.
app = Celery('myproj')
default_config = 'myproj.celeryconfig'
app.config_from_object(default_config)
If you follow above instruction, you do not need to pass conf via command line.
answered Nov 16 '18 at 15:09
Saiful AzadSaiful Azad
4371518
answered Nov 16 '18 at 15:09
Saiful AzadSaiful Azad
4371518
answered Nov 16 '18 at 15:09
Saiful AzadSaiful Azad
4371518
answered Nov 16 '18 at 15:09
Saiful AzadSaiful Azad
4371518
4371518
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53318596%2fwhere-should-i-put-the-celery-configuration-file%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
