您好,登錄后才能下訂單哦!
celery是實現(xiàn)一個簡單,靈活可靠的分布式任務(wù)隊列系統(tǒng)的好選擇
tornado則不用過多介紹
在開發(fā)機上安裝rabbitmq這里就不介紹了
首先是task文件的編寫
task.py
#coding=utf-8 from celery import Celery from celery.bin import worker as celery_worker import celeryconfig broker = 'amqp://' backend = 'amqp' app = Celery('celery_test', backend=backend, broker=broker) app.config_from_object(celeryconfig) @app.task def mytask0(task_name): print "task0:%s" %task_name return task_name @app.task def mytask1(task_name): print "task1:%s" %task_name return task_name def worker_start(): worker = celery_worker.worker(app=app) worker.run(broker=broker, concurrency=4, traceback=False, loglevel='INFO') if __name__ == "__main__": worker_start()
celeryconfig.py文件中包含對celery的配置
#coding=utf-8 from kombu import Queue CELERY_DEFAULT_QUEUE = 'mytask0' CELERY_QUEUES = ( Queue('mytask0', routing_key='task.mytask0'), Queue('mytask1', routing_key='task.mytask1'), ) CELERY_DEFAULT_EXCHANGE_TYPE = 'direct' CELERY_DEFAULT_ROUTING_KEY = 'task.mytask0' CELERY_TIMEZONE = 'Asia/Shanghai' CELERY_ROUTES = { 'task.mytask0': { 'queue': 'mytask0', 'routing_key': 'task.mytask0', }, 'task.mytask1': { 'queue': 'mytask1', 'routing_key': 'task.mytask1', }, }
執(zhí)行python task.py將會啟動worker
tornado調(diào)用celery將阻塞任務(wù)變?yōu)榉亲枞?/p>
這會使用到tcelery模塊,即tornado下的一個非阻塞的broker實現(xiàn)
app.py
#coding=utf-8 from tornado import web import task class TestHandler(tornado.web.RequestHandler): @web.asynchronous def get(self): task.mytask0.apply_async( args=['task0'], queue='mytask0', routing_key='task.mytask0', callback=self.on_success) def on_success(self, result): self.finish({'task':result.result})
start.py
用于實現(xiàn)tornado服務(wù)的啟動
#coding=utf-8 import tornado from tornado.options import define, options, parse_command_line from tornado.log import enable_pretty_logging import tcelery from app import TestHandler import tornado.httpserver define("port", default=8000, help="run on the given port", type=int) define("debug", default=False, help="run in debug mode") urls = [(r"/api/task/test", TestHandler)] def server_start(): app = tornado.web.Application(urls, debug=options.debug) enable_pretty_logging() parse_command_line() server = tornado.httpserver.HTTPServer(app) server.bind(options.port) server.start(2) tcelery.setup_nonblocking_producer(limit=2) tornado.ioloop.IOLoop.current().start() if __name__ == "__main__": server_start()
執(zhí)行python start.py即可啟動服務(wù)
以上這篇tornado+celery的簡單使用詳解就是小編分享給大家的全部內(nèi)容了,希望能給大家一個參考,也希望大家多多支持億速云。
免責(zé)聲明:本站發(fā)布的內(nèi)容(圖片、視頻和文字)以原創(chuàng)、轉(zhuǎn)載和分享為主,文章觀點不代表本網(wǎng)站立場,如果涉及侵權(quán)請聯(lián)系站長郵箱:is@yisu.com進行舉報,并提供相關(guān)證據(jù),一經(jīng)查實,將立刻刪除涉嫌侵權(quán)內(nèi)容。