CN103793273A - Distributed type queue scheduling method and device based on Redis - Google Patents

Distributed type queue scheduling method and device based on Redis Download PDF

Info

Publication number
CN103793273A
CN103793273A CN201410034919.2A CN201410034919A CN103793273A CN 103793273 A CN103793273 A CN 103793273A CN 201410034919 A CN201410034919 A CN 201410034919A CN 103793273 A CN103793273 A CN 103793273A
Authority
CN
China
Prior art keywords
task
handling procedure
redis
task data
data queue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410034919.2A
Other languages
Chinese (zh)
Inventor
戴晨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN201410034919.2A priority Critical patent/CN103793273A/en
Publication of CN103793273A publication Critical patent/CN103793273A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention relates to the technical field of computers, in particular to a distributed type queue scheduling method and device based on a Redis. The method comprises the steps that the names of task data queues, to be processed, in the Redis at the current moment are acquired; the information of asynchronous task processing programs connected with the Redis is acquired; according to the names of the task data queues and the information of the asynchronous task processing programs, the asynchronous task processing programs are distributed for the task data queues. According to the method, the situation that asynchronous task processing programs fight for data, and deadlock is caused is avoided.

Description

A kind of distributed queue's dispatching method and device based on Redis
Technical field
The present invention relates to field of computer technology, relate in particular to a kind of distributed queue's dispatching method and device based on Redis.
Background technology
When having multiple pending distributed task schedulings, and when having multiple asynchronous task handling procedures (worker) and can responding described distributed task scheduling, the scheduling that how to realize distributed task scheduling is the key factor that affects distributed task scheduling execution efficiency.
In existing distributed queue dispatching method, controlling equipment adopts Redis store tasks queuing data, utilize Redis to support the feature of chained list (list) data type, deposit task queue data in Redis queue and transfer to asynchronous task handling procedure (worker) to process.Asynchronous task handling procedure (worker) obtains task data as required from described task data queue, then executes the task according to the task data of obtaining.
But, when each asynchronous task handling procedure (worker) reads task queue data from Redis, because contention data between worker may cause deadlock.
Summary of the invention
The invention provides a kind of distributed queue's dispatching method and device based on Redis, avoided contention data between asynchronous task handling procedure to cause deadlock.
On the one hand, the present invention proposes the method for a kind of distributed queue based on Redis scheduling, comprising:
The title of all pending task data queues in Redis described in acquisition current time;
Obtain the information of the asynchronous task handling procedure being connected with described Redis;
According to the information of the title of described task data queue and described asynchronous task handling procedure, it is described task data queue assignment asynchronous task handling procedure.
On the other hand, the present invention also proposes the device of a kind of distributed queue based on Redis scheduling, comprising:
Name acquiring unit, for obtaining the title of all pending task data queues of Redis described in current time;
Program acquiring unit, for obtaining the information of the asynchronous task handling procedure being connected with described Redis;
Programme distribution unit, for according to the information of the title of described task data queue and described asynchronous task handling procedure, is described task data queue assignment asynchronous task handling procedure.
Method and the device of the scheduling of the distributed queue based on Redis that the present invention proposes, realize the distributed scheduling to task data queue in Redis, reduce the dependence to relevant database in distributed queue's scheduling, avoided contention data between asynchronous task handling procedure to cause deadlock.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, forms a part of the present invention, does not form limitation of the invention.In the accompanying drawings:
Fig. 1 is the realization flow figure of the method for a kind of distributed queue based on the Redis scheduling that provides in the embodiment of the present invention;
Fig. 2 is the schematic diagram of the scheduling result of the task data queue that provides in the embodiment of the present invention;
Fig. 3 is the realization flow figure that the method for a kind of distributed queue based on Redis scheduling is provided in the embodiment of the present invention;
Fig. 4 is the structural representation of the device of a kind of distributed queue based on the Redis scheduling that provides in the embodiment of the present invention.
Embodiment
Below in conjunction with drawings and the specific embodiments, the present invention is carried out more in detail and complete explanation.Be understandable that, specific embodiment described herein is only for explaining the present invention, but not limitation of the invention.It also should be noted that, for convenience of description, in accompanying drawing, only show part related to the present invention but not full content.
Fig. 1 is the realization flow figure of the method for a kind of distributed queue based on the Redis scheduling that provides in the embodiment of the present invention.The device of the scheduling of the distributed queue based on Redis that the method that the embodiment of the present invention provides can be provided by the embodiment of the present invention is carried out, and this device can be realized by software and/or hardware.As shown in Figure 1, the method that the embodiment of the present invention provides comprises:
The title of all pending task data queues in Redis described in step 101, acquisition current time.
Redis is a stored data base based on internal memory and key-value pair (key – value).Owing to having lightweight characteristic, Redis is the key-value pair stored data base receiving much concern.Redis intermediate value (Value) is supported storage numerous types of data, for example character string (String), Hash (Map), chained list (list), the types such as set (sets) and ordered set (sorted sets).The chained list providing in Redis can be used as the task data queue of lightweight.In Redis, the title of task data queue is made up of task names and queue numbering, makes can obtain all pending task data queues by the order of key word fuzzy query in Redis.Preferably, task names has unified prefix, and for example, task names all has prefix " Queue-" can pass through " keysQueue-* " order fuzzy matching, dynamically obtains the title of all pending task data queues of current time in Redis.
The information of the asynchronous task handling procedure that step 102, acquisition are connected with described Redis.
Before carrying out the scheduling of distributed queue, the preset passage (channel) that passes through is set up the worker of each pending distributed task scheduling data queue and being connected of Redis.Because each worker is all corresponding with passage, the information that obtains each passage being connected with Redis can obtain the information of each worker being connected with described Redis, wherein, the information of passage comprises the number of passage and the title of passage, and the information of worker comprises the number of worker and the title of worker.If can directly obtain by pub/sub order the information of all passages that are connected with Redis in Redis, can directly obtain the title of all passages by the order of key word fuzzy query.Preferably, task names has unified prefix, and for example prefix is that " channel-" can pass through " keys channel-* " order fuzzy matching, dynamically obtains the title of each passage being connected with Redis.If can not directly obtain by pub/sub order the number of connected all passages in Redis, obtain the tunnel name of preserving in all heartbeat packet.Preferably, the tunnel name of preserving in each heartbeat packet has unified prefix, and for example their prefix is " channel-".
It should be noted that, preset while setting up being connected of Redis and each asynchronous task handling procedure, the worker of each pending distributed queue is connected with Redis by passage, concrete, when Redis is that lowest version is while not having the order of the title that obtains all passages that are connected with Redis in Redis, each worker periodically sends heartbeat packet to Redis, and wherein heartbeat packet comprises the title of worker respective channel.In the time thering is the order that obtains all tunnel names in Redis, directly obtain the title of each passage by order.Preferably, each worker is connected with Redis by a unique passage, and each worker is corresponding with unique passage, while making as certain worker allocating task data queue, only task data queue assignment need be given and its unique corresponding passage.
Step 103, according to the information of the title of described task data queue and described asynchronous task handling procedure, be described task data queue assignment asynchronous task handling procedure.
Adopt dispatching algorithm by each task data queue assignment in Redis to each worker of being connected with Redis, by each task data queue assignment in Reids in each passage.Concrete, according to the information of the title of described task data queue and described asynchronous task handling procedure, be described task data queue assignment asynchronous task handling procedure, comprising:
Calculate asynchronous task handling procedure corresponding to described task data queue by following formula:
i?mod?j=k
Wherein, i is the queue numbering of described task data queue, j is the number of the asynchronous task handling procedure that is connected with described Redis, k be in the asynchronous task handling procedure connecting with described Redis with the task data queue that is numbered i the numbering of corresponding asynchronous task handling procedure;
The executive routine of asynchronous task handling procedure all data in the task data queue of the described i of being numbered of k will be numbered.
As shown in Figure 2, in Reids, there are 5 pending task data queues and 2 passages that are connected with Redis, and the title of each task data queue is followed successively by Queue-0, Queue-1, Queue-2, Queue-3 and Queue-4, the title of two passages is followed successively by passage-0 and passage-1, be task data queue assignment worker described in each, be described in each computation process of task data queue assignment passage as follows:
Queue-0%2=0;
Queue-1%2=1;
Queue-2%2=0;
Queue-3%2=1;
Queue-4%2=0
The above results be 0 task data queue assignment to the worker-0 being connected with passage " passage-0 ", the task data queue assignment that result is 1 arrives the worker-1 being connected with passage " passage-1 ".Therefore, the task data queue that worker-0 will receive has Queue-0, Queue-2 and Queue-4, and the task data queue that worker-1 will receive has Queue-1 and Queue-3.
It should be noted that, because the task queue data in Redis are with the form storage of chained list, and chained list is not supported random access, the executive routine of asynchronous task handling procedure all data in the task data queue of the described i of being numbered of k will be numbered, while being in Redis described in each task data queue assignment worker, each task data queue all need to be done to as a whole scheduling.
The asynchronous task handling procedure that is numbered k, after the executive routine of the task data queue of the described i of being numbered, is also comprised: described in sending to the asynchronous task handling procedure of the described k of being numbered, be numbered the task data queue of i.
For example, publish order by Lua script is sent to the task data in the task data queue of each i of being numbered in the worker that is numbered k, concrete, the task data being numbered in Redis in the task data queue of i is sent in the passage being connected with the worker that is numbered k, and the worker that notice is numbered k goes to process corresponding data.Server is carried out Lua script by Crontab order timing, and uses EvalSHA buffer memory content for script.Unless Redis place server is cut off, otherwise dispatching process can be carried out always.
According to the information of the title of described task data queue and described asynchronous task handling procedure, after described task data queue assignment asynchronous task handling procedure, also comprise:
Receive the delete instruction of the asynchronous task handling procedure transmission distributing;
Delete the data in corresponding task data queue in described Redis according to described delete instruction.
Exemplary, the worker that is numbered k obtains after the title of the task data queue that is numbered i, first by LRange order from be numbered i task data queue head (for example, the right side of the task data queue shown in Fig. 2) take out a part of data and carry out batch processing, after task data queue processing completes, use Trim order to delete the data of handling, avoid directly taking out data from being numbered the task data queue of i with Lpop order, when tasks carrying failure, caused data to be lost from task data queue.
After described task data queue assignment asynchronous task handling procedure, also comprise: receive task data; The described task data receiving is inserted in the task data queue of Redis, triggered operation dispatching.Preferably, the reception task data of timing, and by Lush order, task data is saved in task data queue.And then after having added new task data in task data queue in Redis, re-execute the scheduling of each task data queue in Redis.
The dispatching method of the distributed queue based on Redis that the embodiment of the present invention provides, by being each task data queue assignment passage in Redis, thereby each task data queue assignment is arrived in each asynchronous task handling procedure (worker), to realize the scheduling of each task data queue.Further, because data in Reids are to store this characteristic with chain sheet form, in dispatching method, each task data queue is all done as a whole.The embodiment of the present invention makes full use of the high-performance of Redis service, has reduced the dependence to traditional database.The embodiment of the present invention is each task data queue United Dispatching in to Redis, reduces the complicacy of logic in Worker, avoids contention data between Worker to cause deadlock.
Fig. 3 is the realization flow figure that the method for a kind of distributed queue based on Redis scheduling is provided in the embodiment of the present invention.As described in Figure 3, the process that a certain moment Redis carries out task data queue scheduling is as follows:
Step 301, by subscribe command or by send heartbeat packet to be connected in Redis;
All pending task data queues in step 302, Dynamic Acquisition current time Reids;
Step 303, check Redis version, if when Redis is 2.4/2.6, obtain the title of all passages that are connected with Reids by heartbeat, if when Reids is 2.7/2.8, obtain the title of all passages that are connected with Redis by pub/sub;
Step 304, calculate the title of the pending task data queue of each worker;
Step 305, notice worker go to capture data in pending queue;
Step 306, judge scheduling whether finish, if finish scheduling, trigger if not operation dispatching, come back in the step of all pending task data queues in Dynamic Acquisition current time Reids.
The embodiment of the present invention is utilized light weight and the high-performance of Redis, avoids the queue service of operating weight level.And carry out United Dispatching at Redis server end with Lua script and Pub/Sub notice subscribing mechanism, avoid the competition between asynchronous task handling procedure to cause deadlock, and avoid the dependence of dispatching method to traditional database.
Fig. 4 is the structural representation of the device of a kind of distributed queue based on the Redis scheduling that provides in the embodiment of the present invention.
In the embodiment of the present invention and the present invention, embodiment of the method belongs to unified design, for realizing method embodiment illustrated in fig. 1.As shown in Figure 4, the device that the embodiment of the present invention provides, comprising:
Name acquiring unit 401, for obtaining the title of all pending task data queues of Redis described in current time;
Program acquiring unit 402, for obtaining the information of the asynchronous task handling procedure being connected with described Redis;
Programme distribution unit 403, for according to the information of the title of described task data queue and described asynchronous task handling procedure, is described task data queue assignment asynchronous task handling procedure.
Described programme distribution unit 403 comprises:
Program computing unit, for calculate asynchronous task handling procedure corresponding to described task data queue by following formula:
i?mod?j=k
Wherein, i is the queue numbering of described task data queue, j is the number of the asynchronous task handling procedure that is connected with described Redis, k be in the asynchronous task handling procedure connecting with described Redis with the task data queue that is numbered i the numbering of corresponding asynchronous task handling procedure;
Programming unit, for being numbered the asynchronous task handling procedure of k as the executive routine of all data of task data queue of the described i of being numbered.
Described device also comprises: task data queue transmitting element, is numbered the task data queue of i for the asynchronous task handling procedure to the described k of being numbered described in sending; Delete instruction receiving element, the delete instruction sending for receiving the asynchronous task handling procedure of distribution; Data delete unit, for deleting the data in the corresponding task data queue of described Redis according to described delete instruction.
Described device also comprises: task data receiving element, for receiving task data; Scheduling trigger element, for the described task data receiving being inserted to the task data queue of Redis, triggers operation dispatching.
The distributed queue's dispatching method based on Redis that the distributed queue's dispatching device based on Redis that the present embodiment provides provides for carrying out any embodiment of the present invention, possesses corresponding functional module, reaches identical technique effect.
The above is only the preferred embodiments of the present invention, is not limited to the present invention, and to those skilled in the art, the present invention can have various changes and variation.All any modifications of doing, be equal to replacement, improvement etc., within protection scope of the present invention all should be included within spirit of the present invention and principle.

Claims (10)

1. the distributed queue's dispatching method based on Redis, is characterized in that, comprising:
The title of all pending task data queues in Redis described in acquisition current time;
Obtain the information of the asynchronous task handling procedure being connected with described Redis;
According to the information of the title of described task data queue and described asynchronous task handling procedure, it is described task data queue assignment asynchronous task handling procedure.
2. method according to claim 1, is characterized in that, according to the information of the title of described task data queue and described asynchronous task handling procedure, is described task data queue assignment asynchronous task handling procedure, comprising:
Calculate asynchronous task handling procedure corresponding to described task data queue by following formula:
i?mod?j=k
Wherein, i is the queue numbering of described task data queue, j is the number of the asynchronous task handling procedure that is connected with described Redis, k be in the asynchronous task handling procedure connecting with described Redis with the task data queue that is numbered i the numbering of corresponding asynchronous task handling procedure;
The executive routine of asynchronous task handling procedure all data in the task data queue of the described i of being numbered of k will be numbered.
3. method according to claim 2, is characterized in that, the asynchronous task handling procedure that is numbered k, after the executive routine of the task data queue of the described i of being numbered, is also comprised:
Described in sending to the asynchronous task handling procedure of the described k of being numbered, be numbered the task data queue of i.
4. according to the method described in claim 1-3 any one, it is characterized in that, according to the information of the title of described task data queue and described asynchronous task handling procedure, after described task data queue assignment asynchronous task handling procedure, also comprise:
Receive the delete instruction of the asynchronous task handling procedure transmission distributing;
Delete the data in corresponding task data queue in described Redis according to described delete instruction.
5. method according to claim 4, is characterized in that, after described task data queue assignment asynchronous task handling procedure, also comprises:
Receive task data;
The described task data receiving is inserted in the task data queue of Redis, triggered operation dispatching.
6. the distributed queue's dispatching device based on Redis, is characterized in that, comprising:
Name acquiring unit, for obtaining the title of all pending task data queues of Redis described in current time;
Program acquiring unit, for obtaining the information of the asynchronous task handling procedure being connected with described Redis;
Programme distribution unit, for according to the information of the title of described task data queue and described asynchronous task handling procedure, is described task data queue assignment asynchronous task handling procedure.
7. device according to claim 6, is characterized in that, described programme distribution unit comprises:
Program computing unit, for calculate asynchronous task handling procedure corresponding to described task data queue by following formula:
i?mod?j=k
Wherein, i is the queue numbering of described task data queue, j is the number of the asynchronous task handling procedure that is connected with described Redis, k be in the asynchronous task handling procedure connecting with described Redis with the task data queue that is numbered i the numbering of corresponding asynchronous task handling procedure;
Programming unit, for being numbered the asynchronous task handling procedure of k as the executive routine of all data of task data queue of the described i of being numbered.
8. device according to claim 7, is characterized in that, described device also comprises:
Task data queue transmitting element, is numbered the task data queue of i for the asynchronous task handling procedure to the described k of being numbered described in sending.
9. according to the device described in claim 6-8 any one, it is characterized in that, described device also comprises:
Delete instruction receiving element, the delete instruction sending for receiving the asynchronous task handling procedure of distribution;
Data delete unit, for deleting the data in the corresponding task data queue of described Redis according to described delete instruction.
10. device according to claim 9, is characterized in that, described device also comprises:
Task data receiving element, for receiving task data;
Scheduling trigger element, for the described task data receiving being inserted to the task data queue of Redis, triggers operation dispatching.
CN201410034919.2A 2014-01-24 2014-01-24 Distributed type queue scheduling method and device based on Redis Pending CN103793273A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410034919.2A CN103793273A (en) 2014-01-24 2014-01-24 Distributed type queue scheduling method and device based on Redis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410034919.2A CN103793273A (en) 2014-01-24 2014-01-24 Distributed type queue scheduling method and device based on Redis

Publications (1)

Publication Number Publication Date
CN103793273A true CN103793273A (en) 2014-05-14

Family

ID=50668984

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410034919.2A Pending CN103793273A (en) 2014-01-24 2014-01-24 Distributed type queue scheduling method and device based on Redis

Country Status (1)

Country Link
CN (1) CN103793273A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105760221A (en) * 2016-02-02 2016-07-13 中博信息技术研究院有限公司 Task dispatching system with distributed calculating frame
CN105843813A (en) * 2015-01-14 2016-08-10 ***通信集团重庆有限公司 Method and device for processing big data
CN106445648A (en) * 2016-10-21 2017-02-22 天津海量信息技术股份有限公司 System for achieving multi-worker coordination based on redis
CN106656863A (en) * 2016-12-31 2017-05-10 广东欧珀移动通信有限公司 Business monitoring method and apparatus, and computer device
CN107479829A (en) * 2017-08-03 2017-12-15 杭州铭师堂教育科技发展有限公司 A kind of Redis cluster mass datas based on message queue quickly clear up system and method
CN107798108A (en) * 2017-10-30 2018-03-13 中国联合网络通信集团有限公司 A kind of asynchronous task querying method and equipment
CN108874513A (en) * 2017-05-11 2018-11-23 北京京东尚科信息技术有限公司 Handle method, system, electronic equipment and the computer-readable medium of timed task
CN108958948A (en) * 2018-06-19 2018-12-07 北京云枢网络科技有限公司 A kind of timer event processing method, database and timer
CN109408212A (en) * 2018-09-28 2019-03-01 平安科技(深圳)有限公司 Task schedule component building method, device and storage medium, server
CN109410040A (en) * 2018-11-07 2019-03-01 杭州创金聚乾网络科技有限公司 A kind of match method, device and the equipment of loan application and investment application
CN109597699A (en) * 2018-11-28 2019-04-09 泰康保险集团股份有限公司 Data processing method, device, electronic equipment and computer-readable medium
CN113384874A (en) * 2021-05-27 2021-09-14 深圳市大头互动文化传播有限公司 Asynchronous solution method for game

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101446910A (en) * 2008-12-08 2009-06-03 哈尔滨工程大学 AEDF task scheduling method based on SMP
US8056079B1 (en) * 2005-12-22 2011-11-08 The Mathworks, Inc. Adding tasks to queued or running dynamic jobs
US20120023498A1 (en) * 2010-05-18 2012-01-26 Lsi Corporation Local messaging in a scheduling hierarchy in a traffic manager of a network processor
CN102521051A (en) * 2011-12-05 2012-06-27 中国联合网络通信集团有限公司 Task scheduling method, device and system in Map Reduce system applied to nomography
CN103207806A (en) * 2012-01-12 2013-07-17 阿里巴巴集团控股有限公司 Method and system for sending messages
CN103294531A (en) * 2012-03-05 2013-09-11 阿里巴巴集团控股有限公司 Method and system for task distribution
CN103345423A (en) * 2013-07-03 2013-10-09 北京京东尚科信息技术有限公司 Method and system for processing asynchronous task

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8056079B1 (en) * 2005-12-22 2011-11-08 The Mathworks, Inc. Adding tasks to queued or running dynamic jobs
CN101446910A (en) * 2008-12-08 2009-06-03 哈尔滨工程大学 AEDF task scheduling method based on SMP
US20120023498A1 (en) * 2010-05-18 2012-01-26 Lsi Corporation Local messaging in a scheduling hierarchy in a traffic manager of a network processor
CN102521051A (en) * 2011-12-05 2012-06-27 中国联合网络通信集团有限公司 Task scheduling method, device and system in Map Reduce system applied to nomography
CN103207806A (en) * 2012-01-12 2013-07-17 阿里巴巴集团控股有限公司 Method and system for sending messages
CN103294531A (en) * 2012-03-05 2013-09-11 阿里巴巴集团控股有限公司 Method and system for task distribution
CN103345423A (en) * 2013-07-03 2013-10-09 北京京东尚科信息技术有限公司 Method and system for processing asynchronous task

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105843813A (en) * 2015-01-14 2016-08-10 ***通信集团重庆有限公司 Method and device for processing big data
CN105760221A (en) * 2016-02-02 2016-07-13 中博信息技术研究院有限公司 Task dispatching system with distributed calculating frame
CN106445648A (en) * 2016-10-21 2017-02-22 天津海量信息技术股份有限公司 System for achieving multi-worker coordination based on redis
CN106656863A (en) * 2016-12-31 2017-05-10 广东欧珀移动通信有限公司 Business monitoring method and apparatus, and computer device
CN108874513A (en) * 2017-05-11 2018-11-23 北京京东尚科信息技术有限公司 Handle method, system, electronic equipment and the computer-readable medium of timed task
CN107479829A (en) * 2017-08-03 2017-12-15 杭州铭师堂教育科技发展有限公司 A kind of Redis cluster mass datas based on message queue quickly clear up system and method
CN107479829B (en) * 2017-08-03 2020-04-17 杭州铭师堂教育科技发展有限公司 Redis cluster mass data rapid cleaning system and method based on message queue
CN107798108A (en) * 2017-10-30 2018-03-13 中国联合网络通信集团有限公司 A kind of asynchronous task querying method and equipment
CN108958948A (en) * 2018-06-19 2018-12-07 北京云枢网络科技有限公司 A kind of timer event processing method, database and timer
CN109408212A (en) * 2018-09-28 2019-03-01 平安科技(深圳)有限公司 Task schedule component building method, device and storage medium, server
CN109408212B (en) * 2018-09-28 2023-09-19 平安科技(深圳)有限公司 Task scheduling component construction method and device, storage medium and server
CN109410040A (en) * 2018-11-07 2019-03-01 杭州创金聚乾网络科技有限公司 A kind of match method, device and the equipment of loan application and investment application
CN109597699A (en) * 2018-11-28 2019-04-09 泰康保险集团股份有限公司 Data processing method, device, electronic equipment and computer-readable medium
CN113384874A (en) * 2021-05-27 2021-09-14 深圳市大头互动文化传播有限公司 Asynchronous solution method for game

Similar Documents

Publication Publication Date Title
CN103793273A (en) Distributed type queue scheduling method and device based on Redis
US9888048B1 (en) Supporting millions of parallel light weight data streams in a distributed system
US20200241915A1 (en) Work conserving, load balancing, and scheduling
Tan et al. Coupling task progress for mapreduce resource-aware scheduling
CN104834558B (en) A kind of method and system of data processing
US8898172B2 (en) Parallel generation of topics from documents
CN106250226B (en) Method for scheduling task and system based on consistency hash algorithm
US8806498B2 (en) Method and system for resolving dependency among the enqueued works and/or finished works and scheduling the dependency-resolved works
CN103309738B (en) User job dispatching method and device
CN102170396B (en) QoS control method of cloud storage system based on differentiated service
US8214356B1 (en) Apparatus for elastic database processing with heterogeneous data
CN104601696B (en) Service processing method, service calling system, device and system
US20130339636A1 (en) Storage-side storage request management
JP5480395B2 (en) Stream data processing method and apparatus
US20140095748A1 (en) Reconfigurable hardware structures for functional pipelining of on-chip special purpose functions
CN104598563A (en) High concurrency data storage method and device
US20130097608A1 (en) Processor With Efficient Work Queuing
US8868855B2 (en) Request management system and method for dynamically managing prioritized requests
CN104735077B (en) It is a kind of to realize the efficiently concurrent methods of UDP using Circular buffer and circle queue
US9256506B1 (en) System and method for performing operations on target servers
KR101612682B1 (en) Method, system and computer program product for sequencing asynchronous messages in a distributed and parallel environment
CN107239342A (en) A kind of storage cluster task management method and device
CN104683472A (en) Data transmission method capable of supporting large data volume
CN104346401A (en) Method and device for message forwarding between components in cloud management platform
US8156289B2 (en) Hardware support for work queue management

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20140514

RJ01 Rejection of invention patent application after publication