CN106656863A - Business monitoring method and apparatus, and computer device - Google Patents
Business monitoring method and apparatus, and computer device Download PDFInfo
- Publication number
- CN106656863A CN106656863A CN201611266539.7A CN201611266539A CN106656863A CN 106656863 A CN106656863 A CN 106656863A CN 201611266539 A CN201611266539 A CN 201611266539A CN 106656863 A CN106656863 A CN 106656863A
- Authority
- CN
- China
- Prior art keywords
- queue
- message queue
- distributed message
- monitoring data
- thread
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention relates to a business monitoring method and apparatus, and computer device. The method comprises the following steps: obtaining user request information; packaging the user request information into monitoring data; obtaining a queue serial number of a distributed message queue corresponding to the monitoring data, and sending the monitoring data to the distributed message queue corresponding to the queue serial number in a distributed message queue cluster for storage; obtaining a queue serial number corresponding to a thread identifier, and obtaining the monitoring data in the distributed message queue corresponding to the queue serial number from the distributed message queue cluster; and allocating the monitoring data in the distributed message queue corresponding to the queue serial number to a thread corresponding to the thread identifier for processing. By adoption of the method, a monitoring system and a local queue for storing the monitoring data are decoupled, thereby avoiding the situation that the monitoring data sent by the local queue are lost in the case of instability of the monitoring system.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of business monitoring method, device and computer equipment.
Background technology
With the development of Internet technology, increasing user is engaged in social life by internet.With user
The quick increase of colony, user's request amount is also quickly increasing in internet, and internet system is needed to substantial amounts of user's request
Amount is monitored, and then understands the health status of system and find system problem in time.
The content of the invention
The embodiment of the present invention provides a kind of business monitoring method, device and computer equipment, can avoid in business monitoring
The situation that monitoring data is lost.
A kind of business monitoring method, including：
Obtain user request information；
The user request information is encapsulated as into monitoring data；
The queue number of Distributed Message Queue corresponding with the monitoring data is obtained, and the monitoring data is sent
Stored to Distributed Message Queue corresponding with the queue number in Distributed Message Queue cluster；
The corresponding queue number of thread identification is obtained, is obtained from the Distributed Message Queue cluster and is compiled with the queue
Monitoring data in number corresponding Distributed Message Queue；
Monitoring data in the Distributed Message Queue corresponding with the queue number is distributed into the thread mark
Know corresponding thread process.
A kind of business monitoring device, including：
Acquisition module, for obtaining user request information；
Package module, for the user request information to be encapsulated as into monitoring data；
Data memory module, for obtaining the queue number of Distributed Message Queue corresponding with the monitoring data, and
The monitoring data is sent into Distributed Message Queue corresponding with the queue number in Distributed Message Queue cluster to enter
Row storage；
Data acquisition module, for obtaining the corresponding queue number of thread identification, from the Distributed Message Queue cluster
The middle monitoring data obtained in Distributed Message Queue corresponding with the queue number；
Distribute module, for the monitoring data in the Distributed Message Queue corresponding with the queue number to be distributed
Give the thread identification corresponding thread process.
A kind of computer equipment, including memory, processor and storage can run on a memory and on a processor
Computer program, during the computing device described program following steps are realized：
Obtain user request information；
The user request information is encapsulated as into monitoring data；
The queue number of Distributed Message Queue corresponding with the monitoring data is obtained, and the monitoring data is sent
Stored to Distributed Message Queue corresponding with the queue number in Distributed Message Queue cluster；
The corresponding queue number of thread identification is obtained, is obtained from the Distributed Message Queue cluster and is compiled with the queue
Monitoring data in number corresponding Distributed Message Queue；
Monitoring data in the Distributed Message Queue corresponding with the queue number is distributed into the thread mark
Know corresponding thread process.
Business monitoring method, device and computer equipment in the embodiment of the present invention, after monitoring data is obtained, obtains prison
The corresponding Distributed Message Queue numbering of control data, and the Distributed Message Queue that monitoring data is sent to reference numeral is deposited
Storage.By introducing Distributed Message Queue, by supervising data storage in Distributed Message Queue, realize monitoring system from distributed
Monitoring data is obtained in message queue, and monitoring data is processed.By by monitoring system with storage monitoring data sheet
Ground queue decoupling, it is to avoid when monitoring system is unstable, the situation that the monitoring data that local queue sends is lost.
Description of the drawings
Fig. 1 is the applied environment schematic diagram of business monitoring method in one embodiment；
Fig. 2 is the internal structure schematic diagram of server in one embodiment；
Fig. 3 is the flow chart of business monitoring method in one embodiment；
Fig. 4 is the system architecture diagram of business monitoring method in one embodiment；
Fig. 5 is the structured flowchart of business monitoring device in one embodiment；
Fig. 6 is the structured flowchart of data memory module 506 in one embodiment；
Fig. 7 is the structured flowchart of business monitoring device in another embodiment；
Fig. 8 is the structured flowchart of business monitoring device in another embodiment.
Specific embodiment
In order that the objects, technical solutions and advantages of the present invention become more apparent, it is right below in conjunction with drawings and Examples
The present invention is further elaborated.It should be appreciated that specific embodiment described herein is only to explain the present invention, not
For limiting the present invention.
Fig. 1 is the applied environment schematic diagram of business monitoring method in one embodiment.As shown in figure 1, the applied environment bag
Include deployment application gateway on the server, local queue, Distributed Message Queue cluster, monitoring system, database and monitoring
Backstage.Wherein, monitoring blocker is deployed with application gateway, monitoring blocker can intercept user's request and record user's request letter
Breath；Local queue and Distributed Message Queue cluster can store monitoring data；Monitoring system can process monitoring data；Database can
Result of the storage monitoring system to monitoring data；Monitoring backstage can read, data in display data storehouse.In the present embodiment,
The user request information of record can be encapsulated as monitoring data and be sent to local queue being stored by monitoring blocker, then from local
Monitoring data is obtained in the message queue of queue, by the monitoring data corresponding user's request time of reception and distributed message team
The number of queues of row can obtain the queue number of the corresponding Distributed Message Queue of monitoring data, and monitoring blocker is again by monitoring data
It is sent to Distributed Message Queue corresponding with queue number in Distributed Message Queue cluster to be stored.Wrap in monitoring system
Including can process the thread of monitoring data, and each thread carries thread identification.According to pre-configured thread identification and distributed message
Corresponding relation between the queue number of queue, monitoring system can obtain the Distributed Message Queue corresponding with thread identification
The monitoring data in Distributed Message Queue corresponding to queue number, and monitoring data is distributed into corresponding thread process.
Monitoring system can also obtain result of the thread to monitoring data, and above-mentioned result is stored in database.Monitoring
The result to monitoring data of backstage readable data library storage, and the result to monitoring data for obtaining is visual
Change and show.Use above gateway, local queue, Distributed Message Queue cluster, monitoring system, database and monitoring backstage can portions
Administration also can dispose on a different server on same server.
Fig. 2 is the internal structure schematic diagram of server in one embodiment.As shown in Fig. 2 the server is included by being
Processor, non-volatile memory medium, built-in storage and network interface that system bus connects.Wherein, the server is non-volatile
Property storage medium is stored with operating system, database and business monitoring device, and being stored with database monitoring data is carried out point
The statistics that analysis is obtained, the business monitoring device is used to realize a kind of business monitoring method suitable for server.The service
The processor of device is used to provide calculating and control ability, supports the operation of whole server.The built-in storage of the server is non-
The operation of the business monitoring device in volatile storage medium provides environment, computer-readable can be stored in the built-in storage and is referred to
Order, when the computer-readable instruction is by the computing device, can cause a kind of business monitoring method of the computing device.Should
The network interface of server is used to communicate by network connection with outside terminal according to this, such as intercept user's request etc..Service
Device can with independent server or multiple server groups into server cluster realizing.Server falls within computer
Equipment.It will be understood by those skilled in the art that the structure illustrated in Fig. 2, the only part-structure related to application scheme
Block diagram, do not constitute the restriction of the server being applied thereon to application scheme, specific server can include ratio
More or less of part shown in figure, or some parts are combined, or arrange with different parts.
Fig. 3 is the flow chart of business monitoring method in one embodiment, as shown in figure 3, a kind of method of business monitoring, bag
Include：
S302, obtains user request information.
In one embodiment, monitoring blocker is deployed with server on application gateway, monitoring blocker can intercept clothes
Response of the user's request and server that business device is received to user's request, and record user request information.Wherein user's request is believed
Breath may include the moment that server receive user is asked, i.e. the user's request time of reception；Server responds to user's request
Moment, i.e., user's request response the moment；It is used to process user's request on the service module that user's request is called, i.e. server
Module；It is used to process the server address of user's request on the service node of user's request, i.e. server；User's request side IP
(Internet Protocol, the agreement interconnected between network)；URL (the Uniform Resource of user's request
Locator, URL)；Requested Party title etc..
S304, by user request information monitoring data is encapsulated as.
In one embodiment, monitoring blocker can be encapsulated as monitoring data by the user request information of acquisition, and will prison
Control data storage is in the message queue of local queue.For example, it is by the monitoring data that user request information is packaged into
{ srvGroup='cdo-card', the service module that // user's request is called
SrvNode='173.17.100.34:39814', the service node of // user's request
Url='PageCardService.queryPage', the URL of // user's request
ClientIp='173.17.153.176', // user's request side IP
Consumer='store-app', // Requested Party title
The startTime=1481536600008, // user's request time of reception
EndTime=1481536615369, // user's request response moment
Status=0//state }
S306, obtains the queue number of Distributed Message Queue corresponding with monitoring data, and monitoring data is sent to
Distributed Message Queue corresponding with queue number is stored in Distributed Message Queue cluster.
In one embodiment, monitoring blocker can obtain monitoring data from the message queue of local queue, and obtain
The monitoring data corresponding user's request time of reception.By the way that the time of reception user is converted into timestamp, calculated using HashCode
Timestamp is converted to cryptographic Hash by method, and the number of queues of cryptographic Hash and Distributed Message Queue is carried out into modulo operation, be obtained with
The queue number of the corresponding Distributed Message Queue of monitoring data.In the team for obtaining the corresponding Distributed Message Queue of monitoring data
After column number, monitoring blocker can by Http, (Hyper Text Transfer Protocol, hypertext be passed by monitoring data
Defeated agreement) the asynchronous bulk transfer of mode enters to Distributed Message Queue corresponding with queue number in Distributed Message Queue cluster
Row storage.
S308, obtains the corresponding queue number of thread identification, obtains and queue number from Distributed Message Queue cluster
Monitoring data in corresponding Distributed Message Queue.
In one embodiment, there is the thread for processing monitoring data in monitoring system, monitoring system is obtained after thread identification,
According to the corresponding relation between the queue number of pre-configured thread identification and Distributed Message Queue, can obtain and thread identification
The queue number of corresponding Distributed Message Queue.According to the queue number of the corresponding Distributed Message Queue of thread identification, prison
Control system can obtain the monitoring data in Distributed Message Queue corresponding with thread identification.Wherein, thread identification is for only
The character string of one mark thread identity.The character string may include at least one such as numeral, letter, character.In monitoring system each
Thread identification has the queue number of corresponding Distributed Message Queue, and monitoring system obtains the line after thread identification is obtained
Journey identifies the monitoring data in corresponding Distributed Message Queue.
S310, distributes to thread identification corresponding by the monitoring data in Distributed Message Queue corresponding with queue number
Thread process.
In one embodiment, monitoring system obtain monitoring data after, according to pre-configured thread identification with it is distributed
Corresponding relation between the queue number of message queue, can be by the monitoring number in Distributed Message Queue corresponding with queue number
According to distributing to the corresponding thread process of thread identification.Wherein, thread identification can correspond to multiple distributed disappear in monitoring system
The queue number of breath queue, the queue number of the Distributed Message Queue corresponding to each thread identification is differed.That is monitoring system
In thread can process monitoring data in multiple Distributed Message Queues, the Distributed Message Queue handled by each thread
In monitoring data differ, the monitoring data in a Distributed Message Queue is processed in a fixed thread.
Above-mentioned business monitoring method, after monitoring data is obtained, obtains the corresponding Distributed Message Queue of monitoring data and compiles
Number, and monitoring data is sent into the Distributed Message Queue storage of reference numeral.By introducing Distributed Message Queue, will supervise
Control data storage realizes that monitoring system obtains monitoring data from Distributed Message Queue in Distributed Message Queue, and to prison
Control data are processed.By by the local queue decoupling of monitoring system and storage monitoring data, it is to avoid in monitoring system not
When stable, the situation that the monitoring data that local queue sends is lost.
In one embodiment, above-mentioned business monitoring method also includes：Obtain result of the thread to monitoring data；Will
Thread is stored in database to the result of monitoring data, so that monitoring backstage can read and data in display data storehouse.
In one embodiment, thread the result of monitoring data may include QPS (Query Per Second, often
Second query rate), error number and response time etc..Wherein, QPS refers to the number of times that user per second accesses；Error number refers to per minute
System exception number, system exception may include to process abnormal, process user's request time-out of user's request etc.；Response time refers to process
The time of user's request, the response time can respond the moment by the user's request time of reception in user request information with user's request
Calculate and obtain.Monitoring system can store the result of monitoring data after result of the thread to monitoring data is obtained
In database.The result of the monitoring data stored in monitoring backstage readable data storehouse, and by the process of monitoring data
Result visualization shows.
Above-mentioned business monitoring method, thread is stored in database to the result of monitoring data, makes monitoring backstage
The result of monitoring data in readable data storehouse, and by the result visual presentation of monitoring data, be conducive to understanding
System health and in time discovery system problem, realize that second level is alerted when there is system problem.
In one embodiment, step S306 obtains the queue of Distributed Message Queue corresponding with monitoring data in Fig. 3
Numbering includes：Obtain distributed message team in the monitoring data corresponding user's request time of reception and Distributed Message Queue cluster
The number of queues of row；The user's request time of reception is converted into timestamp；According to timestamp and the number of queues of Distributed Message Queue
Obtain the queue number of Distributed Message Queue corresponding with monitoring data.
In one embodiment, the team that blocker can read Distributed Message Queue in Distributed Message Queue cluster is monitored
Columns；Monitoring blocker can also obtain monitoring data from the message queue of local queue, and user is read from monitoring data please
The time of reception is asked, the user's request time of reception is converted into timestamp, the corresponding Kazakhstan of timestamp is calculated by HashCode algorithms
Uncommon value, by the number of queues of the corresponding cryptographic Hash of timestamp and Distributed Message Queue modulo operation is carried out, and monitoring data is obtained
The queue number of corresponding Distributed Message Queue.I.e.【The queue number of the corresponding Distributed Message Queue of monitoring data】=
【HashCode (the user's request time of reception corresponding timestamp)】mod【The number of queues of Distributed Message Queue】.For example, monitor
24 points 44 seconds when the data corresponding user's request time of reception is 12 days 19 December in 2016, by the conversion of the user's request time of reception
It is 1481628284951 for timestamp, it is 125421857 to calculate the corresponding cryptographic Hash of timestamp by HashCode algorithms, point
The number of queues of Distributed Message Queue is 8 in cloth message queue cluster, then the queue by cryptographic Hash to Distributed Message Queue
It is 1 that number carries out modulo operation and obtains delivery result for 1, the i.e. queue number of the corresponding Distributed Message Queue of the monitoring data,
The monitoring data can be sent to the Distributed Message Queue that queue number is 1 and be stored by monitoring blocker.Wherein, user please
Ask the queue number of Distributed Message Queue corresponding to the monitoring data that the time of reception is same minute identical, i.e. user's request
The time of reception is the supervising data storage of same minute in same Distributed Message Queue.
Above-mentioned business monitoring method, after obtaining the monitoring data corresponding user's request time of reception, user's request is received
Moment is converted to timestamp, monitoring data is obtained by the number of queues of timestamp and Distributed Message Queue corresponding distributed
The numbering of message queue, is capable of achieving the supervising data storage that the user's request time of reception is same minute and distributed disappears in same
In breath queue, it is advantageously implemented the monitoring data that the user's request time of reception is same minute and processes in same computer,
Ensure that the precision of data processing.
In one embodiment, step S308 obtains corresponding with queue number from Distributed Message Queue cluster in Fig. 3
Distributed Message Queue in monitoring data include：Obtained from Distributed Message Queue cluster according to default time interval
Monitoring data in Distributed Message Queue corresponding with queue number.
In one embodiment, monitoring system obtain thread identification after, according to pre-configured thread identification with it is distributed
Corresponding relation between the queue number of message queue, the queue that can obtain Distributed Message Queue corresponding with thread identification is compiled
Number.According to the queue number and default time interval of the corresponding Distributed Message Queue of thread identification, monitoring system can timing
The monitoring data in Distributed Message Queue corresponding with thread identification is obtained from Distributed Message Queue cluster.
In one embodiment, the corresponding thread of thread identification includes sub-line journey；Step S310 will be compiled with queue in Fig. 3
Monitoring data in number corresponding Distributed Message Queue distributes to the corresponding thread process of thread identification to be included：Obtain sub-line journey
Identify corresponding queue number；By the monitoring in the Distributed Message Queue corresponding to queue number corresponding with sub- thread identification
Data distribution gives the corresponding sub- thread process of sub- thread identification.
In one embodiment, each thread includes sub-line journey in monitoring system, and each sub-line journey has sub- thread identification, sub-line
Journey mark is for the character string of unique mark sub-line journey identity.The character string may include numeral, letter, character etc. at least
Kind.And a thread includes multiple sub-line journeys, a sub- thread identification can correspond to the queue volume of multiple Distributed Message Queues
Number, the queue number of the Distributed Message Queue corresponding to each sub- thread identification is differed.Monitoring system obtains each son in thread
After thread identification, according to the corresponding relation between pre-configured sub- thread identification and the queue number of Distributed Message Queue, can
Obtain the queue number of Distributed Message Queue corresponding with sub- thread identification.Compiled according to the queue of above-mentioned Distributed Message Queue
Number, monitoring system can obtain the monitoring data in Distributed Message Queue corresponding with sub- thread identification, and by distributed message
Monitoring data in queue distributes to the corresponding sub- thread process of sub- thread identification.Wherein, the number of queues of Distributed Message Queue
Total sub-line number of passes in >=monitoring system.Under normal circumstances, the sub- number of threads that each thread includes in monitoring system is identical, that is, divide
The number of queues of the cloth message queue >=single thread neutron Thread Counts of monitoring system center line number of passes *.When Distributed Message Queue
During the single thread neutron Thread Counts of number of queues=monitoring system center line number of passes *, monitoring system is capable of achieving a sub- thread process one
Monitoring data in individual Distributed Message Queue.
Above-mentioned business monitoring method, according to the corresponding pass between sub- thread identification and the queue number of Distributed Message Queue
System, can distribute to corresponding sub- thread process by monitoring data in the Distributed Message Queue of acquisition.At each sub-line journey
Monitoring data in the Distributed Message Queue that reason is specified, realizes that each sub-line journey is processing monitoring data in monitoring system, carries
The high efficiency of monitoring system processing data.
In one embodiment, above-mentioned business monitoring method also includes：If detecting newly-increased Distributed Message Queue and new
Increase thread；The corresponding relation set up between the queue number and the thread identification of newly-increased thread of newly-increased Distributed Message Queue.
In one embodiment, when QPS increases, Distributed Message Queue node and thread node can be increased.If service
Device detects newly-increased Distributed Message Queue node and newly-increased thread node, and the queue that can obtain newly-increased Distributed Message Queue is compiled
Number, the thread identification of newly-increased thread, and by the queue number pair of the thread identification of newly-increased thread and newly-increased Distributed Message Queue
Should, i.e., newly-increased thread obtains monitoring data from newly-increased Distributed Message Queue and is processed.
Above-mentioned business monitoring method, when user's request amount increases, can set up automatically newly-increased Distributed Message Queue with
Corresponding relation between newly-increased thread.I.e. when user's request amount increases, can be by extension Distributed Message Queue number and thread
Count to improve the ability of monitoring system processing data, improve the efficiency of monitoring system processing data.
In one embodiment, as shown in figure 4, being deployed with monitoring blocker in server on application gateway, monitoring is intercepted
Device can the response to user's request of user's request and server that receives of intercept server, and record user request information.Monitoring
User request information is encapsulated as supervising data storage in the message queue of local queue by blocker, and obtains monitoring data pair
The queue number of the Distributed Message Queue answered.When specially the corresponding user's request of monitoring blocker acquisition monitoring data is received
Carve, user is converted into timestamp the time of reception, timestamp is converted into cryptographic Hash using HashCode algorithms, by cryptographic Hash with
The number of queues of Distributed Message Queue carries out modulo operation, and then obtains the team of Distributed Message Queue corresponding with monitoring data
Column number.After the queue number for obtaining the corresponding Distributed Message Queue of monitoring data, monitoring blocker leads to monitoring data
Cross the asynchronous bulk transfer of Http modes to enter to Distributed Message Queue corresponding with queue number in Distributed Message Queue cluster
Row storage.Wherein, the user's request time of reception is the queue of the Distributed Message Queue corresponding to the monitoring data of same minute
Numbering is identical, i.e. the user's request time of reception is the supervising data storage of same minute in same Distributed Message Queue.
Monitoring system includes Master threads 1 and Master threads 2, and Master threads 1 include Slave threads 1 and Slave threads
2, Master threads 2 include Slave threads 3 and Slave threads 4.Disappeared with distributed according to pre-configured Slave thread identifications
Corresponding relation between the queue number of breath queue, is obtained the correspondence Distributed Message Queue 1 of Slave threads 1 and distributed disappears
Breath queue 2；The correspondence Distributed Message Queue 3 of Slave threads 2 and Distributed Message Queue 4；The correspondence of Slave threads 3 is distributed to disappear
Breath queue 5 and Distributed Message Queue 6；The correspondence Distributed Message Queue 7 of Slave threads 4 and Distributed Message Queue 8.Then supervise
The corresponding Distributed Message Queue 1 of Master threads 1 in control system, Distributed Message Queue 2, Distributed Message Queue 3 and point
Cloth message queue 4；The corresponding Distributed Message Queue 5 of Master threads 2, Distributed Message Queue 6, Distributed Message Queue
7 and Distributed Message Queue 8.Monitoring system is obtained after the monitoring data in Distributed Message Queue, by Distributed Message Queue
1st, the monitoring fraction in Distributed Message Queue 2, Distributed Message Queue 3 and Distributed Message Queue 4 distributes to Master lines
Journey 1；Monitoring in Distributed Message Queue 5, Distributed Message Queue 6, Distributed Message Queue 7 and Distributed Message Queue 8
Fraction distributes to Master threads 2.Master threads 1 will monitor number in Distributed Message Queue 1 and Distributed Message Queue 2 again
Process according to Slave threads 1 are distributed to；Monitoring data in Distributed Message Queue 3 and Distributed Message Queue 4 is distributed to
Slave threads 2 are processed.Master threads 2 again distribute monitoring data in Distributed Message Queue 5 and Distributed Message Queue 6
Process to Slave threads 3；Monitoring data in Distributed Message Queue 7 and Distributed Message Queue 8 is distributed into Slave threads 4
Process.
Above-mentioned business monitoring method, after monitoring data is obtained, obtains the corresponding Distributed Message Queue of monitoring data and compiles
Number, and monitoring data is sent into the Distributed Message Queue storage of reference numeral.By introducing Distributed Message Queue, will supervise
Control data storage realizes that monitoring system obtains monitoring data from Distributed Message Queue in Distributed Message Queue, and to prison
Control data are processed.By by the local queue decoupling of monitoring system and storage monitoring data, it is to avoid in monitoring system not
When stable, the situation that the monitoring data that local queue sends is lost.
Fig. 5 is the structured flowchart of business monitoring device in one embodiment.As shown in figure 5, a kind of is to realize business in Fig. 3
The virtual bench of monitoring method institute framework, including：
Acquisition module 502, for obtaining user request information.
Package module 504, for user request information to be encapsulated as into monitoring data.
Data memory module 506, for obtaining the queue number of Distributed Message Queue corresponding with monitoring data, and will
Monitoring data is sent to Distributed Message Queue corresponding with queue number in Distributed Message Queue cluster and is stored.
Data acquisition module 508, for obtaining the corresponding queue number of thread identification, from Distributed Message Queue cluster
Obtain the monitoring data in Distributed Message Queue corresponding with queue number.
Distribute module 510, for the monitoring data in Distributed Message Queue corresponding with queue number to be distributed into line
Journey identifies corresponding thread process.
Above-mentioned business monitoring device, after monitoring data is obtained, obtains the corresponding Distributed Message Queue of monitoring data and compiles
Number, and monitoring data is sent into the Distributed Message Queue storage of reference numeral.By introducing Distributed Message Queue, will supervise
Control data storage realizes that monitoring system obtains monitoring data from Distributed Message Queue in Distributed Message Queue, and to prison
Control data are processed.By by the local queue decoupling of monitoring system and storage monitoring data, it is to avoid in monitoring system not
When stable, the situation that the monitoring data that local queue sends is lost.
Fig. 6 is the structured flowchart of data memory module 506 in one embodiment.In one embodiment, user's request letter
Breath includes the user's request time of reception；Data memory module 506 includes：
Acquiring unit 602, for obtaining the monitoring data corresponding user's request time of reception and Distributed Message Queue collection
The number of queues of Distributed Message Queue in group.
Converting unit 604, for the user's request time of reception to be converted into timestamp.
Computing unit 606, for obtaining corresponding with monitoring data according to the number of queues of timestamp and Distributed Message Queue
Distributed Message Queue queue number.
Memory cell 608, it is corresponding with queue number in Distributed Message Queue cluster for monitoring data to be sent to
Distributed Message Queue is stored.
Above-mentioned business monitoring device, after obtaining the monitoring data corresponding user's request time of reception, user's request is received
Moment is converted to timestamp, monitoring data is obtained by the number of queues of timestamp and Distributed Message Queue corresponding distributed
The numbering of message queue, is capable of achieving the supervising data storage that the user's request time of reception is same minute and distributed disappears in same
In breath queue, it is advantageously implemented the monitoring data that the user's request time of reception is same minute and processes in same computer,
Ensure that the precision of data processing.
In one embodiment, data acquisition module 508 is additionally operable to obtain the corresponding queue number of thread identification, according to pre-
If time interval monitoring in Distributed Message Queue corresponding with queue number is obtained from Distributed Message Queue cluster
Data.
In one embodiment, the corresponding thread of thread identification includes sub-line journey；Distribute module 510 is additionally operable to obtain son
The corresponding queue number of thread identification；By in the Distributed Message Queue corresponding to queue number corresponding with sub- thread identification
Monitoring data distributes to the corresponding sub- thread process of sub- thread identification.
Above-mentioned business monitoring device, according to the corresponding pass between sub- thread identification and the queue number of Distributed Message Queue
System, can distribute to corresponding sub- thread process by monitoring data in the Distributed Message Queue of acquisition.At each sub-line journey
Monitoring data in the Distributed Message Queue that reason is specified, realizes that each sub-line journey is processing monitoring data in monitoring system, carries
The high efficiency of monitoring system processing data.
Fig. 7 is the structured flowchart of business monitoring device in another embodiment.As shown in fig. 7, a kind of business monitoring device,
Including acquisition module 702, package module 704, data memory module 706, data acquisition module 708, distribute module 710 and correspondence
Module 712.Wherein acquisition module 702, package module 704, data memory module 706, data acquisition module 708 and distribute module
710 is identical with corresponding functions of modules in Fig. 5.
Respective modules 712, if for detecting newly-increased Distributed Message Queue and newly-increased thread；Set up and increase distributed disappearing newly
Corresponding relation between the queue number and the thread identification of newly-increased thread of breath queue.
Above-mentioned business monitoring device, when user's request amount increases, can set up automatically newly-increased Distributed Message Queue with
Corresponding relation between newly-increased thread.I.e. when user's request amount increases, can be by extension Distributed Message Queue number and thread
Count to improve the ability of monitoring system processing data, improve the efficiency of monitoring system processing data.
Fig. 8 is the structured flowchart of business monitoring device in another embodiment.As shown in figure 8, a kind of business monitoring device,
Including acquisition module 802, package module 804, data memory module 806, data acquisition module 808, distribute module 810 and result
Memory module 812.Wherein acquisition module 802, package module 804, data memory module 806, data acquisition module 808 and distribution
Module 810 is identical with corresponding functions of modules in Fig. 5.
As a result memory module 812, for obtaining result of the thread to monitoring data；By place of the thread to monitoring data
Reason result is stored in database, so that monitoring backstage can read and data in display data storehouse.
Above-mentioned business monitoring device, thread is stored in database to the result of monitoring data, makes monitoring backstage
The result of monitoring data in readable data storehouse, and by the result visual presentation of monitoring data, be conducive to understanding
System health and in time discovery system problem, realize that second level is alerted when there is system problem.
The division of modules in above-mentioned business monitoring device is only used for illustrating, in other embodiments, can be by industry
Business supervising device is divided into as required different modules, to complete all or part of function of above-mentioned business monitoring device.
A kind of computer equipment, including memory, processor and storage can run on a memory and on a processor
Computer program (instruction), realizes following steps (1) to (5) during computing device program：
(1) user request information is obtained.
In one embodiment, monitoring blocker is deployed with server on application gateway, monitoring blocker can intercept clothes
Response of the user's request and server that business device is received to user's request, and record user request information.Wherein user's request is believed
Breath may include the moment that server receive user is asked, i.e. the user's request time of reception；Server responds to user's request
Moment, i.e., user's request response the moment；It is used to process user's request on the service module that user's request is called, i.e. server
Module；It is used to process the server address of user's request on the service node of user's request, i.e. server；User's request side IP；
The URL of user's request；Requested Party title etc..
(2) user request information is encapsulated as into monitoring data.
In one embodiment, monitoring blocker can be encapsulated as monitoring data by the user request information of acquisition, and will prison
Control data storage is in the message queue of local queue.
(3) obtain the queue number of corresponding with monitoring data Distributed Message Queue, and monitoring data is sent to point
Distributed Message Queue corresponding with queue number is stored in cloth message queue cluster.
In one embodiment, monitoring blocker can obtain monitoring data from the message queue of local queue, and obtain
The monitoring data corresponding user's request time of reception.By the way that the time of reception user is converted into timestamp, calculated using HashCode
Timestamp is converted to cryptographic Hash by method, and the number of queues of cryptographic Hash and Distributed Message Queue is carried out into modulo operation, be obtained with
The queue number of the corresponding Distributed Message Queue of monitoring data.In the team for obtaining the corresponding Distributed Message Queue of monitoring data
After column number, monitoring blocker can by monitoring data by the asynchronous bulk transfer of Http modes in Distributed Message Queue cluster
Distributed Message Queue corresponding with queue number is stored.
(4) the corresponding queue number of thread identification is obtained, is obtained and queue number pair from Distributed Message Queue cluster
Monitoring data in the Distributed Message Queue answered.
In one embodiment, there is the thread for processing monitoring data in monitoring system, monitoring system is obtained after thread identification,
According to the corresponding relation between the queue number of pre-configured thread identification and Distributed Message Queue, can obtain and thread identification
The queue number of corresponding Distributed Message Queue.According to the queue number of the corresponding Distributed Message Queue of thread identification, prison
Control system can obtain the monitoring data in Distributed Message Queue corresponding with thread identification.Wherein, thread identification is for only
The character string of one mark thread identity.The character string may include at least one such as numeral, letter, character.In monitoring system each
Thread identification has the queue number of corresponding Distributed Message Queue, and monitoring system obtains the line after thread identification is obtained
Journey identifies the monitoring data in corresponding Distributed Message Queue.
(5) monitoring data in Distributed Message Queue corresponding with queue number is distributed into the corresponding line of thread identification
Journey process.
In one embodiment, monitoring system obtain monitoring data after, according to pre-configured thread identification with it is distributed
Corresponding relation between the queue number of message queue, can be by the monitoring number in Distributed Message Queue corresponding with queue number
According to distributing to the corresponding thread process of thread identification.Wherein, thread identification can correspond to multiple distributed disappear in monitoring system
The queue number of breath queue, the queue number of the Distributed Message Queue corresponding to each thread identification is differed.That is monitoring system
In thread can process monitoring data in multiple Distributed Message Queues, the Distributed Message Queue handled by each thread
In monitoring data differ, the monitoring data in a Distributed Message Queue is processed in a fixed thread.
Above computer equipment, after monitoring data is obtained, obtains the corresponding Distributed Message Queue numbering of monitoring data,
And monitoring data is sent into the Distributed Message Queue storage of reference numeral.By introducing Distributed Message Queue, will monitor
Data storage realizes that monitoring system obtains monitoring data from Distributed Message Queue in Distributed Message Queue, and to monitoring
Data are processed.By by the local queue decoupling of monitoring system and storage monitoring data, it is to avoid unstable in monitoring system
Regularly, the situation that the monitoring data that local queue sends is lost.
In one embodiment, following steps are also realized during computing device program in above computer equipment：Obtain line
Result of the journey to monitoring data；Thread is stored in into database to the result of monitoring data, so that monitoring backstage can
Read and data in display data storehouse.
In one embodiment, thread may include QPS, error number and response time etc. to the result of monitoring data.
Wherein, QPS refers to the number of times that user per second accesses；Error number refers to system exception number per minute, and system exception may include to process
User's request is abnormal, process user's request time-out etc.；Response time refers to the time for processing user's request, and the response time can pass through
The user's request time of reception calculates with the user's request response moment and obtains in user request information.Monitoring system is obtaining thread pair
After the result of monitoring data, the result of monitoring data can be stored in database.Monitoring backstage readable data
The result of the monitoring data stored in storehouse, and by the result visual presentation of monitoring data.
Above computer equipment, thread is stored in database to the result of monitoring data, makes the monitoring backstage can
The result of monitoring data in reading database, and by the result visual presentation of monitoring data, be conducive to understanding system
System health status and in time discovery system problem, realize that second level is alerted when there is system problem.
In one embodiment, the step of realizing during computing device program in above computer equipment：Obtain and monitoring
The queue number of the corresponding Distributed Message Queue of data includes：Obtain the monitoring data corresponding user's request time of reception and divide
The number of queues of Distributed Message Queue in cloth message queue cluster；The user's request time of reception is converted into timestamp；According to
The number of queues of timestamp and Distributed Message Queue obtains the queue number of Distributed Message Queue corresponding with monitoring data.
In one embodiment, the team that blocker can read Distributed Message Queue in Distributed Message Queue cluster is monitored
Columns；Monitoring blocker can also obtain monitoring data from the message queue of local queue, and user is read from monitoring data please
The time of reception is asked, the user's request time of reception is converted into timestamp, the corresponding Kazakhstan of timestamp is calculated by HashCode algorithms
Uncommon value, by the number of queues of the corresponding cryptographic Hash of timestamp and Distributed Message Queue modulo operation is carried out, and monitoring data is obtained
The queue number of corresponding Distributed Message Queue.I.e.【The queue number of the corresponding Distributed Message Queue of monitoring data】=
【HashCode (the user's request time of reception corresponding timestamp)】mod【The number of queues of Distributed Message Queue】.Wherein, user
The request time of reception is that the queue number of the Distributed Message Queue corresponding to the monitoring data of same minute is identical, i.e., user please
The supervising data storage that the time of reception is same minute is sought in same Distributed Message Queue.
Above computer equipment, after obtaining the monitoring data corresponding user's request time of reception, when user's request is received
Quarter is converted to timestamp, obtains that monitoring data is corresponding distributed to disappear by the number of queues of timestamp and Distributed Message Queue
The numbering of breath queue, the achievable user's request time of reception is the supervising data storage of same minute in same distributed message
In queue, it is advantageously implemented the monitoring data that the user's request time of reception is same minute and processes in same computer, protects
The precision of data processing is demonstrate,proved.
In one embodiment, the step of realizing during computing device program in above computer equipment：Disappear from distributed
The monitoring data obtained in Distributed Message Queue corresponding with queue number in breath queue cluster includes：According to the default time
Interval obtains the monitoring data in Distributed Message Queue corresponding with queue number from Distributed Message Queue cluster.
In one embodiment, monitoring system obtain thread identification after, according to pre-configured thread identification with it is distributed
Corresponding relation between the queue number of message queue, the queue that can obtain Distributed Message Queue corresponding with thread identification is compiled
Number.According to the queue number and default time interval of the corresponding Distributed Message Queue of thread identification, monitoring system can timing
The monitoring data in Distributed Message Queue corresponding with thread identification is obtained from Distributed Message Queue cluster.
In one embodiment, the corresponding thread of thread identification includes sub-line journey；Processor in above computer equipment
The step of realizing during configuration processor：Monitoring data in Distributed Message Queue corresponding with queue number is distributed into thread mark
Knowing corresponding thread process includes：Obtain the corresponding queue number of sub- thread identification；Queue corresponding with sub- thread identification is compiled
The monitoring data in Distributed Message Queue corresponding to number distributes to the corresponding sub- thread process of sub- thread identification.
In one embodiment, each thread includes sub-line journey in monitoring system, and each sub-line journey has sub- thread identification, sub-line
Journey mark is for the character string of unique mark sub-line journey identity.The character string may include numeral, letter, character etc. at least
Kind.And a thread includes multiple sub-line journeys, a sub- thread identification can correspond to the queue volume of multiple Distributed Message Queues
Number, the queue number of the Distributed Message Queue corresponding to each sub- thread identification is differed.Monitoring system obtains each son in thread
After thread identification, according to the corresponding relation between pre-configured sub- thread identification and the queue number of Distributed Message Queue, can
Obtain the queue number of Distributed Message Queue corresponding with sub- thread identification.Compiled according to the queue of above-mentioned Distributed Message Queue
Number, monitoring system can obtain the monitoring data in Distributed Message Queue corresponding with sub- thread identification, and by distributed message
Monitoring data in queue distributes to the corresponding sub- thread process of sub- thread identification.Wherein, the number of queues of Distributed Message Queue
Total sub-line number of passes in >=monitoring system.Under normal circumstances, the sub- number of threads that each thread includes in monitoring system is identical, that is, divide
The number of queues of the cloth message queue >=single thread neutron Thread Counts of monitoring system center line number of passes *.When Distributed Message Queue
During the single thread neutron Thread Counts of number of queues=monitoring system center line number of passes *, monitoring system is capable of achieving a sub- thread process one
Monitoring data in individual Distributed Message Queue.
Above computer equipment, according to the corresponding pass between sub- thread identification and the queue number of Distributed Message Queue
System, can distribute to corresponding sub- thread process by monitoring data in the Distributed Message Queue of acquisition.At each sub-line journey
Monitoring data in the Distributed Message Queue that reason is specified, realizes that each sub-line journey is processing monitoring data in monitoring system, carries
The high efficiency of monitoring system processing data.
In one embodiment, following steps are also realized during computing device program in above computer equipment：If detection
To newly-increased Distributed Message Queue and newly-increased thread；Set up the queue number of newly-increased Distributed Message Queue and the line of newly-increased thread
Corresponding relation between journey mark.
In one embodiment, when QPS increases, Distributed Message Queue node and thread node can be increased.If service
Device detects newly-increased Distributed Message Queue node and newly-increased thread node, and the queue that can obtain newly-increased Distributed Message Queue is compiled
Number, the thread identification of newly-increased thread, and by the queue number pair of the thread identification of newly-increased thread and newly-increased Distributed Message Queue
Should, i.e., newly-increased thread obtains monitoring data from newly-increased Distributed Message Queue and is processed.
Above computer equipment, when user's request amount increases, can set up automatically newly-increased Distributed Message Queue with it is new
Increase the corresponding relation between thread.I.e. when user's request amount increases, can be by extension Distributed Message Queue number and Thread Count
To improve the ability of monitoring system processing data, the efficiency of monitoring system processing data is improve.
One of ordinary skill in the art will appreciate that realizing all or part of flow process in above-described embodiment method, can be
Related hardware is instructed to complete by computer program, described program can be stored in a non-volatile computer and can read
In storage medium, the program is upon execution, it may include such as the flow process of the embodiment of above-mentioned each method.Wherein, described storage is situated between
Matter can be magnetic disc, CD, read-only memory (Read-Only Memory, ROM) etc..
Embodiment described above only expresses the several embodiments of the present invention, and its description is more concrete and detailed, but and
Therefore the restriction to the scope of the claims of the present invention can not be interpreted as.It should be pointed out that for one of ordinary skill in the art
For, without departing from the inventive concept of the premise, some deformations and improvement can also be made, these belong to the guarantor of the present invention
Shield scope.Therefore, the protection domain of patent of the present invention should be defined by claims.
Claims (11)
1. a kind of business monitoring method, it is characterised in that include：
Obtain user request information；
The user request information is encapsulated as into monitoring data；
Obtain the queue number of corresponding with monitoring data Distributed Message Queue, and the monitoring data is sent to point
Distributed Message Queue corresponding with the queue number is stored in cloth message queue cluster；
The corresponding queue number of thread identification is obtained, is obtained from the Distributed Message Queue cluster and the queue number pair
Monitoring data in the Distributed Message Queue answered；
Monitoring data in the Distributed Message Queue corresponding with the queue number is distributed into the thread identification pair
The thread process answered.
2. business monitoring method according to claim 1, it is characterised in that the user request information includes that user please
Seeking the queue number of the time of reception, acquisition Distributed Message Queue corresponding with the monitoring data includes：
Obtain distributed in the monitoring data corresponding user's request time of reception and the Distributed Message Queue cluster disappearing
The number of queues of breath queue；
The user's request time of reception is converted into timestamp；
Distributed message corresponding with the monitoring data is obtained according to the number of queues of the timestamp and Distributed Message Queue
The queue number of queue.
3. business monitoring method according to claim 1, it is characterised in that described from the Distributed Message Queue cluster
The middle monitoring data obtained in Distributed Message Queue corresponding with the queue number includes：
Distribution corresponding with the queue number is obtained from the Distributed Message Queue cluster according to default time interval
Monitoring data in formula message queue.
4. business monitoring method according to claim 1, it is characterised in that the corresponding thread of the thread identification includes
Sub-line journey；
The monitoring data by the Distributed Message Queue corresponding with the queue number distributes to the thread mark
Knowing corresponding thread process includes：
Obtain the corresponding queue number of sub- thread identification；
Monitoring data in Distributed Message Queue corresponding to queue number corresponding with the sub- thread identification is distributed to
The corresponding sub- thread process of the sub- thread identification.
5. business monitoring method according to claim 1, it is characterised in that methods described also includes：
If detecting newly-increased Distributed Message Queue and newly-increased thread；
The corresponding relation set up between the queue number and the thread identification of newly-increased thread of newly-increased Distributed Message Queue.
6. a kind of business monitoring device, it is characterised in that include：
Acquisition module, for obtaining user request information；
Package module, for the user request information to be encapsulated as into monitoring data；
Data memory module, for obtaining the queue number of corresponding with monitoring data Distributed Message Queue, and by institute
State monitoring data and be sent to Distributed Message Queue corresponding with the queue number in Distributed Message Queue cluster and deposited
Storage；
Data acquisition module, for obtaining the corresponding queue number of thread identification, obtains from the Distributed Message Queue cluster
Take the monitoring data in Distributed Message Queue corresponding with the queue number；
Distribute module, for the monitoring data in the Distributed Message Queue corresponding with the queue number to be distributed into institute
State the corresponding thread process of thread identification.
7. business monitoring device according to claim 6, it is characterised in that the user request information includes that user please
Ask the time of reception；The data memory module includes：
Acquiring unit, for obtaining the monitoring data corresponding user's request time of reception and the Distributed Message Queue collection
The number of queues of Distributed Message Queue in group；
Converting unit, for the user's request time of reception to be converted into timestamp；
Computing unit, for obtaining corresponding with the monitoring data according to the number of queues of the timestamp and Distributed Message Queue
Distributed Message Queue queue number；
Memory cell, it is corresponding with the queue number in Distributed Message Queue cluster for the monitoring data to be sent to
Distributed Message Queue is stored.
8. business monitoring device according to claim 6, it is characterised in that the data acquisition module is additionally operable to obtain line
Journey identifies corresponding queue number, is obtained from the Distributed Message Queue cluster and the team according to default time interval
Monitoring data in the corresponding Distributed Message Queue of column number.
9. business monitoring device according to claim 6, it is characterised in that the corresponding thread of the thread identification includes
Sub-line journey；
The distribute module is additionally operable to obtain the corresponding queue number of sub- thread identification；Will team corresponding with the sub- thread identification
The monitoring data in Distributed Message Queue corresponding to column number distributes to the corresponding sub- thread process of the sub- thread identification.
10. business monitoring device according to claim 6, it is characterised in that described device also includes：
Respective modules, if for detecting newly-increased Distributed Message Queue and newly-increased thread；Set up newly-increased Distributed Message Queue
Queue number and the thread identification of newly-increased thread between corresponding relation.
A kind of 11. computer equipments, including memory, processor and the meter that store on a memory and can run on a processor
Calculation machine program, it is characterised in that realize following steps during the computing device described program：
Obtain user request information；
The user request information is encapsulated as into monitoring data；
Obtain the queue number of corresponding with monitoring data Distributed Message Queue, and the monitoring data is sent to point
Distributed Message Queue corresponding with the queue number is stored in cloth message queue cluster；
The corresponding queue number of thread identification is obtained, is obtained from the Distributed Message Queue cluster and the queue number pair
Monitoring data in the Distributed Message Queue answered；
Monitoring data in the Distributed Message Queue corresponding with the queue number is distributed into the thread identification pair
The thread process answered.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611266539.7A CN106656863A (en) | 2016-12-31 | 2016-12-31 | Business monitoring method and apparatus, and computer device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611266539.7A CN106656863A (en) | 2016-12-31 | 2016-12-31 | Business monitoring method and apparatus, and computer device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106656863A true CN106656863A (en) | 2017-05-10 |
Family
ID=58838975
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611266539.7A Pending CN106656863A (en) | 2016-12-31 | 2016-12-31 | Business monitoring method and apparatus, and computer device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106656863A (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107645542A (en) * | 2017-09-03 | 2018-01-30 | 中国南方电网有限责任公司 | A kind of data acquisition device applied to cloud auditing system |
| CN107689958A (en) * | 2017-09-03 | 2018-02-13 | 中国南方电网有限责任公司 | A kind of network audit subsystem applied to cloud auditing system |
| CN108322470A (en) * | 2018-02-07 | 2018-07-24 | 链家网（北京）科技有限公司 | A kind of network request processing method and processing device |
| CN108459917A (en) * | 2018-03-15 | 2018-08-28 | 欧普照明股份有限公司 | A kind of message distribution member, message handling system and message distribution method |
| CN109451051A (en) * | 2018-12-18 | 2019-03-08 | 百度在线网络技术（北京）有限公司 | Service request processing method, device, electronic equipment and storage medium |
| CN110427354A (en) * | 2019-07-12 | 2019-11-08 | 四川九洲电器集团有限责任公司 | A kind of distribution studies and judges system, method and computer storage medium, electronic equipment |
| CN110928664A (en) * | 2019-12-02 | 2020-03-27 | 南京甄视智能科技有限公司 | Distributed face searching method and system based on multiple message threads |
| CN111013133A (en) * | 2019-11-29 | 2020-04-17 | 北京奇艺世纪科技有限公司 | Data processing method and device |
| CN112581289A (en) * | 2020-12-14 | 2021-03-30 | 京东数字科技控股股份有限公司 | Data processing method, device, equipment and computer readable storage medium |
| CN112860446A (en) * | 2019-11-27 | 2021-05-28 | 上海哔哩哔哩科技有限公司 | Message distribution method |
| CN113051045A (en) * | 2019-12-27 | 2021-06-29 | 南京甄视智能科技有限公司 | Method and device for dynamically balancing equipment end load under IOT platform |
| CN113393246A (en) * | 2021-06-29 | 2021-09-14 | 山东派盟网络科技有限公司 | Payment platform risk identification method and system based on data acquisition system |
| CN113419871A (en) * | 2021-06-21 | 2021-09-21 | Oppo广东移动通信有限公司 | Object processing method based on synchronous slot and related product |
| CN113448725A (en) * | 2021-05-27 | 2021-09-28 | 深圳震有科技股份有限公司 | Data pushing method, device, terminal and storage medium |
| CN115396494A (en) * | 2022-08-19 | 2022-11-25 | 北京银丰新融科技开发有限公司 | Real-time monitoring method and system based on stream computing |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101547212A (en) * | 2008-03-29 | 2009-09-30 | 华为技术有限公司 | Method and system for scheduling distributed objects |
| CN101719872A (en) * | 2009-12-11 | 2010-06-02 | 曙光信息产业(北京)有限公司 | Zero-copy mode based method and device for sending and receiving multi-queue messages |
| CN103491190A (en) * | 2013-09-30 | 2014-01-01 | 国家电网公司 | Processing method for large-scale real-time concurrent charger monitoring data |
| CN103793273A (en) * | 2014-01-24 | 2014-05-14 | 北京京东尚科信息技术有限公司 | Distributed type queue scheduling method and device based on Redis |
| CN104158757A (en) * | 2014-08-21 | 2014-11-19 | 福建星海通信科技有限公司 | GPS (Global Positioning System) data loading and processing method and system |
| CN105138656A (en) * | 2015-08-31 | 2015-12-09 | 浪潮软件股份有限公司 | Method and device for processing data |
| CN105450618A (en) * | 2014-09-26 | 2016-03-30 | Tcl集团股份有限公司 | Operation method and operation system of big data process through API (Application Programming Interface) server |
-
2016
- 2016-12-31 CN CN201611266539.7A patent/CN106656863A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101547212A (en) * | 2008-03-29 | 2009-09-30 | 华为技术有限公司 | Method and system for scheduling distributed objects |
| CN101719872A (en) * | 2009-12-11 | 2010-06-02 | 曙光信息产业(北京)有限公司 | Zero-copy mode based method and device for sending and receiving multi-queue messages |
| CN103491190A (en) * | 2013-09-30 | 2014-01-01 | 国家电网公司 | Processing method for large-scale real-time concurrent charger monitoring data |
| CN103793273A (en) * | 2014-01-24 | 2014-05-14 | 北京京东尚科信息技术有限公司 | Distributed type queue scheduling method and device based on Redis |
| CN104158757A (en) * | 2014-08-21 | 2014-11-19 | 福建星海通信科技有限公司 | GPS (Global Positioning System) data loading and processing method and system |
| CN105450618A (en) * | 2014-09-26 | 2016-03-30 | Tcl集团股份有限公司 | Operation method and operation system of big data process through API (Application Programming Interface) server |
| CN105138656A (en) * | 2015-08-31 | 2015-12-09 | 浪潮软件股份有限公司 | Method and device for processing data |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107645542A (en) * | 2017-09-03 | 2018-01-30 | 中国南方电网有限责任公司 | A kind of data acquisition device applied to cloud auditing system |
| CN107689958A (en) * | 2017-09-03 | 2018-02-13 | 中国南方电网有限责任公司 | A kind of network audit subsystem applied to cloud auditing system |
| CN108322470A (en) * | 2018-02-07 | 2018-07-24 | 链家网（北京）科技有限公司 | A kind of network request processing method and processing device |
| CN108459917A (en) * | 2018-03-15 | 2018-08-28 | 欧普照明股份有限公司 | A kind of message distribution member, message handling system and message distribution method |
| CN109451051A (en) * | 2018-12-18 | 2019-03-08 | 百度在线网络技术（北京）有限公司 | Service request processing method, device, electronic equipment and storage medium |
| CN109451051B (en) * | 2018-12-18 | 2021-11-02 | 百度在线网络技术（北京）有限公司 | Service request processing method and device, electronic equipment and storage medium |
| CN110427354A (en) * | 2019-07-12 | 2019-11-08 | 四川九洲电器集团有限责任公司 | A kind of distribution studies and judges system, method and computer storage medium, electronic equipment |
| CN110427354B (en) * | 2019-07-12 | 2022-04-15 | 四川九洲电器集团有限责任公司 | Distributed studying and judging system and method, computer storage medium and electronic equipment |
| CN112860446A (en) * | 2019-11-27 | 2021-05-28 | 上海哔哩哔哩科技有限公司 | Message distribution method |
| CN111013133A (en) * | 2019-11-29 | 2020-04-17 | 北京奇艺世纪科技有限公司 | Data processing method and device |
| CN110928664A (en) * | 2019-12-02 | 2020-03-27 | 南京甄视智能科技有限公司 | Distributed face searching method and system based on multiple message threads |
| CN113051045A (en) * | 2019-12-27 | 2021-06-29 | 南京甄视智能科技有限公司 | Method and device for dynamically balancing equipment end load under IOT platform |
| CN113051045B (en) * | 2019-12-27 | 2022-08-16 | 南京甄视智能科技有限公司 | Method and device for dynamically balancing equipment end load under IOT platform |
| CN112581289A (en) * | 2020-12-14 | 2021-03-30 | 京东数字科技控股股份有限公司 | Data processing method, device, equipment and computer readable storage medium |
| CN113448725A (en) * | 2021-05-27 | 2021-09-28 | 深圳震有科技股份有限公司 | Data pushing method, device, terminal and storage medium |
| CN113419871A (en) * | 2021-06-21 | 2021-09-21 | Oppo广东移动通信有限公司 | Object processing method based on synchronous slot and related product |
| CN113419871B (en) * | 2021-06-21 | 2023-01-31 | Oppo广东移动通信有限公司 | Object processing method based on synchronous groove and related product |
| CN113393246A (en) * | 2021-06-29 | 2021-09-14 | 山东派盟网络科技有限公司 | Payment platform risk identification method and system based on data acquisition system |
| CN115396494A (en) * | 2022-08-19 | 2022-11-25 | 北京银丰新融科技开发有限公司 | Real-time monitoring method and system based on stream computing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106656863A (en) | Business monitoring method and apparatus, and computer device | |
| CN110659109B (en) | System and method for monitoring openstack virtual machine | |
| CN105956138B (en) | The control method and device of database connection | |
| WO2022179140A1 (en) | Data processing method and system | |
| US20100229182A1 (en) | Log information issuing device, log information issuing method, and program | |
| CN108900434A (en) | Data collection distribution method and device | |
| CN112039701A (en) | Interface call monitoring method, device, equipment and storage medium | |
| US8073938B2 (en) | Information processing apparatus and method of operating the same | |
| CN107548087A (en) | A kind of method and device of warning association analysis | |
| EP3329407A1 (en) | Application centric network experience monitoring | |
| CN114064402A (en) | Server system monitoring method | |
| CN106210101B (en) | Message management system and information management method | |
| CN103514044B (en) | Resource optimization method, device and system of dynamic behavior analysis system | |
| CN111245727B (en) | Message routing method, electronic device, proxy node and medium based on DHT network | |
| CN115794423B (en) | Intelligent machine room management method and device, electronic equipment and storage medium | |
| CN109831335B (en) | Data monitoring method, monitoring terminal, storage medium and data monitoring system | |
| CN107026761A (en) | A kind of method and device for determining alarm source | |
| CN114598622B (en) | Data monitoring method and device, storage medium and computer equipment | |
| US11890814B2 (en) | Data aggregation and analytics for digital manufacturing | |
| CN107306416A (en) | The recording method of business diary and device | |
| CN106301889B (en) | A kind of port numbers rapid-setting method and system | |
| CN113055493B (en) | Data packet processing method, device, system, scheduling device and storage medium | |
| CN104796294A (en) | Cloud acceleration network monitoring system and method | |
| JP3279517B2 (en) | Event processing method in network management system, network management system | |
| CN115269719A (en) | Data synchronization method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |
|
| RJ01 | Rejection of invention patent application after publication |