CN111131382A - Message monitoring method and device - Google Patents
Message monitoring method and device Download PDFInfo
- Publication number
- CN111131382A CN111131382A CN201911119447.XA CN201911119447A CN111131382A CN 111131382 A CN111131382 A CN 111131382A CN 201911119447 A CN201911119447 A CN 201911119447A CN 111131382 A CN111131382 A CN 111131382A
- Authority
- CN
- China
- Prior art keywords
- message
- information
- processing result
- index information
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 146
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000012545 processing Methods 0.000 claims abstract description 109
- 238000012806 monitoring device Methods 0.000 claims abstract description 4
- 238000012423 maintenance Methods 0.000 claims description 105
- 230000002159 abnormal effect Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012795 verification Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 15
- 230000008569 process Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 101150024767 arnT gene Proteins 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/08—Protocols specially adapted for terminal emulation, e.g. Telnet
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/31—Indexing; Data structures therefor; Storage structures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/083—Network architectures or network communication protocols for network security for authentication of entities using passwords
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Computer Security & Cryptography (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a message monitoring method and a message monitoring device, and relates to the technical field of computers. One embodiment of the method comprises: monitoring a message sent by a system, and acquiring parameter information and message information of the system to establish index information of the message; the unique key value of the message in the parameter information is used as the identifier of the index information; when monitoring that the system receives the processing result of the message, acquiring the processing result so as to update and monitor the index information of the message according to the unique message key value in the processing result; when a processing result that the system does not receive the message within preset time is monitored, acquiring timeout information based on a message unique key value in the processing result to generate a message exception record; and updating the message exception record to the index information of the message. Therefore, the embodiment of the invention can solve the problem that the processing efficiency of the message queue cannot be monitored in real time in the prior art.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and an apparatus for message monitoring.
Background
In various customer acquiring activities, a plurality of highly concurrent scenes are used in a message queue, and the activity platform back-end systems involved in different customer acquiring activities are connected to a core system through the message queue.
In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art:
at present, no monitoring method exists for processing the messages, and the processing efficiency, the number, the bug number and the like of the opposite message queue cannot be known in real time. This creates unnecessary trouble when we deal with the production accident. Moreover, the problem cannot be known at the first time, and thus cannot be dealt with at the first time.
Disclosure of Invention
In view of this, embodiments of the present invention provide a message monitoring method and device, which can solve the problem in the prior art that the processing efficiency of a message queue cannot be monitored in real time.
In order to achieve the above object, according to an aspect of the embodiments of the present invention, there is provided a message monitoring method, including monitoring a system sending message, and acquiring parameter information and message information of the system to establish index information of the message; when monitoring that the system receives the processing result of the message, acquiring the processing result to update and monitor the index information of the message; when a processing result that the system does not receive the message within a preset time is monitored, acquiring overtime information to generate a message exception record; and updating the message exception record to the index information of the message.
Optionally, the method further comprises:
counting the number of the abnormal message records of the system according to the parameter information of the system in the index information;
and when the monitored message abnormal record quantity of the system is greater than a preset threshold value, sending alarm information of the system.
Optionally, the method further comprises:
and setting a port which can enable the client to be connected with the port, so that the client can obtain the index information of the message.
Optionally, setting a port to which the client can be connected, so that the client can obtain index information of the message, including:
setting a port capable of connecting the client with the port, and connecting the port through a telnet command so that the client can acquire the index information of the message based on the verification information;
the authentication information is a user name and a password required by the client during connection, which are preset.
Optionally, acquiring parameter information and message information of the system to establish index information of the message, including:
acquiring parameter information and message information of the system, storing the parameter information and the message information into a redis, and creating index information through lucene.
Optionally, monitoring a processing result of the system receiving the message, and acquiring the processing result to update and monitor the index information of the message, including:
monitoring a processing result of the system for receiving the message, and extracting a message unique key value in the processing result;
and updating the index information according to the unique key value of the message.
Optionally, monitoring a processing result that the system does not receive the message within a preset time, and acquiring timeout information to generate a message exception record; after the message exception record is updated to the index information of the message, the method includes:
monitoring a processing result of the system receiving the message;
and searching index information according to the unique message key value in the processing result so as to mark the message abnormal record.
In addition, according to an aspect of the embodiments of the present invention, there is provided a message monitoring apparatus, including a monitoring operation and maintenance module arranged on each system and a monitoring operation and maintenance project corresponding to the monitoring operation and maintenance modules; the monitoring operation and maintenance module monitors a system to send a message, acquires parameter information and message information of the system and sends the parameter information and the message information to a monitoring operation and maintenance project, and the monitoring operation and maintenance project establishes index information of the message; the unique key value of the message in the parameter information is used as the identifier of the index information; when the monitoring operation and maintenance module monitors that the system receives the processing result of the message, the processing result is obtained and sent to the monitoring operation and maintenance engineering, and then the monitoring operation and maintenance engineering updates and monitors the index information of the message according to the unique message key value in the processing result; when the monitoring operation and maintenance module monitors that the system does not receive the processing result of the message within the preset time, acquiring timeout information based on the unique key value of the message in the processing result to generate a message exception record, and sending the message exception record to a monitoring operation and maintenance project; and the monitoring operation and maintenance engineering updates the message exception record to the index information of the message.
Optionally, the monitoring operation and maintenance engineering is further configured to:
counting the number of the abnormal message records of the system according to the parameter information of the system in the index information;
and when the monitored message abnormal record quantity of the system is greater than a preset threshold value, sending alarm information of the system.
Optionally, the monitoring operation and maintenance engineering is further configured to:
and setting a port which can enable the client to be connected with the port, so that the client can obtain the index information of the message.
Optionally, the monitoring operation and maintenance engineering sets a port to which the client is connected, so that the client obtains the index information of the message, including:
setting a port capable of connecting the client with the port, and connecting the port through a telnet command so that the client can acquire the index information of the message based on the verification information;
the authentication information is a user name and a password required by the client during connection, which are preset.
Optionally, the monitoring operation and maintenance module obtains parameter information and message information of the system and sends the parameter information and the message information to a monitoring operation and maintenance project, and then the monitoring operation and maintenance project establishes index information of the message, including:
and the monitoring operation and maintenance module acquires the parameter information and the message information of the system, stores the parameter information and the message information into redis, and further monitors the operation and maintenance engineering to create index information through lucene.
Optionally, the monitoring operation and maintenance module monitors a processing result of the message received by the system, acquires the processing result, sends the processing result to the monitoring operation and maintenance engineering, and then monitors the updating and monitoring of the operation and maintenance engineering for the index information of the message, including:
the monitoring operation and maintenance module monitors a processing result of the system for receiving the message, acquires the processing result and sends the processing result to a monitoring operation and maintenance project, and then the monitoring operation and maintenance project extracts a unique key value of the message in the processing result; and updating the index information according to the unique key value of the message.
Optionally, the monitoring operation and maintenance module monitors that the system does not receive the processing result of the message within a preset time, acquires timeout information to generate a message exception record, and sends the message exception record to the monitoring operation and maintenance engineering; after the monitoring operation and maintenance engineering updates the message exception record to the index information of the message, the method comprises the following steps:
the monitoring operation and maintenance module monitors the processing result of the message received by the system and sends the processing result to the monitoring operation and maintenance engineering;
and searching index information by the monitoring operation and maintenance engineering according to the unique message key value in the processing result so as to mark the message abnormal record.
According to another aspect of the embodiments of the present invention, there is also provided an electronic device, including:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any of the message listening embodiments described above.
According to another aspect of the embodiments of the present invention, there is also provided a computer readable medium, on which a computer program is stored, which when executed by a processor, implements the method according to any of the above-mentioned message listening based embodiments.
One embodiment of the above invention has the following advantages or benefits: the invention acquires the parameter information and the message information of the system by monitoring the message sent by the system so as to establish the index information of the message; the unique key value of the message in the parameter information is used as the identifier of the index information; when monitoring that the system receives the processing result of the message, acquiring the processing result so as to update and monitor the index information of the message according to the unique message key value in the processing result; when a processing result that the system does not receive the message within preset time is monitored, acquiring timeout information based on a message unique key value in the processing result to generate a message exception record; and updating the message exception record to the index information of the message. Therefore, the invention can monitor the message processing condition in real time and determine the production problem.
Further effects of the above-mentioned non-conventional alternatives will be described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
fig. 1 is a schematic diagram of a main flow of a message monitoring method according to a first embodiment of the present invention;
fig. 2 is a schematic diagram of a main flow of a message monitoring method according to a second embodiment of the present invention;
fig. 3 is a message monitoring apparatus according to an embodiment of the present invention;
FIG. 4 is a diagram of an embodiment of a message monitoring apparatus according to the invention;
fig. 5 is a schematic diagram of a message monitoring apparatus according to still another embodiment of the present invention;
FIG. 6 is an exemplary system architecture diagram in which embodiments of the present invention may be employed;
fig. 7 is a schematic block diagram of a computer system suitable for use in implementing a terminal device or server of an embodiment of the invention.
Detailed Description
Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, in which various details of embodiments of the invention are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 is a schematic diagram of a main flow of a message monitoring method according to a first embodiment of the present invention, where the message monitoring method may include:
step S101, monitoring a system sending message, and acquiring parameter information and message information of the system to establish index information of the message.
And the unique key value of the message in the parameter information is used as the identifier of the index information.
In an embodiment, the parameter information of the system may include: calling end IP, system port of the calling end, calling service code, transferred service parameter, calling time, message unique key value and the like. In addition, the message processing described in the present invention may be applied to environments such as ActiveMQ, RabbitMQ, rocktmq, Kafka, etc., and fig. 4 and 5 are described below with reference to RabbitMQ as an example, in order to more specifically describe the implementation of the present invention.
Preferably, the parameter information and the message information may be saved in redis, and the index may be created through lucene. Where redis is a key-value storage system. lucene is an information search repository.
Step S102, when monitoring that the system receives the processing result of the message, acquiring the processing result so as to update and monitor the index information of the message according to the unique message key value in the processing result; when a processing result that the system does not receive the message within preset time is monitored, acquiring timeout information based on a message unique key value in the processing result to generate a message exception record; and updating the message exception record to the index information of the message.
In an embodiment, the processing result of the message may include a message unique key, a processing completion time, a backend return state, a return message, and the like.
Preferably, a port capable of connecting the client to the server can be set, so that the client can obtain the index information of the message.
In an embodiment, a processing result that the system does not receive the message within a preset time may be monitored, and timeout information may be obtained to generate a message exception record. Then, the message exception record is updated to the index information of the message. Wherein, the processing result that the system does not receive the message within the preset time may be that the system does not receive the processing result of the message at all no matter how long, or the system receives the processing result of the message but exceeds the preset time.
In a further embodiment, when monitoring the index information of the message, the number of message exception records of the system may be counted according to the parameter information of the system in the index information. And when the monitored message abnormal record quantity of the system is greater than a preset threshold value, sending alarm information of the system.
It should be noted that if the processing result that the system does not receive the message within the preset time is monitored, the timeout information is obtained to generate a message exception record; after the message exception record is updated to the index information of the message, the system may also monitor the processing result of the received message, and then may search the index information according to the unique key value of the message in the processing result to mark the message exception record.
Fig. 2 is a schematic diagram of a main flow of a message monitoring method according to a second embodiment of the present invention, where the message monitoring method may include:
step S201, monitoring a system sending message, and acquiring parameter information and message information of the system to establish index information of the message.
Step S202, determining whether a processing result that the system does not receive the message within a preset time is monitored, if yes, performing step S203, and otherwise, performing step S205.
Step S203, acquiring the timeout information to generate a message exception record, updating the message exception record to the index information of the message, and performing step S204.
Step S204, determining whether a processing result of the system receiving the message is monitored, if yes, performing step S205, otherwise, performing step S206.
Step S205, obtaining the processing result, updating the index information of the message for monitoring, and exiting the process.
Step S206, updating the index information of the message with the information of the message processing result which is not received for monitoring, and exiting the process.
In summary, the message monitoring method of the present invention can creatively monitor the message processing status and determine the production problem in real time, and monitor and operate and maintain in a command line manner. Meanwhile, the real-time running condition of the message and the operation and maintenance problem can be determined through the association of the terminal and the server in real time and through the command line.
Fig. 3 is a message monitoring apparatus according to an embodiment of the present invention, and as shown in fig. 3, the message monitoring apparatus 300 includes a monitoring operation and maintenance module 301 disposed on each system and a monitoring operation and maintenance project 302 having a plurality of monitoring operation and maintenance modules. The monitoring operation and maintenance module 301 monitors a system transmission message, acquires parameter information and message information of the system, and transmits the parameter information and the message information to the monitoring operation and maintenance engineering 302, so that the monitoring operation and maintenance engineering 302 establishes index information of the message. The unique key value of the message in the parameter information is used as the identifier of the index information; when the monitoring operation and maintenance module 301 monitors that the system receives the processing result of the message, the processing result is obtained and sent to the monitoring operation and maintenance engineering 302, and then the monitoring operation and maintenance engineering 302 updates and monitors the index information of the message according to the message unique key value in the processing result; when the monitoring operation and maintenance module monitors that the system does not receive the processing result of the message within the preset time, acquiring timeout information based on the unique key value of the message in the processing result to generate a message exception record, and sending the message exception record to a monitoring operation and maintenance project; and the monitoring operation and maintenance engineering updates the message exception record to the index information of the message.
In a further embodiment, the monitoring operation and maintenance engineering 302 counts the number of message exception records of the system according to the parameter information of the system in the index information. And when the monitored message abnormal record quantity of the system is greater than a preset threshold value, sending alarm information of the system.
It should be noted that the listening operation and maintenance engineering 302 may set a port to which the client can be connected, so that the client can obtain the index information of the message.
Further, the monitoring operation and maintenance engineering sets a port to which the client is connected, so that the client can obtain the index information of the message, including:
and setting a port which can enable the client to be connected with the port, and connecting the port through a telnet command so that the client can acquire the index information of the message based on the verification information. The authentication information is a user name and a password required by the client during connection, which are preset.
In addition, the monitoring operation and maintenance module acquires the parameter information and the message information of the system and sends the parameter information and the message information to the monitoring operation and maintenance engineering, and then the monitoring operation and maintenance engineering establishes the index information of the message, which comprises the following steps:
and the monitoring operation and maintenance module acquires the parameter information and the message information of the system, stores the parameter information and the message information into redis, and further monitors the operation and maintenance engineering to create index information through lucene.
It should be further noted that the monitoring operation and maintenance module monitors the processing result of the message received by the system, acquires the processing result, sends the processing result to the monitoring operation and maintenance engineering, and then monitors the updating of the operation and maintenance engineering and monitors the index information of the message, including:
the monitoring operation and maintenance module monitors a processing result of the system for receiving the message, acquires the processing result and sends the processing result to a monitoring operation and maintenance project, and then the monitoring operation and maintenance project extracts a unique key value of the message in the processing result; and updating the index information according to the unique key value of the message.
As another embodiment, the monitoring operation and maintenance module monitors that the system does not receive the processing result of the message within a preset time, acquires timeout information to generate a message exception record, and sends the message exception record to the monitoring operation and maintenance engineering; after the monitoring operation and maintenance engineering updates the message exception record to the index information of the message, the method comprises the following steps:
the monitoring operation and maintenance module monitors the processing result of the message received by the system and sends the processing result to the monitoring operation and maintenance engineering;
and searching index information by the monitoring operation and maintenance engineering according to the unique message key value in the processing result so as to mark the message abnormal record.
It should be noted that, the message monitoring method and the message monitoring apparatus of the present invention have corresponding relation in the specific implementation content, so the repeated content is not described again.
Fig. 4 is a schematic diagram of a specific embodiment of the message monitoring device according to the present invention, and the systems 1 and 2 are examples of the mobile platform backend systems (two mobile platform backend systems are shown in fig. 4, but there may be more mobile platform backend systems in practice) which communicate with the core system through the RabbitMQ. The MQ monitoring operation and maintenance module can monitor the MQ message sent to the core system by the back-end system of the movable platform and send the message to the monitoring operation and maintenance engineering.
Further, the MQ monitoring operation and maintenance module monitors that the back-end systems (such as system 1 and system 2 in fig. 4) of the active platform send messages to MQ, and obtains the parameter information and the message information of the system. Wherein, the parameter information of the system comprises: calling end IP, system port of the calling end, calling service code, transferred service parameter, calling time, message unique key value and the like. And then, sending the parameter information and the message information of the system to a monitoring operation and maintenance project.
It should be further noted that, when the MQ monitoring operation and maintenance module monitors that a back-end system (such as system 1 and system 2 in fig. 4) of the active platform receives the processing result of the message, the processing result is obtained, which includes the unique key value of the message, the processing completion time, the back-end return state, and the return message. Preferably, the index information in the monitoring operation and maintenance project can be updated through the message unique key value.
Preferably, the MQ listening operation and maintenance module may be an exception condition that listens for MQ messages to time out. Specifically, whether the MQ message is overtime is judged through preset overtime time, that is, whether a processing result of the message is not received by the back-end system of the active platform within the preset time is judged. If the timeout happens, the information of the processing result such as the message unique parameter, the timeout time, the timeout state, the timeout message and the like is saved.
In another further embodiment, the monitoring operation and maintenance engineering stores the parameter information and the message information transmitted by the MQ monitoring operation and maintenance module, and further establishes the index information. Preferably, the parameter information and the message information transmitted by the MQ listening operation and maintenance module may be stored in redis, and an index may be created through lucene, so that specific message content may be determined through fuzzy query. Where redis is a key-value storage system. lucene is an information search repository.
It is also worth mentioning that the monitoring operation and maintenance engineering can set an alarm mechanism of the message. Specifically, the number of the message abnormal records of the system is counted according to the parameter information of the system in the index information. And when the monitored message abnormal record quantity of the system is greater than a preset threshold value, sending alarm information of the system. For example: when the message exception record exceeds the preset threshold value, a corresponding alarm message is sent to the administrator. Notifying it to process.
Preferably, the monitoring operation and maintenance engineering can set a user name and a password required by the connection of the client, and then the operation and maintenance monitoring personnel can verify information when the operation and maintenance monitoring personnel connect through a telnet command. In addition, a port is opened in the monitoring operation and maintenance project, and the client can be connected through a telnet command and connected into the monitoring operation and maintenance project through inputting a corresponding user name and a corresponding password. The telnet protocol is a member of the TCP/IP protocol family, and is a standard protocol and a main mode of the Internet remote login service.
The command functions of the monitoring operation and maintenance project can include the following:
fig. 5 is a schematic diagram of another embodiment of a message monitoring device according to the present invention, wherein the event platform now has a guest-obtaining event that gives the guest an unexpected risk free on the day five. At this time, 4 servers (system 1, system 2, system 3 and system 4 in fig. 5) at the back end of the movable platform send policy information to the core underwriting system through a RabbitMQ message queue. Wherein, the underwriting information comprises the following information: policy number, product code, seed code, premium, name of the applicant, number of the applicant's certificate, date of the application, etc.
System 1IP:192.168.0.3 port: 8080
System 2IP 192.168.0.3 port: 8081
System 3IP 192.168.0.4 port: 8080
System 4IP 192.168.0.4 port: 8081
At the time of application, the information is operated through one of the system 1, the system 2, the system 3 and the system 4 and is transmitted to the core underwriting system through the RabbitMQ.
It should be noted that the timeout time of the RabbitMQ is monitored, and the login user name and password are set. In this example, the timeout time is set to 10 seconds, the login user name is admin, and the password is pass 1. Meanwhile, setting the abnormal RabbitMQ message of underwriting to exceed 10 alarms, and setting the alarm of the notification to be one third.
In the process of underwriting, the MQ monitoring operation and maintenance module monitors the transmitted underwriting information and forms own monitoring information to be transmitted to the monitoring operation and maintenance engineering.
The transmitted listening information is in the form:
{
"IP":"192.168.0.3",
"port":"8080",
"bustype":"CB",
"data" { ' productname ': product name ', ' riskname ': risk species name ', ' arnt ': premium ', ' inspired name ': insured name ', ' ido ': identity number ', ' valid ': effective date ', ' prodno ': guaranteed number ' },
"deadline": "reception time",
"returntime":"",
"status":"",
"return" "," UUID ": message unique key value"
}
And the MQ monitoring operation and maintenance module transmits the json information to the monitoring operation and maintenance engineering and stores the json information in the monitoring operation and maintenance engineering. And if the MQ is processed, updating the json information, modifying the fields of return time, status and return time, and filling the fields as return time and processing state. If the return process succeeds status, 0 is saved, and if the return process succeeds status, 1 is returned. return saves the returned information. And after the updating is finished, sending the message to a monitoring operation and maintenance project. If the MQ processes for more than 10 seconds, the json information is also updated, the return time and status, return fields are modified, and the status is saved as 3. And the return is stored as 'calling interface overtime', the return is the current time, and the message is sent to the monitoring operation and maintenance engineering after the update is finished.
In the monitoring operation and maintenance project, if the overtime messages of underwriting exceed 10, the early warning interface is called to inform the manager to process the problem by turning on and off the three. And the manager receives the alarm information and connects the monitoring operation and maintenance engineering system through a local computer.
122.0.0.1 is the IP address of the monitoring operation and maintenance engineering system, and 80 is the port of the monitoring operation and maintenance engineering system.
(1) Enter commands through the local CMD window: telnet 122.0.0.180
(2) Inputting login admin/pass1 to log in the monitoring operation and maintenance engineering system.
(3) The input ls presents all traffic codes, this time CB) (underwriting traffic).
(4) The input count CB 20190704 shows the data of all underwriting services in 7, 4 and 2019, and the returned result is as follows: success: 1000 error: 40 timeout: 20, this means that the service was successful for 1000 pieces, 40 errors occurred, and 20 times out.
(5) The input command detail CB timeout-L3 can show the first three timeout service messages. The results are returned as follows:
(6) when a command detailCB timeout 0001 is input, detail information of the piece of data can be displayed, and the returned result is as follows:
{
"IP":"192.168.0.3",
"port":"8080",
"bustype":"CB",
"data":
"{ 'productname': A02',' riskname ': R1', 'amp': 10000',' prem ': 1', 'inspired name': Zhang III ',' idno ': 1102221998703273333', 'validate': 20190704',' prodno ': G0001' },
"dealtime":"20190704000001",
"returntime":"20190704000051",
"status":"3",
"returnmes":""，"UUID":"0001"
}
this allows the corresponding database information to be modified based on the error data.
Fig. 6 shows an exemplary system architecture 600 to which the message listening method or the message listening apparatus of the embodiments of the present invention may be applied.
As shown in fig. 6, the system architecture 600 may include terminal devices 601, 602, 603, a network 604, and a server 605. The network 604 serves to provide a medium for communication links between the terminal devices 601, 602, 603 and the server 605. Network 604 may include various types of connections, such as wire, wireless communication links, or fiber optic cables, to name a few.
A user may use the terminal devices 601, 602, 603 to interact with the server 605 via the network 604 to receive or send messages or the like. The terminal devices 601, 602, 603 may have installed thereon various communication client applications, such as shopping applications, web browser applications, search applications, instant messaging tools, mailbox clients, social platform software, etc. (by way of example only).
The terminal devices 601, 602, 603 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.
The server 605 may be a server providing various services, such as a background management server (for example only) providing support for shopping websites browsed by users using the terminal devices 601, 602, 603. The backend management server may analyze and perform other processing on the received data such as the product information query request, and feed back a processing result (for example, target push information, product information — just an example) to the terminal device.
It should be noted that the message monitoring method provided by the embodiment of the present invention is generally executed by the server 605, and accordingly, the message monitoring apparatus is generally disposed in the server 605.
It should be understood that the number of terminal devices, networks, and servers in fig. 6 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Referring now to FIG. 7, shown is a block diagram of a computer system 700 suitable for use with a terminal device implementing an embodiment of the present invention. The terminal device shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 7, the computer system 700 includes a Central Processing Unit (CPU)701, which can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)702 or a program loaded from a storage section 1208 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data necessary for the operation of the system 700 are also stored. The CPU 1201, the ROM 1202, and the RAM 703 are connected to each other by a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.
The following components are connected to the I/O interface 705: an input portion 706 including a keyboard, a mouse, and the like; an output section 707 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 708 including a hard disk and the like; and a communication section 709 including a network interface card such as a LAN card, a modem, or the like. The communication section 709 performs communication processing via a network such as the internet. A drive 710 is also connected to the I/O interface 705 as needed. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 710 as necessary, so that a computer program read out therefrom is mounted into the storage section 708 as necessary.
In particular, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 709, and/or installed from the removable medium 711. The computer program performs the above-described functions defined in the system of the present invention when executed by the Central Processing Unit (CPU) 701.
It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present invention may be implemented by software or hardware. The described modules may also be provided in a processor, which may be described as: a processor comprises a monitoring operation and maintenance module and a monitoring operation and maintenance project. Wherein the names of the modules do not in some cases constitute a limitation of the module itself.
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be separate and not incorporated into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to comprise: monitoring a message sent by a system, and acquiring parameter information and message information of the system to establish index information of the message; the unique key value of the message in the parameter information is used as the identifier of the index information; when monitoring that the system receives the processing result of the message, acquiring the processing result so as to update and monitor the index information of the message according to the unique message key value in the processing result; when a processing result that the system does not receive the message within preset time is monitored, acquiring timeout information based on a message unique key value in the processing result to generate a message exception record; and updating the message exception record to the index information of the message.
According to the technical scheme of the embodiment of the invention, the problem that the processing efficiency of the message queue cannot be monitored in real time in the prior art can be solved.
The above-described embodiments should not be construed as limiting the scope of the invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions can occur, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A message listening method, comprising:
monitoring a message sent by a system, and acquiring parameter information and message information of the system to establish index information of the message; the unique key value of the message in the parameter information is used as the identifier of the index information;
when monitoring that the system receives the processing result of the message, acquiring the processing result so as to update and monitor the index information of the message according to the unique message key value in the processing result; when a processing result that the system does not receive the message within preset time is monitored, acquiring timeout information based on a message unique key value in the processing result to generate a message exception record; and updating the message exception record to the index information of the message.
2. The method of claim 1, further comprising:
counting the number of the abnormal message records of the system according to the parameter information of the system in the index information;
and when the monitored message abnormal record quantity of the system is greater than a preset threshold value, sending alarm information of the system.
3. The method of claim 1, further comprising:
and setting a port which can enable the client to be connected with the port, so that the client can obtain the index information of the message.
4. The method according to claim 3, wherein setting a port to which the client can connect for the client to obtain the index information of the message comprises:
setting a port capable of connecting the client with the port, and connecting the port through a telnet command so that the client can acquire the index information of the message based on the verification information;
the authentication information is a user name and a password required by the client during connection, which are preset.
5. The method of claim 1, wherein obtaining parameter information and message information of the system to establish index information of the message comprises:
acquiring parameter information and message information of the system, storing the parameter information and the message information into a redis, and creating index information through lucene.
6. The method of claim 1, wherein monitoring a processing result of the system receiving the message, and obtaining the processing result to update and monitor index information of the message comprises:
monitoring a processing result of the system for receiving the message, and extracting a message unique key value in the processing result;
and updating the index information according to the unique key value of the message.
7. The method according to claim 6, wherein if a processing result that the system does not receive the message within a preset time is monitored, time-out information is obtained to generate a message exception record; after the message exception record is updated to the index information of the message, the method includes:
monitoring a processing result of the system receiving the message;
and searching index information according to the unique message key value in the processing result so as to mark the message abnormal record.
8. The message monitoring device is characterized by comprising a monitoring operation and maintenance module arranged on each system and a monitoring operation and maintenance project corresponding to a plurality of monitoring operation and maintenance modules;
the monitoring operation and maintenance module monitors a system to send a message, acquires parameter information and message information of the system and sends the parameter information and the message information to a monitoring operation and maintenance project, and the monitoring operation and maintenance project establishes index information of the message;
when the monitoring operation and maintenance module monitors that the system receives the processing result of the message, the processing result is obtained and sent to the monitoring operation and maintenance engineering, and the monitoring operation and maintenance engineering updates and monitors the index information of the message; when a processing result that the system does not receive the message within a preset time is monitored, acquiring overtime information to generate a message exception record; and updating the message exception record to the index information of the message.
9. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-7.
10. A computer-readable medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911119447.XA CN111131382A (en) | 2019-11-15 | 2019-11-15 | Message monitoring method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911119447.XA CN111131382A (en) | 2019-11-15 | 2019-11-15 | Message monitoring method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111131382A true CN111131382A (en) | 2020-05-08 |
Family
ID=70495939
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911119447.XA Pending CN111131382A (en) | 2019-11-15 | 2019-11-15 | Message monitoring method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111131382A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112287643A (en) * | 2020-09-01 | 2021-01-29 | 上海泛微软件有限公司 | Message monitoring method, device, equipment and computer readable storage medium |
| CN114422576A (en) * | 2022-01-24 | 2022-04-29 | 深圳壹账通智能科技有限公司 | Session cleaning method and device, computer equipment and readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103888287A (en) * | 2013-12-18 | 2014-06-25 | 北京首都国际机场股份有限公司 | Information system integrated operation and maintenance monitoring service early warning platform and realization method thereof |
| CN104901955A (en) * | 2015-05-20 | 2015-09-09 | 腾讯科技（深圳）有限公司 | Early warning method, early warning device and processing server |
| US20160373509A1 (en) * | 2015-06-16 | 2016-12-22 | Sk Telecom Co., Ltd. | APPARATUS AND METHOD FOR REPORTING QoS/QoE IN MOBILE ENVIRONMENT |
| CN108600094A (en) * | 2018-05-11 | 2018-09-28 | 深圳壹账通智能科技有限公司 | Message pushes monitor method, device, computer equipment and the storage medium of process |
| CN110019001A (en) * | 2017-08-17 | 2019-07-16 | 中国电信股份有限公司 | Promote method, system and the monitoring module of message-oriented middleware message trace ability |
-
2019
- 2019-11-15 CN CN201911119447.XA patent/CN111131382A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103888287A (en) * | 2013-12-18 | 2014-06-25 | 北京首都国际机场股份有限公司 | Information system integrated operation and maintenance monitoring service early warning platform and realization method thereof |
| CN104901955A (en) * | 2015-05-20 | 2015-09-09 | 腾讯科技（深圳）有限公司 | Early warning method, early warning device and processing server |
| US20160373509A1 (en) * | 2015-06-16 | 2016-12-22 | Sk Telecom Co., Ltd. | APPARATUS AND METHOD FOR REPORTING QoS/QoE IN MOBILE ENVIRONMENT |
| CN110019001A (en) * | 2017-08-17 | 2019-07-16 | 中国电信股份有限公司 | Promote method, system and the monitoring module of message-oriented middleware message trace ability |
| CN108600094A (en) * | 2018-05-11 | 2018-09-28 | 深圳壹账通智能科技有限公司 | Message pushes monitor method, device, computer equipment and the storage medium of process |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112287643A (en) * | 2020-09-01 | 2021-01-29 | 上海泛微软件有限公司 | Message monitoring method, device, equipment and computer readable storage medium |
| CN112287643B (en) * | 2020-09-01 | 2023-01-24 | 上海泛微软件有限公司 | Message monitoring method, device, equipment and computer readable storage medium |
| CN114422576A (en) * | 2022-01-24 | 2022-04-29 | 深圳壹账通智能科技有限公司 | Session cleaning method and device, computer equipment and readable storage medium |
| CN114422576B (en) * | 2022-01-24 | 2024-02-06 | 深圳壹账通智能科技有限公司 | Session cleaning method and device, computer equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109257200B (en) | Method and device for monitoring big data platform | |
| CN112860451A (en) | Multi-tenant data processing method and device based on SaaS | |
| CN113157545A (en) | Method, device and equipment for processing service log and storage medium | |
| CN109669835B (en) | MySQL database monitoring method, device, equipment and readable storage medium | |
| US11074652B2 (en) | System and method for model-based prediction using a distributed computational graph workflow | |
| US20180157685A1 (en) | Systems and methods for remotely monitoring databases | |
| CN110928934A (en) | Data processing method and device for business analysis | |
| CN111460129A (en) | Method and device for generating identification, electronic equipment and storage medium | |
| CN111131382A (en) | Message monitoring method and device | |
| CN110727563A (en) | Cloud service alarm method and device for preset customer | |
| CN112118352B (en) | Method and device for processing notification trigger message, electronic equipment and computer readable medium | |
| CN113760634A (en) | Data processing method and device | |
| CN113056761A (en) | Payment platform management method, device, payment platform and computer storage medium | |
| CN115190125A (en) | Monitoring method and device for cache cluster | |
| CN113485902B (en) | Method, device, equipment and computer readable medium for testing service platform | |
| CN107682432A (en) | Data handling system and method based on Spark | |
| CN113450149A (en) | Information processing method and device, electronic equipment and computer readable medium | |
| CN109495469B (en) | Flow analysis safety management and control system, method and device | |
| CN113783828A (en) | Business system monitoring method and device | |
| CN114090397A (en) | Alarm information processing method and device | |
| CN112463616A (en) | Chaos testing method and device for Kubernetes container platform | |
| CN109388546B (en) | Method, device and system for processing faults of application program | |
| CN113778780A (en) | Application stability determination method and device, electronic equipment and storage medium | |
| CN116450622B (en) | Method, apparatus, device and computer readable medium for data warehouse entry | |
| CN115309612B (en) | Method and device for monitoring data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200508 |