CN111949476A - Lightweight method and system for monitoring business health degree in APP in real time - Google Patents

Lightweight method and system for monitoring business health degree in APP in real time Download PDF

Info

Publication number
CN111949476A
CN111949476A CN202010686697.8A CN202010686697A CN111949476A CN 111949476 A CN111949476 A CN 111949476A CN 202010686697 A CN202010686697 A CN 202010686697A CN 111949476 A CN111949476 A CN 111949476A
Authority
CN
China
Prior art keywords
app
data
error
real time
monitoring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010686697.8A
Other languages
Chinese (zh)
Inventor
韩征峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Si Tech Information Technology Co Ltd
Original Assignee
Beijing Si Tech Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Si Tech Information Technology Co Ltd filed Critical Beijing Si Tech Information Technology Co Ltd
Priority to CN202010686697.8A priority Critical patent/CN111949476A/en
Publication of CN111949476A publication Critical patent/CN111949476A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
    • G06F11/3093—Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/546—Message passing systems or structures, e.g. queues
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/80—Database-specific techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/865—Monitoring of software
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00—Indexing scheme relating to G06F9/00
    • G06F2209/54—Indexing scheme relating to G06F9/54
    • G06F2209/548—Queue

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

The invention provides a lightweight method and a system for monitoring the health degree of business in APP in real time, which comprises the following steps: generating a JS probe code file, introducing the JS probe code file into an APP system, and generating a corresponding identity and a corresponding key string to be recorded in a service system; the JS probe code monitors error information of a user in an APP access process in real time, encrypts the error information, and a data packet consisting of the encrypted error information and the identity mark is uploaded to a service system; the service system carries out decryption verification on the encrypted error information; the service system obtains error data and puts the error data into a message queue; and the service system reads and consumes the error data in the message queue and synchronizes the data into the database. The beneficial effects of the invention are: by constructing a front-end JS probe, the operation condition of a user in the APP is collected in real time, and data is encrypted and transmitted to the service system, so that the service system can accurately know the business health state in the APP; the monitoring system is light in weight by adopting the JS probe.

Description

Lightweight method and system for monitoring business health degree in APP in real time
Technical Field
The invention relates to the technical field of information monitoring, in particular to a lightweight method and system for monitoring APP internal business health in real time.
Background
With the rapid development of 5G +, the interconnection of mobile phones has become a trend of times, various mobile phone APP emerge endlessly, and a user is inevitable to have an abnormality in the using process, so that a service provider needs to solve the abnormality in time.
The system abnormity is solved, and the basic requirement for ensuring the use quality of each APP is met, so that the user can be protected. When the system is abnormal, a user initiates complaints through a complaint channel, if a service provider can know the service operation condition, the problem is solved, better experience is brought to the user, and the method has important significance for the long-term operation of the APP.
The traditional solution at present adopts page code insertion, forms a code insertion log file through page access records, combines big data analysis capability, and cleans, saves and retrieves the code insertion file.
Disclosure of Invention
Aiming at the problems, the invention provides a lightweight method and a lightweight system for monitoring the health degree of business in APP in real time, which are used for monitoring the access process of a user in an APP system in real time, acquiring error information and reporting the error information to an analysis platform, further helping operators to accurately and quickly know the health condition of the APP, and directionally optimizing and upgrading the APP according to the health condition of the APP.
In order to achieve the purpose, the invention provides a lightweight method for monitoring the health degree of APP internal business in real time, which comprises the following steps:
generating a JS probe code file and a corresponding identity and a corresponding key string, introducing the JS probe code into an APP system, and recording the corresponding identity and the corresponding key string in a service system;
the JS probe code monitors error information of a user in an APP access process in real time, encrypts the error information, and a data packet consisting of the encrypted error information and the identity mark is uploaded to a service system;
the service system receives the data packet, searches a corresponding key string according to the identity identifier in the data packet, and decrypts and verifies the data packet;
the service system obtains error data after decryption and verification pass, and the error data are placed in a message queue;
and the service system reads and consumes the error data in the message queue and synchronizes the data into the database.
In the above technical solution, preferably, the method further includes the steps of:
and the operator logs in the service platform to obtain error data in real time and know the health condition of the APP.
In the above-described technical solution, preferably,
the JS probe code files are designed according to different service attributes, different APP system development tools and different error acquisition levels to generate unique JS probe code files;
the service attributes include: package inquiry, recharging and paying, and service handling;
the APP system development tool comprises: VUE, JSP, Html;
the error collection level includes: info, error and warning.
In the above technical solution, preferably, the JS probe code sends the error information to the service system in the form of a rest interface;
the key string is a key for unlocking the encrypted error information, and the identity identification and the key string have a unique corresponding relation.
In the foregoing technical solution, preferably, the decryption check includes:
and the service system queries the key string according to the identity in the data packet and decrypts the encrypted error information.
In the above technical solution, preferably, the error data in the message queue is read and consumed, the message is temporarily stored in the Redis database cache, and simultaneously synchronized and persisted in the open-source Mysql library table.
The invention also provides a lightweight system for monitoring the health degree of the business in the APP in real time, which comprises a real-time monitoring module, an information sending module, an information receiving module and a data storage module;
the real-time monitoring module is used for:
introducing a JS probe code file and a corresponding identity mark;
monitoring error information in the user access process in the APP in real time;
the information sending module is configured to:
encrypting the error information acquired by the real-time monitoring module, forming a data packet by the encrypted error information and the identity identifier, and sending the data packet to the information receiving module;
the information receiving module is configured to:
receiving a data packet sent by an information sending module, and carrying out decryption and verification;
putting the decrypted and verified error data into a message queue;
the data storage module is configured to:
and reading and consuming error data in the message queue, and synchronously and persistently persisting the data into the open-source Mysql library table.
In the above technical solution, preferably, the system further includes a data query module, configured to:
and the operator acquires error data in real time through the query module to know the health condition of the APP.
In the above technical solution, preferably, the information sending module sends the error information acquired by the real-time monitoring module to the information receiving module in a form of a rest interface;
the key string is a key for unlocking the encrypted error information, and the identity identification and the key string have a unique corresponding relation.
In the above technical solution, preferably, the data receiving module queries the key string according to the identity in the data packet, and decrypts the encrypted error information using the key string to obtain the error data.
Compared with the prior art, the invention has the beneficial effects that: by constructing a front-end JS probe, the operation condition of a user in the APP is collected in real time, and data is encrypted and transmitted to the service system, so that the service system can accurately know the business health state in the APP; the method of adopting the JS probe also realizes the light weight of data, and further realizes the light weight of the monitoring system.
According to the method, when the front-end JS probe is constructed, according to the difference of APP development tools, the business attributes in the APP are different, and the service platform operator carries out classification and orientation design for knowing the difference of error levels in the APP, so that the compatibility is strong, the introduction is convenient, the access threshold is low, and the specified business operation health condition can be known.
The data acquisition and storage of the service system are separated, the acquired data are firstly put into a message queue, so that the message queue is firstly ordered to a certain extent, because a plurality of users of the APP have a plurality of acquired error information, and if the APP is not ordered, the APP is directly accessed into a database, so that the problems of data confusion, untimely processing and the like are easily caused; when data are stored, the data are firstly put into a Redis database for caching, and are synchronized and persisted into an open-source Mysql table after a certain time, so that an operator can conveniently inquire the data, and the operator can more quickly read the data which are acquired for a few days in the Redis database.
Drawings
FIG. 1 is a flowchart of a lightweight method for monitoring health of an APP in real time according to an embodiment of the present invention;
FIG. 2 is a schematic view of a lightweight system for monitoring health of an APP in real time according to an embodiment of the present invention;
fig. 3 is a detailed flowchart of a lightweight method for monitoring health of an APP in real time according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
The invention is described in further detail below with reference to the attached drawing figures:
as shown in fig. 1, the lightweight method for monitoring health of APP in real time provided by the invention comprises the following steps:
designing and generating a unique JS probe code file and a corresponding identity mark and a key string according to the service attribute to be monitored in the APP, the APP system development tool and the error acquisition level, introducing the JS probe code into the APP system, and recording the corresponding identity mark and the key string in a service system;
the JS probe code monitors error information of a user in an APP access process in real time, encrypts the error information, and a data packet consisting of the encrypted error information and the identity mark is uploaded to a service system;
the service system receives the data packet, searches a corresponding key string according to the identity identifier in the data packet, and decrypts and verifies the encrypted error information;
the service system obtains error data after decryption and verification pass, and the error data are placed in a message queue;
and the service system reads and consumes the error data in the message queue, temporarily stores the message into a Redis database for caching, and synchronously and persistently stores the data into an open-source Mysql base table.
And the operator logs in the service platform to obtain error data in real time and know the health condition of the APP.
As shown in fig. 2, the invention further provides a lightweight system for monitoring the health degree of the business in the APP in real time, which comprises a real-time monitoring module, an information sending module, an information receiving module, a data storage module and a data query module;
a real-time monitoring module for:
introducing a JS probe code file and a corresponding identity mark;
monitoring error information in the user access process in the APP in real time;
an information sending module, configured to:
encrypting the error information acquired by the real-time monitoring module, forming a data packet by the encrypted error information and the identity identifier, and sending the data packet to the information receiving module in a rest interface mode;
the data packet includes encrypted error information and an identification.
An information receiving module for:
and receiving the data packet sent by the information sending module, inquiring the corresponding key string according to the identity in the data packet, and carrying out decryption and verification on the encrypted error information to obtain error data.
Putting the decrypted and verified error data into a message queue;
a data storage module to:
and reading and consuming error data in the message queue, temporarily storing the data in a Redis database for caching, and synchronizing and persisting the data in an open-source Mysql table.
A data query module to:
and the operator acquires error data in real time through the query module to know the health condition of the APP.
Example (b):
taking mobile company APP as an example, the service attributes include: package inquiry, recharging and paying, service handling and the like; the APP system development tool comprises: VUE, JSP, Html; the error collection level includes: info, error and warning.
In the real-time example, the code adopts an html development tool, and for the example of recharging and paying service in the mobile APP, the ASR encryption method is adopted to encrypt the acquired error information; generating a JS probe file, a corresponding identity (channel A) and a key string, and backing up the identity (channel A) and the key string corresponding to the JS probe to a service system, wherein the key string and encrypted information have a unique corresponding relation; the identity mark and the key string also have a unique corresponding relation; introducing the JS probe file into the following positions in the mobile APP system code:
Figure BDA0002587826340000061
directly inserting the JS probe code at the top of the head label to monitor the most comprehensive; the monitoring process is shown in fig. 3, and specifically includes:
s1: when a user accesses the APP system, a reminding (info) error occurs in the access process;
s2: the JS probe acquires error information in real time, the form of the error information is structured and contains information such as error types (interface abnormity), error IP (Internet protocol) and service types (recharging and paying), and the error information is encrypted and then is transmitted to a service system together with an identity (channel A) in a rest interface form;
s3: the service system receives the data packet, searches a corresponding key string according to the identity (channel A) in the data packet, decrypts and verifies the encrypted error information through the key string, and if the decryption verification is passed, the decrypted error information is put into a kafka queue;
s4: the system design process takes out data from the kafka queue all the time, stores the data into a Redis database for caching, sets the caching time to be 3 days, and synchronously persists the data into a Mysql table;
s5: the platform operator acquires data through a rest interface, and if the recharging and paying service error reporting data of nearly 3 days needs to be acquired, the data can be directly acquired in a Redis database;
if data before 3 days needs to be acquired, reading in a Mysql base table;
s6: and the data is imported into a data query display tool, so that the visual display of recharging, paying and reminding errors in the form of icons and pictures and texts can be obtained, and the information such as the current health condition, the error overview and the like can be visually checked in real time.
The acquisition error grade in the method can be set as info, error, warming and the like; the JS probe code has the characteristic of low aggressiveness, and when the error information is sent to the rest interface of the service system, the user side cannot receive the return information of the rest interface and cannot be influenced.
The invention has the advantages that: adopt the front end to generate JS probe, JS probe automatic catch the corresponding condition of browser, send the mode of rest engine with the result in real time, classify based on business type, in real time simultaneously, finally through visual icon directly perceived show APP health, help impel the continuous optimization upgrading of APP product, realized the lightweight of APP health degree control.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. A lightweight method for monitoring the health degree of business in APP in real time is characterized by comprising the following steps:
generating a JS probe code file and a corresponding identity and a corresponding key string, introducing the JS probe code into an APP system, and recording the corresponding identity and the corresponding key string in a service system;
the JS probe code monitors error information of a user in an APP access process in real time, encrypts the error information, and a data packet consisting of the encrypted error information and the identity mark is uploaded to a service system;
the service system receives the data packet, searches a corresponding key string according to the identity identifier in the data packet, and decrypts and verifies the encrypted error information;
the service system obtains error data after decryption and verification pass, and the error data are placed in a message queue;
and the service system reads and consumes the error data in the message queue and synchronizes the data into the database.
2. The lightweight method for monitoring the health degree of the APP business in real time according to claim 1, further comprising the steps of:
and the operator logs in the service platform to obtain error data in real time and know the health condition of the APP.
3. The lightweight method for monitoring the health degree of the APP business in real time according to claim 1, is characterized in that:
the JS probe code files are designed according to different service attributes, different APP system development tools and different error acquisition levels to generate unique JS probe code files;
the service attributes include: package inquiry, recharging and paying, and service handling;
the APP system development tool comprises: VUE, JSP, Html;
the error collection level includes: info, error and warning.
4. The lightweight method for monitoring the health degree of the APP business in real time according to claim 1, is characterized in that:
the JS probe code sends error information to a data packet to a service system in a rest interface mode;
the key string is a key for unlocking the encrypted file, and the identity and the key string have a unique corresponding relation.
5. The lightweight method for monitoring the health of the APP business in real time according to claim 1, wherein the decryption check comprises:
and the service system queries the key string according to the identity in the data packet and decrypts the encrypted error information.
6. The lightweight method for monitoring the health degree of the APP business in real time according to claim 1, is characterized in that:
and reading and consuming error data in the message queue, temporarily storing the message into a Redis database for caching, and synchronously and persistently storing the message into an open-source Mysql library table.
7. The utility model provides a lightweight system of real time monitoring APP internal business health degree which characterized in that: the system comprises a real-time monitoring module, an information sending module, an information receiving module and a data storage module;
the real-time monitoring module is used for:
introducing a JS probe code file;
monitoring error information in the user access process in the APP in real time;
the information sending module is configured to:
encrypting the error information acquired by the real-time monitoring module, forming a data packet by the encrypted error information and the identity identifier, and sending the data packet to the information receiving module;
the information receiving module is configured to:
receiving a data packet sent by an information sending module, and carrying out decryption and verification;
putting the decrypted and verified error data into a message queue;
the data storage module is configured to:
and reading and consuming error data in the message queue, and synchronously and persistently persisting the data into the open-source Mysql library table.
8. The lightweight system for monitoring the health of the APP business in real time according to claim 7, further comprising a data query module for:
and the operator acquires error data in real time through the query module to know the health condition of the APP.
9. The lightweight system for monitoring the health degree of the APP business in real time according to claim 7, is characterized in that:
the information sending module sends the error information acquired by the real-time monitoring module to the information receiving module in a rest interface mode;
the key string is a key for unlocking the encrypted error information, and the identity identification and the key string have a unique corresponding relation.
10. The lightweight system for monitoring the health degree of the APP business in real time according to claim 7, is characterized in that:
and the data receiving module queries the key string according to the identity in the data packet, and decrypts the encrypted error information by using the key string to obtain error data.
CN202010686697.8A 2020-07-16 2020-07-16 Lightweight method and system for monitoring business health degree in APP in real time Pending CN111949476A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010686697.8A CN111949476A (en) 2020-07-16 2020-07-16 Lightweight method and system for monitoring business health degree in APP in real time

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010686697.8A CN111949476A (en) 2020-07-16 2020-07-16 Lightweight method and system for monitoring business health degree in APP in real time

Publications (1)

Publication Number Publication Date
CN111949476A true CN111949476A (en) 2020-11-17

Family

ID=73340945

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010686697.8A Pending CN111949476A (en) 2020-07-16 2020-07-16 Lightweight method and system for monitoring business health degree in APP in real time

Country Status (1)

Country Link
CN (1) CN111949476A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112579392A (en) * 2020-12-21 2021-03-30 深圳云之家网络有限公司 Application detection method and device, computer equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112579392A (en) * 2020-12-21 2021-03-30 深圳云之家网络有限公司 Application detection method and device, computer equipment and storage medium
CN112579392B (en) * 2020-12-21 2023-01-24 深圳云之家网络有限公司 Application detection method and device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
US10109119B2 (en) System and method for automotive diagnostic tool data collection and analysis
CN110457190B (en) Full link monitoring method, device and system based on block chain
CN109039749B (en) Remote log acquisition and encryption transmission system and method
US9405802B2 (en) Database system and method
US8498995B1 (en) Optimizing data retrieval during event data query processing
CN110474962B (en) Data checking system and method based on edge calculation
CN110232044B (en) System and method for realizing big data summarizing and scheduling service
CN112685436B (en) Tracing information processing method and device
CN106650493A (en) Method for obtaining behavioral data and device thereof
CN109347665A (en) A kind of Website Usability alarm method and its system based on web log
CN111949476A (en) Lightweight method and system for monitoring business health degree in APP in real time
CN111915331A (en) Enterprise credit investigation data management method and system based on block chain
CN108269059B (en) Data management system
CN105630650A (en) Log processing method, device and system
CN111767262A (en) Log display method, device, equipment and storage medium
CN110611715A (en) System and method for collecting cloud monitoring information by service link
CN102055621A (en) Method and apparatus for the efficient correlation of network traffic to related packets
CN104904255A (en) Inferring events based on MOB source video
CN112749071B (en) System and method for detecting health degree of application cluster
CN106534162A (en) Server temperature monitoring system and method based on remote management communication protocol
CN108829568A (en) A kind of data monitoring method and device
CN111124891B (en) Method and device for detecting access state, storage medium and electronic device
CN103034815B (en) Detection method and device for portable document format (PDF) file
CN110995466A (en) Multi-format log unified processing method and system under security situation awareness system
CN110149308B (en) External equipment management method, device and system based on network database

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination