CN115357546A - Log management method, device, equipment and storage medium for application service - Google Patents
Log management method, device, equipment and storage medium for application service Download PDFInfo
- Publication number
- CN115357546A CN115357546A CN202210950006.XA CN202210950006A CN115357546A CN 115357546 A CN115357546 A CN 115357546A CN 202210950006 A CN202210950006 A CN 202210950006A CN 115357546 A CN115357546 A CN 115357546A
- Authority
- CN
- China
- Prior art keywords
- application service
- log
- index
- file
- service file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007726 management method Methods 0.000 title claims abstract description 61
- 238000000034 method Methods 0.000 claims abstract description 32
- 238000012544 monitoring process Methods 0.000 claims abstract description 18
- 238000007781 pre-processing Methods 0.000 claims abstract description 9
- 238000004590 computer program Methods 0.000 claims description 16
- 230000011218 segmentation Effects 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 abstract description 4
- 238000004891 communication Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000012550 audit Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/178—Techniques for file synchronisation in file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a log management method, a log management device, log management equipment and a log management storage medium for application services. Preprocessing a log of the application service of the designated type in real time through a log center to obtain application service files, wherein each application service file corresponds to one application service of the designated type; acquiring an application service file through an Elasticissearch database, and storing the application service file after creating an index for the application service file; and log management is carried out on the application service file for creating the index through a designated port. The method comprises the steps of carrying out unified centralized collection on different application service logs in real time through a log center, storing collected application service files into an Elasticissearch database in an index mode, and managing the application service files through a designated port so as to realize effective monitoring, analysis and management on application services.
Description
Technical Field
The present invention relates to the field of information synchronization technologies, and in particular, to a method, an apparatus, a device, and a storage medium for managing logs of an application service.
Background
In order to better serve customers, traditional financial institutions such as banks, securities and insurance disputes launch an open platform, and the financial service capacity of the traditional financial institutions is output externally in the form of API, so that the development of the financial industry is promoted. The APIX open exchange platform is a unified open capability output platform aiming at financial companies and financial technology companies. The platform performs unified display and popularization on API service capability, and realizes interface capability exchange among mechanisms by depending on a gateway system of the APIX platform, thereby further promoting scene innovation, openness capability fusion and the like.
Currently, user operation information and transaction data information in an APIX platform are stored in an object store, and when a user inquires certain transaction information or checks the operation information of the user, log information needs to be pulled from the object store first and then retrieved.
When the detailed information of a certain transaction is tracked, log information needs to be pulled from an object storage for retrieval, but because the log information is obtained through statistics for a period of time, the change of the calling condition of a specific API service cannot be accurately analyzed, and similarly, the situation of a sudden increase of the calling quantity of a certain API service cannot be effectively monitored, so that the existing APIX platform cannot accurately and quickly perform effective monitoring analysis management on the application service log.
Disclosure of Invention
The invention provides a log management method, a log management device, log management equipment and a log management storage medium of an application service, which are used for effectively monitoring, analyzing and managing logs of the application service.
According to an aspect of the present invention, there is provided a log management method of an application service, including:
preprocessing a log of the application service of the specified type in real time through a log center to obtain application service files, wherein each application service file corresponds to one application service of the specified type;
acquiring the application service file through an Elasticissearch database, and storing the application service file after creating an index for the application service file;
and performing log management on the application service file for creating the index through a designated port.
According to another aspect of the present invention, there is provided a log management apparatus of an application service, including:
the application service file acquisition module is used for preprocessing the log of the specified type of application service in real time through a log center to acquire application service files, wherein each application service file corresponds to one specified type of application service;
the application service file storage module is used for acquiring the application service file through an Elasticissearch database, creating an index for the application service file and then storing the index;
and the log management module is used for performing log management on the application service file with the index through a specified port.
According to another aspect of the present invention, there is provided an electronic apparatus including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform a method of log management for an application service according to any of the embodiments of the present invention.
According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for causing a processor to implement a method for log management of an application service according to any one of the embodiments of the present invention when executed.
According to the technical scheme of the embodiment of the invention, different application service logs are subjected to unified centralized collection in real time through the log center, collected application service files are stored in an elastic search database in an index form, and the application service files are managed through a specified port, so that the application service is effectively monitored, analyzed and managed.
It should be understood that the statements in this section are not intended to identify key or critical features of the embodiments of the present invention, nor are they intended to limit the scope of the invention. Other features of the present invention will become apparent from the following description.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a log management method for an application service according to an embodiment of the present invention;
fig. 2 is a schematic application scenario diagram of a log management method for an application service according to an embodiment of the present invention;
fig. 3 is a flowchart of a log management method for an application service according to a second embodiment of the present invention;
fig. 4 is a schematic structural diagram of a log management apparatus for an application service according to a third embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device implementing an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example one
Fig. 1 is a flowchart of a log management method for an application service according to an embodiment of the present invention, where the present embodiment is applicable to a case of managing logs of the application service, and the method may be executed by a log management apparatus for the application service, where the apparatus may be implemented in a software and/or hardware manner, and may be generally integrated in a computer device. As shown in fig. 1, the method includes:
step S101, preprocessing the log of the specified type of application service in real time through a log center to obtain an application service file.
Specifically, in the embodiment, the APIX open exchange platform is used to execute the log management method of the Application service, the APIX open exchange platform provides the financial institutions with functions of unified publishing, subscribing, reviewing and the like of Application Programming Interface (API) services, the gateway system is used to perform authentication, flow control, charging and the like on the investigation of the API services, and the Application service system is used to adapt and convert the Interface protocols between the institutions, so that the Interface protocols between the institutions are unified, and the Application service is convenient for users to use. The off-line data system unifies the calling of the API service, so that a client can conveniently check the calling data of the API service and the like. As shown in fig. 2, which is a schematic view of an application scenario of the log management method for application services in this embodiment, an APIX open exchange platform includes a log center, an ES storage, a Kibana port and a Grafana port, and the APIX open exchange platform is connected to a log generation system.
Wherein the specified type of application service for generating the log in the log generating system comprises: the portal service, the backend management service, the gateway service, the application service, the billing service, the registry service, and the like are, of course, only exemplified in the embodiment, and the specific type of the application service is not limited. The portal service relates to operations of user login, API release, subscription, auditing and the like; the back management service relates to an operation manager, and performs operations such as platform user identity authentication and audit, API release and audit, secondary domain name audit and the like, wherein the operations are recorded in the form of logs, the registration center performs unified management on the API configuration information of the publisher, and when the user updates the API configuration information, the push service of the registration center is triggered and the logs are recorded; the gateway service receives a transaction request on the Internet, and performs authentication, flow control, white list control and the like on the request; the application service carries out protocol conversion and adaptation on the API request, the charging center calls the API service according to whether the API charges or not, fee deduction is carried out, meanwhile, recharging of the user is supported, relevant information of transaction information is recorded in a log mode, and the platform log is printed in a Json mode uniformly. And the gateway service and the charging service send the log to a log center by using a syslog component, and the portal service, the back management service, the registration center service and the application service send the log to the log center by using an rsyslog service.
Optionally, the pre-processing the application service log of the specified type in real time by the log center to obtain the application service file includes: starting the syslog-ng service through a log center; the log of the application service of the specified type is segmented according to unit time through the syslog-ng service; and creating an application service file according to the log segmentation result.
Specifically, the log center of the embodiment is used for collecting logs of an APIX open exchange platform, the log center starts syslog-ng service to perform hourly segmentation and storage on log information sent by portal service, backend management service, registry service, application service, gateway service and charging service system, logs of each service are separately stored in a file form according to an hour, so that an application service file is created according to a log segmentation result, each application service file corresponds to a specified type of application service, and each application service file comprises a plurality of log subfiles in unit time.
Step S102, obtaining the application service file through the Elasticissearch database, creating an index for the application service file and then saving the index.
Optionally, the obtaining the application service file through the Elasticsearch database, and storing the application service file after creating the index to the application service file includes: receiving an application service file sent by a log center through a filebeat service through an Elasticissearch database; and creating an index for the application service file according to the specified type of application service and the receiving time, and then storing the index.
Specifically, in the embodiment, the elastic search database is used for storing log information of the APIX platform, the elastic search, that is, the ES, receives an application service file sent by the log center through the filebeat, creates different indexes for storage according to different services and time, and stores one file in one day by the same service. The Elasticissearch database is selected for use, excellent data retrieval of the Elasticissearch database and a powerful search engine are mainly utilized, and convenience is provided for a platform to check the real-time running state of the system.
And step S103, performing log management on the application service file for creating the index through a designated port.
Optionally, log management is performed on the application service file for creating the index through a designated port, including: performing data traversal on the application service file with the index established through a Kibana port based on a preset display rule to obtain a display log; and displaying the display log according to a report form or a graph form.
Specifically, the APIX open exchange platform in the embodiment provides a Kibana port, a display rule is configured in advance in the Kibana port, and the display rule includes a specific type of an application service file to be displayed and a specific display mode, for example, the display rule includes a file corresponding to the registration center service, the application service file to be displayed, and the display mode is report display, so that when it is determined that log data is stored in the registration center service file in the ES, a log report is generated according to the log data in the file, and the log report is displayed to an operator through the Kibana port.
Optionally, log management is performed on the application service file for creating the index through a designated port, and includes: performing data traversal on the application service file for creating the index through a Grafana port based on a pre-configured monitoring rule to obtain a monitoring log; and generating alarm information when the monitoring log meets the preset condition.
Specifically, the APIX open exchange platform in this embodiment provides a Grafana port, a monitoring rule is pre-configured in the Grafana port, and the monitoring rule includes a specified type of application service to be monitored and an alarm condition, for example, the specified type of application service to be monitored is included in the monitoring rule as a registry service, and the alarm condition is that a registration request log exceeds 500 in a unit time interval, so when it is determined that a request log corresponding to the monitored registry service is 501, an email is sent to an operator through the Grafana port to prompt an alarm to remind an operator to check whether the system service is normally operated, and the stable operation of the system can be monitored by using the rule in cooperation with the call of a test API. Therefore, by monitoring the calling quantity change of an application service API, if the request quantity reaches a critical value in unit time, operation and maintenance personnel are reminded to expand the service capacity through mails. Grafana supports flexible rule creation, and for a trigger rule, the trigger rule is sent to operation and maintenance personnel of a platform through an email, so that the operation and maintenance personnel can quickly respond and process the trigger rule.
According to the technical scheme of the embodiment of the invention, the unified centralized collection is carried out on different application service logs in real time through the log center, the collected application service files are stored in the Elasticissearch database in an index mode, and the application service files are managed through the designated port, so that the effective monitoring, analysis and management of the application service are realized.
Example two
Fig. 3 is a flowchart of a log management method for an application service according to a second embodiment of the present invention, and this embodiment mainly describes a log management manner of an application service in a data active pull manner based on the second embodiment. As shown in fig. 3, the method includes:
step S201, the log center preprocesses the log of the specified type of application service in real time to obtain an application service file.
Optionally, the pre-processing the application service log of the specified type in real time by the log center to obtain the application service file includes: starting the syslog-ng service through a log center; the log of the application service of the specified type is segmented according to unit time through the syslog-ng service; and creating an application service file according to the log segmentation result.
Step S202, acquiring the application service file through the Elasticissearch database, creating an index for the application service file and then saving the index.
Optionally, the obtaining the application service file through the Elasticsearch database, and storing the application service file after creating the index, includes: receiving an application service file sent by a log center through a filebeat service through an Elasticissearch database; and creating an index for the application service file according to the specified type of application service and the receiving time, and then storing the index.
In step S203, a log query instruction is received through the Kibana port.
Specifically, the Kibana port in this embodiment may further receive a log query instruction, where the log query instruction includes a service identifier or a user identifier, and may be used for real-time query of system operation through the Kibana port. For example, the log query instruction includes a transaction id and a user id, and the user may query the transaction log associated with the input transaction id and query the user operation log associated with the user id according to the user id.
And step S204, inquiring the application service file for creating the index according to the inquiry instruction to obtain an inquiry log.
The method comprises the steps of searching transaction running information according to a transaction id, retrieving an Elasticissearch database, locating gateway processing information, application service processing information and charging center information, and locating the running state of the whole transaction quickly. The user id can be used for checking the log information of the user when and where the user logs in, what operation is performed and the like. Of course, in this embodiment, the query process of the relevant log information, such as the running state of the transaction and the operation of the user, is merely illustrated, and the query method for other types of log data is substantially the same as this, and is not described in detail in this embodiment.
According to the technical scheme of the embodiment of the invention, the unified centralized collection is carried out on different application service logs in real time through the log center, the collected application service files are stored in the Elasticissearch database in an index mode, and the application service files are managed through the designated port, so that the effective monitoring, analysis and management of the application service are realized.
EXAMPLE III
Fig. 4 is a schematic structural diagram of a log management device for application services according to a third embodiment of the present invention. As shown in fig. 4, the apparatus includes: an application service file acquisition module 310, an application service file saving module 320 and a log management module 330.
The application service file obtaining module 310 is configured to pre-process a log of an application service of a specified type in real time through a log center to obtain application service files, where each application service file corresponds to one application service of the specified type;
the application service file storage module 320 is configured to obtain an application service file through an Elasticsearch database, create an index for the application service file, and store the index;
and the log management module 330 is configured to perform log management on the application service file for creating the index through a specified port.
Optionally, the specified type of application service includes: portal services, backend management services, gateway services, application services, billing services, and registry services.
Optionally, the application service file acquiring module is configured to start a syslog-ng service through a log center;
the log of the application service of the specified type is segmented according to unit time through the syslog-ng service;
and creating an application service file according to the log segmentation result.
Optionally, the application service file saving module is configured to receive, through the Elasticsearch database, an application service file sent by the log center through the filebeat service;
and creating an index for the application service file according to the specified type of application service and the receiving time, and then storing the index.
Optionally, the log management module is configured to receive a log query instruction through the Kibana port, where the log query instruction includes a service identifier or a user identifier;
and inquiring the application service file for creating the index according to the inquiry instruction to obtain an inquiry log.
Optionally, the log management module is configured to perform data traversal on the application service file with the created index through the Kibana port based on a preconfigured display rule to obtain a display log;
and displaying the display log according to a report form or a graph form.
Optionally, the log management module is configured to perform data traversal on the application service file for creating the index through the Grafana port based on a preconfigured monitoring rule to obtain a monitoring log;
and generating alarm information when the monitoring log meets the preset condition.
The log management device of the application service provided by the embodiment of the invention can execute the log management method of the application service provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example four
FIG. 5 illustrates a block diagram of an electronic device 10 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 5, the electronic device 10 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, and the like, wherein the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various suitable actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data necessary for the operation of the electronic apparatus 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.
A number of components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, or the like; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The processor 11 performs the various methods and processes described above, such as a log management method of an application service.
In some embodiments, the log management method of the application service may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the log management method of the application service described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured by any other suitable means (e.g., by means of firmware) to perform the log management method of the application service.
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be performed. A computer program can execute entirely on a machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present invention may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solution of the present invention can be achieved.
The above-described embodiments should not be construed as limiting the scope of the invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A log management method for an application service, comprising:
preprocessing a log of the application service of the specified type in real time through a log center to obtain application service files, wherein each application service file corresponds to one application service of the specified type;
acquiring the application service file through an Elasticissearch database, and storing the application service file after creating an index for the application service file;
and performing log management on the application service file for creating the index through a designated port.
2. The method of claim 1, wherein the specified type of application service comprises: portal services, backend management services, gateway services, application services, billing services, and registry services.
3. The method according to claim 1, wherein the pre-processing the application service log of the specified type in real time by the log center to obtain the application service file comprises:
starting syslog-ng service through a log center;
the logs of the specified type application service are segmented according to unit time through the syslog-ng service;
and creating the application service file according to the log segmentation result.
4. The method of claim 1, wherein the obtaining the application service file through an Elasticsearch database, and saving the application service file after creating an index to the application service file comprises:
receiving the application service file sent by the log center through the filebeat service through the Elasticissearch database;
and creating an index for the application service file according to the specified type of application service and the receiving time, and then storing the index.
5. The method of claim 1, wherein the log managing the application service file for creating the index through the designated port comprises:
receiving a log query instruction through a Kibana port, wherein the log query instruction comprises a service identifier or a user identifier;
and inquiring the application service file for creating the index according to the inquiry instruction to obtain an inquiry log.
6. The method of claim 5, wherein the log managing the application service file for creating the index through the designated port comprises:
performing data traversal on the application service file with the index established through the Kibana port based on a preset display rule to obtain a display log;
and displaying the display log according to a report form or a graph form.
7. The method of claim 1, wherein the log managing the application service file for creating the index through the designated port comprises:
performing data traversal on the application service file with the index established through a Grafana port based on a pre-configured monitoring rule to acquire a monitoring log;
and generating alarm information when the monitoring log meets a preset condition.
8. An apparatus for log management of an application service, comprising:
the application service file acquisition module is used for preprocessing the log of the specified type of application service in real time through a log center to acquire application service files, wherein each application service file corresponds to one specified type of application service;
the application service file storage module is used for acquiring the application service file through an Elasticissearch database, creating an index for the application service file and then storing the index;
and the log management module is used for performing log management on the application service file with the index through a specified port.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
10. A computer-readable storage medium, having stored thereon computer instructions for causing a processor, when executed, to implement the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210950006.XA CN115357546A (en) | 2022-08-09 | 2022-08-09 | Log management method, device, equipment and storage medium for application service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210950006.XA CN115357546A (en) | 2022-08-09 | 2022-08-09 | Log management method, device, equipment and storage medium for application service |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115357546A true CN115357546A (en) | 2022-11-18 |
Family
ID=84033462
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210950006.XA Pending CN115357546A (en) | 2022-08-09 | 2022-08-09 | Log management method, device, equipment and storage medium for application service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115357546A (en) |
-
2022
- 2022-08-09 CN CN202210950006.XA patent/CN115357546A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP4099170A1 (en) | Method and apparatus of auditing log, electronic device, and medium | |
| CN115335821B (en) | Offloading statistics collection | |
| CN110334059A (en) | Method and apparatus for handling file | |
| CN114416685A (en) | Log processing method, system and storage medium | |
| CN114398520A (en) | Data retrieval method, system, device, electronic equipment and storage medium | |
| CN113595886A (en) | Instant messaging message processing method and device, electronic equipment and storage medium | |
| CN113836237A (en) | Method and device for auditing data operation of database | |
| CN116450622B (en) | Method, apparatus, device and computer readable medium for data warehouse entry | |
| CN114756301B (en) | Log processing method, device and system | |
| CN113360689B (en) | Image retrieval system, method, related device and computer program product | |
| CN115357546A (en) | Log management method, device, equipment and storage medium for application service | |
| CN115687406A (en) | Sampling method, device and equipment of call chain data and storage medium | |
| CN113722141A (en) | Method and device for determining delay reason of data task, electronic equipment and medium | |
| CN116301869B (en) | Front-end page configuration management and control system, method, equipment and medium | |
| CN109684158A (en) | Method for monitoring state, device, equipment and the storage medium of distributed coordination system | |
| CN115964409A (en) | Management method, device, equipment and storage medium for system access data | |
| CN115242799B (en) | Data reporting method, device, equipment, storage medium and program product | |
| CN115048413B (en) | Service domain data management method and device | |
| US20210279075A1 (en) | Preventing disruption within information technology environments | |
| CN113225228B (en) | Data processing method and device | |
| CN109447386B (en) | Work assessment method and terminal equipment | |
| CN115964368A (en) | Tracing method for application program interface of data service | |
| CN115658131A (en) | Path analysis method, device, equipment and storage medium | |
| CN117632138A (en) | Attendance application form analysis method and device, electronic equipment and storage medium | |
| CN116319716A (en) | Information processing method, no-service system, electronic device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |