CN1815451A - Log information management method and system - Google Patents
Log information management method and system Download PDFInfo
- Publication number
- CN1815451A CN1815451A CN 200510005318 CN200510005318A CN1815451A CN 1815451 A CN1815451 A CN 1815451A CN 200510005318 CN200510005318 CN 200510005318 CN 200510005318 A CN200510005318 A CN 200510005318A CN 1815451 A CN1815451 A CN 1815451A
- Authority
- CN
- China
- Prior art keywords
- log
- request
- log information
- access
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The method divides log information management system into log request process module and log information process module. Log detection process of the method includes (1) the log request process module constructs and outputs log detection request to the log information process module; (2) after detecting the log detection request, the log information process module detects stored state of log information in log information base, determines whether the detected stored state of log information exceeds prearranged configured threshold of log stored state; if yes, deleting log information with attribute being as unimportant in log information base; otherwise, ending current process. The invention realizes detection of log information, deletes unimportant log information automatically.
Description
Technical field
The present invention relates to the log information treatment technology of computer system, particularly log information management method and system.
Background technology
At present, nearly all computer system all needs regularly or in real time to preserve log information, described log information recording the computer system situation of operating each time, comprise: information such as holding time, equipment, order and command process state, thus can diagnose, in time make the system recovery operation to the system failure that takes place according to log information.Wherein, the way to manage of log information has two kinds substantially: based on file system with based on Database Systems.
The file system management mode of described log information belongs to comparatively traditional administrative mechanism, and this machine-processed principal feature is: one, log information with the form long preservation of file in external storage; Two, application program is opened journal file according to filename and is conducted interviews when access log information.But when this mechanism is applied to large computer system, following problem will occur: one, log information is stored hereof, and information does not possess structural, and isolated between each file, therefore can't reflect the contact between the log information; Two, log information deposit the logical relation that depends between the application program, share a log information file by one or several application program usually; Three, the expression of log information depends on application program, be difficult for expanding, and independence is relatively poor, and same log information may be deposited in a plurality of journal files and the value difference, and therefore, the redundance of data is big, consistance is poor.
At the problems referred to above, the log information management technology based on Database Systems has appearred, log information is stored in the shared database, all log informations are carried out management unified, that concentrate, log information is independent of outside the application program.In addition, log information is stored in the database with the form of table, and information can be organized into the structural data towards whole application programs, also can realize all application programs sharing log information thereby be easy to expand.The way to manage of this kind log information Database Systems need be set up the log information management system between each application program and log information database, processing such as responsible visit to log information, detection are controlled.
But existing log information management system carries out indistinction to all log informations and handles, and often preserves a large amount of unessential log informations in the log information database, wastes a large amount of storage spaces, and important log information can't be preserved.Like this, when breaking down in system, the log information of preserving in the database often can not satisfy the needs of case study, greatly reduces the value of log information.In addition, because the limited storage space of database, the user must regularly clear up log information by configuration order, and not only the user uses inconvenience, and can't in real time, effectively remove unessential log information.
In sum, though the data base administration mechanism of log information can realize sharing of log information at present, but continuous expansion along with computer system, the treatment capacity of log information will increase greatly, and how making full use of the important log information of the effective preservation of database storing resource becomes problem demanding prompt solution in the current log information management technology.
Summary of the invention
In view of this, fundamental purpose of the present invention is to provide log information management method and system, can the log information of being preserved be detected, and deletes unessential log information automatically, thereby effectively utilize database storing space management log information.
For achieving the above object, technical scheme of the present invention is achieved in that
The invention discloses a kind of log information management method, is log request processing module and log information processing module with the log information management system divides; This method comprises: the daily record testing process; Described daily record testing process comprises:
A1. log request processing module structure and output journal detect request and give the log information processing module;
B1. after the log information processing module monitors daily record detection request, detect the store status of log information in the current log information storehouse, whether the store status of judging the log information that this detection obtains exceeds pre-configured log store state thresholding, if, the unessential log information of log information attribute in the deletion log information storehouse; Otherwise finish to work as pre-treatment.
Wherein, this method further comprises: the log access process; Described log access process comprises:
A2. after the log request processing module received the request of access of external application, structure and output journal request of access were given the log information processing module;
B2. after the log information processing module monitors the log access request, according to this log access request access log information storehouse.
Wherein, described log access process further comprises: the log information processing module is constructed the log access result and is returned to the log request processing module according to the result in access log information storehouse; Described daily record testing process further comprises: the log information processing module is constructed the daily record testing result and is returned to the log request processing module according to the result who detects the log information storehouse.
Wherein, according to the log information attribute log information is divided into a class or more than the class; Be each class log information configuration log store status thresholding; Among the step B1, described being judged as: whether have a class or the log information more than the class to exceed the log store state thresholding of class under it according to the log information determined property,, delete the unessential log information of log information attribute in such log information if having; Otherwise finish to work as pre-treatment.
Wherein, describedly log information is divided into a class or the method more than the class is according to the log information attribute: the combination in any according to the holding time in the log information attribute or equipment or order or command process state or four is classified.
Wherein, the method that described log request processing module is exported described daily record detection request to the log information processing module is: the daily record of log request processing module structure detects request this request of buffer memory afterwards, and notice daily record message processing module, this log information processing module is extracted this daily record that is buffered from this log request processing module again and is detected request.
Wherein, described daily record detects and asks to be carried by the log information frame; In message queue, described log information processing module is extracted the log information frame to described log request processing module from this message queue with the log information frame buffer of being constructed.
Wherein, the method that described log request processing module is exported described log access request to the log information processing module is: this request of buffer memory after the request of log request processing module structure log access, and notice daily record message processing module, this log information processing module is extracted the log access request that this is buffered from this log request processing module again.
Wherein, described log access request is carried by the log information frame; In message queue, described log information processing module is extracted the log information frame to described log request processing module from this message queue with the log information frame buffer of being constructed.
In the steps A 1, the log request processing module is regularly constructed daily record by pre-configured sense cycle and is detected request.
In the steps A 1, the log request processing module detects request according to pre-configured trigger condition structure daily record.
Among the step B1, described log store state thresholding is holding time thresholding and/or record quantity thresholding.
Among the step B1, described method according to log information attribute deletion log information is: according to the holding time in the log information attribute, delete one or more than one log informations by the principle of holding time elder generation's deletion the earliest.
Wherein, described log information storehouse is independent the setting, keeps this log information storehouse when application software system unloading or upgrading; When application software system was installed, this method further comprised: the application software installed module is judged the current log information storehouse that whether exists, if then use this already present log information storehouse; Otherwise set up the log information storehouse.
Wherein, described request of access is for creating or revising or query requests.
The present invention also provides a kind of log information management system, and this system comprises:
The log request processing module is used to construct daily record detection Intra-request Concurrency and delivers to the log information processing module;
The log information processing module is used to receive daily record and detects request, detects log information, and deletes unessential log information.
Wherein, described log request processing module comprises: detect request module, be used to construct daily record detection Intra-request Concurrency and deliver to the log information processing module; And further comprise: the request of access module, be used to receive the request of access of external application, structure log access request also exports the log information processing module to; Described log information processing module is further used for receiving the log access request, and according to this log access request access log information storehouse.
Wherein, described log information processing module comprises: the daily record detection module, and be used to receive and detect request from the daily record that detects request module, detect log information, and delete unessential log information; Log access module is used to receive the log access request from the request of access module, according to this log access request access log information storehouse.
Wherein, described log request processing module further comprises: the log request cache module, be used for receiving daily record detection request and log access request from detecting request module and request of access module respectively, buffer memory and output journal detection request and log access request are to daily record request monitoring module; Described log information processing module further comprises: the log request monitoring module, be used for receiving daily record and detect request and log access request, this daily record detection request and log access request are sent to daily record detection module and log access module respectively from described log request cache module.
Wherein, described daily record detection module further returns the daily record testing result and gives the detection request module; Described log access module is further returned the log access result and is given the request of access module.
Wherein, described log information processing module further comprises: daily record feedback cache module, be used for respectively receiving daily record testing result and log access result from daily record detection module and log access module, buffer memory and output journal testing result and log access result feed back monitoring module to daily record; Described log request processing module further comprises: daily record feedback monitoring module, be used for extracting daily record testing result and log access result, this daily record testing result and log access result are sent to detection request module and request of access module respectively from described daily record feedback cache module.
By such scheme as can be seen, key of the present invention is: with the log information management system divides is log request processing module and log information processing module; Detect request by log request processing module structure and output journal and give the log information processing module; Receive to judge whether the store status of log information in the current log information storehouse exceeds pre-configured log store state thresholding after this daily record detects request by the log information processing module, if delete unessential log information according to the log information attribute; Otherwise finish to work as pre-treatment.
Therefore, log information management method provided by the present invention and system, can realize the detection of log information, automatically delete unessential log information, and the classification and Detection that further realizes the visit of log information and log information is handled, thereby finish to log information comprehensively, flexibly the management, can effectively utilize the database storing space that more important log information is preserved, help providing effective analysis foundation for the Liability Retroact of the system failure.
Description of drawings
Fig. 1 forms structural representation for log information management of the present invention system;
Fig. 2 is log access process one a preferred embodiment treatment scheme synoptic diagram in the inventive method;
Fig. 3 is daily record testing process one a preferred embodiment treatment scheme synoptic diagram in the inventive method;
Fig. 4 is the processing one preferred embodiment treatment scheme synoptic diagram of the described detection log information of Fig. 3.
Embodiment
The present invention is further described in more detail below in conjunction with drawings and the specific embodiments.
The invention provides a kind of log information management system, this system comprises: log request processing module and log information processing module.Described log request processing module is responsible for constructing daily record and is detected request and export the log information processing module to; Described log information processing module detects request according to the daily record that receives and finishes daily record and detect and handle, and when detecting the log information store status and exceed the log store state thresholding that sets in advance, deletes unessential log information.Wherein, described log request processing module can also be further used for constructing the log access request and export the log information processing module to, and this log information processing module can also be further used for according to the log access request access log information storehouse that receives; Here, described log request processing module comprises: request of access module and detection request module, described log information processing module comprises: log access module and daily record detection module.
Because, the log request processing module is when a large amount of log access requests of concurrent structure and/or daily record detection request, if directly the request of being constructed is sent to the log information processing module, the log information processing module is difficult in time carry out a large amount of processing of request, like this, will occur asking losing, system's situation of paralysing even because of inadequate resource.Therefore, described log request processing module also further comprises: be used for the log request cache module that log cache request of access and/or daily record detect request, described log information processing module also further comprises: the log request monitoring module that is used for extracting from described log request cache module log access request and/or daily record detection request.
Fig. 1 forms structural representation for system of the present invention one preferred embodiment.As shown in Figure 1, this system comprises: log request processing module 110 and log information processing module 120; Described log request processing module 110 comprises: request of access module 111, detection request module 112 and log request cache module 113; Described log information processing module 120 comprises: log access module 121, daily record detection module 122 and log request monitoring module 123.In the present embodiment, because log access module 121 and daily record detection module 122 also will return the visit result and the testing result of log information respectively after finishing log information visit and detection task; Therefore, described log information processing module 120 also further comprises daily record feedback cache module 124, described log request processing module 110 also further comprises daily record feedback monitoring module 114, then described visit result and testing result can be sent to request of access module 111 respectively and detects request module 112 by daily record feedback cache module 124 and daily record feedback monitoring module 114.
Wherein, request of access module 111 is used for constructing the log access request and exporting log request cache module 113 to according to the request of access that receives from external application; Detect request module 112, be used for regularly constructing daily record and detect request and export log request cache module 113 to; Log request cache module 113, when receiving log access request and/or daily record detection request, the buffer memory described request also sends a notification message to log request monitoring module 123.Log request monitoring module 123, be used for after the notice that receives log request cache module 113, extract log access request and/or daily record detection request from log request cache module 113, log access module 121 and/or daily record detection module 122 are discerned and exported in the request of extracting; Daily record detection module 122, be used for the log information storehouse being detected in the daily record detection request back that receives from log request monitoring module 123, when the log information store status exceeds log store state thresholding, deletion or whole unessential log information, and where necessary the testing result of log information is sent to daily record feedback cache module 124; Log access module 121, be used for the log information storehouse being conducted interviews according to log access request from log request cache module 123, comprise: operations such as establishment, modification, inquiry, and will visit the result especially the inquiry log result of information send to daily record feedback cache module 124.Daily record feedback cache module 124 receives visit result and/or testing result from log access module 121 and/or daily record detection module 122, carries out buffer memory and send a notification message feeding back monitoring module 114 to daily record; Daily record feedback monitoring module 114, after the notice that receives from daily record feedback cache module 124, extract visit result and/or testing result from this daily record feedback cache module 124, the information of extracting is discerned and is sent to request of access module 111 and/or detects request module 112.
Based on the composition structure of the invention described above log information management system, the processing of the inventive method comprises two relatively independent processes: daily record testing process and log access process.Described daily record testing process is mainly finished by detecting request module, log request cache module, log request monitoring module and daily record detection module; Described log access process is mainly finished by request of access module, log request cache module, log request monitoring module and log access module.Wherein, mutual information between each module, as: log access request, daily record detect request etc. and can be carried by the log information frame, and then described log request cache module can adopt the caching mechanism reception/transmission log information frame of message queue.
During log information management system start-up, the configuration information relevant with daily record will be read automatically, comprise: the log store state thresholding of the classification of daily record, all kinds of daily records, daily record sense cycle etc., simultaneously by daily record sense cycle start detection timer, initial message formation or the like, then, system begins to prepare to carry out described log access and/or daily record testing process.Here, specifically how to finish relevant information configuration and initialized process during about system start-up, belong to known technology, be not described further here.Below in conjunction with Fig. 2 to Fig. 4 the log access and the daily record testing process of the inventive method are described in detail.
Fig. 2 is log access process one a preferred embodiment treatment scheme synoptic diagram in the inventive method.As shown in Figure 2, the concrete processing comprises:
Step 201: the request of access module receives starting log access process after the request of access of external application, and this module is according to the request of access structure log access request that receives, and this request is carried by the log access message frame.
Wherein, the request of access of application program transmission comprises at least: visit character and log information content.The information which kind of operation is described visit character carry out for indication to the log information storehouse, described operation can for: create, inquiry or revise or the like, wherein, what is called is created as the new log information recording of interpolation in the log information storehouse, so-called inquiry obtains meeting the log information recording of querying condition for coupling from the log information storehouse, and what is called is revised as makes amendment to the value of certain entry of the log information recording in the log information storehouse.The information that described log information content conducts interviews to which content in log information storehouse for indication, such as: for the request of access that indication is created, the log information recording content of its log information content for needing to add; For the request of access of indication inquiry, its log information content indication querying condition and the log information recording item that requires output; For the request of access that indication is revised, its log information content is then indicated which entry of which log information recording is made amendment and amended value.
The log access message frame that this step is constructed should comprise visit character and the log information content in the request of access that application program sends at least, and also comprises the sign of its module of originating, the i.e. sign of request of access module in this message frame.
Step 202: the request of access module exports the log access message frame of self structure to the log request cache module, and this log request cache module adds message queue with this message frame.
Step 203: will trigger the notification event of log request cache module when the message frame in the step 202 adds message queue, then this module sends notice to the log request monitoring module at once.This log request monitoring module receives the notice back and extracts the log information frame from described log request cache module.
Step 204: whether the log information frame that log request monitoring module determining step 203 is extracted is the log access message frame, if, execution in step 205; Otherwise finish to work as pre-treatment.
Here, can whether according to whether comprising the request of access module id in the log information frame to adjudicate this message frame be the log access message frame.
Step 205: the log request monitoring module is sent to log access module with this log access message frame, and this log access module is operated the log information storehouse according to the log access message frame that receives.
Here, visit character that comprises in the described log access message frame and log information content will indicate log access module the log information table in the log information storehouse to be created, revised or processing such as inquiry, handle the genus known technology about how finishing this, this paper is not further described.
Fig. 3 is daily record testing process one a preferred embodiment treatment scheme synoptic diagram in the inventive method.As shown in Figure 3, the concrete processing comprises:
Step 301: the detection timer that detects in the request module is regularly constructed the log access request by pre-configured sense cycle, and this request is by the carrying of daily record detect-message frame, and this daily record detect-message frame comprises the sign of this detection request module.
Step 302: detect request module and export the daily record detect-message frame of self constructing to the log request cache module, this log request cache module adds message queue with this message frame.
Step 303: will trigger the notification event of log request cache module when the message frame in the step 302 adds message queue, then this module sends notice to the log request monitoring module at once.This log request monitoring module receives the notice back and extracts the log information frame from described log request cache module.
Step 304: whether the log information frame that log request monitoring module determining step 303 is extracted is daily record detect-message frame, if, execution in step 305; Otherwise finish to work as pre-treatment.Here, can detect whether this message frame of request module sign judgement is daily record detect-message frame according to whether comprising in the log information frame.
When described log access process of Fig. 2 and the parallel processing of the described daily record testing process of Fig. 3, the log request cache module all is buffered in log access message frame and the daily record detect-message frame that receives in the message queue, and whenever receive a message frame and all can send the message frame notice to the log request monitoring module, the log request monitoring module whenever receives the message frame notice and promptly extracts the log information frame from message queue, and according to entrained module id in this log information frame, discerning this log information frame is log access message frame or daily record detect-message frame, still is the daily record detection module thereby select message frame is sent to log access module.Like this, can avoid losing of message frame substantially, and each message frame can both be handled in time.In addition, because the log request monitoring module calls log access module and daily record detection module by the unification of identification log information frame, therefore can also avoid log access module and daily record detection module incidental deadlock situation during the access log information storehouse simultaneously, thereby guarantee the security of log information system.
Step 305: the log request monitoring module is sent to the daily record detection module with this daily record detect-message frame, this daily record detection module detects the log information table in the log information storehouse, and when the store status of log information exceeds pre-configured log store state thresholding, deletion or whole unessential log information.
Wherein, log information is kept in the log information storehouse with the form of log information table, and when application program sent request of access that indication creates to the log information management system at every turn, this system is log information recording of interpolation in the log information table just.The entry that described log information recording comprised comprises: information such as holding time, equipment, order, command process state, this log information recording item can be represented the attribute of log information.Described pre-configured log store state thresholding can be holding time thresholding and/or record quantity thresholding, according to this log store state thresholding, the daily record detection module is by the direct inquiry log information bank of configuration querying condition, and whether the quantity that the holding time that determines whether log information exceeds thresholding or log information recording exceeds thresholding.And, when detecting current log information store status and exceed log store state thresholding, the unessential log information of deletion log information attribute, such as: holding time log information more early is inessential more usually, then can by the principle of holding time deletion earlier the earliest holding time one or more than one log information recordings the earliest be deleted according to the holding time in the log information attribute.
Here, described configuration querying condition query log information storehouse, determine whether the log information store status exceeds log store state thresholding and according to the concrete processing procedure of log information attribute deletion log information, belong to known technology, be not described in further detail here.
In order to make log information management more flexible, the present invention also preserves at the characteristic of variety classes log information, in advance log information is divided into several classes, and disposing the log store state thresholding of all kinds of log informations respectively, the log store state thresholding according to all kinds of log informations carries out classification and Detection to log information then.Like this, the log store state threshold setting of log information that can several classes are more important is higher, and just can be more and/or preserve important log information for more time in the log information storehouse, thereby makes full use of finite storage space.Wherein, can classify to log information according to the attribute of log information, such as: classify by the holding time section or by device type or by command type or by the command process state or by this combination etc.Below in conjunction with Fig. 4 the processing of the described daily record detection module of step 305 classification and Detection log information is described in detail.
Fig. 4 is the processing one preferred embodiment treatment scheme synoptic diagram of the described detection log information of Fig. 3.As shown in Figure 4, the concrete processing comprises:
Step 401: the daily record detection module is according to the record quantity thresholding inquiry log information bank of pre-configured all kinds of log informations, judges whether that the above log information of a class or a class exceeds the record quantity thresholding of class under self, if, execution in step 402; Otherwise execution in step 403.
Step 402:, delete holding time one or more than one log information recordings the earliest in the log information that respectively exceeds this class record quantity thresholding according to the holding time of log information.Here, several log informations of the pre-configured concrete deletion of system can also can be deleted wherein a part of log information with exceeding the log information Delete All of record quantity thresholding part, and the present invention does not limit.
Step 403: the daily record detection module is according to the holding time thresholding inquiry log information bank of pre-configured all kinds of log informations, judges whether that the above log information of a class or a class exceeds the holding time thresholding of class under self, if, execution in step 404; Otherwise finish to work as pre-treatment.
Step 404:, delete holding time one or more than one log information recordings the earliest in the log information that respectively exceeds this class holding time thresholding according to the holding time of log information.Here, several log informations of the pre-configured concrete deletion of system can also can be deleted wherein a part of log information with exceeding the log information Delete All of holding time thresholding, and the present invention does not limit.
Among the described embodiment of Fig. 4, log store state thresholding comprises: record quantity thresholding and holding time thresholding.In actual process, the present invention does not limit and judges that earlier record quantity thresholding still judges the holding time thresholding earlier, therefore can first execution in step 403 and step 404, execution in step 401 and step 402 more yet; Perhaps, step 401 and step 402 are with step 403 and step 404 executed in parallel.In addition, this log store state thresholding also can only be: record quantity thresholding or holding time thresholding, and corresponding, then only execution in step 401 and step 402, perhaps only execution in step 403 and step 404.
In the described processing of above-mentioned Fig. 3 and Fig. 4, detect request module and regularly construct daily record detect-message frame, thereby initiate described daily record testing process.System also can pre-configured daily record testing process trigger condition, when satisfying this trigger condition, begin the execution journal testing process.Such as: it is that log store state thresholding is reshuffled that trigger condition can be set.Because when daily record store status thresholding was modified, existing log information probably exceeded amended log store state thresholding, then needs the execution journal testing process.Therefore, it is that log store state thresholding is reshuffled that described trigger condition is set usually, then detect request module after learning that log store state thresholding reconfigures, structure daily record detect-message frame, thereby trigger Fig. 3 and the described daily record testing process of Fig. 4, log information is detected and clears up according to the log store state thresholding after upgrading again.Here, how to learn the method that described log store state thresholding is reshuffled, belong to known technology about detecting request module, and non-emphasis of the present invention, therefore be not described further.
In the processing of above-mentioned log access process and daily record testing process, do not return the object information of processing to the user, this is feasible for general establishment, modification and normal detecting operation.But for query manipulation, system must return Query Result to the user; And when finding more serious problem, detection also needs to return testing result to the user.Therefore, after described log access module and daily record detection module are finished log access processing and daily record detection processing respectively, can also further will visit result and testing result respectively is configured to the log information frame and is sent to daily record feedback cache module, by the message queue of this daily record feedback cache module with log information frame adding self, and the transmission message frame is notified to daily record feedback monitoring module.Daily record feedback monitoring module extracts the log information frame again from the message queue of daily record feedback cache module, and according to the message frame content recognition this still is the testing result message frame for visit results messages frame, to visit results messages frame and testing result message frame then and be sent to the request of access module respectively and detect request module, the visit result and the testing result that will be received respectively by request of access module and detection request module are shown to the user.Here, describedly will visit the concrete grammar that result and testing result return to the user, belong to known technology, therefore not be further described.
Because existing log information other configuration information common and application software system is stored in the same database, when system's unloading or upgrading, log information also will be deleted together with other configuration information.Like this, system is after unloading or upgrading, just can't get access to the unloading or the upgrading before log information, thereby can't according to the unloading or the upgrading before log information to the unloading or the upgrading after the system failure analyze, also can't analyze the problem that occurs in the escalation process.Therefore, log information of the present invention storehouse is the independent database that is provided with, and this log information storehouse still keeps when application software system unloading or upgrading; And when application software system was installed, the application software installed module was judged the current log information storehouse that whether exists automatically, if then use this already present log information storehouse; Otherwise set up the log information storehouse.Here, the method how described application software installed module is judged and set up the log information storehouse belongs to known technology, and this paper is not described further.
In sum, application the inventive method and system can realize the detection of log information, when exceeding log store state thresholding, the store status that detects log information can also delete unessential log information automatically, and, on the basis of this log information testing mechanism, can conveniently realize the visit of log information.Wherein, the detection of log information can regularly trigger, also can be triggered by condition, and can realize classification and Detection, thus start detection process flexibly, and different log store state thresholdings is set according to all kinds of log information characteristics, effectively utilize the database storing space to preserve log information.
The above is preferred embodiment of the present invention only, is not to be used to limit protection scope of the present invention.All any modifications of being done within the spirit and principles in the present invention, be equal to replacement, improvement etc., all be included in protection scope of the present invention.
Claims (21)
1, a kind of log information management method is characterized in that, is log request processing module and log information processing module with the log information management system divides; This method comprises: the daily record testing process;
Described daily record testing process comprises:
A1. log request processing module structure and output journal detect request and give the log information processing module;
B1. after the log information processing module monitors daily record detection request, detect the store status of log information in the current log information storehouse, whether the store status of judging the log information that this detection obtains exceeds pre-configured log store state thresholding, if, the unessential log information of log information attribute in the deletion log information storehouse; Otherwise finish to work as pre-treatment.
2, method according to claim 1 is characterized in that, this method further comprises: the log access process;
Described log access process comprises:
A2. after the log request processing module received the request of access of external application, structure and output journal request of access were given the log information processing module;
B2. after the log information processing module monitors the log access request, according to this log access request access log information storehouse.
3, method according to claim 2 is characterized in that, described log access process further comprises: the log information processing module is constructed the log access result and is returned to the log request processing module according to the result in access log information storehouse;
Described daily record testing process further comprises: the log information processing module is constructed the daily record testing result and is returned to the log request processing module according to the result who detects the log information storehouse.
4, method according to claim 1 is characterized in that, log information is divided into a class or more than the class according to the log information attribute; Be each class log information configuration log store status thresholding;
Among the step B1, described being judged as: whether have a class or the log information more than the class to exceed the log store state thresholding of class under it according to the log information determined property,, delete the unessential log information of log information attribute in such log information if having; Otherwise finish to work as pre-treatment.
5, method according to claim 4, it is characterized in that, describedly log information is divided into a class or the method more than the class is according to the log information attribute: the combination in any according to the holding time in the log information attribute or equipment or order or command process state or four is classified.
6, method according to claim 1, it is characterized in that, the method that described log request processing module is exported described daily record detection request to the log information processing module is: the daily record of log request processing module structure detects request this request of buffer memory afterwards, and notice daily record message processing module, this log information processing module is extracted this daily record that is buffered from this log request processing module again and is detected request.
7, method according to claim 6 is characterized in that, described daily record detects request and carried by the log information frame; In message queue, described log information processing module is extracted the log information frame to described log request processing module from this message queue with the log information frame buffer of being constructed.
8, method according to claim 2, it is characterized in that, the method that described log request processing module is exported described log access request to the log information processing module is: this request of buffer memory after the request of log request processing module structure log access, and notice daily record message processing module, this log information processing module is extracted the log access request that this is buffered from this log request processing module again.
9, method according to claim 8 is characterized in that, described log access request is carried by the log information frame; In message queue, described log information processing module is extracted the log information frame to described log request processing module from this message queue with the log information frame buffer of being constructed.
According to each described method of claim 1 to 9, it is characterized in that 10, in the steps A 1, the log request processing module is regularly constructed daily record by pre-configured sense cycle and detected request.
According to each described method of claim 1 to 9, it is characterized in that 11, in the steps A 1, the log request processing module detects request according to pre-configured trigger condition structure daily record.
According to each described method of claim 1 to 9, it is characterized in that 12, among the step B1, described log store state thresholding is holding time thresholding and/or record quantity thresholding.
13, according to each described method of claim 1 to 9, it is characterized in that, among the step B1, described method according to log information attribute deletion log information is: according to the holding time in the log information attribute, delete one or more than one log informations by the principle of holding time elder generation's deletion the earliest.
According to each described method of claim 1 to 9, it is characterized in that 14, described log information storehouse is independent the setting, keeps this log information storehouse when application software system unloading or upgrading; When application software system was installed, this method further comprised: the application software installed module is judged the current log information storehouse that whether exists, if then use this already present log information storehouse; Otherwise set up the log information storehouse.
According to claim 2,3,8 or 9 described methods, it is characterized in that 15, described request of access is for creating or revising or query requests.
16, a kind of log information management system is characterized in that this system comprises:
The log request processing module is used to construct daily record detection Intra-request Concurrency and delivers to the log information processing module;
The log information processing module is used to receive daily record and detects request, detects log information, and deletes unessential log information.
17, system according to claim 16 is characterized in that, described log request processing module comprises: detect request module, be used to construct daily record detection Intra-request Concurrency and deliver to the log information processing module;
And further comprise: the request of access module, be used to receive the request of access of external application, structure log access request also exports the log information processing module to;
Described log information processing module is further used for receiving the log access request, and according to this log access request access log information storehouse.
18, system according to claim 17 is characterized in that, described log information processing module comprises:
The daily record detection module is used to receive from the daily record that detects request module and detects request, detects log information, and deletes unessential log information;
Log access module is used to receive the log access request from the request of access module, according to this log access request access log information storehouse.
19, system according to claim 18, it is characterized in that, described log request processing module further comprises: the log request cache module, be used for receiving daily record detection request and log access request from detecting request module and request of access module respectively, buffer memory and output journal detection request and log access request are to daily record request monitoring module;
Described log information processing module further comprises: the log request monitoring module, be used for receiving daily record and detect request and log access request, this daily record detection request and log access request are sent to daily record detection module and log access module respectively from described log request cache module.
According to claim 18 or 19 described systems, it is characterized in that 20, described daily record detection module further returns the daily record testing result and gives the detection request module; Described log access module is further returned the log access result and is given the request of access module.
21, system according to claim 20, it is characterized in that, described log information processing module further comprises: daily record feedback cache module, be used for respectively receiving daily record testing result and log access result from daily record detection module and log access module, buffer memory and output journal testing result and log access result feed back monitoring module to daily record;
Described log request processing module further comprises: daily record feedback monitoring module, be used for extracting daily record testing result and log access result, this daily record testing result and log access result are sent to detection request module and request of access module respectively from described daily record feedback cache module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB200510005318XA CN100361091C (en) | 2005-01-31 | 2005-01-31 | Log information management method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB200510005318XA CN100361091C (en) | 2005-01-31 | 2005-01-31 | Log information management method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1815451A true CN1815451A (en) | 2006-08-09 |
| CN100361091C CN100361091C (en) | 2008-01-09 |
Family
ID=36907668
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB200510005318XA Expired - Fee Related CN100361091C (en) | 2005-01-31 | 2005-01-31 | Log information management method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100361091C (en) |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010031302A1 (en) * | 2008-09-16 | 2010-03-25 | 中兴通讯股份有限公司 | Method and system for clearing log files of service system |
| CN101216800B (en) * | 2008-01-02 | 2010-12-29 | 中兴通讯股份有限公司 | LINUX log controller and method |
| WO2011079690A1 (en) * | 2009-12-29 | 2011-07-07 | 北京世纪高通科技有限公司 | Journal monitoring method and device |
| CN102164043A (en) * | 2010-10-27 | 2011-08-24 | 青岛海信传媒网络技术有限公司 | Log reporting method and terminal |
| CN102385624A (en) * | 2011-10-25 | 2012-03-21 | 曙光信息产业(北京)有限公司 | DFS (distributed file system)-oriented log data organization method |
| CN102467516A (en) * | 2010-11-04 | 2012-05-23 | 北京北方微电子基地设备工艺研究中心有限责任公司 | Method, device and system for recording logs in equipment control process |
| CN102542036A (en) * | 2010-12-14 | 2012-07-04 | 微软公司 | Usage-optimized tables |
| CN102611611A (en) * | 2011-12-13 | 2012-07-25 | 北京安天电子设备有限公司 | Log caching system and method |
| CN103092745A (en) * | 2013-01-22 | 2013-05-08 | 中兴通讯股份有限公司 | Control method and control device of system log records |
| CN103297640A (en) * | 2012-02-23 | 2013-09-11 | 佳能株式会社 | Image forming apparatus and control method thereof |
| CN103546350A (en) * | 2013-11-06 | 2014-01-29 | 北京国双科技有限公司 | Method and device for detecting log generation |
| CN103793479A (en) * | 2014-01-14 | 2014-05-14 | 上海上讯信息技术股份有限公司 | Log management method and log management system |
| US8874718B2 (en) | 2007-04-04 | 2014-10-28 | Huawei Technologies Co., Ltd. | Method and device for storing domain name system records, method and device for parsing domain name |
| CN105279398A (en) * | 2014-05-29 | 2016-01-27 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for protecting information, and terminal |
| CN105515836A (en) * | 2015-11-27 | 2016-04-20 | 小米科技有限责任公司 | Log processing method, device and server |
| CN106293541A (en) * | 2016-08-19 | 2017-01-04 | 浪潮(北京)电子信息产业有限公司 | A kind of blog management method storing system and system |
| CN106485461A (en) * | 2016-09-08 | 2017-03-08 | 东软集团股份有限公司 | The method and apparatus of record process log |
| CN106528344A (en) * | 2016-11-11 | 2017-03-22 | 郑州云海信息技术有限公司 | Log management method for storage system |
| CN107423411A (en) * | 2017-07-28 | 2017-12-01 | 郑州云海信息技术有限公司 | Journal displaying method and apparatus |
| CN108170819A (en) * | 2018-01-02 | 2018-06-15 | 联想(北京)有限公司 | A kind of blog management method and device for baseboard management controller |
| CN108257383A (en) * | 2018-01-16 | 2018-07-06 | 河南魏来网络科技有限公司 | A kind of car-mounted terminal and traffic are passed through the monitoring system of behavior |
| CN109933462A (en) * | 2019-02-25 | 2019-06-25 | 深圳小云字符信息科技有限公司 | Log information processing method |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6125393A (en) * | 1997-03-28 | 2000-09-26 | International Business Machines Corporation | System of compressing the tail of a sparse log stream of a multisystem environment |
| JP2004185189A (en) * | 2002-12-02 | 2004-07-02 | Sankyo Seiki Mfg Co Ltd | Log record data management method |
| CN1265284C (en) * | 2002-12-13 | 2006-07-19 | 英业达股份有限公司 | Dynamic journal recording method |
-
2005
- 2005-01-31 CN CNB200510005318XA patent/CN100361091C/en not_active Expired - Fee Related
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8874718B2 (en) | 2007-04-04 | 2014-10-28 | Huawei Technologies Co., Ltd. | Method and device for storing domain name system records, method and device for parsing domain name |
| CN101216800B (en) * | 2008-01-02 | 2010-12-29 | 中兴通讯股份有限公司 | LINUX log controller and method |
| WO2010031302A1 (en) * | 2008-09-16 | 2010-03-25 | 中兴通讯股份有限公司 | Method and system for clearing log files of service system |
| CN101789174B (en) * | 2009-12-29 | 2013-07-24 | 北京世纪高通科技有限公司 | Journal monitoring method and device |
| WO2011079690A1 (en) * | 2009-12-29 | 2011-07-07 | 北京世纪高通科技有限公司 | Journal monitoring method and device |
| CN102164043A (en) * | 2010-10-27 | 2011-08-24 | 青岛海信传媒网络技术有限公司 | Log reporting method and terminal |
| CN102467516A (en) * | 2010-11-04 | 2012-05-23 | 北京北方微电子基地设备工艺研究中心有限责任公司 | Method, device and system for recording logs in equipment control process |
| CN102542036A (en) * | 2010-12-14 | 2012-07-04 | 微软公司 | Usage-optimized tables |
| CN102385624A (en) * | 2011-10-25 | 2012-03-21 | 曙光信息产业(北京)有限公司 | DFS (distributed file system)-oriented log data organization method |
| CN102611611A (en) * | 2011-12-13 | 2012-07-25 | 北京安天电子设备有限公司 | Log caching system and method |
| CN102611611B (en) * | 2011-12-13 | 2015-08-12 | 北京安天电子设备有限公司 | A kind of log buffer system and method |
| CN103297640A (en) * | 2012-02-23 | 2013-09-11 | 佳能株式会社 | Image forming apparatus and control method thereof |
| US9268628B2 (en) | 2012-02-23 | 2016-02-23 | Canon Kabushiki Kaisha | Image forming apparatus, control method for image forming apparatus, and storage medium |
| CN103092745A (en) * | 2013-01-22 | 2013-05-08 | 中兴通讯股份有限公司 | Control method and control device of system log records |
| CN103092745B (en) * | 2013-01-22 | 2016-04-13 | 中兴通讯股份有限公司 | The control method of system journal record and device |
| CN103546350A (en) * | 2013-11-06 | 2014-01-29 | 北京国双科技有限公司 | Method and device for detecting log generation |
| CN103793479A (en) * | 2014-01-14 | 2014-05-14 | 上海上讯信息技术股份有限公司 | Log management method and log management system |
| CN105279398A (en) * | 2014-05-29 | 2016-01-27 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for protecting information, and terminal |
| CN105515836A (en) * | 2015-11-27 | 2016-04-20 | 小米科技有限责任公司 | Log processing method, device and server |
| CN106293541A (en) * | 2016-08-19 | 2017-01-04 | 浪潮(北京)电子信息产业有限公司 | A kind of blog management method storing system and system |
| CN106485461A (en) * | 2016-09-08 | 2017-03-08 | 东软集团股份有限公司 | The method and apparatus of record process log |
| CN106485461B (en) * | 2016-09-08 | 2020-02-04 | 东软集团股份有限公司 | Method and device for recording flow log |
| CN106528344A (en) * | 2016-11-11 | 2017-03-22 | 郑州云海信息技术有限公司 | Log management method for storage system |
| CN107423411A (en) * | 2017-07-28 | 2017-12-01 | 郑州云海信息技术有限公司 | Journal displaying method and apparatus |
| CN108170819A (en) * | 2018-01-02 | 2018-06-15 | 联想(北京)有限公司 | A kind of blog management method and device for baseboard management controller |
| CN108257383A (en) * | 2018-01-16 | 2018-07-06 | 河南魏来网络科技有限公司 | A kind of car-mounted terminal and traffic are passed through the monitoring system of behavior |
| CN109933462A (en) * | 2019-02-25 | 2019-06-25 | 深圳小云字符信息科技有限公司 | Log information processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100361091C (en) | 2008-01-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1815451A (en) | Log information management method and system | |
| CN107463635B (en) | Method for inquiring picture data and distributed NewSQL database system | |
| CN100521623C (en) | High-performance Syslog processing and storage method | |
| CN110795257B (en) | Method, device, equipment and storage medium for processing multi-cluster job record | |
| US5812996A (en) | Database system with methods for optimizing query performance with a buffer manager | |
| US5822749A (en) | Database system with methods for improving query performance with cache optimization strategies | |
| CN1808411A (en) | Methods and apparatus for accessing content in a virtual pool on a content addressable storage system | |
| US7661036B1 (en) | Cache for collecting events on a monitored computer | |
| CN1573757A (en) | Automatic task generator method and system | |
| CN1892613A (en) | Reconciliation method and system of backup data | |
| CN1829964A (en) | A method, apparatus and computer program for processing a queue of messages | |
| CN110389942B (en) | Method and system for separating and storing key values without garbage recovery | |
| CN1708757A (en) | A transparent edge-of-network data cache | |
| CN1477518A (en) | System for handling file name of file system filter driver and its method | |
| CN1738352A (en) | Document processing device, document processing method, and storage medium recording program therefor | |
| CN1975731A (en) | System and method for managing access to data in a database | |
| CN1662905A (en) | Multiple concurrent active file systems | |
| EP2237185A2 (en) | Method for optimization of anti-virus scan | |
| CN111062684B (en) | System and method for realizing consistency processing of business data and process data under cloud process platform | |
| CN1510575A (en) | High-efficient administration method for database connection | |
| US20060230085A1 (en) | Key sequenced clustered I/O in a database management system | |
| JP2000172696A (en) | Document managing system | |
| CN103685233B (en) | A kind of wooden horse monitoring method based on Windows kernel-driven | |
| CN112464044B (en) | File data block change information monitoring and management system and method thereof | |
| CN102375888A (en) | Method for deleting big files in distributed file system efficiently |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20080109 Termination date: 20170131 |