CN106021315A - Log management method and system for application program - Google Patents
Log management method and system for application program Download PDFInfo
- Publication number
- CN106021315A CN106021315A CN201610294396.4A CN201610294396A CN106021315A CN 106021315 A CN106021315 A CN 106021315A CN 201610294396 A CN201610294396 A CN 201610294396A CN 106021315 A CN106021315 A CN 106021315A
- Authority
- CN
- China
- Prior art keywords
- daily record
- log
- thread
- consumer
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9032—Query formulation
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the invention discloses a log management method and system for an application program. The method includes that: a log consumer sends a log subscription request to a log server, wherein the log subscription request includes a target log theme; a log producer sends a current generated log to the log server through an issue manner; and the log server sends the current log to the log consumer while determining that the received current log matches the target log theme. The log management method and system can effectively improve the speed and the aging of acquiring the desired log of the log consumer, allow the log consumer to conveniently and timely process (analyze) the acquired log, and improve the real time.
Description
Technical field
The present embodiments relate to Internet technical field, particularly relate to the log management side of a kind of application program
Method and system.
Background technology
The ruuning situation of the application program in order to be apparent from the Internet, developer needs to apply journey
The operational data collection of sequence is to together, in order to carries out concentration and checks and the operation such as analysis.The operation of application program
Data are typically recorded in the daily record of application program, can enter the daily record of application program by log server
Row is collected, and developer can be obtained the daily record of required application program, enter by access log server
And understand the correlation circumstance of each side such as business and O&M in time.
Generally, generate daily record one can be referred to as daily record Producer, obtain daily record and carry out daily record point
The one of the process such as analysis can be referred to as daily record consumer.For daily record consumer, in order to understand timely
The ruuning situation of application program, the real-time of log acquisition is extremely important.But, along with the number of users of website
Amount constantly increases, and application program operates in increasing terminal, makes the collection of application log become
It is more and more difficult, additionally, daily record typically can be converted in log server by existing log management scheme
Local file, daily record consumer needs obtain log content by actively reading this local file, have impact on
The real-time of the operation such as log acquisition and follow-up log analysis.
Summary of the invention
The purpose of the embodiment of the present invention is to provide blog management method and the system of a kind of application program, to solve
The problem that in the log management scheme of existing application program, the real-time of log management is poor.
First aspect, embodiments provides the blog management method of a kind of application program, including:
Daily record consumer sends daily record to log server and subscribes to request, and the described daily record request of subscribing to includes mesh
Mark log topic；
Daily record Producer sends produced current log to described log server in the way of issue；
When described log server determines that the described current log received matches with described target journaling theme
Time, described current log is sent to described daily record consumer.
On the other hand, the Log Administration System of a kind of application program is embodiments provided, including daily record
Consumer, log server and daily record Producer；
Described daily record consumer includes subscribing to request sending module, and described subscription request sending module is for institute
Stating log server and send daily record subscription request, the described daily record request of subscribing to includes target journaling theme；
Described daily record Producer includes daily record release module, and described daily record release module is in the way of issue
Produced current log is sent to described log server；
Described log server includes log processing module, and described log processing module is for taking in described daily record
Business device determines when the described current log received and described target journaling theme match, and works as the day before yesterday by described
Will sends to described daily record consumer.
The log management scheme of the application program provided in the embodiment of the present invention, daily record consumer is to log services
Device send include target journaling theme daily record subscribe to request, when daily record Producer by issue in the way of to daily record
After server sends produced current log, log server can determine that the current log that receives whether with
Target journaling theme matches, if coupling, illustrates that daily record consumer have subscribed current log, directly will be current
Daily record sends to daily record consumer, treats that daily record consumer actively reads, therefore without being converted into local file
Daily record consumer can be effectively improved and obtain speed and the timeliness of required daily record, facilitate daily record consumer in time to institute
The daily record obtained is analyzed waiting and processes, and improves the real-time of log management.
Accompanying drawing explanation
The schematic flow sheet of the blog management method of a kind of application program that Fig. 1 provides for the embodiment of the present invention one；
The schematic flow sheet of the blog management method of a kind of application program that Fig. 2 provides for the embodiment of the present invention two；
The internal mutual signal of the Log Administration System of a kind of application program that Fig. 3 provides for the embodiment of the present invention two
Figure；
The schematic flow sheet of the blog management method of a kind of application program that Fig. 4 provides for the embodiment of the present invention three；
The Log Administration System of a kind of based on multithreading the application program that Fig. 5 provides for the embodiment of the present invention three
Internal mutual schematic diagram；
The structured flowchart of the Log Administration System of a kind of application program that Fig. 6 provides for the embodiment of the present invention four.
Detailed description of the invention
Further illustrate technical scheme below in conjunction with the accompanying drawings and by detailed description of the invention.Permissible
Being understood by, specific embodiment described herein is used only for explaining the present invention, rather than the limit to the present invention
Fixed.It also should be noted that, for the ease of describing, accompanying drawing illustrate only portion related to the present invention
Divide rather than entire infrastructure.
It should be mentioned that, some exemplary embodiment quilts before being discussed in greater detail exemplary embodiment
It is described as process or the method described as flow chart.Although each step is described as the process of order by flow chart,
But many of which step can be implemented concurrently, concomitantly or simultaneously.Additionally, each step is suitable
Sequence can be rearranged.The most described process can be terminated, it is also possible to have not
Including additional step in the accompanying drawings.Described process can correspond to method, function, code, subroutine,
Subprogram etc..
Embodiment one
The schematic flow sheet of the blog management method of a kind of application program that Fig. 1 provides for the embodiment of the present invention one,
The method can be performed by the Log Administration System of application program, specifically can be by the log management of application program
In system, software and/or the hardware of configuration realize.As it is shown in figure 1, the method includes:
Step 101, daily record consumer send daily record to log server and subscribe to request.
Wherein, the daily record request of subscribing to includes target journaling theme.
Exemplary, generate the one of daily record and can be referred to as daily record Producer, obtain daily record and daily record is carried out
The one of the process such as analysis can be referred to as daily record consumer.Daily record Producer and daily record consumer can be understood as
Client or application program (App).General, daily record Producer and daily record consumer can be configured in not
In same server.The present embodiment is to the tool between daily record Producer, log server and daily record consumer
Body communication mode is not especially limited.Daily record consumer can send daily record by network to log server and subscribe to
Request.
The daily record request of subscribing to includes target journaling theme (topic), target journaling theme i.e. institute of daily record consumer
The theme belonging to daily record being concerned about.When log topic is divided into different types, daily record is subscribed in request
May also include target journaling type of theme.The target journaling master in the present embodiment, the daily record request of subscribing to included
The quantity of topic or target journaling type of theme is not especially limited.
Exemplary, log server can serve multiple daily record consumer, when there is multiple daily record consumption
During person, log server can record the daily record subscription request that different daily record consumer is sent respectively.Daily record disappears
Fei Zheke repeatedly sends daily record subscription request to log server and belongs to different themes to subscribe to or to update to subscribe to
Daily record.
Step 102, daily record Producer send produced current log to log server in the way of issue.
Exemplary, daily record Producer is working as the day before yesterday to produced by log server transmission in the way of issue
During will, the theme belonging to current log can be identified, in order to log server carries out follow-up judgement.
Step 103, when log server determines that the current log received and target journaling theme match,
Current log is sent to daily record consumer.
Exemplary, log server can know the master belonging to current log by the subject identification of current log
Topic, it is possible to by the theme being identified knowing belonging to current log to the content of current log.When determining
When current log and target journaling theme match, illustrate that daily record consumer have subscribed current log, will be current
Daily record sends to daily record consumer.After log server receives current log, current log will not be turned
It is changed to local file and treats that daily record consumer actively reads, but directly the theme belonging to current log is sentenced
Disconnected, if current log is subscribed, then current log is directly sent to subscribe to the daily record consumer of current log,
Thus improve daily record consumer and obtain speed and the timeliness of required daily record.
The blog management method of the application program that the embodiment of the present invention one provides, daily record consumer is to log services
Device send include target journaling theme daily record subscribe to request, when daily record Producer by issue in the way of to daily record
After server sends produced current log, log server can determine that the current log that receives whether with
Target journaling theme matches, if coupling, illustrates that daily record consumer have subscribed current log, directly will be current
Daily record sends to daily record consumer, treats that daily record consumer actively reads, therefore without being converted into local file
Daily record consumer can be effectively improved and obtain speed and the timeliness of required daily record, facilitate daily record consumer in time to institute
The daily record obtained is analyzed waiting and processes, and improves the real-time of log management.
Embodiment two
The schematic flow sheet of the blog management method of a kind of application program that Fig. 2 provides for the embodiment of the present invention two,
The present embodiment is optimized based on above-described embodiment, in the present embodiment, and the related protocol of application Redis
Realize issue and the subscription of daily record.
The method of the present embodiment comprises the steps:
Step 201, daily record consumer send daily record subscription by the subscription order of Redis to log server and ask
Ask.
Redis (Remote Dictionary Server) is a kind of high performance key (key)-value (value) number
According to storehouse, it is provided that Java, C/C++, C#, PHP, JavaScript, Perl, Object-C, Python, Ruby,
The clients such as Erlang, easy to use, it is widely used.Redis can pass through PUBLISH and (send out
Cloth), the order such as SUBSCRIBE (subscription) and PSUBSCRIBE (pattern subscription) realize issuing and
Subscribe to function.Wherein, SUBSCRIBE can be used for subscribing to the daily record belonging to certain or some themes,
PSUBSCRIBE can be used for the daily record that subscription belongs to the theme of certain class (or pattern).Concrete, daily record
Consumer can send daily record by the pub/sub interface of Redis to log server and subscribe to request.The present embodiment
Middle employing Redis is advantageous in that, makes full use of the pub/sub agreement of Redis, makes daily record Producer and day
Will consumer only need to use standard Redis client just can carry out issuing and subscribing to message.Additionally, daily record is raw
Product person is potentially based on multiple different language and writes, and almost every kind of language has Redis client real
It is existing, so the scope of application of the present embodiment method can be improved.
Step 202, daily record Producer send produced working as by the issue order of Redis to log server
Front daily record.
Exemplary, daily record Producer can be produced to log server transmission by the pub/sub interface of Redis
Raw current log.
Preferably, daily record Producer sends produced working as by the issue order of Redis to log services agency
Front daily record；Current log is forwarded to log server by log services agency.The good of log services agency is set
Place is, when needing the corresponding relation revising daily record Producer and log server, at daily record Producer one
End carry out configuring amendment be the most complicated, and if be provided with log services agency, then only revise daily record
The relevant configuration of service broker, and above-mentioned corresponding relation can be realized without revising the configuration of daily record Producer
Amendment.Such as, can be realized in whole Log Administration System by the relevant configuration of amendment log services agency
The multiple log server of middle deployment, strengthens the retractility of system, in order to support bigger real-time logs stream.
Further, can in the subordinate server of each daily record Producer configuration log service broker, with letter
Change daily record Producer and log services communication between agents, be further ensured that the real-time of log management.
Step 203, when log server determines that the current log received and target journaling theme match,
Current log is sent to daily record consumer.
The internal mutual signal of the Log Administration System of a kind of application program that Fig. 3 provides for the embodiment of the present invention two
Figure.As it is shown on figure 3, daily record Producer (App) acts on behalf of (Agent) to log services by the way of issue
Send daily record；Daily record can be transmitted to log server (Server) by log services agency, it is possible to daily record turned
Issue another log services agency, also can be directly forwarded to daily record once subscribe to from log services agency
The daily record consumer (such as logic analyzer Log Analyzer) of daily record；Log server is receiving daily record clothes
After the daily record that business agency forwards, can be sent to daily record once carry out subscribing to (Subscribe) at log server
Or the daily record consumer of pattern subscription (Psubscribe).
Preferably, method described in the present embodiment realizes based on C Plus Plus.Concrete, the method for the present embodiment
Program code involved by can be write based on C Plus Plus, and can be packaged into deb bag, only needs one during installation
Line command, updates and the most only needs a line command, runs the agency of the log services on each server and takies central authorities' process
Device (Central Processing Unit, CPU) is little, when daily record Producer is deployed in log services agency
During same server, log services acts on behalf of the operation on daily record Producer almost without impact.
The embodiment of the present invention two is by the issue of Redis and subscribes to function and realizes the sending out of daily record of application program
Cloth and subscription, make full use of the pub/sub agreement of Redis, makes daily record Producer and daily record consumer only need to make
Just can carry out by standard Redis client issuing and subscribing to message.Additionally, daily record Producer is potentially based on many
Plant different language to write, and almost every kind of language has Redis client to realize, so can improve
The scope of application of the present embodiment method.
Embodiment three
The embodiment of the present invention is optimized on the basis of above-described embodiment, it is provided that the daily record of a kind of application program
Management method, the log server in the method is based on multithread mode.
Concrete, multithread mode includes: the main thread of log server distributes the first worker thread and is used for connecing
Receive the daily record that daily record Producer sends, and distribute the second worker thread for sending daily record to daily record consumer；
The current log received is pushed to global message queue by the first worker thread, and in log server
All working thread and storage thread send and receive notice, so that all working thread and storage thread are according to connecing
Receive notice and point to the current log in global message queue；When the second worker thread determines current log and target
When log topic matches, current log is obtained, and current log is sent to daily record consumer.
The schematic flow sheet of the blog management method of a kind of application program that Fig. 4 provides for the embodiment of the present invention three,
As shown in Figure 4, the method comprises the steps:
Step 401, daily record consumer send daily record to log server and subscribe to request.
Step 402, daily record Producer send produced current log to log server in the way of issue.
Step 403, the main thread of log server distribute the first worker thread and send for receiving daily record Producer
Daily record.
The current log received is pushed to global message queue by step 404, the first worker thread, and to day
All working thread in will server and storage thread send and receive notice, so that all working thread and depositing
Storage thread points to the current log in global message queue according to receiving notice.
Exemplary, the processing speed of each worker thread and storage thread may be different, and the present embodiment is to work
The opportunity making thread and storage thread sensing current log is not especially limited, and can be simultaneously directed to work as the day before yesterday
Will, it is possible to refer again to after the process of history log before current log work as in completing global message queue
Front daily record.
Exemplary, storage thread can carry out storage process to current log by storage strategy based on Scribe.
Scribe is the result collection system that face book (facebook) is increased income, and has obtained a large amount of inside facebook
Application.The maximum feature of the storage strategy of Scribe is zmodem, when the storage system jam of rear end
Time, scribe can write data on local disk, and after storage system recovery is normal, scribe is again by daily record
It is re-loaded in storage system.Store in storage system i.e. scribe, current scribe support the most
Storage mode, including file (file storage), buffer (double-deck storage, a main storage, a pair
Storage), network (by data conversion storage to another scribe server), bucket (comprise multiple store,
Data are stored in different store by hash), null (ignoring data) and multi (is stored in data simultaneously
In different store) etc..Storage strategy based on Scribe can realize the diversified storage tube to daily record above
Reason, improves the performance of Log Administration System further.
Step 405, the main thread of log server distribute the second worker thread for sending day to daily record consumer
Will, when the second worker thread determines that current log matches with target journaling theme, is carried out current log
Obtain, and current log is sent to daily record consumer.
Exemplary, for current log, the first worker thread and the second worker thread can be same
Individual worker thread, it is also possible to be different worker threads.
The Log Administration System of a kind of based on multithreading the application program that Fig. 5 provides for the embodiment of the present invention three
Internal mutual schematic diagram, as it is shown in figure 5, comprise main thread (Master Thread), many in log server
Individual worker thread (Worker Thread) (for convenience of description, illustrate only two worker threads in figure) and
Storage thread (Storer Thread), each worker thread can service multiple client (Client) (in figure only
Show that two clients are illustratively).Daily record Producer and daily record consumer respectively with log services
Device main thread sets up communication connection, and main thread accepts the daily record of daily record Producer and issues and distribute the first active line
For receiving the daily record that daily record Producer is issued, the first worker thread is connecing journey (left side worker thread in figure)
After receiving current log, current log is pushed to global message queue (Global Message Queue).False
If global message queue comprises n bar message, i.e. n daily record, it is followed successively by hot information from left to right
(Message Latest) (message 1), message 2 to message (n-1) and oldest message (message n), i.e.
The most pushed daily record is positioned at the rightmost of global message queue, and the most pushed daily record is positioned at the overall situation and disappears
The Far Left of breath queue.Meanwhile, the first worker thread also can to all working thread in log server and
Storage thread sends and receives notice, so that all working thread and storage thread point to the overall situation according to receiving notice
Current log in message queue.Main thread accepts the daily record subscription of daily record consumer and second work is requested and allocated
Make thread for subscribing to the transmission of daily record, when the second worker thread (right side worker thread in figure) determines current
When daily record and target journaling theme match, current log is obtained, and current log is sent to once
Subscribed to the daily record consumer of target log topic.And store thread and obtain daily record also from global message queue
Storing, storage mode can include Multiple storage (MultipleStore), buffer-stored (BufferStore)
And preferential storage (PriorityStore) etc..
Preferably, in order to alleviate memory pressure, can the daily record that is transmitted in global message queue be disappeared timing
Expense person the daily record having completed to store are deleted.Such as, can be by storage thread and all working thread indication
To last daily record before the daily record that pushes in global message queue delete.
Log server in the embodiment of the present invention three, based on multithread mode, can make full use of separate unit daily record clothes
Multiple core cpus in business device, improve the transmitting-receiving efficiency of daily record, further enhancing the reality of log management
Shi Xing.Test shows, the method for the application embodiment of the present invention, and daily record starts to transmission to daily record to disappear from generation
The delay of the person of expense, within 1 second, can reach the effect of real time propelling movement substantially.
Embodiment four
The structured flowchart of the Log Administration System of a kind of application program that Fig. 6 provides for the embodiment of the present invention four,
By performing the blog management method of application program, the daily record of application program is managed, specifically can pass through
In the Log Administration System of application program, software and/or the hardware of configuration realize.As shown in Figure 6, this system
Including daily record consumer 610, log server 620 and daily record Producer 630.
Wherein, described daily record consumer 610 includes subscribing to request sending module 611, and the described request of subscribing to sends
Module 611 subscribes to request for sending daily record to described log server 620, and described daily record is subscribed in request
Including target journaling theme.Described daily record Producer 630 includes daily record release module 631, and described daily record is issued
Module is for sending produced current log to described log server 620 in the way of issue.Described day
Will server 620 includes log processing module 621, and described log processing module 621 is for taking in described daily record
Business device 620 determines when the described current log received and described target journaling theme match, and works as described
Front daily record sends to described daily record consumer 610.
The Log Administration System of the application program that the embodiment of the present invention four provides, can be effectively improved daily record consumer
Obtain speed and the timeliness of required daily record, facilitate daily record consumer in time acquired daily record to be analyzed
Process, improve the real-time of log management.
On the basis of above-described embodiment, described subscription request sending module is specifically for ordering by Redis
Read order and send daily record subscription request to log server.Described daily record release module specifically for: pass through Redis
Issue order send produced current log to described log server.
On the basis of above-described embodiment, this system may also include log services agency, and mould is issued in described daily record
Block specifically for: send produced current log by the issue order of Redis to log services agency；Institute
Stating log services agency and include daily record forwarding module, described daily record forwarding module is for turning described current log
Send to described log server.
On the basis of above-described embodiment, described log processing module based on multithread mode, described multithreading
Pattern includes: the main thread of described log server distributes the first worker thread and produces for receiving described daily record
The daily record that person sends, and distribute the second worker thread for sending daily record to described daily record consumer；Described
The described current log received is pushed to global message queue by one worker thread, and to described log services
All working thread in device and storage thread send and receive notice, so that described all working thread and described
Storage thread points to the described current log in described global message queue according to the described notice that receives；When described
Second worker thread determines when described current log and described target journaling theme match, and works as the day before yesterday to described
Will obtains, and sends described current log to described daily record consumer.
On the basis of above-described embodiment, described multithread mode also includes: described storage thread is based on Scribe
Storage strategy described current log is carried out storage process.
On the basis of above-described embodiment, described system realizes based on C Plus Plus.
The Log Administration System of the application program provided in above-described embodiment can perform any embodiment of the present invention institute
The blog management method of the application program provided, possesses the execution corresponding functional module of the method and beneficial effect.
The ins and outs of the most detailed description, can be found in that any embodiment of the present invention provided should
With the blog management method of program.
Note, above are only presently preferred embodiments of the present invention and institute's application technology principle.Those skilled in the art
It will be appreciated that the invention is not restricted to specific embodiment described here, can enter for a person skilled in the art
Row various obvious changes, readjust and substitute without departing from protection scope of the present invention.Therefore, though
So by above example, the present invention is described in further detail, but the present invention be not limited only to
Upper embodiment, without departing from the inventive concept, it is also possible to include other Equivalent embodiments more,
And the scope of the present invention is determined by scope of the appended claims.
Claims (11)
1. the blog management method of an application program, it is characterised in that including:
Daily record consumer sends daily record to log server and subscribes to request, and the described daily record request of subscribing to includes mesh
Mark log topic；
Daily record Producer sends produced current log to described log server in the way of issue；
When described log server determines that the described current log received matches with described target journaling theme
Time, described current log is sent to described daily record consumer.
Method the most according to claim 1, it is characterised in that daily record consumer is sent out to log server
Daily record is sent to subscribe to request, including:
Daily record consumer sends daily record by the subscription order of Redis to log server and subscribes to request；
Daily record Producer sends produced current log to described log server in the way of issue, including:
Daily record Producer works as the day before yesterday by the issue order of Redis to produced by the transmission of described log server
Will.
Method the most according to claim 2, it is characterised in that daily record Producer sending out by Redis
Cloth order sends produced current log to described log server, including:
Described daily record Producer sends produced current by the issue order of Redis to log services agency
Daily record；
Described current log is forwarded to described log server by described log services agency.
Method the most according to claim 1, it is characterised in that described log server is based on multithreading
Pattern, described multithread mode includes:
The main thread of described log server distributes the first worker thread and sends for receiving described daily record Producer
Daily record, and distribute the second worker thread for described daily record consumer send daily record；
The described current log received is pushed to global message queue by described first worker thread, and to institute
State all working thread in log server and storage thread sends and receives notice, so that described all working
Thread and described storage thread work as the day before yesterday according to described reception in the notice described global message queue of sensing
Will；
When described second worker thread determines that described current log matches with described target journaling theme, right
Described current log obtains, and sends described current log to described daily record consumer.
Method the most according to claim 4, it is characterised in that also include: described storage thread based on
The storage strategy of Scribe carries out storage process to described current log.
Method the most according to claim 1, it is characterised in that described method realizes based on C Plus Plus.
7. the Log Administration System of an application program, it is characterised in that include daily record consumer, daily record clothes
Business device and daily record Producer；
Described daily record consumer includes subscribing to request sending module, and described subscription request sending module is for institute
Stating log server and send daily record subscription request, the described daily record request of subscribing to includes target journaling theme；
Described daily record Producer includes daily record release module, and described daily record release module is in the way of issue
Produced current log is sent to described log server；
Described log server includes log processing module, and described log processing module is for taking in described daily record
Business device determines when the described current log received and described target journaling theme match, and works as the day before yesterday by described
Will sends to described daily record consumer.
System the most according to claim 7, it is characterised in that described subscription request sending module is concrete
For:
Send daily record by the subscription order of Redis to log server and subscribe to request；
Described daily record release module specifically for:
Produced current log is sent to described log server by the issue order of Redis.
System the most according to claim 8, it is characterised in that also include that log services is acted on behalf of, described
Daily record release module specifically for: send produced by the issue order of Redis to log services agency
Current log；
Described log services agency include daily record forwarding module, described daily record forwarding module for by described currently
Daily record is forwarded to described log server.
System the most according to claim 7, it is characterised in that described log processing module is based on many
Thread mode, described multithread mode includes:
The main thread of described log server distributes the first worker thread and sends for receiving described daily record Producer
Daily record, and distribute the second worker thread for described daily record consumer send daily record；
The described current log received is pushed to global message queue by described first worker thread, and to institute
State all working thread in log server and storage thread sends and receives notice, so that described all working
Thread and described storage thread work as the day before yesterday according to described reception in the notice described global message queue of sensing
Will；
When described second worker thread determines that described current log matches with described target journaling theme, right
Described current log obtains, and sends described current log to described daily record consumer.
11. systems according to claim 10, it is characterised in that described multithread mode also includes:
Described storage thread storage based on Scribe strategy carries out storage process to described current log.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610294396.4A CN106021315B (en) | 2016-05-05 | 2016-05-05 | Log management method and system for application program |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610294396.4A CN106021315B (en) | 2016-05-05 | 2016-05-05 | Log management method and system for application program |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106021315A true CN106021315A (en) | 2016-10-12 |
| CN106021315B CN106021315B (en) | 2020-06-02 |
Family
ID=57081806
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610294396.4A Active CN106021315B (en) | 2016-05-05 | 2016-05-05 | Log management method and system for application program |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106021315B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107239343A (en) * | 2017-06-02 | 2017-10-10 | 浪潮金融信息技术有限公司 | Data processing method and device |
| CN107544855A (en) * | 2017-10-11 | 2018-01-05 | 江苏电力信息技术有限公司 | A kind of method for quickly being analyzed and processed using multithreading and distributing data |
| CN108881651A (en) * | 2018-05-30 | 2018-11-23 | 平安科技（深圳）有限公司 | Data processing method, device and equipment of call platform and storage medium |
| CN109002534A (en) * | 2018-07-18 | 2018-12-14 | 杭州安恒信息技术股份有限公司 | A kind of log analysis method, system, equipment and computer readable storage medium |
| CN109672735A (en) * | 2018-12-20 | 2019-04-23 | ***通信集团江苏有限公司 | A kind of method, device and equipment of Message Processing |
| CN109995801A (en) * | 2017-12-29 | 2019-07-09 | 北京京东尚科信息技术有限公司 | A kind of method for message transmission and device |
| CN110019045A (en) * | 2017-12-29 | 2019-07-16 | 北京奇虎科技有限公司 | Method and device is landed in log |
| CN111064610A (en) * | 2019-12-10 | 2020-04-24 | 广州品唯软件有限公司 | Log file subscription method, terminal device and storage medium |
| CN113938497A (en) * | 2021-12-17 | 2022-01-14 | 中证信用增进股份有限公司 | Data synchronization method, device and system based on message middleware |
| CN113986444A (en) * | 2021-11-19 | 2022-01-28 | 深圳前海移联科技有限公司 | General management method for software system prompt words, computer equipment and storage medium |
| CN114707911A (en) * | 2022-05-25 | 2022-07-05 | 日照港腾电子科技有限公司 | Cross-border e-commerce information risk analysis method and server combined with cloud computing |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103064731A (en) * | 2012-12-26 | 2013-04-24 | 人民搜索网络股份公司 | Device and method for improving message queue system performance |
| US20130304903A1 (en) * | 2012-05-09 | 2013-11-14 | Rackspace Us, Inc. | Market-Based Virtual Machine Allocation |
| CN103581250A (en) * | 2012-07-31 | 2014-02-12 | 盛趣信息技术（上海）有限公司 | Data processing, issuing and obtaining method and system |
| CN105630913A (en) * | 2015-12-22 | 2016-06-01 | 福建星海通信科技有限公司 | Redis pipeline communication-based message passing method and system |
-
2016
- 2016-05-05 CN CN201610294396.4A patent/CN106021315B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130304903A1 (en) * | 2012-05-09 | 2013-11-14 | Rackspace Us, Inc. | Market-Based Virtual Machine Allocation |
| CN103581250A (en) * | 2012-07-31 | 2014-02-12 | 盛趣信息技术（上海）有限公司 | Data processing, issuing and obtaining method and system |
| CN103064731A (en) * | 2012-12-26 | 2013-04-24 | 人民搜索网络股份公司 | Device and method for improving message queue system performance |
| CN105630913A (en) * | 2015-12-22 | 2016-06-01 | 福建星海通信科技有限公司 | Redis pipeline communication-based message passing method and system |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107239343A (en) * | 2017-06-02 | 2017-10-10 | 浪潮金融信息技术有限公司 | Data processing method and device |
| CN107239343B (en) * | 2017-06-02 | 2020-10-16 | 浪潮金融信息技术有限公司 | Data processing method and device |
| CN107544855A (en) * | 2017-10-11 | 2018-01-05 | 江苏电力信息技术有限公司 | A kind of method for quickly being analyzed and processed using multithreading and distributing data |
| CN109995801B (en) * | 2017-12-29 | 2022-11-08 | 北京京东尚科信息技术有限公司 | Message transmission method and device |
| CN109995801A (en) * | 2017-12-29 | 2019-07-09 | 北京京东尚科信息技术有限公司 | A kind of method for message transmission and device |
| CN110019045A (en) * | 2017-12-29 | 2019-07-16 | 北京奇虎科技有限公司 | Method and device is landed in log |
| CN110019045B (en) * | 2017-12-29 | 2024-04-16 | 北京奇虎科技有限公司 | Log floor method and device |
| CN108881651A (en) * | 2018-05-30 | 2018-11-23 | 平安科技（深圳）有限公司 | Data processing method, device and equipment of call platform and storage medium |
| WO2019227623A1 (en) * | 2018-05-30 | 2019-12-05 | 平安科技（深圳）有限公司 | Method and apparatus for processing data of call platforms, device, and storage medium |
| CN109002534A (en) * | 2018-07-18 | 2018-12-14 | 杭州安恒信息技术股份有限公司 | A kind of log analysis method, system, equipment and computer readable storage medium |
| CN109672735A (en) * | 2018-12-20 | 2019-04-23 | ***通信集团江苏有限公司 | A kind of method, device and equipment of Message Processing |
| CN111064610A (en) * | 2019-12-10 | 2020-04-24 | 广州品唯软件有限公司 | Log file subscription method, terminal device and storage medium |
| CN111064610B (en) * | 2019-12-10 | 2023-01-03 | 广州品唯软件有限公司 | Log file subscription method, terminal device and storage medium |
| CN113986444A (en) * | 2021-11-19 | 2022-01-28 | 深圳前海移联科技有限公司 | General management method for software system prompt words, computer equipment and storage medium |
| CN113938497A (en) * | 2021-12-17 | 2022-01-14 | 中证信用增进股份有限公司 | Data synchronization method, device and system based on message middleware |
| CN114707911A (en) * | 2022-05-25 | 2022-07-05 | 日照港腾电子科技有限公司 | Cross-border e-commerce information risk analysis method and server combined with cloud computing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106021315B (en) | 2020-06-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106021315A (en) | Log management method and system for application program | |
| CN107018042B (en) | Tracking method and tracking system for online service system | |
| CN108076098B (en) | Service processing method and system | |
| CN102236581B (en) | Mapping reduction method and system thereof for data center | |
| CN110069354A (en) | The full link trace method of micro services and micro services framework | |
| CN109995859A (en) | A kind of dispatching method, dispatch server and computer readable storage medium | |
| CN106294741B (en) | A kind of automated data inquiry synchronization storage system | |
| CN110119292A (en) | System operational parameters querying method, matching process, device and node device | |
| WO2019228506A1 (en) | Method of verifying access of multi-core interconnect to level-2 cache | |
| CN110032451A (en) | Distributed multilingual message realization method, device and server | |
| CN110134738A (en) | Distributed memory system resource predictor method, device | |
| CN110825731A (en) | Data storage method and device, electronic equipment and storage medium | |
| CN113076304A (en) | Distributed version management method, device and system | |
| CN105989065B (en) | Flash data processing method and system | |
| CN101673217B (en) | Method for realizing remote program call and system thereof | |
| CN103248636B (en) | The system and method downloaded offline | |
| CN114416868A (en) | Data synchronization method, device, equipment and storage medium | |
| CN110069533A (en) | A kind of event subscription method and device based on block chain | |
| CN110865973B (en) | Data processing method and equipment and related device | |
| CN112818183B (en) | Data synthesis method, device, computer equipment and storage medium | |
| CN114816778A (en) | Time delay control method, system and related equipment | |
| CN112199202A (en) | Development method for expanding Kafka consumption capacity | |
| CN111078736A (en) | Data aggregation processing method and device, terminal and storage medium | |
| AU2018206850A1 (en) | Computer implemented technologies configured to enable efficient processing of data in a transportation network based on generation of directed graph data derived from transportation timetable data | |
| CN108920182A (en) | Novel source code statistical analysis method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |