CN106130782A - A kind of method and system obtaining server log - Google Patents
A kind of method and system obtaining server log Download PDFInfo
- Publication number
- CN106130782A CN106130782A CN201610570092.6A CN201610570092A CN106130782A CN 106130782 A CN106130782 A CN 106130782A CN 201610570092 A CN201610570092 A CN 201610570092A CN 106130782 A CN106130782 A CN 106130782A
- Authority
- CN
- China
- Prior art keywords
- server
- log
- workspace
- server log
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/069—Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a kind of method and system obtaining server log, this system includes at least one log server and multiple stage workspace server, and workspace server, for being sent to log server by the server log that self generates；Log server, for receiving the server log from workspace server, described server log is saved in this locality, and when receiving the inquiry request from client, obtain corresponding server log from this locality, the server log got is returned to described client.Said system is by being collected the server log on multiple stage workspace server, on server log centralized stores to the log server that will collect, and provide enquiry module to check server log voluntarily for user, it is achieved thereby that the optimization of the flow process to inquiry server log, improve the efficiency of investigation server program mistake.
Description
Technical field
The present invention relates to field of computer technology, particularly relate to a kind of method and system obtaining server log.
Background technology
Server log, for recording the various information such as process request and run-time error that server receives, is program
The Main Basis of the daily investigation server program mistake of member.By server log is added up, analysis and synthesis, additionally it is possible to
Effectively grasp the operation conditions of server, understand client and access distribution, the preferably maintenance and management of strengthening system.
In prior art, when server program is made mistakes, operation maintenance personnel logs on the server of correspondence, matching program person
Check daily record, and then investigation error reason.Along with the expansion of project, the quantity of the server in project gets more and more, server
The code release cycle of program is more and more frequent, causes operation maintenance personnel to need frequently logging in multiple servers checking daily record, takies
Operation maintenance personnel substantial amounts of routine work time, and work efficiency is relatively low.Additionally, when operation maintenance personnel the most at the scene when, journey
Sequence person cannot use server log to investigate mistake, and the efficiency causing investigation mistake is the lowest.
Summary of the invention
Present invention is primarily targeted at a kind of method and system obtaining server log of proposition, it is possible to increase investigation journey
The efficiency of sequence mistake.
For achieving the above object, the present invention proposes a kind of system obtaining server log, and described system includes at least one
Platform log server and multiple stage workspace server；
Workspace server, for being sent to log server by the server log that self generates；
Log server, for receiving the server log from workspace server, is saved in described server log
This locality, and when receiving the inquiry request from client, obtain corresponding server log, the clothes that will get from this locality
Business device daily record returns to described client.
Additionally, for achieving the above object, the present invention also proposes a kind of method obtaining server log, described method bag
Include:
Log server receives the server log from workspace server by message queue；
Log server obtains described server log from described message queue, stores described server log
To this locality；
When log server receives the inquiry request from client, obtain corresponding server log from this locality, and will
The server log got returns to described client.
Additionally, for achieving the above object, the present invention also proposes a kind of method obtaining server log, described method bag
Include:
Workspace server collects the server log that self generates；
Described server log is filtered by workspace server, and the server log after filtering is sent to log services
Device.
The method and system obtaining server log that the present invention proposes, by the server on multiple stage workspace server
Daily record is collected, and on server log centralized stores to the log server that will collect, and provides query interface mould
Block checks server log voluntarily for user, it is achieved thereby that the optimization of the flow process to inquiry server log, improves investigation
The efficiency of server program mistake.It addition, by using message queue storage server log, obtain service in an asynchronous manner
Device daily record, thus scabbled the concurrent server daily record of peak period, reduce the impact to log server, improve daily record clothes
The performance of business device.
Accompanying drawing explanation
Fig. 1 is the system structure schematic diagram obtaining server log realizing each embodiment of the present invention；
Fig. 2 is the structural representation of the workspace server of first embodiment of the invention；
Fig. 3 is the structural representation of the log server of second embodiment of the invention；
Fig. 4 is the interface schematic diagram being checked server log by browser；
Fig. 5 is the method flow diagram obtaining server log of third embodiment of the invention；
Fig. 6 is the method flow diagram obtaining server log of fourth embodiment of the invention；
Fig. 7 is the method flow diagram obtaining server log of fifth embodiment of the invention；
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further referring to the drawings.
Detailed description of the invention
Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.
The system obtaining server log realizing each embodiment of the present invention is described, such as Fig. 1 institute referring now to accompanying drawing
Showing, this system includes at least one log server 110 and multiple stage workspace server 120, wherein, workspace server 110, is used for
The server log that self generates is sent to log server 120.
In each embodiment of the present invention, server log comprises Log Types information, this Log Types information and service
Project belonging to device daily record is corresponding.
Additionally, workspace server 110, the server log being additionally operable to generate self filters, such as, such as, and will
The Nginx daily record self generated is filtered into the journal file only comprising required field.
Log server 120, for receiving the server log from workspace server 110, preserves server log
To this locality, and when receiving the inquiry request from client, obtain corresponding server log from this locality, by get
Server log returns to client.
In each embodiment of the present invention, inquiry request comprises server identification and time period；Correspondingly, log server
120 when receiving the inquiry request from client, according to the server identification in inquiry request and time period, from this locality
The service generated in obtaining the workspace server corresponding with the server identification in the inquiry request time period in inquiry request
Device daily record, and the server log got is sent to client.
Further, in order to improve safety, it is achieved the system obtaining server log of each embodiment of the present invention, also
Including:
Web page server, for receiving the inquiry request from client, is authenticated inquiry request, and leads in certification
Later, inquiry request is sent to enquiry module 114.
Wherein, web page server can be Nginx server, it is also possible to be apache server, comprises in its configuration
HTTP Basic Authentication.
In the system obtaining server log realizing each embodiment of the present invention, by multiple stage workspace server
Server log be collected, on server log centralized stores to the log server that will collect, and provide look into
Ask module and check server log voluntarily for user, it is achieved thereby that the optimization of the flow process to inquiry server log, improve
The efficiency of investigation server program mistake.It addition, by using message queue storage server log, it is possible in an asynchronous manner
Obtain server log, thus scabble the concurrent server daily record of peak period, reduce the impact to log server, improve daily record
The performance of server.
System based on above-mentioned acquisition server log, proposes each embodiment of the inventive method.
As in figure 2 it is shown, first embodiment of the invention proposes a kind of workspace server, including:
Log collection module 121, for collecting the server log that place workspace server 120 generates, by server day
Will is sent to log server 110.
Specifically, log collection module 121 monitors the server log that place workspace server 120 generates, to server
Daily record is filtered, and will filter after server log be sent to log server 110.Such as, log collection module 121 is received
The Nginx daily record that collection workspace server 120 generates, is filtered into the journal file only comprising required field by Nginx daily record, and will
This journal file is sent to log server 110.In each embodiment of the present invention, it is sent to the server of log server 110
Comprising Log Types information in daily record, project belonging to this Log Types information and server log is corresponding.
Above-mentioned log collection module 121 can realize by configuring the platforms such as Logstash or rsyslog, when by configuring
When Logstash platform realizes, need to install Logstash platform on workspace server 120, including Logstash Platform Dependent
Java environment, and Logstash platform is configured.Such as, by Logstash platform configuration be by path '/data/
It is the server log of " pec " that logs/system.log' collects type, use canonical form [DEBUG], [ERROR] and
Server log is mated by [EXCEPTION], and by "@version " field in server log and " message "
Field Sanitization, the server log after filtering exports in Redis data base, and the address of this Redis data base is "
10.47.49.134 ", port numbers is 6379, and data type is " list ", and key assignments is " Logstash:nubia_pec ".Wherein,
Logstash is a log management instrument increased income；Rsyslog is a free software for quickly process daily record.
First embodiment of the invention, by being collected the server log on multiple stage workspace server and filtering, was incited somebody to action
On server log centralized stores after filter to log server, it is achieved that the server log will collected according to demand
It is filtered into the journal format of needs, improves the formatting flexibility of server log, it is achieved that be follow-up to inquiry server log
The optimization of flow process, thus improve the efficiency of investigation server program mistake.Additionally, server log after Guo Lving comprises
Log Types information, it is simple to server log is classified.
As it is shown on figure 3, second embodiment of the invention proposes a kind of log server, including:
Message processing module 111, for caching server daily record in the way of message queue.
Module 112 is reprinted in daily record, for obtaining server log from message processing module 111, is sent out by server log
Deliver to memory module 113.
In each embodiment of the present invention, module 112 is reprinted in message processing module 111 and daily record can be respectively by configuring
Redis data base and Logstash platform realize, when by configure Logstash platform realize daily record reprint module 112 time, need
Log server 110 to be installed Logstash platform, including the java environment of Logstash Platform Dependent and right
Logstash platform configures.Such as by Logstash platform configuration for obtain server log from Redis data base, should
Server log exports to elasticsearch search engine.Wherein, the address of Redis data base is " 10.47.49.134 ",
Port numbers is 6379, and data type is " list ", and key assignments is " Logstash:nubia_pec ".Elasticsearch search is drawn
The agreement held up is " http ", and address is " 127.0.0.1 ", and port numbers is " 9200 ", indexes as " nubia_pec-%{+
YYYY.MM.dd}"。
Memory module 113, is used for storing server log.
In each embodiment of the present invention, memory module 113 can realize by configuring elasticsearch search engine, i.e.
Log server 110 is installed elasticsearch search engine and its java environment relied on.Such as, configuration
The cluster name of elasticsearch search engine is elasticsearch, and arranging acquiescence index burst number is 5, arranges
Acquiescence index copy number is 1 copy, and the store path arranging configuration file is the config file under root, arranges
The store path of index data is the data file under root, and the store path arranging temporary file is under root
Work file, the store path arranging server log is the logs file under root, and arrange plug-in unit deposits path
For the plugins file under root.Wherein, elasticsearch search engine is a standard built based on lucene
Real-time search engine.
Enquiry module 114, for receiving the inquiry request from client, obtains the clothes of correspondence from memory module 113
Business device daily record, and the server log got is returned to client.
Wherein, inquiry request comprises server identification and time period；Correspondingly, enquiry module 114, specifically for receiving
From the inquiry request of client, according to the server identification in inquiry request and time period, from memory module 113 obtain with
The server log that the workspace server that this server identification is corresponding generated within this time period, and the server day that will get
Will is sent to client.
In each embodiment of the present invention, enquiry module 114 can realize by configuring kibana interface, i.e. in log services
Install kibana interface on device 110, and be configured to kibana interface from elasticsearch search engine obtain number
According to.User, by client-access kibana interfaces such as browsers, inquires about server log, as shown in Figure 4.Wherein, kibana
Interface is increase income analysis and a Visualization Platform for elasticsearch search engine.
Second embodiment of the invention is by by the server log centralized stores on multiple stage workspace server to daily record
On server, and provide query interface to check server log voluntarily for user, thus realize the stream to inquiry server log
The optimization of journey, improves the efficiency of investigation server program mistake.It addition, by using message queue storage server log,
Server log can be obtained in an asynchronous manner, thus scabble the concurrent server daily record of peak period, reduce log services
The impact of device, improves the performance of log server.
As it is shown in figure 5, third embodiment of the invention proposes a kind of method obtaining server log, the method includes:
Step 301, log server receives the server log from workspace server by message queue.
Wherein, server log comprises Log Types information, project belonging to this Log Types information and server log
Corresponding.
Step 302, log server obtains server log from message queue, server log is stored to this locality.
Step 303, log server receives the inquiry request from client, obtains corresponding server day from this locality
Will, and the server log got is returned to client.
Wherein, comprising server identification and time period in inquiry request, log server is according to the service in inquiry request
Device mark and time period, obtain the server day that the workspace server corresponding with this server identification generated within this time period
Will.
Third embodiment of the invention is by being collected the server log on multiple stage workspace server, by collect
On server log centralized stores to log server, and query interface is provided to check server log voluntarily for user,
Thus realize the optimization of the flow process to inquiry server log, improve the efficiency of investigation server program mistake.It addition, pass through
Use message queue storage server log, it is possible to obtain server log in an asynchronous manner, thus scabble peak period also
Send out server log, reduce the impact to log server, improve the performance of log server.
As shown in Figure 6, fourth embodiment of the invention proposes a kind of method obtaining server log, and the method includes:
Step 401, log server receives the server log from workspace server by message queue.
Wherein, server log comprises Log Types information, project belonging to this Log Types information and server log
Corresponding.
Step 402, log server obtains server log from message queue, server log is stored to this locality.
Step 403, after the inquiry request certification from client is passed through by web page server, log server receives net
The inquiry request that page server forwards.
Step 404, log server obtains the server log corresponding with inquiry request, and the clothes that will get from this locality
Business device daily record returns to client.
Wherein, comprising server identification and time period in inquiry request, log server is according to the service in inquiry request
Device mark and time period, obtain the server day that the workspace server corresponding with this server identification generated within this time period
Will.
Fourth embodiment of the invention is by being collected the server log on multiple stage workspace server, by collect
On server log centralized stores to log server, and at web page server to the inquiry request certification from client
By rear, it is provided that query interface checks server log voluntarily for user, thus realizes the flow process to inquiry server log
Optimize, improve efficiency and the safety of inquiry server log of investigation server program mistake.Additionally, server log
In comprise Log Types information, it is simple to server log is classified.By using message queue storage server log, energy
Enough obtain server log in an asynchronous manner, thus scabble the concurrent server daily record of peak period, reduce log server
Impact, improve the performance of log server.
As it is shown in fig. 7, fifth embodiment of the invention proposes a kind of method obtaining server log, the method includes:
Step 501, workspace server is collected the server log that self generates, is filtered this server log.
Specifically, the server log that in workspace server, log collection module monitors self generates, and to server day
Will filters, i.e. server log is filtered into the journal format of correspondence according to demand.Such as, log collection module work
Server collects the Nginx daily record that self generates, and Nginx daily record is filtered into the journal file only comprising required field.
Step 502, the server log after workspace server will filter is sent to log server.
Wherein, the server log after filtration comprises Log Types information, this Log Types information and server log
Affiliated project is corresponding.
Fifth embodiment of the invention, by being collected the server log on multiple stage workspace server and filtering, was incited somebody to action
On server log centralized stores after filter to log server, it is achieved that the server log will collected according to demand
It is filtered into the journal format of needs, improves the formatting flexibility of server log, it is achieved that be follow-up to inquiry server log
The optimization of flow process, thus improve the efficiency of investigation server program mistake.Additionally, server log after Guo Lving comprises
Log Types information, it is simple to server log is classified.
It should be noted that in this article, term " includes ", " comprising " or its any other variant are intended to non-row
Comprising of his property, so that include that the process of a series of key element, method, article or device not only include those key elements, and
And also include other key elements being not expressly set out, or also include intrinsic for this process, method, article or device
Key element.In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that including this
The process of key element, method, article or device there is also other identical element.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art is it can be understood that arrive above-described embodiment side
Method can add the mode of required general hardware platform by software and realize, naturally it is also possible to by hardware, but a lot of in the case of
The former is more preferably embodiment.Based on such understanding, prior art is done by technical scheme the most in other words
The part going out contribution can embody with the form of software product, and this computer software product is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions with so that a station terminal equipment (can be mobile phone, computer, take
Business device, air-conditioner, or the network equipment etc.) perform the method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention, not thereby limit the scope of the claims of the present invention, every utilize this
Equivalent structure or equivalence flow process that bright description and accompanying drawing content are made convert, or are directly or indirectly used in other relevant skills
Art field, is the most in like manner included in the scope of patent protection of the present invention.
Claims (10)
1. the system obtaining server log, it is characterised in that described system includes that at least one log server is with many
Platform workspace server；
Workspace server, for being sent to log server by the server log that self generates；
Log server, for receiving the server log from workspace server, is saved in this locality by described server log,
And when receiving the inquiry request from client, obtain corresponding server log, the server that will get from this locality
Daily record returns to described client.
2. the system as claimed in claim 1, it is characterised in that described log server includes:
Message processing module, for receiving the server log from workspace server, buffer service in the way of message queue
Device daily record；
Module is reprinted in daily record, for obtaining described server log from message processing module, is sent out by the server log of acquisition
Deliver to memory module；
Memory module, is used for storing described server log；
Enquiry module, for receiving the inquiry request from client, obtains the server log of correspondence from memory module, and
The server log got is returned to client.
3. system as claimed in claim 2, it is characterised in that comprise server identification and time period in described inquiry request；
Described enquiry module, specifically for receiving the inquiry request from client, according to the server in described inquiry request
Mark and time period, from memory module, obtain the workspace server corresponding with described server identification raw within the described time period
The server log become, and the server log got is sent to client.
4. the system as claimed in claim 1, it is characterised in that
Described workspace server, the server log being additionally operable to generate self filters.
5. the system as claimed in claim 1, it is characterised in that comprise Log Types information in described server log.
6. the method obtaining server log, it is characterised in that described method includes:
Log server receives the server log from workspace server by message queue；
Log server obtains described server log from described message queue, described server log carries out storage to this
Ground；
When log server receives the inquiry request from client, obtain corresponding server log from this locality, and will obtain
To server log return to described client.
7. method as claimed in claim 6, it is characterised in that comprise server identification and time period in described inquiry request；
Described log server obtains corresponding server log, particularly as follows:
Described log server, according to the server identification in described inquiry request and time period, obtains and described server identification
The server log that corresponding workspace server generated within the described time period.
8. method as claimed in claim 7, it is characterised in that comprise Log Types information in described server log.
9. the method obtaining server log, it is characterised in that described method includes:
Workspace server collects the server log that self generates；
Described server log is filtered by workspace server, and the server log after filtering is sent to log server.
10. the method stated such as claim 9, it is characterised in that comprise Log Types letter in the server log after described filtration
Breath.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610570092.6A CN106130782A (en) | 2016-07-19 | 2016-07-19 | A kind of method and system obtaining server log |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610570092.6A CN106130782A (en) | 2016-07-19 | 2016-07-19 | A kind of method and system obtaining server log |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106130782A true CN106130782A (en) | 2016-11-16 |
Family
ID=57289743
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610570092.6A Pending CN106130782A (en) | 2016-07-19 | 2016-07-19 | A kind of method and system obtaining server log |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106130782A (en) |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106777371A (en) * | 2017-01-23 | 2017-05-31 | 北京齐尔布莱特科技有限公司 | Result collection system and method |
| CN106855888A (en) * | 2016-12-29 | 2017-06-16 | 北京车智赢科技有限公司 | Daily record monitoring system based on Logstash distributed systems |
| CN107451034A (en) * | 2017-08-17 | 2017-12-08 | 浪潮软件股份有限公司 | A kind of big data cluster log management apparatus, method and system |
| CN107608078A (en) * | 2017-09-26 | 2018-01-19 | 深圳智慧园区信息技术有限公司 | A kind of ELA big data flight deck systems with VR glasses |
| CN107784050A (en) * | 2016-12-14 | 2018-03-09 | 平安科技（深圳）有限公司 | Log information lookup method and device |
| CN107861859A (en) * | 2017-11-22 | 2018-03-30 | 北京汇通金财信息科技有限公司 | A kind of blog management method and system based on micro services framework |
| CN108076134A (en) * | 2017-10-31 | 2018-05-25 | 努比亚技术有限公司 | Record information acquisition method, terminal, server and computer readable storage medium |
| CN108376181A (en) * | 2018-04-24 | 2018-08-07 | 丹阳飓风物流股份有限公司 | Log services platform based on ELK |
| CN108509326A (en) * | 2018-04-09 | 2018-09-07 | 四川长虹电器股份有限公司 | A kind of service state statistical method and system based on nginx daily records |
| CN108880890A (en) * | 2018-06-26 | 2018-11-23 | 郑州云海信息技术有限公司 | Collection method and system are unified in a kind of data center's log |
| CN109151075A (en) * | 2018-10-30 | 2019-01-04 | 迈普通信技术股份有限公司 | Log processing method, device and electronic equipment |
| CN109492037A (en) * | 2018-11-02 | 2019-03-19 | 北京明朝万达科技股份有限公司 | Collecting method and equipment based on Redis and Logstash |
| CN109861958A (en) * | 2018-11-20 | 2019-06-07 | 新疆福禄网络科技有限公司 | Data gathering system and method based on Nginx |
| CN110309130A (en) * | 2018-03-21 | 2019-10-08 | 中国人民财产保险股份有限公司 | A kind of method and device for host performance monitor |
| WO2020001138A1 (en) * | 2018-06-29 | 2020-01-02 | 深圳市同泰怡信息技术有限公司 | Server system log collection method |
| CN110781154A (en) * | 2018-07-11 | 2020-02-11 | 中兴通讯股份有限公司 | Log collection method, device, system and computer readable storage medium |
| CN111078648A (en) * | 2019-11-29 | 2020-04-28 | 珠海金山网络游戏科技有限公司 | Method and system for acquiring GoCD execution task in real time |
| CN111585807A (en) * | 2020-04-30 | 2020-08-25 | 杭州涂鸦信息技术有限公司 | Log management method and related equipment |
| CN112445861A (en) * | 2019-09-05 | 2021-03-05 | 中移(苏州)软件技术有限公司 | Information processing method, device, system and storage medium |
| CN112532424A (en) * | 2020-11-03 | 2021-03-19 | 武汉悦学帮网络技术有限公司 | Service system, server and information processing method |
| CN112860456A (en) * | 2021-02-08 | 2021-05-28 | 青岛海尔科技有限公司 | Log processing method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050114321A1 (en) * | 2003-11-26 | 2005-05-26 | Destefano Jason M. | Method and apparatus for storing and reporting summarized log data |
| CN102411533A (en) * | 2011-08-08 | 2012-04-11 | 浪潮电子信息产业股份有限公司 | Log-management optimizing method for clustered storage system |
| CN102750326A (en) * | 2012-05-30 | 2012-10-24 | 浪潮电子信息产业股份有限公司 | Log management optimization method of cluster system based on downsizing strategy |
| CN102891873A (en) * | 2011-07-21 | 2013-01-23 | 腾讯科技（深圳）有限公司 | Method for storing log data and log data storage system |
| CN105100128A (en) * | 2014-04-24 | 2015-11-25 | 北京金山网络科技有限公司 | Server cluster log acquiring and providing methods, log server and node server |
| CN105205167A (en) * | 2015-10-10 | 2015-12-30 | 国网信息通信产业集团有限公司 | Log data system |
-
2016
- 2016-07-19 CN CN201610570092.6A patent/CN106130782A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050114321A1 (en) * | 2003-11-26 | 2005-05-26 | Destefano Jason M. | Method and apparatus for storing and reporting summarized log data |
| CN102891873A (en) * | 2011-07-21 | 2013-01-23 | 腾讯科技（深圳）有限公司 | Method for storing log data and log data storage system |
| CN102411533A (en) * | 2011-08-08 | 2012-04-11 | 浪潮电子信息产业股份有限公司 | Log-management optimizing method for clustered storage system |
| CN102750326A (en) * | 2012-05-30 | 2012-10-24 | 浪潮电子信息产业股份有限公司 | Log management optimization method of cluster system based on downsizing strategy |
| CN105100128A (en) * | 2014-04-24 | 2015-11-25 | 北京金山网络科技有限公司 | Server cluster log acquiring and providing methods, log server and node server |
| CN105205167A (en) * | 2015-10-10 | 2015-12-30 | 国网信息通信产业集团有限公司 | Log data system |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107784050A (en) * | 2016-12-14 | 2018-03-09 | 平安科技（深圳）有限公司 | Log information lookup method and device |
| CN106855888A (en) * | 2016-12-29 | 2017-06-16 | 北京车智赢科技有限公司 | Daily record monitoring system based on Logstash distributed systems |
| CN106855888B (en) * | 2016-12-29 | 2020-12-22 | 北京车智赢科技有限公司 | Log monitoring system based on Logstash distributed system |
| CN106777371A (en) * | 2017-01-23 | 2017-05-31 | 北京齐尔布莱特科技有限公司 | Result collection system and method |
| CN106777371B (en) * | 2017-01-23 | 2019-12-06 | 北京齐尔布莱特科技有限公司 | Log collection system and method |
| CN107451034A (en) * | 2017-08-17 | 2017-12-08 | 浪潮软件股份有限公司 | A kind of big data cluster log management apparatus, method and system |
| CN107608078A (en) * | 2017-09-26 | 2018-01-19 | 深圳智慧园区信息技术有限公司 | A kind of ELA big data flight deck systems with VR glasses |
| CN108076134A (en) * | 2017-10-31 | 2018-05-25 | 努比亚技术有限公司 | Record information acquisition method, terminal, server and computer readable storage medium |
| CN107861859A (en) * | 2017-11-22 | 2018-03-30 | 北京汇通金财信息科技有限公司 | A kind of blog management method and system based on micro services framework |
| CN110309130A (en) * | 2018-03-21 | 2019-10-08 | 中国人民财产保险股份有限公司 | A kind of method and device for host performance monitor |
| CN108509326A (en) * | 2018-04-09 | 2018-09-07 | 四川长虹电器股份有限公司 | A kind of service state statistical method and system based on nginx daily records |
| CN108509326B (en) * | 2018-04-09 | 2021-08-27 | 四川长虹电器股份有限公司 | Service state statistical method and system based on nginx log |
| CN108376181A (en) * | 2018-04-24 | 2018-08-07 | 丹阳飓风物流股份有限公司 | Log services platform based on ELK |
| CN108880890A (en) * | 2018-06-26 | 2018-11-23 | 郑州云海信息技术有限公司 | Collection method and system are unified in a kind of data center's log |
| WO2020001138A1 (en) * | 2018-06-29 | 2020-01-02 | 深圳市同泰怡信息技术有限公司 | Server system log collection method |
| CN110781154A (en) * | 2018-07-11 | 2020-02-11 | 中兴通讯股份有限公司 | Log collection method, device, system and computer readable storage medium |
| CN109151075B (en) * | 2018-10-30 | 2021-07-20 | 迈普通信技术股份有限公司 | Log processing method and device and electronic equipment |
| CN109151075A (en) * | 2018-10-30 | 2019-01-04 | 迈普通信技术股份有限公司 | Log processing method, device and electronic equipment |
| CN109492037B (en) * | 2018-11-02 | 2020-06-12 | 北京明朝万达科技股份有限公司 | Data acquisition method and device based on Redis and Logstash |
| CN109492037A (en) * | 2018-11-02 | 2019-03-19 | 北京明朝万达科技股份有限公司 | Collecting method and equipment based on Redis and Logstash |
| CN109861958A (en) * | 2018-11-20 | 2019-06-07 | 新疆福禄网络科技有限公司 | Data gathering system and method based on Nginx |
| CN112445861A (en) * | 2019-09-05 | 2021-03-05 | 中移(苏州)软件技术有限公司 | Information processing method, device, system and storage medium |
| CN112445861B (en) * | 2019-09-05 | 2023-08-15 | 中移(苏州)软件技术有限公司 | Information processing method, device, system and storage medium |
| CN111078648A (en) * | 2019-11-29 | 2020-04-28 | 珠海金山网络游戏科技有限公司 | Method and system for acquiring GoCD execution task in real time |
| CN111585807A (en) * | 2020-04-30 | 2020-08-25 | 杭州涂鸦信息技术有限公司 | Log management method and related equipment |
| CN112532424A (en) * | 2020-11-03 | 2021-03-19 | 武汉悦学帮网络技术有限公司 | Service system, server and information processing method |
| CN112860456A (en) * | 2021-02-08 | 2021-05-28 | 青岛海尔科技有限公司 | Log processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106130782A (en) | A kind of method and system obtaining server log | |
| EP2088711B1 (en) | A log analyzing method and system based on distributed compute network | |
| CN107273267A (en) | Log analysis method based on elastic components | |
| CN107895011B (en) | Session information processing method, system, storage medium and electronic equipment | |
| US20020178169A1 (en) | System and method for efficient and adaptive web accesses filtering | |
| CN109582551A (en) | Daily record data analytic method, device, computer equipment and storage medium | |
| CN107667370A (en) | Abnormal account is detected using event log | |
| CN102750326A (en) | Log management optimization method of cluster system based on downsizing strategy | |
| CN102411533A (en) | Log-management optimizing method for clustered storage system | |
| CN108509326A (en) | A kind of service state statistical method and system based on nginx daily records | |
| EP2692119B1 (en) | Non-existent domain names traffic analysis | |
| CN103763117A (en) | Service and operation management system | |
| CN110764980A (en) | Log processing method and device | |
| CN109992569A (en) | Cluster log feature extracting method, device and storage medium | |
| US20160098734A1 (en) | A personal data integration and management system and a method thereof | |
| CN104408050A (en) | Online automatic interpretation system and method of test data | |
| CN106484742A (en) | Log processing method and device | |
| KR100912177B1 (en) | User behavior analysis method and system | |
| CN106326280B (en) | Data processing method, device and system | |
| CN103812679B (en) | A kind of massive logs statistical analysis system and method | |
| CN109978547A (en) | Risk behavior control method and system, equipment and storage medium | |
| CN103902447B (en) | The system detection method and device of a kind of distributed system | |
| CN110097486A (en) | A kind of movable police verification core recording system | |
| CN110457351B (en) | Government financing platform data information-based management system and management method | |
| CN110187829A (en) | A kind of data processing method, device, system and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161116 |