CN107528749A - Website Usability detection method, apparatus and system based on cloud protection daily record - Google Patents
Website Usability detection method, apparatus and system based on cloud protection daily record Download PDFInfo
- Publication number
- CN107528749A CN107528749A CN201710749521.0A CN201710749521A CN107528749A CN 107528749 A CN107528749 A CN 107528749A CN 201710749521 A CN201710749521 A CN 201710749521A CN 107528749 A CN107528749 A CN 107528749A
- Authority
- CN
- China
- Prior art keywords
- website
- access
- server
- access information
- daily record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0811—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking connectivity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/069—Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention provides a kind of Website Usability detection method based on cloud protection daily record, apparatus and system, is related to website maintenance technical field, wherein, this method includes：Obtain the access log that user conducts interviews to website；Access log is parsed, obtains access information；Access information includes at least one of：Access time, website domain name, URL, source IP address, http answer codes, request are time-consuming；Various dimensions statistics is carried out according to access information to calculate, and obtains multiple statistical results；The corresponding predetermined threshold value of each statistical result；Determine whether the availability of website meets default available condition based on statistical result.The Website Usability detection method based on cloud protection daily record, the parsing and judgement of the true access log to cloud protective platform can be passed through, Website page availability is comprehensively and accurately analyzed, the detection and alarm of Website Usability are efficiently completed with less Resources Consumption.
Description
Technical field
The present invention relates to website maintenance technical field, protects the Website Usability of daily record to examine based on cloud more particularly, to a kind of
Survey method, apparatus and system.
Background technology
Internet era, website carry the important task of various information issues and data transfer, and attack is invaded in network in recent years
Behavior exponentially level ascendant trend, the under these circumstances also more and more higher of the availability requirement to website.
Traditional Website Usability detection method is made requests on using reptile mode to Website page more, according to certain rule
Then, info web is automatically captured, so as to carry out the detection of Website Usability, in this process, the following aspects be present
The problem of：
1) it is limited and fixed to detect the page；
2) reptile mode is that extra abnormal access is easily blocked；
3) network load weight, cause result output delay larger.
At present, in view of the above-mentioned problems, not yet proposing effective solution.
The content of the invention
In view of this, it is an object of the invention to provide it is a kind of based on cloud protection daily record Website Usability detection method,
Apparatus and system, Website page availability can be entered by the parsing and judgement of the true access log to cloud protective platform
Row is comprehensively and accurately analyzed, and the detection and alarm of Website Usability are efficiently completed with less Resources Consumption, is preferably solved
Problem above.
In a first aspect, the embodiments of the invention provide a kind of Website Usability detection method based on cloud protection daily record, bag
Include：
Obtain the access log that user conducts interviews to website；
Access log is parsed, obtains access information；Access information includes at least one of：Access time, net
Stand domain name, URL, source IP address, http answer codes, request is time-consuming；
Various dimensions statistics is carried out according to access information to calculate, and obtains multiple statistical results；Each statistical result corresponding one
Individual predetermined threshold value；
Determine whether the availability of website meets default available condition based on statistical result.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the first of first aspect, wherein, base
Determine whether the availability of website meets that default available condition includes in statistical result：
Judge whether include object statistics result in preset time in multiple statistical results, object statistics result is multiple systems
Any one statistical result in result is counted, and object statistics result is more than predetermined threshold value, predetermined threshold value is object statistics result
Corresponding threshold value；
If it is judged that object statistics result is included in multiple statistical results, it is determined that the availability of website is unsatisfactory for presetting
Condition can be used, and triggers alarm server and is alerted to user.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of second of first aspect, wherein,
Access log is parsed, after obtaining access information, in addition to：
According to JSON forms, access information is sent to Message Queuing server, so that Message Queuing server is chronologically right
Access information is preserved；
In the case of the detection instruction that the availability got to website is detected, carried from Message Queuing server
Take access information.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the third of first aspect, wherein, also
Including：
After object statistics result is included in judging multiple statistical results, by the access corresponding to object statistics result
Information is stored in target information list, and target information list is used for recording exceptional information.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the 4th of first aspect kind, wherein, side
Method also includes：
Following at least one processing is performed to each statistical result and target information list, obtains learning outcome：Data are held
Longization processing, big data study processing；
According to learning outcome, the predetermined threshold value corresponding to each statistical result is adjusted.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the 5th of first aspect kind, wherein, touch
Hair alarm server is alerted to user, including：
According to the quantity of object statistics result in preset time, it is determined that default alarm type；
Based on alarm type to alarm server send triggering command so that alarm server to user according to default alarm
Type is alerted, wherein, default alarm type includes：Warning by telephone, the short message alarm of low frequency time of high frequency time.
Second aspect, the embodiment of the present invention provide a kind of Website Usability detection means based on cloud protection daily record, including：
Log acquisition module, the access log to be conducted interviews for obtaining user to website；
Log analyzing module, for being parsed to access log, obtain access information；Access information include it is following at least
One of：Access time, website domain name, URL, source IP address, http answer codes, request are time-consuming；
Computing module is counted, is calculated for carrying out various dimensions statistics according to access information, obtains multiple statistical results；It is each
The corresponding predetermined threshold value of individual statistical result；
Availability detection module, determine whether the availability of website meets default available condition based on statistical result.
The third aspect, the embodiment of the present invention also provide a kind of Website Usability detecting system based on cloud protection daily record, bag
Include networking client, back-end server, Message Queuing server and alarm server；
Communicated to connect between networking client, back-end server, queue server and alarm server；
Installation is just like the Website Usability detection means based on cloud protection daily record described in second aspect on back-end server.
Fourth aspect, the embodiment of the present invention also provide a kind of electronic equipment, including memory, processor, deposited on memory
Contain the computer program that can be run on a processor, side as described in relation to the first aspect is realized during computing device computer program
The step of method.
5th aspect, the embodiment of the present invention also provide a kind of meter for the non-volatile program code that can perform with processor
Calculation machine computer-readable recording medium, program code make the method for computing device as described in relation to the first aspect.
The embodiment of the present invention brings following beneficial effect：
Provided in an embodiment of the present invention based in the Website Usability detection method of cloud protection daily record, back-end server is first
First obtain the access log that user conducts interviews to website；Parsed by the cleaning to access log, obtain access information；The visit
Ask that information includes at least one of：Access time, website domain name, URL, source IP address, http answer codes,
Request is time-consuming；Various dimensions statistics is carried out according to access information to calculate, and obtains multiple statistical results of various dimensions；Wherein, each
The corresponding predetermined threshold value of statistical result；It is finally based on above-mentioned multiple statistical results and determines whether the availability of website meets to preset
Condition can be used.The Website Usability detection method based on cloud protection daily record that the embodiment of the present invention is provided, can be by cloud
The parsing and judgement of the true access log of protective platform, are comprehensively and accurately analyzed Website page availability, with smaller
Resources Consumption efficiently complete the detection and alarm of Website Usability.
Other features and advantages of the present invention will illustrate in the following description, also, partly become from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages are in specification, claims
And specifically noted structure is realized and obtained in accompanying drawing.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Brief description of the drawings
, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical scheme of the prior art
The required accompanying drawing used is briefly described in embodiment or description of the prior art, it should be apparent that, in describing below
Accompanying drawing is some embodiments of the present invention, for those of ordinary skill in the art, before creative work is not paid
Put, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is a kind of flow of Website Usability detection method based on cloud protection daily record provided in an embodiment of the present invention
Figure；
Fig. 2 is the flow of another Website Usability detection method based on cloud protection daily record provided in an embodiment of the present invention
Figure；
Fig. 3 is the flow of another Website Usability detection method based on cloud protection daily record provided in an embodiment of the present invention
Figure；
Fig. 4 is the flow of another Website Usability detection method based on cloud protection daily record provided in an embodiment of the present invention
Figure；
Fig. 5 is the flow of another Website Usability detection method based on cloud protection daily record provided in an embodiment of the present invention
Figure；
Fig. 6 is the flow of another Website Usability detection method based on cloud protection daily record provided in an embodiment of the present invention
Figure；
Fig. 7 is a kind of structural representation of Website Usability checking device based on cloud protection daily record provided in an embodiment of the present invention
Figure；
Fig. 8 is that a kind of structure of Website Usability detecting system based on cloud protection daily record provided in an embodiment of the present invention is shown
It is intended to；
Fig. 9 is the structural representation of electronic equipment provided in an embodiment of the present invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with accompanying drawing to the present invention
Technical scheme be clearly and completely described, it is clear that described embodiment is part of the embodiment of the present invention, rather than
Whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not making creative work premise
Lower obtained every other embodiment, belongs to the scope of protection of the invention.
Generally use reptile mode carries out availability detection to website at present, in this process, following side be present
The problem of face：1) it is limited and fixed to detect the page；2) reptile mode is that extra abnormal access is easily blocked；3) network is born
Load-carrying, cause result output delay larger.
It is provided in an embodiment of the present invention based on the cloud protection Website Usability detection method of daily record, device and to be based on this
System, Website page availability can be carried out comprehensive, accurate by the parsing and judgement of the true access log to cloud protective platform
True analysis, the detection and alarm of Website Usability are efficiently completed with less Resources Consumption, preferably solve the above and ask
Topic.
For ease of understanding the present embodiment, cloud protection daily record is based on to one kind disclosed in the embodiment of the present invention first
Website Usability detection method describe in detail.
Embodiment one：
The embodiment of the present invention provides a kind of Website Usability detection method based on cloud protection daily record, shown in Figure 1, should
Website Usability detection method includes following steps：
S101：Obtain the access log that user conducts interviews to website.
The cloud computing that cloud protective platform refers to network attack and intrusion behavior can effectively be analyzed, calculate and intercepted is put down
Platform.
First, back-end server is based on cloud protective platform, obtains access log of the user when accessing website, and the daily record is
Cloud protects daily record, i.e., cloud protective platform the flowing of access of trustship website cleaned and intercept attack action process in record
HTTP daily records.
S102：Access log is parsed, obtains access information.
After the access log of user is got, the daily record is parsed according to predetermined rule, accessed as follows
Information, including access time, website domain name, URL, source IP address, http answer codes, request are time-consuming etc..
S103：Various dimensions statistics is carried out according to access information to calculate, and obtains multiple statistical results.
According to the access information obtained above by parsing daily record, carry out various dimensions statistics and calculate, obtain multiple statistics knots
Fruit, such as：Accessed in the http answer codes of its website domain name with the quantity of the answer code of 5 beginnings, according to source IP address
The IP of source region and operator's circuit accesses time-consuming, etc..Wherein, the corresponding predetermined threshold value of each statistical result.
It should be noted that above-mentioned various dimensions statistics calculating process, can take single net according to the quantity of access information
The mode of network node or multiple network nodes is disposed, for example node A is responsible for calculating http response code, and node B is responsible for calculating
Total time-consuming is asked, node C, which is responsible for calculating, accesses source area, the time-consuming distribution situation of operator etc., thus than more fully obtaining
The related data of Website Usability.
S104：Determine whether the availability of website meets default available condition based on statistical result.
The statistical result being calculated according to various dimensions, determine whether the Website Usability whether meet it is default can
It is shown in Figure 2 with condition, specifically include following steps：
S201：Judge whether include object statistics result in multiple statistical results in preset time, object statistics result is
Any one statistical result in multiple statistical results, and object statistics result is more than predetermined threshold value, predetermined threshold value is united for target
Count the corresponding threshold value of result.
S202：If it is judged that object statistics result is included in multiple statistical results, it is determined that the availability of website is discontented with
The default available condition of foot, and trigger alarm server and alerted to user.
When specific implementation, judge whether include the mesh more than predetermined threshold value in preset time in multiple statistical results
Statistical result is marked, as long as there is an object statistics result for exceeding predetermined threshold value, will judge that current site presence can not provide
The risk of service, that is, the availability of the website are unsatisfactory for default available condition.It is of course also possible to have in preset time more
The individual object statistics result more than predetermined threshold value.
Such as in regular hour window (in such as 1 minute or 3 minutes), the answer code of certain domain name in access information
Middle 5xx (500,502,503,504,505) ratio is more than its corresponding pre-set threshold value 3, and obtains access originator according to source IP address
Region and operator's circuit, the IP of this area's circuit, which accesses to take, in preset time exception, you can judges that this area should
Circuit there may be network-in-dialing problem to website source.It is possible thereby to judge that the availability of the website is unsatisfactory for default available bar
Part.
When the availability for judging website is unsatisfactory for default available condition, back-end server can trigger alarm server automatically
Alerted to corresponding user, shown in Figure 3, specific alarm process comprises the following steps：
S301：According to the quantity of object statistics result in preset time, it is determined that default alarm type.
In the present embodiment, different settings can be carried out to alarm type according to the situation of website abnormal, it is,
Include the quantity of object statistics result according to multiple statistical results in preset time, determine its default alarm type accordingly.
For example the quantity of object statistics result is 1, shows that Website Usability is poor, at this moment, can be set as default alarm type
The short message alarm of low frequency time；Or object statistics result shows Website Usability extreme difference, at this point it is possible to by default announcement when being 5
Alert type set is the warning by telephone of high frequency time.
S302：Based on alarm type to alarm server send triggering command so that alarm server to user according to pre-
If alarm type is alerted.
After default alarm type is determined, triggering command is sent to alarm server, so that alarm server is according to pre-
If alarm type is timely alerted to user, wherein, default alarm type includes：Warning by telephone, the low frequency of high frequency time
Short message alarm.
It should be noted that alarm type is not limited only to described in the present embodiment, can also include sending mail etc. its
It alerts mode.
As a preferred embodiment, in execution of step S102：Access log is parsed, obtains accessing letter
Breath, afterwards, can also comprise the following steps, shown in Figure 4：
S401：According to JSON forms, access information is sent to Message Queuing server, so that Message Queuing server is on time
Ordered pair access information is preserved.
After access log of the back-end server when getting user and accessing website, parsed according to predetermined rule,
Obtain the access informations such as access time, website domain name, URL, source IP address, http answer codes, request be time-consuming.
Then these access informations are sent to Message Queuing server according to JSON forms, Message Queuing server will be chronologically to these
Access information is preserved.
S402：In the case of the detection instruction that the availability got to website is detected, from Message Queuing Services
Access information is extracted in device.
Back-end server is when the Website Usability for getting terminal detects instruction, or back-end server carries out net automatically
Calculated when availability of standing detects, it is necessary to carry out various dimensions statistics to above-mentioned access information, at this moment, can be from Message Queuing server
It is middle to extract access information.
Because the access log amount that back-end server obtains is very big, synchronization process can cause daily record bulk deposition, service
Device resource load is very big, and the analysis for being unfavorable for server judges, therefore, can be temporary by access information by above-mentioned two step
Exist in Message Queuing server, realize asynchronous process daily record, reach buffering and the purpose of decoupling, improve the system of back-end server
Meter calculates and log processing efficiency.
In addition, the subsequently further statistical analysis to mass data for convenience, shown in Figure 5, the embodiment of the present invention
The Website Usability detection method based on protection daily record provided also includes：
S501：After object statistics result is included in judging multiple statistical results, by corresponding to object statistics result
Access information be stored in target information list, target information list is used for recording exceptional information.
Specifically, the back-end server can also provide REST api interfaces, so that outside easily get above-mentioned use
In the target information list of recording exceptional information.
In order to improve the accuracy of Website Usability detection, it is necessary to be adjusted in real time to the predetermined threshold value of statistical result
Whole, shown in Figure 6, the method that the embodiment of the present invention is provided also includes：
S601：Following at least one processing is performed to each statistical result and target information list, obtains learning outcome：Number
Handled according to persistence, big data study processing.
S602：According to learning outcome, the predetermined threshold value corresponding to each statistical result is adjusted.
In order to improve the accuracy of Website Usability detection and alarm, it is necessary to which corresponding to each aforesaid statistical result is pre-
If threshold value is reasonably adjusted, therefore, back-end server can be to above-mentioned statistical result and target information list, that is, deposits
The list of abnormal access information, data persistence processing or big data study are carried out, so as to obtain new learning outcome, and then
The predetermined threshold value corresponding to each statistical result is adjusted according to the learning outcome.
The Website Usability detection method based on cloud protection daily record that the embodiment of the present invention is provided can be by preventing cloud
The parsing and judgement of the true access log of platform are protected, Website page availability is comprehensively and accurately analyzed, with less
Resources Consumption efficiently completes the detection and alarm of Website Usability.In addition, this method can also mitigate the load of targeted website,
Combined simultaneously with cloud protective platform, play attack protection and availability detection double action.
Embodiment two：
The embodiment of the present invention provides a kind of Website Usability detection means based on cloud protection daily record, shown in Figure 7, should
Device includes：Log acquisition module 71, log analyzing module 72, statistics computing module 73 and availability detection module 74.
Wherein, log acquisition module 71, the access log to be conducted interviews for obtaining user to website；Log analyzing module
72, for being parsed to access log, obtain access information；Access information includes at least one of：Access time, website
Domain name, URL, source IP address, http answer codes, request are time-consuming；Computing module 73 is counted, for according to access
Information carries out various dimensions statistics and calculated, and obtains multiple statistical results；The corresponding predetermined threshold value of each statistical result；Availability
Detection module 74, determine whether the availability of website meets default available condition based on statistical result.
In the Website Usability detection means based on cloud protection daily record that the embodiment of the present invention is provided, modules are with before
Stating the Website Usability detection method based on cloud protection daily record has identical technical characteristic, therefore, can equally realize above-mentioned
Function.The specific work process of modules in the present apparatus will not be repeated here referring to above method embodiment.
Embodiment three：
The embodiment of the present invention provides a kind of Website Usability detecting system based on cloud protection daily record, shown in Figure 8, should
System includes networking client 81, back-end server 82, Message Queuing server 83 and alarm server 84.
Wherein, communicated between networking client 81, back-end server 82, queue server 83 and alarm server 84
Connection；The Website Usability detection means 821 based on cloud protection daily record described in embodiment two is installed on back-end server 82.
The embodiment of the present invention provided based on cloud protection daily record Website Usability detecting system in, including with foregoing base
In the Website Usability detection method identical technical characteristic of cloud protection daily record, therefore, above-mentioned function can be equally realized.This is
The specific work process of each server in system will not be repeated here referring to above method embodiment.
Example IV：
The embodiment of the present invention also provides a kind of electronic equipment, shown in Figure 9, and the electronic equipment includes：Processor 90, is deposited
Reservoir 91, bus 92 and communication interface 93, the processor 90, communication interface 93 and memory 91 are connected by bus 92；Place
Reason device 90 is used to perform the executable module stored in memory 91, such as computer program.Computing device computer program
The step of methods of the Shi Shixian as described in embodiment of the method.
Wherein, memory 91 may include high-speed random access memory (RAM, RandomAccessMemory), also may be used
Non-labile memory (non-volatile memory), for example, at least a magnetic disk storage can also be included.By at least
One communication interface 93 (can be wired or wireless) realizes the communication between the system network element and at least one other network element
Connection, can use internet, wide area network, LAN, Metropolitan Area Network (MAN) etc..
Bus 92 can be isa bus, pci bus or eisa bus etc..The bus can be divided into address bus, data
Bus, controlling bus etc..Only represented for ease of representing, in Fig. 5 with a four-headed arrow, it is not intended that an only bus or
A type of bus.
Wherein, memory 91 is used for storage program, and the processor 90 performs the journey after execute instruction is received
Sequence, the method performed by device that the stream process that foregoing any embodiment of the embodiment of the present invention discloses defines can apply to handle
In device 90, or realized by processor 90.
Processor 90 is probably a kind of IC chip, has the disposal ability of signal.In implementation process, above-mentioned side
Each step of method can be completed by the integrated logic circuit of the hardware in processor 90 or the instruction of software form.Above-mentioned
Processor 90 can be general processor, including central processing unit (Central Processing Unit, abbreviation CPU), network
Processor (Network Processor, abbreviation NP) etc.；It can also be digital signal processor (Digital Signal
Processing, abbreviation DSP), application specific integrated circuit (Application Specific Integrated Circuit, referred to as
ASIC), ready-made programmable gate array (Field-Programmable Gate Array, abbreviation FPGA) or other are programmable
Logical device, discrete gate or transistor logic, discrete hardware components.It can realize or perform in the embodiment of the present invention
Disclosed each method, step and logic diagram.General processor can be microprocessor or the processor can also be appointed
What conventional processor etc..The step of method with reference to disclosed in the embodiment of the present invention, can be embodied directly in hardware decoding processing
Device performs completion, or performs completion with the hardware in decoding processor and software module combination.Software module can be located at
Machine memory, flash memory, read-only storage, programmable read only memory or electrically erasable programmable memory, register etc. are originally
In the ripe storage medium in field.The storage medium is located at memory 91, and processor 90 reads the information in memory 91, with reference to
Its hardware completes the step of above method.
The computer program production for the Website Usability detection method based on cloud protection daily record that the embodiment of the present invention is provided
Product, including store the computer-readable recording medium of the executable non-volatile program code of processor, described program code
Including instruction can be used for perform previous methods embodiment described in method, specific implementation can be found in embodiment of the method, herein
Repeat no more.
It is apparent to those skilled in the art that for convenience and simplicity of description, the device of foregoing description
And the specific work process of electronic equipment, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
Flow chart and block diagram in accompanying drawing show multiple embodiment method and computer program products according to the present invention
Architectural framework in the cards, function and operation.At this point, each square frame in flow chart or block diagram can represent one
A part for module, program segment or code, a part for the module, program segment or code include one or more and are used to realize
The executable instruction of defined logic function.It should also be noted that at some as the work(in the realization replaced, marked in square frame
Energy can also be with different from the order marked in accompanying drawing generation.For example, two continuous square frames can essentially be substantially parallel
Ground is performed, and they can also be performed in the opposite order sometimes, and this is depending on involved function.It is also noted that block diagram
And/or the combination of each square frame and block diagram in flow chart and/or the square frame in flow chart, work(as defined in performing can be used
Can or the special hardware based system of action realize, or the combination of specialized hardware and computer instruction can be used come reality
It is existing.
In the description of the invention, it is necessary to explanation, term " " center ", " on ", " under ", "left", "right", " vertical ",
The orientation or position relationship of the instruction such as " level ", " interior ", " outer " be based on orientation shown in the drawings or position relationship, merely to
Be easy to the description present invention and simplify description, rather than instruction or imply signified device or element must have specific orientation,
With specific azimuth configuration and operation, therefore it is not considered as limiting the invention.In addition, term " first ", " second ",
" the 3rd " is only used for describing purpose, and it is not intended that instruction or hint relative importance.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, can be with
Realize by another way.Device embodiment described above is only schematical, for example, the division of the unit,
Only a kind of division of logic function, can there is other dividing mode when actually realizing, in another example, multiple units or component can
To combine or be desirably integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or beg for
The mutual coupling of opinion or direct-coupling or communication connection can be by some communication interfaces, device or unit it is indirect
Coupling or communication connection, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.
If the function is realized in the form of SFU software functional unit and is used as independent production marketing or in use, can be with
It is stored in the executable non-volatile computer read/write memory medium of a processor.Based on such understanding, the present invention
The part that is substantially contributed in other words to prior art of technical scheme or the part of the technical scheme can be with software
The form of product is embodied, and the computer software product is stored in a storage medium, including some instructions are causing
One computer equipment (can be personal computer, server, or network equipment etc.) performs each embodiment institute of the present invention
State all or part of step of method.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-
Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with
The medium of store program codes.
Finally it should be noted that：Embodiment described above, it is only the embodiment of the present invention, to illustrate the present invention
Technical scheme, rather than its limitations, protection scope of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, it will be understood by those within the art that：Any one skilled in the art
The invention discloses technical scope in, it can still modify to the technical scheme described in previous embodiment or can be light
Change is readily conceivable that, or equivalent substitution is carried out to which part technical characteristic；And these modifications, change or replacement, do not make
The essence of appropriate technical solution departs from the spirit and scope of technical scheme of the embodiment of the present invention, should all cover the protection in the present invention
Within the scope of.Therefore, protection scope of the present invention described should be defined by scope of the claims.
Claims (10)
- A kind of 1. Website Usability detection method based on cloud protection daily record, it is characterised in that including：Obtain the access log that user conducts interviews to website；The access log is parsed, obtains access information；The access information includes at least one of：During access Between, website domain name, URL, source IP address, http answer codes, request it is time-consuming；Various dimensions statistics is carried out according to the access information to calculate, and obtains multiple statistical results；Each statistical result corresponding one Individual predetermined threshold value；Determine whether the availability of the website meets default available condition based on the statistical result.
- 2. according to the method for claim 1, it is characterised in that the availability of the website is determined based on the statistical result Whether the default available condition of satisfaction includes：Judge whether include object statistics result in the multiple statistical result in preset time, the object statistics result is institute Any one statistical result in multiple statistical results is stated, and the object statistics result is more than predetermined threshold value, the default threshold It is worth for the corresponding threshold value of the object statistics result；If it is judged that object statistics result is included in the multiple statistical result, it is determined that the availability of the website is unsatisfactory for Default available condition, and trigger alarm server and alerted to the user.
- 3. according to the method for claim 1, it is characterised in that the access log is parsed described, must be visited After asking information, in addition to：According to JSON forms, the access information is sent to Message Queuing server, so that the Message Queuing server is on time Access information is preserved described in ordered pair；In the case where getting the detection detected to the availability of the website instruction, from the Message Queuing server The middle extraction access information.
- 4. according to the method for claim 1, it is characterised in that also include：After object statistics result is included in judging the multiple statistical result, by corresponding to the object statistics result Access information is stored in target information list, and the target information list is used for recording exceptional information.
- 5. according to the method for claim 4, it is characterised in that methods described also includes：Following at least one processing is performed to each statistical result and the target information list, obtains learning outcome：Data are held Longization processing, big data study processing；According to the learning outcome, the predetermined threshold value corresponding to each statistical result is adjusted.
- 6. according to the method for claim 2, it is characterised in that the triggering alarm server is accused to the user It is alert, including：According to the quantity of the object statistics result in preset time, it is determined that default alarm type；Triggering command is sent to the alarm server based on the alarm type, so that the alarm server is to the user Alerted according to default alarm type, wherein, the default alarm type includes：The warning by telephone of high frequency time, low frequency time Short message alarm.
- A kind of 7. Website Usability detection means based on cloud protection daily record, it is characterised in that including：Log acquisition module, the access log to be conducted interviews for obtaining user to website；Log analyzing module, for being parsed to the access log, obtain access information；The access information includes following At least one：Access time, website domain name, URL, source IP address, http answer codes, request are time-consuming；Computing module is counted, is calculated for carrying out various dimensions statistics according to the access information, obtains multiple statistical results；It is each The corresponding predetermined threshold value of individual statistical result；Availability detection module, determine whether the availability of the website meets default available condition based on the statistical result.
- 8. a kind of Website Usability detecting system based on cloud protection daily record, it is characterised in that taken including networking client, rear end Business device, Message Queuing server and alarm server；Communicated between the networking client, the back-end server, the queue server and the alarm server Connection；Website Usability as claimed in claim 7 based on cloud protection daily record is installed on the back-end server and detects dress Put.
- 9. a kind of electronic equipment, including memory, processor, it is stored with what can be run on the processor on the memory Computer program, it is characterised in that realize that the claims 1 to 6 are any during computer program described in the computing device Described in method the step of.
- 10. a kind of computer-readable medium for the non-volatile program code that can perform with processor, it is characterised in that described Program code makes the method described in any one of claim 1 to 6 described in the computing device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710749521.0A CN107528749A (en) | 2017-08-28 | 2017-08-28 | Website Usability detection method, apparatus and system based on cloud protection daily record |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710749521.0A CN107528749A (en) | 2017-08-28 | 2017-08-28 | Website Usability detection method, apparatus and system based on cloud protection daily record |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107528749A true CN107528749A (en) | 2017-12-29 |
Family
ID=60682699
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710749521.0A Pending CN107528749A (en) | 2017-08-28 | 2017-08-28 | Website Usability detection method, apparatus and system based on cloud protection daily record |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107528749A (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108572907A (en) * | 2018-01-25 | 2018-09-25 | 北京金山云网络技术有限公司 | A kind of alarm method, device, electronic equipment and computer readable storage medium |
| CN109379213A (en) * | 2018-09-19 | 2019-02-22 | 杭州安恒信息技术股份有限公司 | Website Usability alarm method and warning system based on access log response message |
| CN109688097A (en) * | 2018-09-07 | 2019-04-26 | 平安科技（深圳）有限公司 | Website protection method, website protective device, website safeguard and storage medium |
| CN110061864A (en) * | 2019-03-26 | 2019-07-26 | 网宿科技股份有限公司 | A kind of method and system of domain name configuration automatic Verification |
| CN110109812A (en) * | 2019-05-10 | 2019-08-09 | 广州英睿科技有限公司 | Statistical method, device, computer equipment and the storage medium of access log data |
| CN110166486A (en) * | 2019-06-14 | 2019-08-23 | 李啟锋 | Website protection method, device and computer readable storage medium |
| CN110213375A (en) * | 2019-06-04 | 2019-09-06 | 杭州安恒信息技术股份有限公司 | A kind of method, apparatus and electronic equipment of the IP access control based on cloud WAF |
| CN110311837A (en) * | 2019-07-12 | 2019-10-08 | 广州华多网络科技有限公司 | Online service availability detection method, device and computer equipment |
| CN110955544A (en) * | 2019-12-18 | 2020-04-03 | 杭州安恒信息技术股份有限公司 | Method, device and system for detecting usability of web system |
| CN111193685A (en) * | 2018-11-14 | 2020-05-22 | ***通信集团辽宁有限公司 | Method, device, equipment and medium for verifying authenticity of log information |
| CN111258969A (en) * | 2018-11-30 | 2020-06-09 | ***通信集团浙江有限公司 | Internet access log analysis method and device |
| CN111866854A (en) * | 2019-04-28 | 2020-10-30 | 北京数安鑫云信息技术有限公司 | Automatic application updating method, device and system and computer equipment |
| CN112929360A (en) * | 2021-02-03 | 2021-06-08 | 北京中数智汇科技股份有限公司 | Web terminal protection method, system and storage medium based on port proxy |
| CN113139146A (en) * | 2020-01-17 | 2021-07-20 | ***通信集团浙江有限公司 | Website quality evaluation method and device and computing equipment |
| CN113660244A (en) * | 2021-08-11 | 2021-11-16 | 杭州安恒信息技术股份有限公司 | Website availability detection method, system, readable storage medium and device |
| CN113778780A (en) * | 2020-11-27 | 2021-12-10 | 北京京东尚科信息技术有限公司 | Application stability determination method and device, electronic equipment and storage medium |
| CN115333920A (en) * | 2022-08-12 | 2022-11-11 | 北京天融信网络安全技术有限公司 | Alarm testing method and device, electronic equipment and computer readable storage medium |
| CN115396314A (en) * | 2022-08-26 | 2022-11-25 | 湖北天融信网络安全技术有限公司 | Method, device, system and medium for obtaining protection strategy set and message detection |
| CN117294745A (en) * | 2023-11-24 | 2023-12-26 | 中关村科学城城市大脑股份有限公司 | Network connection state information sending method, device, electronic equipment and medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160344751A1 (en) * | 2015-05-19 | 2016-11-24 | Fastly, Inc. | Customized record handling in a content delivery network |
| CN106371986A (en) * | 2016-09-08 | 2017-02-01 | 上海新炬网络技术有限公司 | Log treatment operation and maintenance monitoring system |
-
2017
- 2017-08-28 CN CN201710749521.0A patent/CN107528749A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160344751A1 (en) * | 2015-05-19 | 2016-11-24 | Fastly, Inc. | Customized record handling in a content delivery network |
| CN106371986A (en) * | 2016-09-08 | 2017-02-01 | 上海新炬网络技术有限公司 | Log treatment operation and maintenance monitoring system |
Non-Patent Citations (1)
| Title |
|---|
| 于希敏: "一个基于Web日志的用户操作序列及网站可用性分析方法", 《第5届全国人机交互学术会议》 * |
Cited By (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108572907B (en) * | 2018-01-25 | 2022-05-06 | 北京金山云网络技术有限公司 | Alarm method, alarm device, electronic equipment and computer readable storage medium |
| CN108572907A (en) * | 2018-01-25 | 2018-09-25 | 北京金山云网络技术有限公司 | A kind of alarm method, device, electronic equipment and computer readable storage medium |
| CN109688097A (en) * | 2018-09-07 | 2019-04-26 | 平安科技（深圳）有限公司 | Website protection method, website protective device, website safeguard and storage medium |
| CN109688097B (en) * | 2018-09-07 | 2023-03-24 | 平安科技（深圳）有限公司 | Website protection method, website protection device, website protection equipment and storage medium |
| CN109379213A (en) * | 2018-09-19 | 2019-02-22 | 杭州安恒信息技术股份有限公司 | Website Usability alarm method and warning system based on access log response message |
| CN111193685A (en) * | 2018-11-14 | 2020-05-22 | ***通信集团辽宁有限公司 | Method, device, equipment and medium for verifying authenticity of log information |
| CN111193685B (en) * | 2018-11-14 | 2022-10-18 | ***通信集团辽宁有限公司 | Method, device, equipment and medium for verifying authenticity of log information |
| CN111258969A (en) * | 2018-11-30 | 2020-06-09 | ***通信集团浙江有限公司 | Internet access log analysis method and device |
| CN111258969B (en) * | 2018-11-30 | 2023-08-15 | ***通信集团浙江有限公司 | Internet access log analysis method and device |
| CN110061864A (en) * | 2019-03-26 | 2019-07-26 | 网宿科技股份有限公司 | A kind of method and system of domain name configuration automatic Verification |
| CN110061864B (en) * | 2019-03-26 | 2022-07-26 | 网宿科技股份有限公司 | Method and system for automatically verifying domain name configuration |
| CN111866854B (en) * | 2019-04-28 | 2023-04-18 | 北京数安鑫云信息技术有限公司 | Automatic application updating method, device and system and computer equipment |
| CN111866854A (en) * | 2019-04-28 | 2020-10-30 | 北京数安鑫云信息技术有限公司 | Automatic application updating method, device and system and computer equipment |
| CN110109812A (en) * | 2019-05-10 | 2019-08-09 | 广州英睿科技有限公司 | Statistical method, device, computer equipment and the storage medium of access log data |
| CN110213375A (en) * | 2019-06-04 | 2019-09-06 | 杭州安恒信息技术股份有限公司 | A kind of method, apparatus and electronic equipment of the IP access control based on cloud WAF |
| CN110166486A (en) * | 2019-06-14 | 2019-08-23 | 李啟锋 | Website protection method, device and computer readable storage medium |
| CN110311837B (en) * | 2019-07-12 | 2022-11-01 | 广州华多网络科技有限公司 | Online service availability detection method and device and computer equipment |
| CN110311837A (en) * | 2019-07-12 | 2019-10-08 | 广州华多网络科技有限公司 | Online service availability detection method, device and computer equipment |
| CN110955544A (en) * | 2019-12-18 | 2020-04-03 | 杭州安恒信息技术股份有限公司 | Method, device and system for detecting usability of web system |
| CN113139146A (en) * | 2020-01-17 | 2021-07-20 | ***通信集团浙江有限公司 | Website quality evaluation method and device and computing equipment |
| CN113778780A (en) * | 2020-11-27 | 2021-12-10 | 北京京东尚科信息技术有限公司 | Application stability determination method and device, electronic equipment and storage medium |
| CN113778780B (en) * | 2020-11-27 | 2024-05-17 | 北京京东尚科信息技术有限公司 | Application stability determining method and device, electronic equipment and storage medium |
| CN112929360A (en) * | 2021-02-03 | 2021-06-08 | 北京中数智汇科技股份有限公司 | Web terminal protection method, system and storage medium based on port proxy |
| CN113660244A (en) * | 2021-08-11 | 2021-11-16 | 杭州安恒信息技术股份有限公司 | Website availability detection method, system, readable storage medium and device |
| CN113660244B (en) * | 2021-08-11 | 2023-02-24 | 杭州安恒信息技术股份有限公司 | Website availability detection method, system, readable storage medium and device |
| CN115333920B (en) * | 2022-08-12 | 2024-04-23 | 北京天融信网络安全技术有限公司 | Alarm test method, alarm test device, electronic equipment and computer readable storage medium |
| CN115333920A (en) * | 2022-08-12 | 2022-11-11 | 北京天融信网络安全技术有限公司 | Alarm testing method and device, electronic equipment and computer readable storage medium |
| CN115396314A (en) * | 2022-08-26 | 2022-11-25 | 湖北天融信网络安全技术有限公司 | Method, device, system and medium for obtaining protection strategy set and message detection |
| CN115396314B (en) * | 2022-08-26 | 2024-04-26 | 湖北天融信网络安全技术有限公司 | Method, device, system and medium for obtaining protection policy set and message detection |
| CN117294745A (en) * | 2023-11-24 | 2023-12-26 | 中关村科学城城市大脑股份有限公司 | Network connection state information sending method, device, electronic equipment and medium |
| CN117294745B (en) * | 2023-11-24 | 2024-02-02 | 中关村科学城城市大脑股份有限公司 | Network connection state information sending method, device, electronic equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107528749A (en) | Website Usability detection method, apparatus and system based on cloud protection daily record | |
| JP6841910B2 (en) | User abnormal behavior detection method, device and system | |
| CN104519032B (en) | A kind of security strategy and system of internet account number | |
| CN104391979B (en) | Network malice reptile recognition methods and device | |
| CN104426713B (en) | The monitoring method and device of web site access effect data | |
| US10516697B2 (en) | ISP blacklist feed | |
| CN108833184A (en) | Service fault localization method, device, computer equipment and storage medium | |
| US20150170070A1 (en) | Method, apparatus, and system for monitoring website | |
| US20110166926A1 (en) | Evaluating Online Marketing Efficiency | |
| CN104657250A (en) | Monitoring method for monitoring performance of cloud host | |
| CN108492150B (en) | Method and system for determining entity heat degree | |
| CN108111554B (en) | Control method and device for access queue | |
| EP3085023B1 (en) | Communications security | |
| CN114095567B (en) | Data access request processing method and device, computer equipment and medium | |
| CN113412607B (en) | Content pushing method and device, mobile terminal and storage medium | |
| CN103279869A (en) | Method and device for determining information treatment targets | |
| CN111061588A (en) | Method and device for locating database abnormal source | |
| CN105939321B (en) | A kind of DNS attack detection method and device | |
| CN112383513B (en) | Crawler behavior detection method and device based on proxy IP address pool and storage medium | |
| CN104219219B (en) | A kind of method of data processing, server and system | |
| CN103916463B (en) | Network access statistical analysis method and system | |
| CN108494635A (en) | A kind of network flow detection system based on cloud computing | |
| CN110866831A (en) | Asset activity level determination method and device and server | |
| US9118563B2 (en) | Methods and apparatus for detecting and filtering forced traffic data from network data | |
| CN113095891A (en) | Data processing method and device, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171229 |
|
| RJ01 | Rejection of invention patent application after publication |