CN109743233A - A kind of pair of strong identity authentication system carries out the method and computer equipment of data acquisition - Google Patents
A kind of pair of strong identity authentication system carries out the method and computer equipment of data acquisition Download PDFInfo
- Publication number
- CN109743233A CN109743233A CN201910134993.4A CN201910134993A CN109743233A CN 109743233 A CN109743233 A CN 109743233A CN 201910134993 A CN201910134993 A CN 201910134993A CN 109743233 A CN109743233 A CN 109743233A
- Authority
- CN
- China
- Prior art keywords
- acquisition
- script
- collection agent
- agent end
- cloud
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention provides the method that a kind of pair of strong identity authentication system carries out data acquisition, comprising: 1, carry out installation and deployment to acquisition cloud；2, for the page customization to be acquired exploitation acquisition script, and the acquisition script is sent to acquisition cloud, the publication of script is acquired by the publication acquisition script subscription service in acquisition cloud；3, Collection agent end is installed on the client；4, the Collection agent end selects the acquisition script issued on acquisition cloud to carry out installation subscription on demand；5, the Collection agent end parses acquisition script by browser, gets the parameter information of the acquisition script；6, when triggering collection instructs, Collection agent end is by script logic code injection defined in the parameter information for acquiring script into the page to be acquired, browser script logic code according to defined in acquisition script carries out executing scheduled operation, and realization is acquired data in the page.The present invention also provides a kind of computer equipments, greatly promote working efficiency.
Description
Technical field
The present invention relates to a kind of collecting method more particularly to a kind of pair of strong identity authentication system (such as: certificate logs in,
Living things feature recognition etc.) carry out data acquisition method and computer equipment.
Background technique
With the arrival of big data era, data are often distributed in as important and valuable resource and each different are
System and platform, and it is all relevant between many data, and studying and judging personnel also as Data Analyst and information will often distinguish never
With system in pick data carry out analysis study and judge.
Traditional way is to carry out data grabber using data interchange platform and data collection system.Data interchange platform
It is to carry out data acquisition by the way of docking target database, in the case where needing target service open system data base authority
Data could be acquired, this cannot achieve under most of scene, and the difficulty for causing data to acquire is big and docking is at high cost；And
Data collection system is to carry out data grabber by the way of simulate HTTP request, although this mode does not have to the open number of other side
According to library permission, but when the HTTP request of target service system needs to authenticate or does encryption or server-side to hyperlink request
It is clearly not applicable that WAF, which does this acquisition mode when anti-acquisition strategies,.
In the Chinese invention that the publication No. that on December 28th, 2016 announces is CN106257887A, discloses one kind and be based on
The method of the acquisition client hardware information of WebSocket, which comprises step 1) expands common Web Socket object
Open up customized JavaScript interface function；Step 2) client creates WebSocket object, and establishes the company with server
It connects, calls the customized JavaScript interface function of the extension of the step 1)；Step 3) Web engine kernel according to
The interface function of WebSocket object reference obtains relevant device hardware information, returns to client；Step 4) client will be returned
The device hardware information returned is included in data message and is sent to server；Step 5) the server to data message at
Reason, and processing result is returned to by client according to device hardware information；Step 6) client according to the place of return bury result after
It is continuous to send datagram to server, until communication finishes；After step 7) communicates, Websocket connection is closed.The invention
Aim to overcome that do not have in current WebSocket object comprising obtain client recommendation information attribute defect, pass through
The JavaScript interface of extension is called to realize Websocket object acquisition client hardware information, it is highly-safe, it is ensured that client
Hardware information cannot be modified.As it can be seen that the technical problems to be solved by the inivention, the technical solution of use and the technology being able to achieve
Effect and the present invention are completely different.
Summary of the invention
One of the technical problem to be solved in the present invention is that providing a kind of pair of strong identity authentication system carries out data acquisition
Method, based on the owned JavaScript debugging capability of browser, the method that developer's usually program development is debugged
And the approach application of safety test personnel safety test into data acquisition, i.e., browser is beaten after supporting developer to press F12
The Develop Tools opened writes JavaScript script and carries out page re-rendered, content of pages acquisition, Ajax request submission
A kind of browser is made according to this ability of browser Deng, the present invention and acquires plug-in unit, makes various acquisitions further according to acquisition demand
JavaScript script, to provide intelligent acquisition.
One of the technical problem to be solved in the present invention is achieved in that a kind of pair of strong identity authentication system carries out data
The method of acquisition, includes the following steps:
Step 1 carries out installation and deployment to acquisition cloud；
Step 2 acquires script for the page customization to be acquired exploitation, and the acquisition script is sent to acquisition cloud,
The publication of script is acquired by the publication acquisition script subscription service in acquisition cloud；
Step 3 installs Collection agent end on the client；
Step 4, the Collection agent end select the acquisition script issued on acquisition cloud to carry out installation subscription on demand；
Step 5, the Collection agent end parse acquisition script by browser, get the ginseng of the acquisition script
Number information；
Step 6, when triggering collection instruction when, script defined in the parameter information for acquiring script is patrolled at Collection agent end
Code injection is collected into the page to be acquired, browser script logic code according to defined in acquisition script execute predetermined
Operation, realization data in the page are acquired.
Further, the mode that triggering collection instructs in the step 6 includes Auto-matching acquisition and reception acquisition tasks
Two kinds of triggering modes of instruction acquisition are realized；
Auto-matching acquisition: when the page address that the browser at Collection agent end is accessed passes through regular expression rule
When being fitted on address matching rule set in the parameter information of acquisition script, the script logic code acquired in script will be automatic
It is injected into current page and triggers execution, start to acquire the data in the page；
It receives acquisition tasks instruction acquisition: acquisition tasks request being initiated by third party's operation system, acquires the task in cloud
After dispatch service receives acquisition tasks request, according to the registration order at Collection agent end successively by acquisition tasks request point
Hair is relayed to different Collection agent ends, when acquisition cloud, which receives Collection agent end, to be responded, then stops continuing distribution acquisition
Task requests were acquired after establishing connection between the WebSocket service of script and Collection agent end by current type, to acquisition generation
It manages end and sends acquisition instructions；Collection agent end will acquire script logic code defined in script according to the acquisition instructions received
It is injected into the page to be acquired, and after perform script logical code is acquired the data in the page, Collection agent end is again
The secondary WebSocket service by acquiring cloud carries out data exchange and gives the data back of acquisition to acquisition cloud, by acquisition
The task schedule service transfer in cloud returns to third party's operation system；Cloud is acquired to carry out by each Collection agent end of poll
Data acquisition stops if receiving after data response, otherwise continues to send acquisition instructions to next Collection agent end.
Further, after the step 6 further include:
The data of the collected page access in Collection agent end are stored into WebSQL database, and adopted by step 7
Collection agent side checks all collected data, and data are exported in excel document.
Further, the parameter information of the acquisition script includes acquisition script name, NameSpace, version number, script
Description information, scenarist, address matching rule and script logic code；After the step 4 further include: when that has subscribed to adopts
After collection script carries out maintenance update, acquisition cloud is automatically same by updated acquisition script by comparing the version number of acquisition script
Walk each Collection agent end；The Collection agent end provides script-editor function, and user is checked by the script-editor
It acquires the logic of script or modifies on demand to the acquisition script of subscription.
Further, before the step 1 further include: client logs in primary rear browsing by browser login page
Device records the logging state and log-on message that system records the page by Session and Cookie.
The second technical problem to be solved by the present invention is to provide a kind of computer equipment, owned based on browser
JavaScript script debugging ability, script be based on JavaScript, using WebSocket as script subscription and task push away
Business is taken, the approach application that the method for developer's usually program development debugging and safety test personnel safety are tested to number
According in acquisition, i.e., browser supports developer to write JavaScript script by the Develop Tools opened after F12 and carry out
Page re-rendered, content of pages obtain, Ajax request is submitted etc., and the present invention makes a kind of browser according to this ability of browser
Plug-in unit is acquired, various acquisition JavaScript scripts are made further according to acquisition demand, to provide intelligent acquisition.
The second technical problem to be solved by the present invention is achieved in that a kind of computer equipment, including memory, place
The computer program managing device and storage on a memory and can running on a processor, the processor execute real when described program
Existing following steps:
Step 1 carries out installation and deployment to acquisition cloud；
Step 2 acquires script for the page customization to be acquired exploitation, and the acquisition script is sent to acquisition cloud,
The publication of script is acquired by the publication acquisition script subscription service in acquisition cloud；
Step 3 installs Collection agent end on the client；
Step 4, the Collection agent end select the acquisition script issued on acquisition cloud to carry out installation subscription on demand；
Step 5, the Collection agent end parse acquisition script by browser, get the ginseng of the acquisition script
Number information；
Step 6, when triggering collection instruction when, script defined in the parameter information for acquiring script is patrolled at Collection agent end
Code injection is collected into the page to be acquired, browser script logic code according to defined in acquisition script execute predetermined
Operation, realization data in the page are acquired.
Further, the mode that triggering collection instructs in the step 6 includes Auto-matching acquisition and reception acquisition tasks
Two kinds of triggering modes of instruction acquisition are realized；
Auto-matching acquisition: when the page address that the browser at Collection agent end is accessed passes through regular expression rule
When being fitted on address matching rule set in the parameter information of acquisition script, the script logic code acquired in script will be automatic
It is injected into current page and triggers execution, start to acquire the data in the page；
It receives acquisition tasks instruction acquisition: acquisition tasks request being initiated by third party's operation system, acquires the task in cloud
After dispatch service receives acquisition tasks request, according to the registration order at Collection agent end successively by acquisition tasks request point
Hair is relayed to different Collection agent ends, when acquisition cloud, which receives Collection agent end, to be responded, then stops continuing distribution acquisition
Task requests were acquired after establishing connection between the WebSocket service of script and Collection agent end by current type, to acquisition generation
It manages end and sends acquisition instructions；Collection agent end will acquire script logic code defined in script according to the acquisition instructions received
It is injected into the page to be acquired, and after perform script logical code is acquired the data in the page, Collection agent end is again
The secondary WebSocket service by acquiring cloud carries out data exchange and gives the data back of acquisition to acquisition cloud, by acquisition
The task schedule service transfer in cloud returns to third party's operation system；Cloud is acquired to carry out by each Collection agent end of poll
Data acquisition stops if receiving after data response, otherwise continues to send acquisition instructions to next Collection agent end.
Further, after the step 6 further include:
The data of the collected page access in Collection agent end are stored into WebSQL database, and adopted by step 7
Collection agent side checks all collected data, and data are exported in excel document.
Further, the parameter information of the acquisition script includes acquisition script name, NameSpace, version number, script
Description information, scenarist, address matching rule and script logic code；After the step 4 further include: when that has subscribed to adopts
After collection script carries out maintenance update, acquisition cloud is automatically same by updated acquisition script by comparing the version number of acquisition script
Walk each Collection agent end；The Collection agent end provides script-editor function, and user is checked by the script-editor
It acquires the logic of script or modifies on demand to the acquisition script of subscription.
Further, before the step 1 further include: client logs in primary rear browsing by browser login page
Device records the logging state and log-on message that system records the page by Session and Cookie.
The present invention has the advantage that the method that a kind of pair of strong identity authentication system of the present invention carries out data acquisition, uses
The mode that data are acquired on the browser of client, makes full use of Session and Cookie to record the original of system login state
Reason has recorded session by Cookie in browser end after user is logged in using fingerprint recognition, recognition of face, ca authentication and believes
Breath, user's operation then do not need to carry out system authentication and authentication again, solve the problems, such as system authentication and authentication, utilize
The principle of the debugging capability combination browser end white-box testing of Chrome kernel browser, i.e., by being write in browser end
The mode that JavaScript script is injected into the operation system page realizes system data acquisition, and there are in the WebSQL of browser
Interim storage, and then realize export or the acquisition mode that acquisition server-side is stored is submitted to by Ajax, due to be
Browser be based on JavaScript script be acquired and system login state passed through Session mechanism carry out save to
A series of demand that data acquisition can be carried out to fast and stable from systems for needing login authentication, replaces manual data duplication
Operation, can be substantially improved working efficiency.
Detailed description of the invention
The present invention is further illustrated in conjunction with the embodiments with reference to the accompanying drawings.
Fig. 1 is the workflow schematic diagram for the method that a kind of pair of strong identity authentication system of the present invention carries out data acquisition.
Fig. 2 is deployment architecture figure of the invention.
Specific embodiment
To be clearer and more comprehensible the present invention, now with a preferred embodiment, and attached drawing is cooperated to be described in detail below.
As depicted in figs. 1 and 2, the method that a kind of pair of strong identity authentication system of the invention carries out data acquisition is specific to wrap
Include following component part:
1, cloud is acquired: the core component that acquisition cloud is acquired as data, it is main to include acquisition script management and data
The big function of acquisition instructions transfer two:
Acquiring script management includes publication acquisition script subscription service (publication and more new function), the system as acquisition script
One administration portal；
Data acquisition instructions transfer includes acquisition tasks dispatch service, establishes in acquisition cloud and Collection agent end
WebSocket service, the terminal of the instruction and data as the acquisition of third party's operation system data.1. acquisition tasks scheduling clothes
Business: the service is a daemon thread for acquiring cloud, is used cooperatively with WebSocket service, acquisition tasks dispatch service master
It is responsible for providing the acquisition tasks request for receiving third party's operation system, forwarding acquisition tasks request to Collection agent end, receives
Data that Collection agent end is passed back, return data give the multinomial service such as third party's operation system.2. WebSocket is serviced: being to adopt
The foundation initiated when collection agent side acquisition script can be used for receiving acquisition in the long connection service in acquisition cloud and Collection agent end
The acquisition instructions and passback collection result that task schedule service is sent.
2, acquire script: acquisition script by developer, implementation personnel or have script edit ability user be directed to
The webpage of acquisition does customized development, and is published to acquisition cloud and subscribes to for installation.It acquires script and is based on JavaScript language
It writes, inherits the processing capacity of all JavaScript, while also possessing all bottom operation abilities of browser.Acquire foot
This parameter information includes acquisition script name, NameSpace, version number, script description information, scenarist, address matching rule
It is specific then with script logic code:
@name: acquisition script name, for identifying script name；
@namespace: NameSpace solves the problems, such as name conflict；
@version: version number automatically updates for script；
@description: script description information describes to introduce to the function that script is realized；
@author: scenarist；
@match: address matching rule, then triggered when path rule defined in browser is matched to rule script into
Row acquisition；
@script: specific script logic code can play all spies of JavaScript completely in acquisition script
Property content of pages is manipulated, can also establish WebSocket with acquisition cloud and connect, third party's operation system passes through acquisition
The acquisition tasks dispatch service in cloud is communicated with acquisition script at any time, and the collected data in Collection agent end not only can be with
It is stored in webSQL database, acquisition cloud can also be sent in real time by WebSocket, acquisition cloud passes through acquisition tasks
Dispatch service is transmitted to third party's operation system.
3, it Collection agent end: as the executor of acquisition tasks, is installed by browser and subscribes to user pass on acquisition cloud
The acquisition script of note carries out data acquisition, as a result feedback passback acquisition cloud.The present invention can support Auto-matching to acquire and receive
Two kinds of triggering modes of acquisition tasks instruction acquisition.
4, WebSQL is stored: for storing the acquisition collected data of script.During the present invention supports passback acquisition cloud simultaneously
Turn to be published to remote third party operation system, and exports to two kinds of way of outputs of the file formats such as Excel, XML.
The method that a kind of pair of strong identity authentication system of the invention carries out data acquisition, specifically comprises the following steps:
Step 0, client are logged in primary rear browser and are remembered by Session and Cookie by browser login page
Recording system records the logging state and log-on message of the page；Since system login state has passed through Session machine after logging in
System is saved a series of demand that data acquisition so as to fast and stable is carried out from systems for needing login authentication,
That is not needing to carry out system authentication and authentication again there is no need to re-start login again during acquiring data, solve
It has determined system authentication and authentication problem, to improve the efficiency of data acquisition；
Step 1 carries out installation and deployment to acquisition cloud, and there is publication acquisition script subscription service, acquisition to appoint in acquisition cloud
Dispatch service of being engaged in and WebSocket service；
Publication by acquiring cloud acquires script subscription service publication acquisition script, installs and subscribes to for Collection agent end；
Acquisition tasks dispatch service is provided simultaneously, the relevant finger of the acquisition for coordinating transfer third party operation system and Collection agent end
Order and data；Connection of the WebSocket service for establishing between acquisition cloud and Collection agent end, and acquisition script are upper
It passes；
Step 2 acquires script, and the WebSocket service for passing through acquisition cloud for the page customization to be acquired exploitation
The acquisition script is sent to acquisition cloud, the hair of script is acquired by the publication acquisition script subscription service in acquisition cloud
Cloth；The acquisition script is published to acquisition cloud, subscribes to and download for Collection agent end, used by written in JavaScript
JavaScript language can play its manipulation ability to the page completely, pass through injection acquisition script to target pages, realization pair
The pressure of page data acquires；
Step 3 installs Collection agent end on the client, i.e., plug-in unit is installed on the browser of client, generates one
Collection agent end；
Step 4, the Collection agent end select the acquisition script issued on acquisition cloud to carry out installation subscription on demand；It is described
Acquiring in script includes version number, and after the acquisition script subscribed to carries out maintenance update, acquisition cloud acquires foot by comparing
This version number is by updated acquisition script automatic synchronization to each Collection agent end；The Collection agent end provides script and compiles
Device function is collected, user is checked the logic for acquiring script by the script-editor or repaired on demand to the acquisition script of subscription
Change；
Step 5, the Collection agent end parse acquisition script by browser, get the ginseng of the acquisition script
Number information, including acquisition script name, NameSpace, version number, script description information, scenarist, address matching rule and
Script logic code；
Step 6, when triggering collection instruction when, script defined in the parameter information for acquiring script is patrolled at Collection agent end
Code injection is collected into the page to be acquired, browser script logic code according to defined in acquisition script execute predetermined
Operation, realization data in the page are acquired.
Wherein, the mode that triggering collection instructs in the step 6 includes Auto-matching acquisition and reception acquisition tasks instruction
Acquire what two kinds of triggering modes were realized；
Auto-matching acquisition: when the page address that the browser at Collection agent end is accessed passes through regular expression rule
When being fitted on address matching rule set in the parameter information of acquisition script, the script logic code acquired in script will be automatic
It is injected into current page and triggers execution, start to acquire the data in the page；
It receives acquisition tasks instruction acquisition: acquisition tasks request being initiated by third party's operation system, acquires the task in cloud
After dispatch service receives acquisition tasks request, according to the registration order at Collection agent end successively by acquisition tasks request point
Hair is relayed to different Collection agent ends, when acquisition cloud, which receives Collection agent end, to be responded, then stops continuing distribution acquisition
Task requests were acquired after establishing connection between the WebSocket service of script and Collection agent end by current type, to acquisition generation
It manages end and sends acquisition instructions；Collection agent end will acquire script logic code defined in script according to the acquisition instructions received
It is injected into the page to be acquired, and after perform script logical code is acquired the data in the page, Collection agent end is again
The secondary WebSocket service by acquiring cloud carries out data exchange and gives the data back of acquisition to acquisition cloud, by acquisition
The task schedule service transfer in cloud returns to third party's operation system；Cloud is acquired to carry out by each Collection agent end of poll
Data acquisition stops if receiving after data response, otherwise continues to send acquisition instructions to next Collection agent end.
Step 7 stores the data of the collected page access in Collection agent end into WebSQL database, is convenient for data
Storage and arrangement；And all collected data are checked at Collection agent end, and data are exported in excel document,
There are two types of the data way of outputs: can directly be exported, can also be transmitted by the acquired cloud in Collection agent end by Collection agent end
Give third party's operation system.
A kind of computer equipment of the invention, including memory, processor and storage are on a memory and can be in processor
The computer program of upper operation, the processor perform the steps of when executing described program
Step 0, client are logged in primary rear browser and are remembered by Session and Cookie by browser login page
Recording system records the logging state and log-on message of the page；Since system login state has passed through Session machine after logging in
System is saved a series of demand that data acquisition so as to fast and stable is carried out from systems for needing login authentication,
That is not needing to carry out system authentication and authentication again there is no need to re-start login again during acquiring data, solve
It has determined system authentication and authentication problem, to improve the efficiency of data acquisition；
Step 1 carries out installation and deployment to acquisition cloud, and there is publication acquisition script subscription service, acquisition to appoint in acquisition cloud
Dispatch service of being engaged in and WebSocket service；
Publication by acquiring cloud acquires script subscription service publication acquisition script, installs and subscribes to for Collection agent end；
Acquisition tasks dispatch service is provided simultaneously, the relevant finger of the acquisition for coordinating transfer third party operation system and Collection agent end
Order and data；Connection of the WebSocket service for establishing between acquisition cloud and Collection agent end, and acquisition script are upper
It passes；
Step 2 acquires script, and the WebSocket service for passing through acquisition cloud for the page customization to be acquired exploitation
The acquisition script is sent to acquisition cloud, the hair of script is acquired by the publication acquisition script subscription service in acquisition cloud
Cloth；The acquisition script is published to acquisition cloud, subscribes to and download for Collection agent end, used by written in JavaScript
JavaScript language can play its manipulation ability to the page completely, pass through injection acquisition script to target pages, realization pair
The pressure of page data acquires；
Step 3 installs Collection agent end on the client, i.e., plug-in unit is installed on the browser of client, generates one
Collection agent end；
Step 4, the Collection agent end select the acquisition script issued on acquisition cloud to carry out installation subscription on demand；It is described
Acquiring in script includes version number, and after the acquisition script subscribed to carries out maintenance update, acquisition cloud acquires foot by comparing
This version number is by updated acquisition script automatic synchronization to each Collection agent end；The Collection agent end provides script and compiles
Device function is collected, user is checked the logic for acquiring script by the script-editor or repaired on demand to the acquisition script of subscription
Change；
Step 5, the Collection agent end parse acquisition script by browser, get the ginseng of the acquisition script
Number information, including acquisition script name, NameSpace, version number, script description information, scenarist, address matching rule and
Script logic code；
Step 6, when triggering collection instruction when, script defined in the parameter information for acquiring script is patrolled at Collection agent end
Code injection is collected into the page to be acquired, browser script logic code according to defined in acquisition script execute predetermined
Operation, realization data in the page are acquired.
Wherein, the mode that triggering collection instructs in the step 6 includes Auto-matching acquisition and reception acquisition tasks instruction
Acquire what two kinds of triggering modes were realized；
Auto-matching acquisition: when the page address that the browser at Collection agent end is accessed passes through regular expression rule
When being fitted on address matching rule set in the parameter information of acquisition script, the script logic code acquired in script will be automatic
It is injected into current page and triggers execution, start to acquire the data in the page；
It receives acquisition tasks instruction acquisition: acquisition tasks request being initiated by third party's operation system, acquires the task in cloud
After dispatch service receives acquisition tasks request, according to the registration order at Collection agent end successively by acquisition tasks request point
Hair is relayed to different Collection agent ends, when acquisition cloud, which receives Collection agent end, to be responded, then stops continuing distribution acquisition
Task requests were acquired after establishing connection between the WebSocket service of script and Collection agent end by current type, to acquisition generation
It manages end and sends acquisition instructions；Collection agent end will acquire script logic code defined in script according to the acquisition instructions received
It is injected into the page to be acquired, and after perform script logical code is acquired the data in the page, Collection agent end is again
The secondary WebSocket service by acquiring cloud carries out data exchange and gives the data back of acquisition to acquisition cloud, by acquisition
The task schedule service transfer in cloud returns to third party's operation system；Cloud is acquired to carry out by each Collection agent end of poll
Data acquisition stops if receiving after data response, otherwise continues to send acquisition instructions to next Collection agent end.
Step 7 stores the data of the collected page access in Collection agent end into WebSQL database, is convenient for data
Storage and arrangement；And all collected data are checked at Collection agent end, and data are exported in excel document,
There are two types of the data way of outputs: can directly be exported, can also be transmitted by the acquired cloud in Collection agent end by Collection agent end
Give third party's operation system.
In conclusion advantages of the present invention is as follows:
The method that a kind of pair of strong identity authentication system of the present invention carries out data acquisition, is adopted using on the browser of client
The mode for collecting data makes full use of Session and Cookie to record the principle of system login state, when user is known using fingerprint
Not, session information is had recorded by Cookie in browser end after recognition of face, ca authentication log in, user's operation then is not required to
System authentication and authentication are carried out again, solves the problems, such as system authentication and authentication, utilize the debugging energy of Chrome kernel browser
The principle of power combination browser end white-box testing, i.e., be injected into operation system by writing JavaScript script in browser end
Mode in the page realizes that system data is obtained there are temporarily storing in the WebSQL of browser, and then realizes export or pass through
Ajax is submitted to the acquisition mode that acquisition server-side is stored, due to being to be based on JavaScript script in browser to be adopted
Collection and system login state have passed through Session mechanism and saved so as to fast and stable to be needed to log in from a series of
The demand that data acquisition is carried out in the system of verifying replaces manual data duplication operation, working efficiency can be substantially improved.
Although specific embodiments of the present invention have been described above, those familiar with the art should be managed
Solution, we are merely exemplary described specific embodiment, rather than for the restriction to the scope of the present invention, it is familiar with this
The technical staff in field should be covered of the invention according to modification and variation equivalent made by spirit of the invention
In scope of the claimed protection.
Claims (10)
1. the method that a kind of pair of strong identity authentication system carries out data acquisition, characterized by the following steps:
Step 1 carries out installation and deployment to acquisition cloud；
Step 2 acquires script for the page customization to be acquired exploitation, and the acquisition script is sent to acquisition cloud, by adopting
The publication acquisition script subscription service in collection cloud is acquired the publication of script；
Step 3 installs Collection agent end on the client；
Step 4, the Collection agent end select the acquisition script issued on acquisition cloud to carry out installation subscription on demand；
Step 5, the Collection agent end parse acquisition script by browser, get the parameter letter of the acquisition script
Breath；
Step 6, when triggering collection instruction, Collection agent end is by script logic generation defined in the parameter information for acquiring script
Code is injected into the page to be acquired, and browser script logic code according to defined in acquisition script carries out executing scheduled behaviour
Make, realization is acquired data in the page.
2. the method that a kind of pair of strong identity authentication system according to claim 1 carries out data acquisition, it is characterised in that: institute
Stating the mode that triggering collection instructs in step 6 includes Auto-matching acquisition and reception two kinds of triggering modes of acquisition tasks instruction acquisition
It is realized；
Auto-matching acquisition: when the page address that the browser at Collection agent end is accessed is arrived by regular expression rule match
When acquiring address matching rule set in the parameter information of script, the script logic code acquired in script will be automatically injected
To current page and execution is triggered, starts to acquire the data in the page；
It receives acquisition tasks instruction acquisition: acquisition tasks request being initiated by third party's operation system, acquires the task schedule in cloud
It, successively will be in acquisition tasks request distribution according to the registration order at Collection agent end after service receives acquisition tasks request
Different Collection agent ends is gone to, when acquisition cloud, which receives Collection agent end, to be responded, then stops continuing to distribute acquisition tasks
Request is acquired after establishing connection between the WebSocket service of script and Collection agent end by current type, to Collection agent end
Send acquisition instructions；Collection agent end will acquire script logic code injection defined in script according to the acquisition instructions received
Into the page to be acquired, and after perform script logical code is acquired the data in the page, Collection agent end leads to again
The WebSocket service for crossing acquisition cloud carries out data exchange and gives the data back of acquisition to acquisition cloud, by acquiring cloud
Task schedule service transfer return to third party's operation system；It acquires cloud and data is carried out by each Collection agent end of poll
Acquisition stops if receiving after data response, otherwise continues to send acquisition instructions to next Collection agent end.
3. the method that a kind of pair of strong identity authentication system according to claim 1 carries out data acquisition, it is characterised in that: institute
After stating step 6 further include:
Step 7 stores the data of the collected page access in Collection agent end into WebSQL database, and in acquisition generation
All collected data are checked at reason end, and data are exported in excel document.
4. the method that a kind of pair of strong identity authentication system according to claim 1 carries out data acquisition, it is characterised in that: institute
State acquisition script parameter information include acquisition script name, NameSpace, version number, script description information, scenarist,
Location matching rule and script logic code；After the step 4 further include: when the acquisition script subscribed to carries out maintenance update
Afterwards, acquisition cloud is by comparing the version number of acquisition script by updated acquisition script automatic synchronization to each Collection agent
End；The Collection agent end provides script-editor function, user checked by the script-editor logic for acquiring script or
It modifies on demand to the acquisition script of subscription.
5. the method that a kind of pair of strong identity authentication system according to claim 1 carries out data acquisition, it is characterised in that: institute
Before stating step 1 further include: client by browser login page, log in it is primary after browser by Session and
Cookie record system records the logging state and log-on message of the page.
6. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor
Calculation machine program, which is characterized in that the processor performs the steps of when executing described program
Step 1 carries out installation and deployment to acquisition cloud；
Step 2 acquires script for the page customization to be acquired exploitation, and the acquisition script is sent to acquisition cloud, by adopting
The publication acquisition script subscription service in collection cloud is acquired the publication of script；
Step 3 installs Collection agent end on the client；
Step 4, the Collection agent end select the acquisition script issued on acquisition cloud to carry out installation subscription on demand；
Step 5, the Collection agent end parse acquisition script by browser, get the parameter letter of the acquisition script
Breath；
Step 6, when triggering collection instruction, Collection agent end is by script logic generation defined in the parameter information for acquiring script
Code is injected into the page to be acquired, and browser script logic code according to defined in acquisition script carries out executing scheduled behaviour
Make, realization is acquired data in the page.
7. according to right want 6 described in a kind of computer equipment, it is characterised in that: in the step 6 triggering collection instruct side
Formula includes that Auto-matching acquisition and reception two kinds of triggering modes of acquisition tasks instruction acquisition are realized；
Auto-matching acquisition: when the page address that the browser at Collection agent end is accessed is arrived by regular expression rule match
When acquiring address matching rule set in the parameter information of script, the script logic code acquired in script will be automatically injected
To current page and execution is triggered, starts to acquire the data in the page；
It receives acquisition tasks instruction acquisition: acquisition tasks request being initiated by third party's operation system, acquires the task schedule in cloud
It, successively will be in acquisition tasks request distribution according to the registration order at Collection agent end after service receives acquisition tasks request
Different Collection agent ends is gone to, when acquisition cloud, which receives Collection agent end, to be responded, then stops continuing to distribute acquisition tasks
Request is acquired after establishing connection between the WebSocket service of script and Collection agent end by current type, to Collection agent end
Send acquisition instructions；Collection agent end will acquire script logic code injection defined in script according to the acquisition instructions received
Into the page to be acquired, and after perform script logical code is acquired the data in the page, Collection agent end leads to again
The WebSocket service for crossing acquisition cloud carries out data exchange and gives the data back of acquisition to acquisition cloud, by acquiring cloud
Task schedule service transfer return to third party's operation system；It acquires cloud and data is carried out by each Collection agent end of poll
Acquisition stops if receiving after data response, otherwise continues to send acquisition instructions to next Collection agent end.
8. a kind of computer equipment according to claim 6, it is characterised in that: after the step 6 further include:
Step 7 stores the data of the collected page access in Collection agent end into WebSQL database, and in acquisition generation
All collected data are checked at reason end, and data are exported in excel document.
9. a kind of computer equipment according to claim 6, it is characterised in that: it is described acquisition script parameter information include
Acquire script name, NameSpace, version number, script description information, scenarist, address matching rule and script logic generation
Code；After the step 4 further include: after the acquisition script subscribed to carries out maintenance update, acquisition cloud is by comparing acquisition
The version number of script is by updated acquisition script automatic synchronization to each Collection agent end；The Collection agent end provides script
Editing machine function, user are checked the logic for acquiring script by the script-editor or repaired on demand to the acquisition script of subscription
Change.
10. a kind of computer equipment according to claim 6, it is characterised in that: before the step 1 further include: client
End is by browser login page, and browser records system by Session and Cookie and records the page after logging in once
Logging state and log-on message.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910134993.4A CN109743233A (en) | 2019-02-19 | 2019-02-19 | A kind of pair of strong identity authentication system carries out the method and computer equipment of data acquisition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910134993.4A CN109743233A (en) | 2019-02-19 | 2019-02-19 | A kind of pair of strong identity authentication system carries out the method and computer equipment of data acquisition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109743233A true CN109743233A (en) | 2019-05-10 |
Family
ID=66368139
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910134993.4A Pending CN109743233A (en) | 2019-02-19 | 2019-02-19 | A kind of pair of strong identity authentication system carries out the method and computer equipment of data acquisition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109743233A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110099132A (en) * | 2019-05-21 | 2019-08-06 | 逍牛网络科技(上海)有限公司 | A kind of method of data synchronization, device, system, equipment and storage medium |
| CN112804201A (en) * | 2020-12-30 | 2021-05-14 | 绿盟科技集团股份有限公司 | Method and device for acquiring equipment information |
| CN113810591A (en) * | 2020-06-15 | 2021-12-17 | 蘑菇车联信息科技有限公司 | High-precision map operating system and cloud platform |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106897357A (en) * | 2017-01-04 | 2017-06-27 | 北京京拍档科技股份有限公司 | A kind of method for crawling the network information for band checking distributed intelligence |
| CN107483591A (en) * | 2017-08-22 | 2017-12-15 | 中国银行股份有限公司 | A kind of script file synchronous method and device |
| US10108432B1 (en) * | 2009-04-16 | 2018-10-23 | Intuit Inc. | Generating a script based on user actions |
| CN108932285A (en) * | 2018-05-22 | 2018-12-04 | 北京工业大学 | A kind of data grab method and system based on browser extension |
-
2019
- 2019-02-19 CN CN201910134993.4A patent/CN109743233A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10108432B1 (en) * | 2009-04-16 | 2018-10-23 | Intuit Inc. | Generating a script based on user actions |
| CN106897357A (en) * | 2017-01-04 | 2017-06-27 | 北京京拍档科技股份有限公司 | A kind of method for crawling the network information for band checking distributed intelligence |
| CN107483591A (en) * | 2017-08-22 | 2017-12-15 | 中国银行股份有限公司 | A kind of script file synchronous method and device |
| CN108932285A (en) * | 2018-05-22 | 2018-12-04 | 北京工业大学 | A kind of data grab method and system based on browser extension |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110099132A (en) * | 2019-05-21 | 2019-08-06 | 逍牛网络科技(上海)有限公司 | A kind of method of data synchronization, device, system, equipment and storage medium |
| CN110099132B (en) * | 2019-05-21 | 2022-05-17 | 逍牛网络科技(上海)有限公司 | Data synchronization method, device, system, equipment and storage medium |
| CN113810591A (en) * | 2020-06-15 | 2021-12-17 | 蘑菇车联信息科技有限公司 | High-precision map operating system and cloud platform |
| CN113810591B (en) * | 2020-06-15 | 2023-11-21 | 蘑菇车联信息科技有限公司 | High-precision map operation system and cloud platform |
| CN112804201A (en) * | 2020-12-30 | 2021-05-14 | 绿盟科技集团股份有限公司 | Method and device for acquiring equipment information |
| CN112804201B (en) * | 2020-12-30 | 2023-04-28 | 绿盟科技集团股份有限公司 | Method and device for acquiring equipment information |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110309071B (en) | Test code generation method and module, and test method and system | |
| CN107370786B (en) | General information management system based on micro-service architecture | |
| US9419884B1 (en) | Intelligent automated testing method for restful web services | |
| US11176030B2 (en) | Conducting automated software testing using centralized controller and distributed test host servers | |
| US20190065351A1 (en) | System and method for providing a test manager for use with a mainframe rehosting platform | |
| CN104639653A (en) | Self-adaptive method and system based on cloud architecture | |
| US10223248B2 (en) | Conducting automated software testing using centralized controller and distributed test host servers | |
| CN109743233A (en) | A kind of pair of strong identity authentication system carries out the method and computer equipment of data acquisition | |
| CN103729294A (en) | Method and device for testing performance script of application software | |
| Wang et al. | A model-based framework for cloud API testing | |
| CN107704369A (en) | A kind of recording method of Operation Log, electronic equipment, storage medium, system | |
| CN107003931A (en) | Test checking is separated from test execution | |
| CN113722020A (en) | Interface calling method, device and computer readable storage medium | |
| Wang et al. | Automated test case generation for the Paxos single-decree protocol using a Coloured Petri Net model | |
| CN102486749A (en) | Method and system for data driving test | |
| US20150193405A1 (en) | Enhanced testing for application services | |
| US11341022B2 (en) | Runtime performance introspection | |
| CN114003916A (en) | Method, system, terminal and storage medium for testing WEB role longitudinal override vulnerability | |
| Okola et al. | Unit testing for wireless sensor networks | |
| CN112433953A (en) | Embedded automatic testing method, device, equipment and medium based on network game client | |
| CN116212398B (en) | Game management method, device, equipment and medium based on data center | |
| US20220244975A1 (en) | Method and system for generating natural language content from recordings of actions performed to execute workflows in an application | |
| Liu et al. | Autonomic self-testing of regression and internationalization based on cloud computing | |
| Smirnova et al. | Load Testing of Vaadin Flow applications | |
| Hirschfeld et al. | Cloud‐based simulation studies in R‐A tutorial on using doRedis with Amazon spot fleets |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190510 |