CN102841789B - A kind of method and apparatus of recording with playback that user in browser is operated - Google Patents
A kind of method and apparatus of recording with playback that user in browser is operated Download PDFInfo
- Publication number
- CN102841789B CN102841789B CN201210227233.6A CN201210227233A CN102841789B CN 102841789 B CN102841789 B CN 102841789B CN 201210227233 A CN201210227233 A CN 201210227233A CN 102841789 B CN102841789 B CN 102841789B
- Authority
- CN
- China
- Prior art keywords
- information
- browser
- mouse
- keyboard
- configuration information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 230000009471 action Effects 0.000 claims abstract description 40
- 238000012544 monitoring process Methods 0.000 claims description 5
- 238000004321 preservation Methods 0.000 claims description 5
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 238000007689 inspection Methods 0.000 claims description 2
- 238000011017 operating method Methods 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 43
- 230000008569 process Effects 0.000 description 10
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 description 7
- 230000006399 behavior Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 229910052709 silver Inorganic materials 0.000 description 7
- 239000004332 silver Substances 0.000 description 7
- 238000004590 computer program Methods 0.000 description 5
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 230000005611 electricity Effects 0.000 description 3
- 238000012856 packing Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000000977 initiatory effect Effects 0.000 description 2
- 241000931705 Cicada Species 0.000 description 1
- 238000009835 boiling Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- QSHDDOUJBYECFT-UHFFFAOYSA-N mercury Chemical compound [Hg] QSHDDOUJBYECFT-UHFFFAOYSA-N 0.000 description 1
- 229910052753 mercury Inorganic materials 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a kind of method and apparatus of recording with playback that user in browser is operated, method wherein, comprising: start recording user's operation; Preserve the configuration information of current browser; Gather operation information when keyboard operation, and/or operation information when mouse action, generating run record; Converting the configuration information of described browser and operation note to single operation program block preserves. The present invention can be in order to the accurate complete operating procedure of recording the program that user uses, and can playback. Improve stability and the reliability recorded with replayed section, simplify user's operation; And function can be integrated in browser easily.
Description
Technical field
The present invention relates to the technical field of program intelligent operation, particularly relate to a kind of in browserUser operation record and the method for playback, and, a kind of to the user's operation in browserRecord the device with playback.
Background technology
Computer applications is now more and more extensive, and many things can solve by network, butBe for some old men or special population (as the disabled), complicated computation makes them more nextMore unable to do what one wishes. Therefore, need to facilitate by some program intelligent operations. As: canA procedure operation is recorded, generate a shortcut, can be only when need to be used next timeClick shortcut, system will complete described procedure operation automatically.
More existing technical solutions are: QuickTestProfessional(is called for short QTP) beA kind of automatic testing instrument of Mercury company exploitation, in the time that user operates, QTP recordsMechanism can be got off each operating procedure of user and operated object record, automatically generatesTest script statement is for user's playback operation at any time. QTP provides 3 kinds to record mode: normally recordSystem (NormalRecording), analogue recording (AnalogRecording), the rudimentary (Low that recordsLevelRecording）。
But there is the place of a lot of deficiencies in the mode of recording of QTP.
1, normal recording mode is the directly operation to standard control, to non-standard control None-identified;
2, analogue recording pattern is track and the button operation of analog mouse, keyboard, and there have to be much invalidOperation, and in the time that window coordinates move, be easy to maloperation;
3, rudimentary recording mode is that all objects are identified as to WinObject, to status requirement moreStrictly can not moving window, while recording, need to set x/y coordinate, process is too complicated.
And QTP software too huge (hundreds of MB), is program independently, can not easily collectBecome in browser.
Therefore, those skilled in the art's problem in the urgent need to address is: provide a kind of to browserIn user operation record and the method and apparatus of playback, record user in order to accurately completeThe operating procedure of the program using, and can playback. Improve record with the stability of replayed section andReliability, simplifies user's operation; And function can be integrated in browser easily.
Summary of the invention
Technical problem to be solved by this invention is to provide a kind of user's operation in browser and carries outRecord and the method for playback, in order to the accurate complete operating procedure of recording the program that user uses,And can playback. Improve stability and the reliability recorded with replayed section, simplify user's operation;And function can be integrated in browser easily.
Accordingly, the present invention also provides a kind of user's operation in browser to record and returnThe device of putting, in order to ensure said method application in practice.
In order to address the above problem, to the invention discloses a kind of user's operation in browser and carry outThe method of recording, is characterized in that, comprising:
Start recording user's operation;
Preserve the configuration information of current browser;
Gather operation information when keyboard operation, and/or operation information when mouse action, behaviour generatedNote down;
Converting the configuration information of described browser and operation note to single operation program block protectsDeposit.
Preferably, the step of the configuration information of the current browser of described preservation can comprise:
Preserve window size and the positional information of current browser;
Preserve the configuration information on interface tool hurdle, status bar and collection hurdle.
Preferably, operation information when described collection keyboard operation, and/or behaviour when mouse actionMake message, the step of generating run record can comprise:
Gather typing operation and the handover operation of keyboard;
And/or moving event and the click event of collection mouse;
Obtain typing operation and the handover operation of described keyboard, and/or the moving event of mouse and clickWhen event, be kept at the lParam parameter of HookProc function;
Generate should keyboard and/or the operation note of mouse action according to this lParam parameter information.
Preferably, the typing operation of described collection keyboard and the step of handover operation can be furtherComprise:
Start the text edit tool, log-on message is inputed to text edit tool;
The log-on message of the text formatting of this input is encrypted, and be written in described lParam.
Preferably, the moving event of described collection mouse and click event can comprise:
Moving event and the click event of monitoring mouse, after moving event triggers, obtain current mouseTarget coordinate and color;
In the time there is mouse click event, moving event is preserved before coordinate and color are saved inClick in color parameter clickcolor.
Preferably, describedly convert the configuration information of described browser and operation note to single behaviourThe step of preserving as program block can comprise:
When each described record operation is carried out in preservation corresponding browser window size and positional information withAnd the configuration information on interface tool hurdle, status bar and collection hurdle;
The configuration information of described browser and operation note are kept in same operation sequence piece, doFor single operation program block is preserved.
Preferably, described method, may further include:
Analyze the lParam parameter information in the operation note generating;
The time interval of deleting described mouse moving event is lower than the behaviour of preset ineffective time of threshold valueDo;
By the time interval before described keyboard operation, be revised as the preset time;
By typing operation and the handover operation of described keyboard, and/or the moving event of mouse and click thingPart records generating run record according to the order of sequence.
Preferably, described preset threshold value ineffective time can be 20 milliseconds, described when presetBetween can be 5 milliseconds.
Preferably, described startup recording step and can comprise user operation:
Shortcut or the shortcut of preset recording operation are set;
Click and start this shortcut or shortcut.
Preferably, described method, may further include:
Click described preset shortcut or shortcut and finish recording operation;
In the operation sequence piece generating, delete the preset shortcut of click or shortcut and finish recordThe operation note of system.
The invention also discloses a kind of operation sequence piece based on record described in claim 1 to clearThe register of looking in device carries out the method for playback, specifically can comprise:
Load the browser configuration information in described single operation program block;
Read described operation note, the operation information while being reduced to keyboard operation, and/or mouse actionTime operation information;
Operation information during according to described keyboard operation, and/or operation information when mouse action is clearLook at device target location carry out respective operations.
Preferably, described method, can also comprise:
By the DocumentComplete function of WebBrowser, judge that described operation playback isNoly normally complete;
If so, finishing described operation records and playback program;
If not, point out user again to record.
Preferably, the described step that judges whether described operation playback normally completes can be furtherComprise:
Check whether loaded of described current browser configuration information;
Check whether the operation information in described operation note returns complete.
Preferably, described read operation record, the operation information while being reduced to keyboard operation, and/Or the step of operation information when mouse action can comprise:
Described operation note is turned back to the position of the sensing of lParam;
Resolve the operation note of the position that described lParam points to, and while being reduced to keyboard operationOperation information, and/or operation information when mouse action.
Preferably, the step of the browser configuration information in the described single operation program block of described loadingSuddenly can comprise:
Resolve the browser configuration information in described single operation program block;
Obtain window size and the positional information of operation in each operation note browser while carrying out,And the configuration information on interface tool hurdle, status bar and collection hurdle.
Preferably, described operation information during according to keyboard operation, and/or behaviour when mouse actionMaking message can comprise in the step of browser target location execution respective operations:
By calling the message playback function of PlayProc, the operation while resolving described keyboard operation disappearsBreath, and/or operation information when mouse action;
Obtain in order typing operation and the handover operation of described keyboard, and/or the moving event of mouseAnd click event;
The window size of browser and position letter while carrying out according to the operation in the operation note of obtainingBreath, and the configuration information on interface tool hurdle, status bar and collection hurdle, carry out accordingly in orderTyping operation and the handover operation of described keyboard, and/or the moving event of mouse and click event.
Preferably, described operation information during according to mouse action is carried out in browser target locationThe step of respective operations can comprise:
When mouse moves to behind target location, obtain the color value of target location, contrast operation's journeyThe click color parameter clickcolor that order piece is preserved, if equated, carries out in this target locationCorresponding mouse action record.
The present invention discloses a kind of device of recording, tool that user in browser is operatedBody can comprise:
Record start unit, it is configured to start recording user's operation;
Configuration information storage unit, it is configured to preserve the configuration information of current browser;
Operation note generation module, operation information when it is configured to gather keyboard operation, and/or mouseOperation information when mark operation, generating run record;
Operation sequence piece is preserved module, and it is configured to the configuration information of described browser and operation noteRecord converts single operation program block to and preserves.
Preferably, described configuration information storage unit can comprise:
Spatial information is preserved submodule, and it is configured to preserve window size and the position of current browserInformation;
Function information is preserved submodule, and it is configured to preserve interface tool hurdle, status bar and collection hurdleConfiguration information.
Preferably, described operation note generation module can comprise:
Keyboard operation gathers submodule, and it is configured to gather typing operation and the handover operation of keyboard;
Mouse event gathers submodule, and it is configured to gather moving event and the click event of mouse;
Operation and event are preserved submodule, and it is configured to obtain the typing operation of described keyboard and switchOperation, and/or be kept at the lParam of HookProc function when the moving event of mouse and click eventParameter;
Operation note generates submodule, and it is configured to generate should according to this lParam parameter informationThe operation note of keyboard and/or mouse action.
Preferably, described operation sequence piece preservation module can comprise:
Configuration information is preserved submodule, and it is configured to preserve correspondence while carrying out each described record operationBrowser window size and the setting on positional information and interface tool hurdle, status bar and collection hurdleInformation;
Program block is preserved submodule, and it is configured to the configuration information of described browser and operation noteBe kept in same operation sequence piece, preserve as single operation program block.
Preferably, described device, may further include:
Submodule is analyzed in operation note, and it is configured to analyze the lParam in the operation note generatingParameter information;
Invalid operation is deleted submodule, and it is configured to delete the time interval of described mouse moving eventLower than the operation of preset ineffective time of threshold value;
Time interval amendment submodule, it was configured to the time interval before described keyboard operation,Be revised as the preset time;
By typing operation and the handover operation of described keyboard, and/or the moving event of mouse and click thingPart records generating run record according to the order of sequence.
The invention also discloses a kind of operation sequence piece based on record described in claim 18 to clearThe register of looking in device carries out the device of playback, specifically can comprise:
Configuration information load-on module, it is configured to load the browser in described single operation program blockConfiguration information;
Operation note read module, it is configured to read described operation note, is reduced to keyboard operationTime operation information, and/or operation information when mouse action;
Respective operations Executive Module, operation information when it is configured to according to described keyboard operation, and/Or operation information when mouse action is carried out respective operations in browser target location.
Preferably, described device, can also comprise:
Playback operation judge module, it is configured to the DocumentComplete by WebBrowserFunction, judges whether described operation playback normally completes;
EP (end of program) module, it is configured to finish described operation and records and playback program;
The reminding module processed of rerecording, it is configured to point out user again to record.
Preferably, described playback operation judge module can comprise:
Environment arranges inspection submodule, and it is configured to check whether the setting of described current system environment addsCarry complete;
Operation information checks submodule, and it is configured to check that the operation information in described operation note isNo return complete.
Compared with prior art, the present invention has the following advantages:
The present invention is recorded and is recorded subprogram with playback program generating messages and message is returned by configuration operationPut subprogram. Operation information while operation by message recording subprogram collection key mouse, generating run noteRecord; Convert corresponding one group of operation note packing to single operation program block. Click single operationProgram block, message playback subprogram starts, and the operation information in described operation note is turned back toIn the region that lParam points to; System is carried out the key mouse operation that described operation information is corresponding, and it is right to completeAnswer the playback of key mouse operation in single operation program block.
And, by the message recording function of HookProc function as record operation is set, generateMessage recording subprogram; The memory location corresponding to lParam of HookProc function is set, generates notePosition is preserved in record operation; The message playback function of PlayProc as record operation is set, and generation disappearsBreath playback subprogram. Facilitate like this operation to record with playback program integrated in browser.
Brief description of the drawings
Fig. 1 is a kind of embodiment of the method for recording that user in browser is operated of the present inventionFlow chart;
To be that the present invention is a kind of operate in the embodiment of the method for recording the user in browser Fig. 2The sub-step flow chart of step 101;
To be that the present invention is a kind of operate in the embodiment of the method for recording the user in browser Fig. 3The sub-step flow chart of step 102;
To be that the present invention is a kind of operate in the embodiment of the method for recording the user in browser Fig. 4The sub-step flow chart of step 103;
To be that the present invention is a kind of operate in the embodiment of the method for recording the user in browser Fig. 5The sub-step flow chart of step 104;
Fig. 6 is that a kind of operation sequence piece based on record of the present invention enters the register in browserThe flow chart of the embodiment of the method for row playback;
Fig. 7 is that a kind of operation sequence piece based on record of the present invention enters the register in browserThe sub-step flow chart of step 201 in the embodiment of the method for row playback;
Fig. 8 is that a kind of operation sequence piece based on record of the present invention enters the register in browserThe sub-step flow chart of step 202 in the embodiment of the method for row playback;
Fig. 9 is that a kind of operation sequence piece based on record of the present invention enters the register in browserThe sub-step flow chart of step 203 in the embodiment of the method for row playback;
Figure 10 is that a kind of operation sequence piece based on record of the present invention enters the register in browserThe sub-step flow chart of step 204 in the embodiment of the method for row playback;
Figure 11 is a kind of device embodiment recording that user in browser is operated of the present inventionStructured flowchart;
To be that the present invention is a kind of operate in the device embodiment recording the user in browser Figure 12Record the sub modular structure block diagram of generation module 303;
To be that the present invention is a kind of operate in the device embodiment recording the user in browser Figure 13Operation sequence piece is preserved the sub modular structure block diagram of module 304;
Figure 14 is that a kind of operation sequence piece based on record of the present invention enters the register in browserThe structured flowchart of the device embodiment of row playback.
Detailed description of the invention
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, below in conjunction withThe present invention is further detailed explanation for the drawings and specific embodiments.
One of core idea of the embodiment of the present invention is, records and playback program by configuration operationGenerating messages is recorded subprogram and message playback subprogram. Gathering key mouse by message recording subprogram graspsOperation information while work, generating run record; Convert corresponding one group of operation note packing to listInferior operation sequence piece. Click single operation program block, message playback subprogram starts, by described behaviourThe operation information of noting down turns back in the region of lParam sensing; System is carried out described operation and is disappearedCease corresponding key mouse operation, complete the playback of key mouse operation in corresponding single operation program block.
And, by the message recording function of HookProc function as record operation is set, generateMessage recording subprogram; The memory location corresponding to lParam of HookProc function is set, generates notePosition is preserved in record operation; The message playback function of PlayProc as record operation is set, and generation disappearsBreath playback subprogram. Facilitate like this operation to record with playback program integrated in browser.
With reference to Fig. 1, show a kind of embodiment of the method for recording that user in browser is operatedFlow chart, specifically can comprise the following steps:
Step 101, startup being recorded user's operation;
In a preferred embodiment of the present invention, described step 101 specifically can comprise following sonStep:
Sub-step S01, the shortcut that preset recording operation is set or shortcut;
Sub-step S02, click start this shortcut or shortcut.
Sub-step S03, click described preset shortcut or shortcut finishes recording operation;
Sub-step S04, in the operation sequence piece generating, delete and click preset shortcut or fastThe operation note that prompt bond bundle is recorded.
Step 102, preserve the configuration information of current browser;
In a preferred embodiment of the present invention, described step 102 specifically can comprise following sonStep:
Sub-step S11, the window size of preserving current browser and positional information;
Sub-step S12, the configuration information of preserving interface tool hurdle, status bar and collection hurdle.
In specific implementation, the window size of browser and position, and instrument in browser interfaceThe configuration information on hurdle, status bar and collection hurdle can affect record with replayed section in the coordinate of mouseThe accuracy of position, thus window size and the position of browser in the time recording with playback, will be ensured,And the uniformity of the configuration information on toolbar, status bar and collection hurdle in browser interface.
In specific implementation, preserve current system configuration information and can comprise the Windows system of preservingConfiguration information and preserve the configuration information of current browser.
As: 360 very fast browsers are example, Preferences file record window size and position,Whether the information such as hurdle, status bar are collected in startup.
Step 103, gather operation information when keyboard operation, and/or operation when mouse action disappearsBreath, generating run record;
In a preferred embodiment of the present invention, described step 103 specifically can comprise following sonStep:
Typing operation and the handover operation of sub-step S21, collection keyboard;
In a preferred embodiment of the present invention, described sub-step S21 specifically can comprise followingUnit:
Start the text edit tool, log-on message is inputed to text edit tool;
The log-on message of the text formatting of this input is encrypted, and be written in described lParam.
In specific implementation, can adopt and record function and record operation information, as:
SetWindowsHookEx(idHook：WH_JOURNALRECORD；lpfn：HookProc; Hmod:HInstance; DwThreadId:0) WH_JOURNALRECORD whereinBe the call method of " recording ", HookProc is the Message function of record operation, whenever there being mouse buttonWhen dish message occurs, system all can be called this function, and information is just kept at HookProc functionLParam in, the information in lParam can generate current operation record.
Moving event and the click event of sub-step S22 and/or collection mouse;
In a preferred embodiment of the present invention, described sub-step S22 specifically can comprise followingUnit:
Moving event and the click event of monitoring mouse, after moving event triggers, obtain current mouseTarget coordinate and color;
In the time there is mouse click event, moving event is preserved before coordinate and color are saved inClick in color parameter clickcolor.
In specific implementation, the operation of preserving mouse color judging point can be:
The moving event of monitoring mouse and click event are (with SetWindowsHookEx'sWH_MOUSE method is hung overall hook), after moving event triggers, obtain the seat of current mouseMark and color. In the time there is mouse click event, moving event is preserved before coordinate and colorBe saved in clickcolor.
Sub-step S23, obtain typing operation and the handover operation of described keyboard, and/or the moving of mouseWhen moving event and click event, be kept at the lParam parameter of HookProc function;
Sub-step S24, generate should keyboard and/or mouse action according to this lParam parameter informationOperation note.
In specific implementation, Windows provides api function SetwindowsHookEx to set up oneIndividual Hook, can be added to a program in Hook chain and monitor by this functionWindows messaging, function grammer is: SetWindowsHookEx (idHook:Integer; Lpfn:TFNHookProc; Hmod:HINST; DwThreadId:DWORD) parameter idHook whereinSpecify the supervision type function of setting up. WH_JOURNALRECORD andWH_JOURNALPLAYBACK is that it is configured to monitor and playback keyboard, mouse action.
In specific implementation, in Windows system, document (Document) is to liking WindowsA part for object, can conduct interviews to it by window.document attribute. Each yearEnter the HTML(HTML of browser, HypertextMarkupLanguage) literary compositionShelves all can become Document object. Utilization Document object can be right from scriptAll elements in html page conducts interviews, such as: click click (), search and specify id'sUser's operations such as element getElementById (). It is configured to operation to record and playback program collectionBecome in browser.
In specific implementation, in the time that needs are inputted bank account, password, press [*] key and openNotepad program, in notepad, and uses code analysis text message user name Password InputMode be interpreted as code language, be integrated in the function lParam recording. Closing notepad continuesContinuous Net silver operation. So just can the operation such as the Net silver generating run record of password and certification will be related to.
In a preferred embodiment of the present invention, described step 103 further can comprise followingSub-step:
LParam parameter information in the operation note that sub-step S25, analysis generate;
Sub-step S26, delete described mouse moving event the time interval lower than preset ineffective timeThe operation of threshold value;
Sub-step S27, by the time interval before described keyboard operation, be revised as the preset time;
Sub-step S28, by typing operation and the handover operation of described keyboard, and/or the movement of mouseEvent and click event record generating run record according to the order of sequence.
In a preferred embodiment of the present invention, described preset threshold value ineffective time can be 20Millisecond, the described preset time can be 5 milliseconds.
In specific implementation, analysis operation record before packing. When the time interval of mouse moving eventFor within 20ms (millisecond) time, can delete waiting time and mouse before it movesMoving event. Object is to delete invalid mouse move operation, allows playback carry out faster. Work as keyboard, can revise the stand-by period is 5ms when at the before free interval of operation; The interval of stand-by periodCan need to set according to client, but for fear of the situation that occurs the machine of delaying and card, minimum settingMay be controlled to 5ms.
Step 104, convert the configuration information of described browser and operation note to single operation programPiece is preserved.
In a preferred embodiment of the present invention, described step 104 specifically can comprise following sonStep:
Sub-step S31, preserve browser window size corresponding while carrying out each described record operation andThe configuration information on positional information and interface tool hurdle, status bar and collection hurdle;
Sub-step S32, the configuration information of described browser and operation note are kept to same operation journeyIn order piece, preserve as single operation program block.
In specific implementation, after end is recorded, can delete the operation of last clickable icon.The operation being integrated in browser is recorded with playback program and can be realized by the form of plug-in unit, can be clearLook on device and show an icon. Starting and stopping message recording subprogram all needs clickable iconBecome, the clicking operation that therefore finishes to record is not user's valid function, so delete.
In specific implementation, one step completed operation note can be generated to corresponding operation sequence piece.In order to facilitate client to use, operation sequence piece can be generated to shortcut at desktop or file,User clicks the operation note of shortcut in both can playback operation program block.
With reference to Fig. 6, show a kind of operation sequence piece based on record to the register in browserCarry out the flow chart of the embodiment of the method for playback, specifically can comprise the following steps:
Step 201, load the browser configuration information in described single operation program block;
In a preferred embodiment of the present invention, described step 201 specifically can comprise following sonStep:
Sub-step S41, resolve the browser configuration information in described single operation program block;
Sub-step S42, obtain operation in each operation note browser while carrying out window size andPositional information, and the configuration information on interface tool hurdle, status bar and collection hurdle.
Step 202, read described operation note, the operation information while being reduced to keyboard operation, and/Or operation information when mouse action;
In a preferred embodiment of the present invention, described step 202 specifically can comprise following sonStep:
Sub-step S51, described operation note is turned back to the position of the sensing of lParam;
Sub-step S52, resolve the operation note of the position that described lParam points to, and be reduced toOperation information when keyboard operation, and/or operation information when mouse action.
Step 203, operation information during according to described keyboard operation, and/or behaviour when mouse actionMake message and carry out respective operations in browser target location;
In a preferred embodiment of the present invention, described step 203 specifically can comprise following sonStep:
Sub-step S61, by calling the message playback function of PlayProc, resolve described keyboard operationTime operation information, and/or operation information when mouse action;
Sub-step S62, obtain in order typing operation and the handover operation of described keyboard and/or mouseTarget moving event and click event;
The window size of browser when operation in sub-step S63, the foundation operation note of obtaining is carried outAnd positional information, and the configuration information on interface tool hurdle, status bar and collection hurdle, press accordinglyOrder is carried out typing operation and the handover operation of described keyboard, and/or the moving event of mouse and clickEvent;
Sub-step S64, when mouse moves to behind target location, obtain the color value of target location,The click color parameter clickcolor that contrast operation's program block is preserved, if equated, in this targetCorresponding mouse action record is carried out in position.
In specific implementation, system environments setting can comprise the configuration of every element of recording processInformation. Wherein, for the method that judges whether element has represented, can be by operation information and to recordWhether the configuration information of the correspondence position generating at operation information in process processed is identical.
As: when mouse moves to behind target location, obtain the color of mouse, the insertion before contrastColor clickcolor. If equated, illustrate that action required element can click. If mouse, in the region of browser, need not judge.
Taking certain browser as example, judge that mouse is whether in browser page:
Enumerate all windows, the handle of preserving class InternetExplorer_Server by name arrivesMainHwnd。
Then obtain the coordinate of the page with GetWindowRect function.
Step 204, by the DocumentComplete function of WebBrowser, described in judgementWhether operation playback normally completes; If so, finishing described operation records and playback program; If not,Point out user again to record.
In specific implementation, whether the page that can carry out by operation information has loaded judgesWhether operation information is carried out smoothly. As: the DocumentComplete of use WebBrowser canJudge whether the page has loaded.
In a preferred embodiment of the present invention, described step 204 specifically can comprise following sonStep:
Sub-step S71, check whether loaded of described current browser configuration information;
Sub-step S72, check whether the operation information in described operation note returns complete.
In specific implementation, playback operation record can opening operation be recorded and playback program, selectsPlayback operation; Also can click corresponding single operation program block, directly the sub-journey of initiation message playbackOrder.
The method of playback mouse key operation can be:
SetWindowsHookEx(idHook：WH_JOURNALPLAYBACK；lpfn：PlayProc；hmod：HInstance；dwThreadId：0)
Wherein WH_JOURNALPLAYBACK is the call method of " playback ", and PlayProc isMessage playback function, can call this function when executable operations message playback when system, and program just willThe operation information value of precedence record turns back in the region of lParam sensing, and system will be carried out this behaviourMake message, thereby realized playback.
In order to facilitate those skilled in the art to understand better the present invention, below by complete showingExample illustrates further the present invention:
1, in certain browser, operate by api function SetwindowsHookEx foundation recordMessage recording function, generating messages is recorded subprogram. And by the bank bit corresponding lParam of functionPut the operation as record and preserve position. Utilize PlayProc to set up the message playback function of record operation,Generating messages playback subprogram.
2, open certain browser, start described operation and record and playback program, prepare to hand over water powerOperation records. First preserve the configuration information of current browser.
3, can hang overall hook monitoring by the WH_MOUSE method of SetWindowsHookExThe moving event of mouse and click event, after moving event triggers, obtain the coordinate of current mouseAnd color. In the time there is mouse click event, moving event is preserved before coordinate and color are protectedDeposit in clickcolor. Can obtain with HookProc Message function the clicking operation of mouse simultaneouslyBe kept in the lParam of HookProc function with the operation information of keyboard move operation, generate currentOperation note.
4,, when needs proceed to the Net silver page, when input Bank Account Number and password, open notepadProgram, user name Password Input in notepad, and by the mode solution of code analysis text messageBe interpreted as code language, be integrated in the function lParam recording. The Net silver of password and certification will be related toDeng operation generating run record.
5, after the operation of handing over water power is all completed, arrange the operation of the lParam that is recorded in functionRecord, deletes the operation note of last clickable icon, converts other operation notes to operationMessage value, is packaged as the operation sequence piece that charges for water and electricity Net silver is submitted to according to the order of sequence. Generate corresponding at desktopShortcut.
6, click the corresponding shortcut that desktop generates, the operation journey that the electricity charge Net silver of fetching boiling water is submitted toOrder piece. Initiation message playback subprogram, can load; Can be message playback by PlayProcFunction, turns back to the operation information value of prior operation record in the region of lParam sensing systemWill carry out corresponding operation information. Load corresponding browser configuration according to corresponding operation informationInformation and the corresponding page.
7, find that corresponding browser configuration information and the corresponding page cannot load, to useFamily sends information; Inform partial page, browser in the operation that user's charges for water and electricity Net silver submits toConfiguration waits element to occur change, need to again record corresponding complete operation.
It should be noted that, for embodiment of the method, for simple description, therefore it is all expressed asA series of combination of actions, but those skilled in the art should know, the present invention be not subject to retouchThe restriction of the sequence of movement of stating because according to the present invention, some step can adopt other order orPerson carries out simultaneously. Secondly, those skilled in the art also should know, the reality described in descriptionExecute example and all belong to preferred embodiment, related action might not be that the present invention is necessary.
With reference to Figure 11, show a kind of device enforcement of recording that user in browser is operatedThe structured flowchart of example, specifically can comprise:
Record start unit 301, it is configured to start recording user's operation;
Configuration information storage unit 302, it is configured to preserve the configuration information of current browser;
In a preferred embodiment of the present invention, described configuration information storage unit 302 specifically canTo comprise following submodule:
Spatial information is preserved submodule, and it is configured to preserve window size and the position of current browserInformation;
Function information is preserved submodule, and it is configured to preserve interface tool hurdle, status bar and collection hurdleConfiguration information.
Operation note generation module 303, operation information when it is configured to gather keyboard operation, and/Or operation information when mouse action, generating run record;
In a preferred embodiment of the present invention, described operation note generation module 303 specifically canTo comprise following submodule:
Keyboard operation gathers submodule S81, and it is configured to gather the typing operation of keyboard and switch behaviourDo;
Mouse event gathers submodule S82, and it is configured to gather the moving event of mouse and clicks thingPart;
Operation and event are preserved submodule S83, and it is configured to obtain the typing operation of described keyboard and cutChange operation, and/or be kept at HookProc function when the moving event of mouse and click eventLParam parameter;
Operation note generates submodule S84, and it is right that it is configured to generate according to this lParam parameter informationShould keyboard and/or the operation note of mouse action;
Submodule S85 is analyzed in operation note, and it is configured to analyze in the operation note generatingLParam parameter information;
Invalid operation is deleted submodule S86, and it was configured to delete between the time of described mouse moving eventEvery lower than preset ineffective time threshold value operation;
Time interval amendment submodule S87, it is configured between the time before described keyboard operationEvery, be revised as the preset time;
Operation note conversion submodule S88, it is configured to the typing operation of described keyboard and switches behaviourDo, and/or the moving event of mouse and click event record generating run record according to the order of sequence.
Operation sequence piece is preserved module 304, and it is configured to the configuration information of described browser and operationRecord converts single operation program block to and preserves.
In a preferred embodiment of the present invention, described operation sequence piece preservation module 304 is concreteCan comprise following submodule:
Configuration information is preserved submodule S91, and it is configured to preserve while carrying out each described record operation pairEstablishing of the browser window size of answering and positional information and interface tool hurdle, status bar and collection hurdlePut information;
Program block is preserved submodule S92, and it is configured to the configuration information of described browser and operation noteRecord is kept in same operation sequence piece, preserves as single operation program block.
With reference to Figure 14, show a kind of operation sequence piece based on record to the login behaviour in browserWork carries out the structured flowchart of the device embodiment of playback, specifically can comprise:
Configuration information load-on module 401, it is configured to load browsing in described single operation program blockDevice configuration information;
Operation note read module 402, it is configured to read described operation note, is reduced to keyboard behaviourOperation information while work, and/or operation information when mouse action;
Respective operations Executive Module 403, operation information when it is configured to according to described keyboard operation,And/or operation information when mouse action is carried out respective operations in browser target location;
Playback operation judge module 404, it is configured to by WebBrowser'sDocumentComplete function, judges whether described operation playback normally completes;
EP (end of program) module 405, it is configured to finish described operation and records and playback program;
The reminding module 406 processed of rerecording, it is configured to point out user again to record.
Because described device embodiment is substantially corresponding to preceding method embodiment, therefore the retouching of the present embodimentNot detailed part in stating, can, referring to the related description in previous embodiment, just not repeat at this.
Those skilled in the art should understand, embodiments of the invention can be provided as method, system,Or computer program. Therefore, the present invention can adopt complete hardware implementation example, software is real completelyExecute example or the form in conjunction with the embodiment of software and hardware aspect. And the present invention can adoptOne or more computer-usable storage medium (bags that wherein include computer usable program codeDraw together but be not limited to magnetic disc store, CD-ROM, optical memory etc.) the upper computer journey of implementingThe form of order product.
The present invention is that reference is according to the method for the embodiment of the present invention, equipment (system) and computer journeyThe flow chart of order product and/or block diagram are described. Should understand can be real by computer program instructionsEach flow process and/or square frame and flow chart and/or side in existing flow chart and/or block diagramFlow process in block diagram and/or the combination of square frame. Can provide these computer program instructions to general meterThe processor of calculation machine, special-purpose computer, Embedded Processor or other programmable data processing deviceTo produce a machine, make by the processor of computer or other programmable data processing deviceThe instruction of carrying out produces for realizing at flow process of flow chart or multiple flow process and/or block diagram oneThe device of the function of specifying in individual square frame or multiple square frame.
These computer program instructions also can be stored in can vectoring computer or other programmable data placesIn the computer-readable memory of reason equipment with ad hoc fashion work, making to be stored in this computer canInstruction in memory read produces the manufacture that comprises command device, and this command device is realized in flow processThe merit of specifying in flow process of figure or multiple flow process and/or square frame of block diagram or multiple square frameEnergy.
These computer program instructions also can be loaded into computer or other programmable data processing deviceUpper, make to carry out sequence of operations step and calculate to produce on computer or other programmable devicesThe processing that machine is realized, thus the instruction of carrying out on computer or other programmable devices is provided forRealize in flow process of flow chart or multiple flow process and/or square frame of block diagram or multiple square frameThe step of the function of specifying.
Although described the preferred embodiments of the present invention, once those skilled in the artThe basic creative concept of cicada, can make other change and amendment to these embodiment. So,Claims are intended to be interpreted as comprising preferred embodiment and fall into all changes of the scope of the inventionMore and amendment.
Method, device and server in the invention described above embodiment are applicable to diverse network or visitorIn end ring border, family, for example, can realize in the computer equipment such as PC device,Or can realize such as mobile phone, mobile communication equipment, PDA(Personal Digital Assistant)In other portable electric appts or non-portable electronic equipment. Therefore those skilled in the artWant clear and definite, the operation that protection scope of the present invention is not limited in the upper running browser of PC is recordedFunction and operation playback function are only for the succinct and convenient of description in embodiments of the present inventionAdopt operation recording function and operation playback function in the upper running browser of PC to be described.
Above to a kind of side recording that user in browser is operated provided by the present inventionMethod, a kind of operation sequence piece based on record carries out playback method to the register in browser;And, a kind of device of recording that user in browser is operated, a kind of behaviour based on recordMake the device that program block carries out playback to the register in browser and be described in detail, hereinIn applied specific case principle of the present invention and embodiment set forth, above embodimentExplanation just for helping to understand method of the present invention and core concept thereof; Meanwhile, for abilityThe those skilled in the art in territory, according to thought of the present invention, in specific embodiments and applicationsAll will change, in sum, this description should not be construed as limitation of the present invention.
Claims (19)
1. the user in browser is operated to a method of recording, it is characterized in that, comprising:
Start recording user's operation;
Preserve the configuration information of current browser;
Gather operation information when keyboard operation, and/or operation information when mouse action, behaviour generatedNote down;
Converting the configuration information of described browser and operation note to single operation program block protectsDeposit;
Wherein, operation information when described collection keyboard operation, and/or operation when mouse action disappearsBreath, the step of generating run record comprises:
Gather typing operation and the handover operation of keyboard;
And/or moving event and the click event of collection mouse;
Obtain typing operation and the handover operation of described keyboard, and/or the moving event of mouse and clickWhen event, be kept at the lParam parameter information of HookProc function, wherein, described HookProcFunction is the Message function of record operation;
Generate should keyboard and/or the operation note of mouse action according to this lParam parameter information;
Wherein, operation information when described collection keyboard operation, and/or operation when mouse action disappearsBreath, the step of generating run record further comprises:
Analyze the lParam parameter information in the operation note generating;
The time interval of deleting described mouse moving event is lower than the behaviour of preset ineffective time of threshold valueDo;
By the time interval before described keyboard operation, be revised as the preset time;
By typing operation and the handover operation of described keyboard, and/or the moving event of mouse and click thingPart records generating run record according to the order of sequence.
2. the method for claim 1, is characterized in that, the current browser of described preservationThe step of configuration information comprises:
Preserve window size and the positional information of current browser;
Preserve the configuration information on interface tool hurdle, status bar and collection hurdle.
3. the method for claim 1, is characterized in that, the typing behaviour of described collection keyboardThe step of work and handover operation further comprises:
Start the text edit tool, log-on message is inputed to text edit tool;
The log-on message of the text formatting of this input is encrypted, and be written to described lParam parameter letterIn breath.
4. the method for claim 1, is characterized in that, the mobile thing of described collection mousePart and click event comprise:
Moving event and the click event of monitoring mouse, after moving event triggers, obtain current mouseTarget coordinate and color;
In the time there is mouse click event, moving event is preserved before coordinate and color are saved inClick in color parameter clickcolor.
5. method as claimed in claim 2, is characterized in that, described joining described browserPutting information and operation note converts the step that single operation program block preserves to and comprises:
When the operation of each described generating run record is carried out in preservation corresponding browser window size andThe configuration information on positional information and interface tool hurdle, status bar and collection hurdle;
The configuration information of described browser and operation note are kept in same operation sequence piece, doFor single operation program block is preserved.
6. the method for claim 1, is characterized in that, described preset threshold ineffective timeValue is 20 milliseconds, and the described preset time is 5 milliseconds.
7. the method for claim 1, is characterized in that, described startup operates userRecording step comprises:
Shortcut or the shortcut of preset recording operation are set;
Click and start this shortcut or shortcut.
8. method as claimed in claim 7, is characterized in that, further comprises:
Click described preset shortcut or shortcut and finish recording operation;
In the single operation program block generating, delete and click preset shortcut or quick bondThe operation note that bundle is recorded.
9. the single operation program block based on recording in method claimed in claim 1 is to clearThe method of playback is carried out in the operation of looking in device, it is characterized in that, comprising:
Load the browser configuration information in described single operation program block;
Read described operation note, the operation information while being reduced to keyboard operation, and/or mouse actionTime operation information;
Operation information during according to described keyboard operation, and/or operation information when mouse action is clearLook at device target location carry out respective operations;
Wherein, the step bag of the browser configuration information in the described single operation program block of described loadingDraw together:
Resolve the browser configuration information in described single operation program block;
Obtain window size and the positional information of operation in each operation note browser while carrying out,And the configuration information on interface tool hurdle, status bar and collection hurdle;
Described operation information during according to keyboard operation, and/or operation information when mouse action is clearLook at device target location and carry out the step of respective operations and comprise:
By calling the message playback function of PlayProc, the operation while resolving described keyboard operation disappearsBreath, and/or operation information when mouse action, wherein, the message playback function of described PlayProcThe function calling during for executable operations message playback;
Obtain in order typing operation and the handover operation of described keyboard, and/or the moving event of mouseAnd click event;
The window size of browser and position letter while carrying out according to the operation in the operation note of obtainingBreath, and the configuration information on interface tool hurdle, status bar and collection hurdle, carry out accordingly in orderTyping operation and the handover operation of described keyboard, and/or the moving event of mouse and click event.
10. method as claimed in claim 9, is characterized in that, also comprises:
By the DocumentComplete function of browser, judge that whether described operation information is normalComplete, wherein, described DocumentComplete function is for judging what described operation information was carried outWhether the page has loaded;
If so, finish present procedure;
If not, point out user again to record.
11. methods as claimed in claim 10, is characterized in that, the described operation of described judgement disappearsThe step whether breath normally completes further comprises:
Check whether loaded of described current browser configuration information;
Check whether the operation information in described operation note returns complete.
12. methods as claimed in claim 9, is characterized in that, described read operation record,Operation information while being reduced to keyboard operation, and/or the step of operation information when mouse action comprises:
Described operation note is turned back to the position of the sensing of lParam parameter information;
Resolve the operation note of the position of described lParam parameter information sensing, and be reduced to keyboardOperation information when operation, and/or operation information when mouse action.
13. methods as claimed in claim 9, is characterized in that, described during according to mouse actionOperation information carry out the step of respective operations in browser target location and comprise:
When mouse moves to behind target location, obtain the color value of target location, contrast described listThe click color parameter clickcolor that inferior operation sequence piece is preserved, if equated, in this target bitPut place and carry out corresponding mouse action record.
14. 1 kinds operate the device of recording to the user in browser, it is characterized in that bagDraw together:
Record start unit, it is configured to start recording user's operation;
Configuration information storage unit, it is configured to preserve the configuration information of current browser;
Operation note generation module, operation information when it is configured to gather keyboard operation, and/or mouseOperation information when mark operation, generating run record;
Operation sequence piece is preserved module, and it is configured to the configuration information of described browser and operation noteRecord converts single operation program block to and preserves;
Wherein, described operation note generation module comprises:
Keyboard operation gathers submodule, and it is configured to gather typing operation and the handover operation of keyboard;
Mouse event gathers submodule, and it is configured to gather moving event and the click event of mouse;
Operation and event are preserved submodule, and it is configured to obtain the typing operation of described keyboard and switchOperation, and/or be kept at the lParam of HookProc function when the moving event of mouse and click eventParameter information, wherein, described HookProc function is the Message function of record operation;
Operation note generates submodule, and it is configured to generate should according to this lParam parameter informationThe operation note of keyboard and/or mouse action;
Wherein, described operation note generation module further comprises:
Submodule is analyzed in operation note, and it is configured to analyze the lParam in the operation note generatingParameter information;
Invalid operation is deleted submodule, and it is configured to delete the time interval of described mouse moving eventLower than the operation of preset ineffective time of threshold value;
Time interval amendment submodule, it was configured to the time interval before described keyboard operation,Be revised as the preset time;
Operation note conversion submodule, it is configured to typing operation and the handover operation of described keyboard,And/or the moving event of mouse and click event record generating run record according to the order of sequence.
15. devices as claimed in claim 14, is characterized in that, described configuration information is preserved singleUnit comprises:
Spatial information is preserved submodule, and it is configured to preserve window size and the position of current browserInformation;
Function information is preserved submodule, and it is configured to preserve interface tool hurdle, status bar and collection hurdleConfiguration information.
16. devices as claimed in claim 15, is characterized in that, described operation sequence piece is preservedModule comprises:
Configuration information is preserved submodule, and it is configured to preserve and carries out each described generating run recordCorresponding browser window size and positional information and interface tool hurdle, status bar and receipts when operationThe configuration information of Zang Lan;
Program block is preserved submodule, and it is configured to the configuration information of described browser and operation noteBe kept in same operation sequence piece, preserve as single operation program block.
Operation sequence piece in 17. 1 kinds of devices based on described in claim 14 is preserved institute in moduleThe single operation program block of record carries out playback device to the operation in browser, is characterized in that,Comprise:
Configuration information load-on module, it is configured to load the browser in described single operation program blockConfiguration information;
Operation note read module, it is configured to read described operation note, is reduced to keyboard operationTime operation information, and/or operation information when mouse action;
Respective operations Executive Module, operation information when it is configured to according to described keyboard operation, and/Or operation information when mouse action is carried out respective operations in browser target location;
Wherein, described configuration information load-on module, is also configured to:
Resolve the browser configuration information in described single operation program block;
Obtain window size and the positional information of operation in each operation note browser while carrying out,And the configuration information on interface tool hurdle, status bar and collection hurdle;
Described respective operations Executive Module, is also configured to:
By calling the message playback function of PlayProc, the operation while resolving described keyboard operation disappearsBreath, and/or operation information when mouse action, wherein, the message playback function of described PlayProcThe function calling during for executable operations message playback;
Obtain in order typing operation and the handover operation of described keyboard, and/or the moving event of mouseAnd click event;
The window size of browser and position letter while carrying out according to the operation in the operation note of obtainingBreath, and the configuration information on interface tool hurdle, status bar and collection hurdle, carry out accordingly in orderTyping operation and the handover operation of described keyboard, and/or the moving event of mouse and click event.
18. devices as claimed in claim 17, is characterized in that, also comprise:
Playback operation judge module, it is configured to the DocumentComplete function by browser,Judge whether described operation information normally completes, wherein, described DocumentComplete function is usedIn judging whether the page that described operation information is carried out has loaded;
EP (end of program) module, it is configured to finish present procedure;
The reminding module processed of rerecording, it is configured to point out user again to record.
19. devices as claimed in claim 18, is characterized in that, described playback operation judges mouldPiece comprises:
Environment arranges inspection submodule, and whether it is configured to check described current browser configuration informationLoaded;
Operation information checks submodule, and it is configured to check that the operation information in described operation note isNo return complete.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210227233.6A CN102841789B (en) | 2012-06-29 | 2012-06-29 | A kind of method and apparatus of recording with playback that user in browser is operated |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210227233.6A CN102841789B (en) | 2012-06-29 | 2012-06-29 | A kind of method and apparatus of recording with playback that user in browser is operated |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102841789A CN102841789A (en) | 2012-12-26 |
| CN102841789B true CN102841789B (en) | 2016-05-25 |
Family
ID=47369193
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210227233.6A Expired - Fee Related CN102841789B (en) | 2012-06-29 | 2012-06-29 | A kind of method and apparatus of recording with playback that user in browser is operated |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102841789B (en) |
Families Citing this family (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103327069B (en) * | 2013-05-16 | 2016-09-21 | 北京神鹰城讯科技股份有限公司 | Remote client's service support method based on WEB and system |
| CN104239018A (en) * | 2013-06-19 | 2014-12-24 | 中兴通讯股份有限公司 | Methods and systems for demonstrating and generating demonstration scripts |
| CN103488507A (en) * | 2013-09-18 | 2014-01-01 | 北京思特奇信息技术股份有限公司 | User behavior trajectory playback method |
| CN103678506B (en) * | 2013-11-20 | 2018-10-12 | 北京奇虎科技有限公司 | The method, apparatus and browser of loading application programs shortcut in a browser |
| GB201321468D0 (en) * | 2013-12-05 | 2014-01-22 | Language Garden Ltd | Manipulating graphic representations of words |
| CN104714948A (en) * | 2013-12-11 | 2015-06-17 | 部落邦（北京）科技有限责任公司 | Method, system and thermodynamic diagram display device for replaying user web page operation behavior |
| CN104731687A (en) * | 2013-12-24 | 2015-06-24 | 镇江金钛软件有限公司 | Real-time computer activity monitoring method |
| CN103713905A (en) * | 2013-12-29 | 2014-04-09 | 广州视源电子科技股份有限公司 | User-defined method, device and system of operation steps |
| CN103870272B (en) * | 2014-03-06 | 2017-09-22 | 联想(北京)有限公司 | A kind of information processing method and device |
| CN103927182A (en) * | 2014-04-29 | 2014-07-16 | 朱林 | Picture recording method by utilization of screen capture combined with operation of mouse and keyboard |
| CN104572464B (en) * | 2014-12-31 | 2018-01-19 | 广东欧珀移动通信有限公司 | The automatic test state saving approach and device of a kind of Android platform |
| CN105824742B (en) * | 2015-01-08 | 2018-10-02 | 阿里巴巴集团控股有限公司 | Operating user interface method for recording and device |
| CN106155760B (en) * | 2015-03-31 | 2019-09-17 | 北京奇虎科技有限公司 | The method and device of key mouse script playback |
| CN106155886B (en) * | 2015-03-31 | 2019-05-14 | 北京奇虎科技有限公司 | A kind of method and apparatus of key mouse script processing |
| CN106155771A (en) * | 2015-03-31 | 2016-11-23 | 北京奇虎科技有限公司 | The method and device of key Mus script playback |
| CN106155473A (en) * | 2015-04-28 | 2016-11-23 | 中兴通讯股份有限公司 | A kind of terminal applies processing method and device thereof |
| CN104881350B (en) * | 2015-04-30 | 2019-03-19 | 百度在线网络技术（北京）有限公司 | For determining user experience and assisting the method and apparatus for determining user experience |
| CN104915243B (en) * | 2015-06-30 | 2018-08-10 | 北京奇虎科技有限公司 | The method and device of key mouse script playback |
| CN104915244B (en) * | 2015-06-30 | 2018-02-16 | 北京奇虎科技有限公司 | The method and device of key mouse script playback |
| CN105159672B (en) * | 2015-08-28 | 2019-08-30 | 小米科技有限责任公司 | Remote assistance method and client |
| CN106610825A (en) * | 2015-10-23 | 2017-05-03 | 中兴通讯股份有限公司 | Shortcut establishment method and apparatus for intelligent terminal |
| CN108459848B (en) * | 2017-02-20 | 2021-12-14 | 深圳市北斗智研科技有限公司 | Script obtaining method and system applied to Excel software |
| CN107133072B (en) * | 2017-04-27 | 2021-02-26 | 新华三信息技术有限公司 | Operation execution method and device |
| CN107844331B (en) * | 2017-11-23 | 2021-01-01 | 腾讯科技(成都)有限公司 | Method, device and equipment for generating boot configuration file |
| CN108693976A (en) * | 2018-08-10 | 2018-10-23 | 唐山数通科技有限公司 | Transcripter |
| CN109446025B (en) * | 2018-10-17 | 2022-08-23 | 北京字节跳动网络技术有限公司 | Operation behavior playback method and device, electronic equipment and readable medium |
| CN109656704B (en) * | 2018-12-21 | 2023-07-04 | 北京天融信网络安全技术有限公司 | Information processing method and information processing device |
| CN111522608B (en) * | 2019-02-03 | 2023-09-22 | 北京数聚鑫云信息技术有限公司 | Method and device for improving execution rate of analog operation |
| CN110046009B (en) * | 2019-02-19 | 2022-08-23 | 创新先进技术有限公司 | Recording method, recording device, server and readable storage medium |
| CN110209557B (en) * | 2019-03-16 | 2022-05-17 | 平安科技（深圳）有限公司 | User operation recording and restoring method, device and equipment and readable storage medium |
| CN113326144B (en) * | 2020-02-29 | 2023-12-12 | 华为技术有限公司 | Method and device for generating task wizard |
| CN111858364A (en) * | 2020-07-24 | 2020-10-30 | 中国建设银行股份有限公司 | Parameter configuration method, device and system of test terminal |
| CN112131085A (en) * | 2020-08-01 | 2020-12-25 | 青岛希望鸟科技有限公司 | Method, system and device for recording and playing back Internet business process |
| CN113360824A (en) * | 2021-06-30 | 2021-09-07 | 四川效率源信息安全技术股份有限公司 | Webpage evidence obtaining and data extracting method based on Chrome browser debugging protocol |
| CN113590092A (en) * | 2021-07-15 | 2021-11-02 | 远光软件股份有限公司 | Script generation method and device and computer readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1313034A2 (en) * | 2001-11-14 | 2003-05-21 | Hitachi, Ltd. | Storage system having means for acquiring execution information of a database management system |
| CN101399821A (en) * | 2007-09-28 | 2009-04-01 | 国际商业机器公司 | Recording/reproducing system, recorder/player, and method |
| CN102142016A (en) * | 2010-01-29 | 2011-08-03 | 微软公司 | Cross-browser interactivity recording, playback and editing |
| CN102508773A (en) * | 2011-10-18 | 2012-06-20 | 深圳市易聆科信息技术有限公司 | Method and device for monitoring WEB service system simulation based on Internet explorer (IE) kernel |
-
2012
- 2012-06-29 CN CN201210227233.6A patent/CN102841789B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1313034A2 (en) * | 2001-11-14 | 2003-05-21 | Hitachi, Ltd. | Storage system having means for acquiring execution information of a database management system |
| CN101399821A (en) * | 2007-09-28 | 2009-04-01 | 国际商业机器公司 | Recording/reproducing system, recorder/player, and method |
| CN102142016A (en) * | 2010-01-29 | 2011-08-03 | 微软公司 | Cross-browser interactivity recording, playback and editing |
| CN102508773A (en) * | 2011-10-18 | 2012-06-20 | 深圳市易聆科信息技术有限公司 | Method and device for monitoring WEB service system simulation based on Internet explorer (IE) kernel |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102841789A (en) | 2012-12-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102841789B (en) | A kind of method and apparatus of recording with playback that user in browser is operated | |
| US20220108107A1 (en) | Method and system for extraction of table data from documents for robotic process automation | |
| CN107295050A (en) | Front end user behavioral statisticses method and device | |
| CN104899016B (en) | Allocating stack Relation acquisition method and device | |
| CN103777967B (en) | Page returning method, page generation method and device | |
| US10289278B2 (en) | Displaying webpage information of parent tab associated with new child tab on graphical user interface | |
| CN109118160B (en) | Information sharing method, device, terminal equipment and medium | |
| CN107894889A (en) | Bury point methods, equipment and computer-readable recording medium | |
| CN104866416B (en) | The method and apparatus for realizing application program capacity analysis | |
| CN101902756A (en) | M2M (Machine To Machine) business platform and working method thereof | |
| CN110381026B (en) | Business service packaging and accessing system, method and device for rich client | |
| CN107943691A (en) | A kind of method and device for the functional test page for automatically generating intelligent contract | |
| CN111371741B (en) | Method, device, computer equipment and storage medium for transmitting external network data to internal network | |
| EP4109321A1 (en) | Mail processing method and apparatus, electronic device and storage medium | |
| EP3436943A1 (en) | Validating stateful dynamic links in mobile applications | |
| CN101311897A (en) | Method and device for snatching at application program graphical user interface resource | |
| CN110162457A (en) | Test method, device, equipment and the storage medium of user interface | |
| CN105556505A (en) | Legacy system | |
| CN109684571A (en) | A kind of collecting method and device, storage medium | |
| WO2020096665A2 (en) | System error detection | |
| EP3195115A1 (en) | Code development tool with multi-context intelligent assistance | |
| CN114996619A (en) | Page display method and device, computer equipment and storage medium | |
| CN107526679A (en) | Automated test frame, the automated testing method based on thereon, storage medium and computer equipment | |
| US20120185823A1 (en) | System and method for self dependent web automation | |
| CN113836014A (en) | Interface testing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20160518 Address after: 100015, room 5, room 501-506, building 2, building 6, Jiuxianqiao Road, Chaoyang District, Beijing, Patentee after: QIFEIXIANGYI (BEIJING) SOFTWARE CO.,LTD. Address before: 100088 Beijing city Xicheng District xinjiekouwai Street 28, block D room 112 (Desheng Park) Patentee before: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Patentee before: Qizhi software (Beijing) Co.,Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160525 Termination date: 20190629 |
|
| RR01 | Reinstatement of patent right |
Former decision: termination of patent right due to unpaid annual fee Former decision publication date: 20200623 |
|
| RR01 | Reinstatement of patent right | ||
| CP01 | Change in the name or title of a patent holder |
Address after: Room 501-506, floor 5, building a, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015 Patentee after: Beijing Qi flying Business Consulting Co.,Ltd. Address before: Room 501-506, floor 5, building a, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015 Patentee before: QIFEIXIANGYI (BEIJING) SOFTWARE CO.,LTD. |
|
| CP01 | Change in the name or title of a patent holder | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220129 Address after: Room 801, 8th floor, No. 104, 1st to 19th floors, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100020 Patentee after: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Address before: Room 501-506, floor 5, building a, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015 Patentee before: Beijing Qi flying Business Consulting Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160525 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |