CN102568529B - Recording and playing back method, device and system of operation process - Google Patents
Recording and playing back method, device and system of operation process Download PDFInfo
- Publication number
- CN102568529B CN102568529B CN201010582696.5A CN201010582696A CN102568529B CN 102568529 B CN102568529 B CN 102568529B CN 201010582696 A CN201010582696 A CN 201010582696A CN 102568529 B CN102568529 B CN 102568529B
- Authority
- CN
- China
- Prior art keywords
- action events
- video record
- video
- described video
- record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Television Signal Processing For Recording (AREA)
Abstract
The invention belongs to the technical field of computers and provides a recording and playing back method, a device and a system of an operation process. The method comprises the following steps: receiving a triggering notification of an operation event, recording a system interface and generating a video record; correlating the operation event with the video record; generating a video file according to a video record set corresponding to an operation event set; and synchronously playing back the operation event and the video record by operating the video file. According to the invention, the operation event and the corresponding operation video are automatically correlated while recording the operation process to synchronously display the current operation video and the corresponding operation event while playing back the operation process so as to clearly and visually play back the operation process.
Description
Technical field
The invention belongs to field of computer technology, particularly relate to a kind of operating process recording/playback method, Apparatus and system.
Background technology
Operating process is made up of some use-cases, and each use-case forms by some Action Events, wherein, Action Events is the operational motion carried out on an operating system, such as mouse is clicked, can carry out text event detection etc. in input area, use-case is then the set of one group of Action Events, normally in order to realize certain function or reach the orderly Action Events set of a group of certain object.
In the application scenarios such as automatic test, operating process is normally unattended, and each execution use-case in its operating process, and each operation steps in each execution use-case, all need to carry out record by certain mode, to facilitate when analytical test result, clearly show whole operating process by playback, do not omit any details.
The existing mode recorded operating process has two kinds, one is by film recording instrument, merely record is carried out to the change of screen in operating process, in real time operation steps is not associated, meanwhile, when carrying out playback to operating process, strictly must follow time shaft, if operation interface does not change for a long time due to hind computation, also identical computing time must be waited for when playback.The another kind of mode recorded operating process is single step free hand drawing sheet mode, namely a screen-picture is intercepted when often carrying out an operation steps, the mode being associated an operation steps by a picture carries out playback, which, due to the noncontinuity of picture, easily loses the details in a lot of operating process.
Summary of the invention
The object of the embodiment of the present invention is to provide a kind of operating process recording/playback method, is intended to solve problem operation steps and operation video cannot being carried out real time correlation in prior art when recording.
The embodiment of the present invention is achieved in that a kind of operating process recording/playback method, and described method comprises the steps:
Receive the trigger notice of Action Events, register system interface, generate video record;
Described Action Events is associated with described video record;
The set of the described video record corresponding to the set of described Action Events, generates video file;
By running described video file, synchronized playback is carried out to described Action Events and described video record.
Another object of the embodiment of the present invention is to provide a kind of operating process recording/displaying device, and described device comprises:
Video record generation unit, for register system interface, generates video record;
Associative cell, for associating described Action Events with described video record;
Video file generation unit, for the set of the described video record corresponding to the set of described Action Events, generates video file;
Synchronized playback unit, for carrying out synchronized playback by running described video file to described Action Events and described video record.
Another object of the embodiment of the present invention is to provide a kind of system comprising aforesaid operations process recording/displaying device.
In embodiments of the present invention, by in the process recorded operating process, its corresponding for current operation event operation video is carried out real-time auto-associating, make when carrying out playback to the operating process of recording, contacting between concrete each Action Events and its operation video can be clear that, realize the reproduction directly perceived to operating process.
Accompanying drawing explanation
Fig. 1 is the realization flow figure of the operating process recording/playback method that first embodiment of the invention provides;
Fig. 2 is the realization flow figure of the operating process recording/playback method that second embodiment of the invention provides;
Fig. 3 is the structural drawing of the operating process recording/displaying device that third embodiment of the invention provides.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
In embodiments of the present invention, by in the process recorded operating process, its corresponding for current operation event operation video is carried out real-time auto-associating, make when carrying out playback to the operating process of recording, contacting between concrete each Action Events and its operation video can be clear that, realize the reproduction directly perceived to operating process.
Fig. 1 shows the operating process recording/playback method realization flow that first embodiment of the invention provides, and details are as follows:
In step S101, receive the trigger notice of Action Events, register system interface, generate video record.
In the present embodiment, before execution step S101, can be monitored by the Action Events setting up operating system, once there be Action Events to occur, then produce the trigger notice of this Action Events, start to record the change of system interface with apprizing system.
Aforesaid operations action listener process is when occurring without Action Events, any output data can not be produced, and send the trigger notice of Action Events once it, then show system triggers Action Events, need the system interface change started this Action Events causes to carry out record.
In the present embodiment, the video record of generation all can be kept in a temporary file, to facilitate follow-up process.
In the present embodiment, Action Events is the operational motion carried out on an operating system, comprises mouse, keyboard and forms operational motion, and the window area that system interface comprises whole on-screen display (osd) area, changes, in this no limit.
In step s 102, video record corresponding with it for Action Events is associated.
In the present embodiment, the corresponding Action Events mark of each Action Events, similarly, when each video record generates, produces unique video record mark, for distinguishing this video record and other video records.Associate by this Action Events mark is identified with video record, set up the incidence relation of this Action Events video record corresponding with this Action Events.In the present embodiment, the above-mentioned mark of the Action Events through association and video record mark can be recorded in system database as one group of data.
In step s 103, the set of the video record corresponding to the set of Action Events, generates video file.
In the present embodiment, video file is the set of one group of video record, for being recorded as the Action Events reaching a certain object and perform, and the change of system interface in implementation.Before execution step S103, for the set of each Action Events, the sequencing that can generate according to its video record generates video record index, conveniently in replayed section, carries out playback in order.
Simultaneously, in the present embodiment, the set of each Action Events, i.e. use-case, corresponding unique use-case mark, by in a database this use-case mark being associated with the filename of video file, the incidence relation of this use-case and this video file can be set up, conveniently in replayed section, as required playback called to different video files.
In the present embodiment, the mode of compressed file can be adopted, by video file together with its relevant information, comprise the information such as video record index, video file size together to compress, decompress(ion) is carried out again when this video file play by needs, reduce the size of video file thus, save system resource.
In step S104, carry out synchronized playback by running the video record of video file to Action Events and its correspondence.
In the present embodiment, according to the incidence relation of use-case mark with the filename of video file, run the video file realizing the operating process of this use-case, due to while recording this operating process, in real time video record corresponding with it for Action Events is wherein associated, therefore, it is possible to realize the synchronized playback of the video record of Action Events and its correspondence, concrete operating process replay procedure as shown in Figure 2, does not repeat them here.
Fig. 2 shows the realization flow of the operating process recording/playback method that second embodiment of the invention provides, and the present embodiment is the refinement to step S104 in the first embodiment, and its specific implementation flow process is as follows:
In step s 201, the index of video record in video file is extracted.
In embodiments of the present invention, according to the incidence relation of use-case mark with the filename of video file, run the video file corresponding to use-case, extract the video record index in video file, this index designates the sequencing of video record in video file.If this video file have passed through compression, then need by decompress(ion), then video record index is extracted.
In step S202, play the video record in video file according to index.
In step S203, the Action Events that this video record associates synchronously is shown.
In the present embodiment, by the incidence relation of video record and Action Events, while broadcasting video record, locate the Action Events be associated with this video record, and carry out, with the synchronous displaying of video record, achieving the synchronized playback of video record and Action Events to this Action Events.
In the process that the video record of the present embodiment is play, stand-by period in operating process can be shortened by setting a time threshold, between two video records interval greater than this time threshold, namely after having carried out an Action Events, certain hour is waited more than when just carrying out next Action Events, because system interface is unconverted during this period, therefore now this time interval is shortened to this time threshold to play, with the speed of the process playback that speeds operations.
As a realization example of the present invention, this time threshold can be set as 1 second.
In the present embodiment, when in the process of carrying out operating process synchronized playback, by specifying concrete Action Events, quick position can be carried out to playback progress.Once specify concrete Action Events, according to the incidence relation of this Action Events video record corresponding with it, select this video record to play, namely achieve the quick position to playback progress, the effect improving playback viewing is experienced.In the present embodiment, the quick position of playback progress can also be realized by the progress bar directly dragging video file, use assigned operation event to position the video location that accurately can navigate to this Action Events place, and use dragging video file progress bar to position the video location can only located faintly and need viewing.
Fig. 3 shows the structure of the operating process recording/displaying device that third embodiment of the invention provides, and for convenience of explanation, illustrate only part related to the present embodiment.
With reference to Fig. 3, this operating process recording/displaying device can be used for comprising in the system of windows operating system, linux operating system, handheld equipment operating system etc., for running on the software unit of said system, hardware cell or soft or hard combining unit, comprising:
Video record generation unit 31, the system interface change after record Action Events triggers, generates video record.
Associative cell 32, associates the video record mark of video record corresponding with it for the Action Events of Action Events mark.In the present embodiment, can the Action Events mark after association and video record mark be recorded in system database as one group of data, conveniently call.
Video file generation unit 33, the set of the video record corresponding to the set of Action Events, generates video file.In the present embodiment, the set of Action Events, i.e. use-case, corresponding unique use-case mark, can associate with the filename of the video file generated, and also be recorded in system database as one group of data, conveniently call.
Synchronized playback unit 34, by running video file, carries out synchronized playback to the video record of Action Events and its correspondence.
In the present embodiment, while the 31 pairs of operating process of video record generation unit are recorded, by associative cell 32, video record corresponding with it for Action Events is associated in real time, when making to carry out playback by the 34 pairs of operating process of synchronized playback unit, the synchronized playback of the video record of Action Events and its correspondence can be realized, improve viewing experience.
This operating process recording/displaying device also comprises:
Notice generation unit 35, is monitored by the Action Events setting up operating system, has Action Events to occur, then produce the trigger notice of this Action Events in system.
Notice receiving element 36, receives the trigger notice of the Action Events from notice generation unit 35, to inform that video record generation unit 31 starts to record the change of system interface.
Index generation unit 37, the sequencing generated according to video record in the set of video record, generates video record index, conveniently in replayed section, carries out playback in order to the video record in video file.
Time threshold setup unit 38, by setting a time threshold, between two video records interval greater than this time threshold time, then this time interval is shortened to this time threshold and plays, to shorten the stand-by period, the speed of the process that speeds operations playback.
In the unit of above-mentioned composition operating process recording/displaying device, synchronized playback unit 34 comprises:
Index extraction unit 341, extracts the video record index in video file.
Broadcast unit 342, according to the sequencing of video record in video record index, plays the video record in video file.
Action Events display unit 343, according to the incidence relation that associative cell 32 pairs of video records and Action Events are set up, while broadcasting video record, locates the Action Events that is associated with this video record, and synchronously shows with video record.
In embodiments of the present invention, by carrying out auto-associating when recording operating process to Action Events and corresponding operation video thereof, make when carrying out playback to operating process, synchronously can show the Action Events of current operation video and correspondence thereof, know and intuitively playback is carried out to operating process.Meanwhile, rapidly operation video is positioned by the stand-by period in shortening operating process and by incidence relation, under the prerequisite of not losing any details, accelerate playback process, promote viewing experience.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, all any amendments done within the spirit and principles in the present invention, equivalent replacement and improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. an operating process recording/playback method, is characterized in that, described method comprises the steps:
Receive the trigger notice of Action Events, register system interface, generate video record;
Described Action Events is associated with described video record;
The set of the described video record corresponding to the set of described Action Events, generates video file;
By running described video file, synchronized playback is carried out to described Action Events and described video record;
Wherein, in the process of playback, concrete Action Events can be specified to position playback progress by incidence relation.
2. the method for claim 1, is characterized in that, receiving the trigger notice of Action Events, register system interface, before generating the step of video record, described method also comprises the steps:
When described Action Events occurs, produce the trigger notice of described Action Events.
3. the method for claim 1, is characterized in that, the set of described described video record corresponding to the set of described Action Events, and before generating the step of video file, described method also comprises the steps:
According to the sequencing that described video record generates, generate video record index.
4. method as claimed in claim 3, is characterized in that, is describedly specially the step that described Action Events and described video record carry out synchronized playback by operation video file:
Extract the described video record index in described video file;
The described video record in described video file is play according to described video record index;
The described Action Events associated with described video record is synchronously shown.
5. the method for claim 1, is characterized in that, described method also comprises the steps:
By setting a time threshold, between two described video records interval greater than described time threshold time, the described time interval is shortened to described time threshold and plays.
6. an operating process recording/displaying device, is characterized in that, described device comprises:
Video record generation unit, for register system interface, generates video record;
Associative cell, for associating Action Events with described video record;
Video file generation unit, for the set of the described video record corresponding to the set of described Action Events, generates video file;
Synchronized playback unit, for carrying out synchronized playback by running described video file to described Action Events and described video record;
Wherein, in the process of playback, concrete Action Events can be specified to position playback progress by incidence relation.
7. device as claimed in claim 6, it is characterized in that, described device also comprises:
Index generation unit, for the sequencing generated according to described video record, generates video record index.
8. device as claimed in claim 7, it is characterized in that, described synchronized playback unit comprises:
Index extraction unit, for extracting the described video record index in described video file;
Video record broadcast unit, for playing the described video record in described video file according to described video record index;
Action Events display unit, for synchronously showing the described Action Events associated with described video record.
9. device as claimed in claim 6, it is characterized in that, described device also comprises:
Notice generation unit, for when described Action Events occurs, produces the trigger notice of described Action Events;
Notice receiving element, for receiving the trigger notice of described Action Events;
Time threshold setup unit, for setting the shortest time interval between two described video records.
10. one kind comprises the system of the operating process recording/displaying device of any one of claim 6 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010582696.5A CN102568529B (en) | 2010-12-10 | 2010-12-10 | Recording and playing back method, device and system of operation process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010582696.5A CN102568529B (en) | 2010-12-10 | 2010-12-10 | Recording and playing back method, device and system of operation process |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102568529A CN102568529A (en) | 2012-07-11 |
| CN102568529B true CN102568529B (en) | 2015-06-03 |
Family
ID=46413761
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010582696.5A Active CN102568529B (en) | 2010-12-10 | 2010-12-10 | Recording and playing back method, device and system of operation process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102568529B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103778048B (en) * | 2012-10-18 | 2017-12-26 | 腾讯科技（深圳）有限公司 | Mobile terminal test method and system |
| CN103019899A (en) * | 2012-11-28 | 2013-04-03 | 广东欧珀移动通信有限公司 | Method and system for replaying intelligent terminal event as well as intelligent terminal |
| CN103929607A (en) * | 2014-03-27 | 2014-07-16 | 山西协康云享科技有限公司 | Communication method based on screen recording, and application client-side |
| CN103927182A (en) * | 2014-04-29 | 2014-07-16 | 朱林 | Picture recording method by utilization of screen capture combined with operation of mouse and keyboard |
| CN104486517A (en) * | 2014-11-28 | 2015-04-01 | 北京佳讯飞鸿电气股份有限公司 | Method for intelligently restoring operation of telephone operator |
| CN106034174B (en) * | 2015-03-13 | 2019-09-24 | 展讯通信（上海）有限公司 | A kind of operation playback system and method and mobile terminal |
| CN105159672B (en) * | 2015-08-28 | 2019-08-30 | 小米科技有限责任公司 | Remote assistance method and client |
| CN105426295A (en) * | 2015-11-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | Video production method and device |
| CN108109088B (en) * | 2016-11-25 | 2021-08-20 | 网易（杭州）网络有限公司 | Method and equipment for processing stalling event |
| CN106875968B (en) * | 2017-01-21 | 2024-03-22 | 上海量明科技发展有限公司 | Information acquisition method, client and system |
| CN107577489A (en) * | 2017-08-03 | 2018-01-12 | 捷开通讯(深圳)有限公司 | Method, mobile terminal and the storage device of remote assistance |
| WO2019056333A1 (en) * | 2017-09-25 | 2019-03-28 | 深圳传音制造有限公司 | Screen recording method for mobile terminal testing and mobile terminal |
| CN111448527A (en) * | 2020-01-14 | 2020-07-24 | 深圳市元征科技股份有限公司 | Vehicle diagnosis process playback method and device and readable storage medium |
| CN113784205B (en) * | 2020-06-10 | 2023-07-18 | 腾讯科技（上海）有限公司 | Method and device for generating audit file and computer storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101242621A (en) * | 2008-01-21 | 2008-08-13 | 中兴通讯股份有限公司 | An automatic testing method and system based on interface |
| CN101620564A (en) * | 2008-06-30 | 2010-01-06 | 福建升腾资讯有限公司 | Method for automatically testing recording playback mode of terminal system |
-
2010
- 2010-12-10 CN CN201010582696.5A patent/CN102568529B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101242621A (en) * | 2008-01-21 | 2008-08-13 | 中兴通讯股份有限公司 | An automatic testing method and system based on interface |
| CN101620564A (en) * | 2008-06-30 | 2010-01-06 | 福建升腾资讯有限公司 | Method for automatically testing recording playback mode of terminal system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102568529A (en) | 2012-07-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102568529B (en) | Recording and playing back method, device and system of operation process | |
| TWI509409B (en) | Methods and systems for viewing log data recorded during execution of a program | |
| WO2017076171A1 (en) | Method and apparatus for displaying information on video image | |
| EP3537278A1 (en) | Recording and playing method for screen video, and screen recording terminal and playing terminal | |
| CN101493790B (en) | Record playback system and record back method | |
| WO2019051938A1 (en) | Live video preservation method and device, and server, anchor terminal and medium | |
| CN103019899A (en) | Method and system for replaying intelligent terminal event as well as intelligent terminal | |
| CA2556995A1 (en) | Automated system and method for conducting usability testing | |
| US8776104B2 (en) | Information providing system using video tracking | |
| KR101991188B1 (en) | Promotion information processing method, device, and apparatus, and non-volatile computer storage medium | |
| JP2010257509A (en) | Authoring apparatus, authoring method, and program | |
| WO2014044164A1 (en) | Content recording method and device | |
| CN105791950A (en) | Power Point video recording method and device | |
| CN108111903A (en) | Record screen document play-back method, device and terminal | |
| CN109144858B (en) | Fluency detection method and device, computing equipment and storage medium | |
| WO2015154517A1 (en) | Software failure locating method, apparatus and equipment | |
| US9910576B2 (en) | Automated multimedia content editing | |
| CN102141957B (en) | Auxiliary test method, device and system for remote real machine | |
| CN106657850A (en) | Lesson content recording method and system | |
| CN113824987B (en) | Method, medium, device and computing equipment for determining time consumption of first frame of live broadcasting room | |
| CN101931827A (en) | Set-top box test method for event replay | |
| CN103500122A (en) | Multimedia file playing method and electronic equipment | |
| CN113382268B (en) | Live broadcast anomaly analysis method, live broadcast anomaly analysis device, computer equipment and storage medium | |
| WO2007119383A1 (en) | Content reproduction device, content reproduction resumption method, and content reproduction program | |
| US8856251B2 (en) | Picture processing method and apparatus for instant communication tool |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |