CN115079914A - Panoramic interaction record playback system based on cloud platform - Google Patents
Panoramic interaction record playback system based on cloud platform Download PDFInfo
- Publication number
- CN115079914A CN115079914A CN202210776395.9A CN202210776395A CN115079914A CN 115079914 A CN115079914 A CN 115079914A CN 202210776395 A CN202210776395 A CN 202210776395A CN 115079914 A CN115079914 A CN 115079914A
- Authority
- CN
- China
- Prior art keywords
- recording
- panoramic
- cloud platform
- user
- playback
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 19
- 238000000034 method Methods 0.000 claims description 18
- 230000002452 interceptive effect Effects 0.000 claims description 14
- 238000010586 diagram Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0486—Drag-and-drop
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
- G06F16/116—Details of conversion of file system types or formats
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11C—STATIC STORES
- G11C7/00—Arrangements for writing information into, or reading information out from, a digital store
- G11C7/16—Storage of analogue signals in digital stores using an arrangement comprising analogue/digital [A/D] converters, digital memories and digital/analogue [D/A] converters
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to the technical field of new-generation information, in particular to a panoramic interaction recording and playback system based on a cloud platform, which is characterized by comprising the following components: s1, starting recording; s2, recording simultaneous recording in time sequence and array form according to three categories of clicking, dragging and zooming by the system; s3, stopping recording; s4, integrating the user operation array, the user information and the recording mark which are recorded in sequence into an Object; s5, converting the Object into a JSON data format, and uploading the JSON data format and the sound recording file to a cloud platform; s6, the JSON and the sound recording file are presented in a playback list of the panoramic page; s7, clicking the playback list, and downloading the corresponding JSON and the recording file from the cloud platform; and S8, analyzing and simultaneously playing the recording until the recording is finished or the user actively stops playing. The invention has the advantages of less occupied resources, simple access and strong universality.
Description
Technical Field
The invention relates to the technical field of new-generation information, in particular to a panoramic interaction recording and playback system based on a cloud platform.
Background
At present, the online panoramic display mode becomes one of important ways for numerous brand manufacturers to perform brand promotion and obtain business leads online.
Nowadays, the online panorama basically performs basic explanation introduction on the exhibition content of the panorama in the form of an online navigation tape or an explanation video embedded in the panorama. Both of these approaches still present some problems while providing a convenient way of teaching based on panoramic presentations. The online guide belt viewing is greatly influenced by the network environment of both the belt viewing party and the video viewing party, and the smooth belt viewing experience can be obtained only when both the belt viewing party and the video viewing party are in a good network environment with low delay; the video format is generally large in size and has high requirements on compatibility of equipment system environment and browsers.
Disclosure of Invention
In order to solve the problems, the invention provides a cloud platform-based panoramic interaction recording and playback system which is light in weight, easy to access and high in universality by means of JSON data formats and functions of page behavior monitoring, background communication support, equipment recording function call and the like provided by Javascript.
In order to realize the purpose, the invention adopts the following technical scheme:
a panoramic interaction record playback system based on a cloud platform comprises the cloud platform and method steps which are operated on the cloud platform and used for storing, loading and executing interaction record playback, and is characterized in that the method steps comprise:
s1, clicking a recording button in the panoramic page to acquire information of an operation user and triggering interactive recording;
s2, recording user operation in an array form according to three categories of clicking, dragging and zooming by the system in a time sequence, and recording at the same time;
s3, clicking a recording stopping button in the panoramic page to finish interactive recording;
s4, integrating the user operation array, the user information and the recording mark which are recorded in sequence into an Object;
s5, converting the Object into a JSON data format by a JSON.stringiness () method, and uploading the Object and the generated sound recording file to a cloud platform for storage;
s6, the updated JSON file and the sound recording file stored in the cloud platform are presented in a playback list preset in the panoramic page in a project mode;
s7, clicking the items in the playback list, and downloading the corresponding JSON file and the recording file from the cloud platform;
s8, analyzing a user operation array, user information and a recording identifier in the JSON file, and then carrying out further operation analysis aiming at the user operation array; and sequentially executing through an application programming interface API (application programming interface) provided by the corresponding panoramic script program krpano, and simultaneously playing the recording until the playback is finished or the user actively stops the playback.
In an embodiment of the present invention, the panoramic webpage of S1 is produced with the panoramic script program krpano as a support; and triggering a recording button in the panoramic webpage to control a popup input box for inputting user information.
In one embodiment of the present invention, the S2 invokes the recording function of the device through an API provided by the MediaRecorder.
In an embodiment of the present invention, the S2 records the operation of the user and the operation time point and time period through the event object event and the Date object Date provided by Javascript; the types of the event object events comprise mouse down, mouse moving, mouse up, click, wheel mouse, touch start, touch process touch move, touch end, click and zoom touch for a PC end browser.
In an embodiment of the present invention, the S2 sets an object for recording for an operation of a user, and a plurality of consecutive operations are recorded in the form of an array in the collective recorderEvents variable of all operation events; in the object of the single operation, a property event is set to record the event of the operation, a property eventName is set to record the name of the operation, a property eventDefs is set to record the name or ID of a scene before and after switching, and a property eventTime is set to record the time of the event.
In one embodiment of the present invention, the S4 converts the sound recording into an audio file through an API provided by the MediaRecorder.
In an embodiment of the present invention, the S4 integrates the variable recorderName for recording the user name, the variable recorderTheme for recording the content title, the variable recorderEvents for recording the user operation array, and the variable recorderAudio for recording the recording identifier into an Object by the Object method.
In an embodiment of the present invention, the S8 parses the data in the JSON file by using a json.parse () method provided by Javascript, and performs automatic sequential execution on the parsed operation array portion by using attribute methods, such as xml.scene, xml.hlookat, xml.vlookat, xml.fov, and the like, provided by the panorama script program krpano, and simultaneously plays the sound record to realize playback.
Compared with the prior art, the invention has the beneficial effects that:
1. on the basis of on-line watching, the invention provides a set of flexible and easy-to-operate recording playback system, so that the on-line watching gets rid of the limitation on network environments of both parties, and a relatively smooth on-line watching experience can be obtained even under the condition of high delay;
2. the invention stores data such as operation records and the like through JSON, has smaller volume compared with a video format, has smaller requirements on compatibility and the like of various panoramic scripts, languages, running environments and the like, and is more universal;
3. aiming at the characteristics of the displayed content, the invention can lead the user to have more choices when checking the playback by recording a plurality of pieces.
Drawings
Fig. 1 is a schematic diagram of a recording flow of the panoramic interactive recording and playback system of the present invention;
fig. 2 is a schematic playback flow diagram of the panoramic interactive recording and playback system of the present invention.
Detailed Description
The following examples further illustrate the embodiments of the present invention in detail. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
The embodiment provides a panorama interactive recording playback system based on cloud platform, utilizes current cloud platform to save, load and carry out each interactive recording playback step, uses the scene to explain in the panorama factory of certain medical enterprise and records to A product line, and the panorama webpage script program of use is krpano, and the webpage program of use includes HTML, CSS, Javascript, and interactive recording playback step mainly includes:
s1, the recorder clicks a recording button on the panoramic page to acquire user information of the recorder, the recording button is changed into a recording stopping button, and the system starts to enter an interactive recording program;
s2, a recorder operates the panoramic webpage, for example, clicking a scene thumbnail to switch scenes, dragging to switch a current scene visual angle, zooming to adjust the zooming ratio of the current scene, the system records the operations of a user in an array form and a time sequence according to three categories of clicking, dragging and zooming, and simultaneously calls an equipment recording system to record;
s3, after the operation demonstration is finished, the recorder clicks a recording stopping button in the panoramic page to finish the interactive recording and finish the recording;
s4, after the recorder stops recording, the system integrates the user operation array, the recorder user information and the recording mark into an Object;
s5, converting the Object into a JSON data format by a JSON.stringiness () method, and uploading the Object and the generated sound recording file to a cloud platform for storage;
s6, a playback list is arranged in the panoramic page, and after uploading is successful, the list is updated, and the latest interaction records are displayed in the list;
s7, clicking the interactive record in the playback list by the user, and downloading the corresponding JSON data and the corresponding recording file from the cloud platform;
s8, analyzing a user operation array, user information and a recording identifier in JSON, further analyzing the user operation array, sequentially executing through an application programming interface API provided by the corresponding panoramic script program krpano, and simultaneously playing the recording until playback is completed or the user actively stops playback.
Further, in S1, the panoramic webpage is produced with the panoramic script program krpano as a support, and a "record" button is added to the panoramic webpage; the recorder clicks the 'record' button to pop up two input boxes, and the recorder is required to fill in the subject and the recorder name respectively. After the input is finished, namely the user information of the recorder is obtained, the interactive record is started, and meanwhile, the state of the button is changed from 'recording' to 'recording ending' through the lnnerText attribute and the className attribute provided by JS.
Further, in S2, the interactive recording is mainly composed of two parts, one is to call the recording function of the device through the API provided by the MediaRecorder to start recording; and secondly, recording the operation of the recorder, the operation time point and the operation time period through the event object event and the Date object Date provided by the Javascript. The event object types are generally mousetown (mouse is pressed down, namely dragging is started), mouseove (mouse is moved, namely dragging is started), mouseup (mouse is lifted, namely dragging is ended), click (clicking), mousewheel (roller wheel, namely zooming), touchstart (touch is started, namely dragging is started), touchmove (touch is started, namely dragging is ended), touchend (touch is ended, namely dragging is ended) and touch (clicking and zooming) for a PC end browser; in addition, the panoramic scene in the page needs to have a name or ID to facilitate the recording of the corresponding scene operation by the program.
For one operation, one object can be set for recording, and a plurality of continuous operations can be recorded in an array form in an aggregate recorderEvents variable of all operation events. In the object of the single operation, a property event is set to record the event of the operation, a property eventName is set to record the name of the operation, a property eventDefs is set to record the name or ID of a scene before and after switching, and a property eventTime is set to record the time of the event.
In S4, after the system stops recording, the recording converts the API provided by the MediaRecorder into an audio file, and in addition, in addition to the recorderEvents variable operated in the recording sequence, the recorderName and recorderName are set to record the name of the recorder and the theme of the recorded content, respectively, the recorderAudio recording identifier is set, and the above three variables are integrated into one Object by the Object method.
In S6, after the interaction operation record of the "product line explanation a" is uploaded successfully, the interaction operation record is displayed in a "playback" list of the panoramic page, and the user clicks the record in the list, and downloads JSON data and a corresponding recording file corresponding to the interaction operation record from the cloud platform.
In S8, the data in the JSON file is parsed by using the JSON. park () method provided by Javascript, and after parsing, the parsed operation array portion is automatically and sequentially executed by using the attribute methods, such as xml.
In S8, the user clicks to end playback or the playback is completed, and then exits the playback. The user may repeat S6-S8 for playback viewing.
The panoramic interaction recording and playback system based on the cloud platform provided by the invention realizes the functions of guiding and watching and provides the recording and playback functions. The operation in the recording process is recorded and stored through the JSON data format, the size is small, the reading speed is high, the universality is high, the limitation of other conditions is basically avoided, and the operation in the recording and playback process is simple and easy to operate.
Claims (5)
1. A panoramic interaction record playback system based on a cloud platform comprises the cloud platform and method steps for storing, loading and executing interaction record playback, and is characterized in that the method steps comprise:
s1, clicking a recording button in the panoramic page to acquire information of an operation user and triggering interactive recording;
s2, recording user operation in an array form according to three categories of clicking, dragging and zooming by the system in a time sequence, and recording at the same time;
s3, clicking a recording stopping button in the panoramic page to finish interactive recording;
s4, integrating the user operation array, the user information and the recording mark which are recorded in sequence into an Object;
s5, converting the Object into a JSON data format by a JSON.stringiness () method, and uploading the Object and the generated sound recording file to a cloud platform for storage;
s6, storing the updated JSON file and the recording file in the cloud platform, and presenting the JSON file and the recording file in a playback list preset in the panoramic page in a project form;
s7, clicking the items in the playback list, and downloading the corresponding JSON file and the recording file from the cloud platform;
s8, analyzing a user operation array, user information and a recording identifier in the JSON file, and then carrying out further operation analysis aiming at the user operation array; sequentially executing through an application programming interface API provided by a corresponding panoramic script program krpano, and simultaneously playing the recording until the playback is finished or the user actively stops the playback;
in said S2:
recording the operation of a user, and the operation time point and time period through an event object event and a Date object Date provided by Javascript; the types of the event object events comprise mouse down, mouse moving, mouse up, click, roller wheel mouse for a PC end browser, touch start, touch process, touch end, click and zoom touch for a mobile end browser;
setting an object for recording according to one operation of a user, and recording a plurality of continuous operations in a set recorderEvents variable of all operation events in an array form; in the object of the single operation, a property event is set to record the event of the operation, a property eventName is set to record the name of the operation, a property eventDefs is set to record the name or ID of a scene before and after switching, and a property eventTime is set to record the time of the event.
2. The panoramic interaction recording and playback system based on the cloud platform as claimed in claim 1,
the panoramic webpage of the S1 is manufactured by taking a panoramic script program krpano as a support; triggering of the record button controls the pop-up input box for inputting user information.
3. The panoramic interaction recording and playback system based on the cloud platform as claimed in claim 1,
the S3 calls the recording function of the device through the API provided by the MediaRecorder.
4. The cloud platform-based panoramic interaction recording and playback system of claim 1, wherein the panoramic interaction recording and playback system is characterized in that
The S4 converts the sound recording into an audio file through an application programming interface API provided by the MediaRecorder.
5. The panoramic interaction recording and playback system based on the cloud platform as claimed in claim 1,
the S4 integrates the variable recorderName for recording the user name, the variable recorderTheme for recording the content topic, the variable recorderEvents for recording the user operation array, and the variable recorderAudio for recording the recording record identifier into one Object by the Object method.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210776395.9A CN115079914A (en) | 2022-07-04 | 2022-07-04 | Panoramic interaction record playback system based on cloud platform |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210776395.9A CN115079914A (en) | 2022-07-04 | 2022-07-04 | Panoramic interaction record playback system based on cloud platform |
Publications (1)
Publication Number | Publication Date |
---|---|
CN115079914A true CN115079914A (en) | 2022-09-20 |
Family
ID=83256836
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210776395.9A Pending CN115079914A (en) | 2022-07-04 | 2022-07-04 | Panoramic interaction record playback system based on cloud platform |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115079914A (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104572447A (en) * | 2014-12-19 | 2015-04-29 | 中国电子科技集团公司第十五研究所 | Method and system for business process recording and replaying based on Android operation system |
CN106303842A (en) * | 2015-06-08 | 2017-01-04 | 闫冰 | A kind of 3D virtual immersive panorama sound recording system |
CN107797724A (en) * | 2017-06-12 | 2018-03-13 | 平安科技(深圳)有限公司 | Method, apparatus, computer equipment and computer-readable recording medium are shielded in record of attending a banquet |
CN107870725A (en) * | 2017-11-30 | 2018-04-03 | 广东欧珀移动通信有限公司 | Record screen method, apparatus and terminal |
CN111741324A (en) * | 2020-07-03 | 2020-10-02 | 全时云商务服务股份有限公司 | Recording playback method and device and electronic equipment |
CN112817866A (en) * | 2021-02-25 | 2021-05-18 | 北京百家科技集团有限公司 | Recording playback method, device, system, computer equipment and storage medium |
-
2022
- 2022-07-04 CN CN202210776395.9A patent/CN115079914A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104572447A (en) * | 2014-12-19 | 2015-04-29 | 中国电子科技集团公司第十五研究所 | Method and system for business process recording and replaying based on Android operation system |
CN106303842A (en) * | 2015-06-08 | 2017-01-04 | 闫冰 | A kind of 3D virtual immersive panorama sound recording system |
CN107797724A (en) * | 2017-06-12 | 2018-03-13 | 平安科技(深圳)有限公司 | Method, apparatus, computer equipment and computer-readable recording medium are shielded in record of attending a banquet |
CN107870725A (en) * | 2017-11-30 | 2018-04-03 | 广东欧珀移动通信有限公司 | Record screen method, apparatus and terminal |
CN111741324A (en) * | 2020-07-03 | 2020-10-02 | 全时云商务服务股份有限公司 | Recording playback method and device and electronic equipment |
CN112817866A (en) * | 2021-02-25 | 2021-05-18 | 北京百家科技集团有限公司 | Recording playback method, device, system, computer equipment and storage medium |
Non-Patent Citations (1)
Title |
---|
饶小力: "基于iOS的视唱评测***的设计与实现", 《信息科技》 * |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
RU2733919C2 (en) | Method of recording, editing and recreating a computer session | |
US11611701B2 (en) | Method and apparatus for video shooting, terminal device and storage medium | |
CA2943975C (en) | Method for associating media files with additional content | |
US9336685B2 (en) | Video lesson builder system and method | |
US20070006063A1 (en) | Synchronization aspects of interactive multimedia presentation management | |
US20240040199A1 (en) | Video-based interaction method and apparatus, storage medium and electronic device | |
US20040010792A1 (en) | Method and system for providing flexible time-based control of application appearance and behavior | |
US8020084B2 (en) | Synchronization aspects of interactive multimedia presentation management | |
CN102143403B (en) | Method and device for displaying and processing multimedia service, and multimedia service system | |
CN101702941A (en) | Apparatus and method for low bandwidth play position previewing of video content | |
US20170048585A1 (en) | Method and electronic device for feeding back voice information, and tv set | |
CN111800668B (en) | Barrage processing method, barrage processing device, barrage processing equipment and storage medium | |
US20240171801A1 (en) | Video processing method and apparatus, and electronic device and storage medium | |
WO2015103636A2 (en) | Injection of instructions in complex audiovisual experiences | |
JP2023539815A (en) | Minutes interaction methods, devices, equipment and media | |
CN113727170A (en) | Video interaction method, device, equipment and medium | |
US20100034515A1 (en) | Information processing apparatus and method, and program | |
KR20140020852A (en) | Method for customizing the display of descriptive information about media assets | |
CN104883614A (en) | WEB video playing method based on Adobe FlashPlayer and Jquery frame | |
CN115079914A (en) | Panoramic interaction record playback system based on cloud platform | |
WO2023088484A1 (en) | Method and apparatus for editing multimedia resource scene, device, and storage medium | |
Meixner | Annotated interactive non-linear video-software suite, download and cache management | |
CN113392260B (en) | Interface display control method, device, medium and electronic equipment | |
CN114925274A (en) | Media content playing method, device, equipment, storage medium and product | |
CN112596732A (en) | Electronic teaching material manufacturing method and system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220920 |