CN115079914A - Panoramic interaction record playback system based on cloud platform - Google Patents

Panoramic interaction record playback system based on cloud platform Download PDF

Info

Publication number
CN115079914A
CN115079914A CN202210776395.9A CN202210776395A CN115079914A CN 115079914 A CN115079914 A CN 115079914A CN 202210776395 A CN202210776395 A CN 202210776395A CN 115079914 A CN115079914 A CN 115079914A
Authority
CN
China
Prior art keywords
recording
panoramic
cloud platform
user
playback
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210776395.9A
Other languages
Chinese (zh)
Inventor
孙德宝
王坤
魏纪坤
赵星磊
王恬
逄晓刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Jerei Digital Technology Co Ltd
Original Assignee
Shandong Jerei Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Jerei Digital Technology Co Ltd filed Critical Shandong Jerei Digital Technology Co Ltd
Priority to CN202210776395.9A priority Critical patent/CN115079914A/en
Publication of CN115079914A publication Critical patent/CN115079914A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486Drag-and-drop
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • G06F16/116Details of conversion of file system types or formats
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11CSTATIC STORES
    • G11C7/00Arrangements for writing information into, or reading information out from, a digital store
    • G11C7/16Storage of analogue signals in digital stores using an arrangement comprising analogue/digital [A/D] converters, digital memories and digital/analogue [D/A] converters 

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention relates to the technical field of new-generation information, in particular to a panoramic interaction recording and playback system based on a cloud platform, which is characterized by comprising the following components: s1, starting recording; s2, recording simultaneous recording in time sequence and array form according to three categories of clicking, dragging and zooming by the system; s3, stopping recording; s4, integrating the user operation array, the user information and the recording mark which are recorded in sequence into an Object; s5, converting the Object into a JSON data format, and uploading the JSON data format and the sound recording file to a cloud platform; s6, the JSON and the sound recording file are presented in a playback list of the panoramic page; s7, clicking the playback list, and downloading the corresponding JSON and the recording file from the cloud platform; and S8, analyzing and simultaneously playing the recording until the recording is finished or the user actively stops playing. The invention has the advantages of less occupied resources, simple access and strong universality.

Description

Panoramic interaction record playback system based on cloud platform
Technical Field
The invention relates to the technical field of new-generation information, in particular to a panoramic interaction recording and playback system based on a cloud platform.
Background
At present, the online panoramic display mode becomes one of important ways for numerous brand manufacturers to perform brand promotion and obtain business leads online.
Nowadays, the online panorama basically performs basic explanation introduction on the exhibition content of the panorama in the form of an online navigation tape or an explanation video embedded in the panorama. Both of these approaches still present some problems while providing a convenient way of teaching based on panoramic presentations. The online guide belt viewing is greatly influenced by the network environment of both the belt viewing party and the video viewing party, and the smooth belt viewing experience can be obtained only when both the belt viewing party and the video viewing party are in a good network environment with low delay; the video format is generally large in size and has high requirements on compatibility of equipment system environment and browsers.
Disclosure of Invention
In order to solve the problems, the invention provides a cloud platform-based panoramic interaction recording and playback system which is light in weight, easy to access and high in universality by means of JSON data formats and functions of page behavior monitoring, background communication support, equipment recording function call and the like provided by Javascript.
In order to realize the purpose, the invention adopts the following technical scheme:
a panoramic interaction record playback system based on a cloud platform comprises the cloud platform and method steps which are operated on the cloud platform and used for storing, loading and executing interaction record playback, and is characterized in that the method steps comprise:
s1, clicking a recording button in the panoramic page to acquire information of an operation user and triggering interactive recording;
s2, recording user operation in an array form according to three categories of clicking, dragging and zooming by the system in a time sequence, and recording at the same time;
s3, clicking a recording stopping button in the panoramic page to finish interactive recording;
s4, integrating the user operation array, the user information and the recording mark which are recorded in sequence into an Object;
s5, converting the Object into a JSON data format by a JSON.stringiness () method, and uploading the Object and the generated sound recording file to a cloud platform for storage;
s6, the updated JSON file and the sound recording file stored in the cloud platform are presented in a playback list preset in the panoramic page in a project mode;
s7, clicking the items in the playback list, and downloading the corresponding JSON file and the recording file from the cloud platform;
s8, analyzing a user operation array, user information and a recording identifier in the JSON file, and then carrying out further operation analysis aiming at the user operation array; and sequentially executing through an application programming interface API (application programming interface) provided by the corresponding panoramic script program krpano, and simultaneously playing the recording until the playback is finished or the user actively stops the playback.
In an embodiment of the present invention, the panoramic webpage of S1 is produced with the panoramic script program krpano as a support; and triggering a recording button in the panoramic webpage to control a popup input box for inputting user information.
In one embodiment of the present invention, the S2 invokes the recording function of the device through an API provided by the MediaRecorder.
In an embodiment of the present invention, the S2 records the operation of the user and the operation time point and time period through the event object event and the Date object Date provided by Javascript; the types of the event object events comprise mouse down, mouse moving, mouse up, click, wheel mouse, touch start, touch process touch move, touch end, click and zoom touch for a PC end browser.
In an embodiment of the present invention, the S2 sets an object for recording for an operation of a user, and a plurality of consecutive operations are recorded in the form of an array in the collective recorderEvents variable of all operation events; in the object of the single operation, a property event is set to record the event of the operation, a property eventName is set to record the name of the operation, a property eventDefs is set to record the name or ID of a scene before and after switching, and a property eventTime is set to record the time of the event.
In one embodiment of the present invention, the S4 converts the sound recording into an audio file through an API provided by the MediaRecorder.
In an embodiment of the present invention, the S4 integrates the variable recorderName for recording the user name, the variable recorderTheme for recording the content title, the variable recorderEvents for recording the user operation array, and the variable recorderAudio for recording the recording identifier into an Object by the Object method.
In an embodiment of the present invention, the S8 parses the data in the JSON file by using a json.parse () method provided by Javascript, and performs automatic sequential execution on the parsed operation array portion by using attribute methods, such as xml.scene, xml.hlookat, xml.vlookat, xml.fov, and the like, provided by the panorama script program krpano, and simultaneously plays the sound record to realize playback.
Compared with the prior art, the invention has the beneficial effects that:
1. on the basis of on-line watching, the invention provides a set of flexible and easy-to-operate recording playback system, so that the on-line watching gets rid of the limitation on network environments of both parties, and a relatively smooth on-line watching experience can be obtained even under the condition of high delay;
2. the invention stores data such as operation records and the like through JSON, has smaller volume compared with a video format, has smaller requirements on compatibility and the like of various panoramic scripts, languages, running environments and the like, and is more universal;
3. aiming at the characteristics of the displayed content, the invention can lead the user to have more choices when checking the playback by recording a plurality of pieces.
Drawings
Fig. 1 is a schematic diagram of a recording flow of the panoramic interactive recording and playback system of the present invention;
fig. 2 is a schematic playback flow diagram of the panoramic interactive recording and playback system of the present invention.
Detailed Description
The following examples further illustrate the embodiments of the present invention in detail. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
The embodiment provides a panorama interactive recording playback system based on cloud platform, utilizes current cloud platform to save, load and carry out each interactive recording playback step, uses the scene to explain in the panorama factory of certain medical enterprise and records to A product line, and the panorama webpage script program of use is krpano, and the webpage program of use includes HTML, CSS, Javascript, and interactive recording playback step mainly includes:
s1, the recorder clicks a recording button on the panoramic page to acquire user information of the recorder, the recording button is changed into a recording stopping button, and the system starts to enter an interactive recording program;
s2, a recorder operates the panoramic webpage, for example, clicking a scene thumbnail to switch scenes, dragging to switch a current scene visual angle, zooming to adjust the zooming ratio of the current scene, the system records the operations of a user in an array form and a time sequence according to three categories of clicking, dragging and zooming, and simultaneously calls an equipment recording system to record;
s3, after the operation demonstration is finished, the recorder clicks a recording stopping button in the panoramic page to finish the interactive recording and finish the recording;
s4, after the recorder stops recording, the system integrates the user operation array, the recorder user information and the recording mark into an Object;
s5, converting the Object into a JSON data format by a JSON.stringiness () method, and uploading the Object and the generated sound recording file to a cloud platform for storage;
s6, a playback list is arranged in the panoramic page, and after uploading is successful, the list is updated, and the latest interaction records are displayed in the list;
s7, clicking the interactive record in the playback list by the user, and downloading the corresponding JSON data and the corresponding recording file from the cloud platform;
s8, analyzing a user operation array, user information and a recording identifier in JSON, further analyzing the user operation array, sequentially executing through an application programming interface API provided by the corresponding panoramic script program krpano, and simultaneously playing the recording until playback is completed or the user actively stops playback.
Further, in S1, the panoramic webpage is produced with the panoramic script program krpano as a support, and a "record" button is added to the panoramic webpage; the recorder clicks the 'record' button to pop up two input boxes, and the recorder is required to fill in the subject and the recorder name respectively. After the input is finished, namely the user information of the recorder is obtained, the interactive record is started, and meanwhile, the state of the button is changed from 'recording' to 'recording ending' through the lnnerText attribute and the className attribute provided by JS.
Further, in S2, the interactive recording is mainly composed of two parts, one is to call the recording function of the device through the API provided by the MediaRecorder to start recording; and secondly, recording the operation of the recorder, the operation time point and the operation time period through the event object event and the Date object Date provided by the Javascript. The event object types are generally mousetown (mouse is pressed down, namely dragging is started), mouseove (mouse is moved, namely dragging is started), mouseup (mouse is lifted, namely dragging is ended), click (clicking), mousewheel (roller wheel, namely zooming), touchstart (touch is started, namely dragging is started), touchmove (touch is started, namely dragging is ended), touchend (touch is ended, namely dragging is ended) and touch (clicking and zooming) for a PC end browser; in addition, the panoramic scene in the page needs to have a name or ID to facilitate the recording of the corresponding scene operation by the program.
For one operation, one object can be set for recording, and a plurality of continuous operations can be recorded in an array form in an aggregate recorderEvents variable of all operation events. In the object of the single operation, a property event is set to record the event of the operation, a property eventName is set to record the name of the operation, a property eventDefs is set to record the name or ID of a scene before and after switching, and a property eventTime is set to record the time of the event.
In S4, after the system stops recording, the recording converts the API provided by the MediaRecorder into an audio file, and in addition, in addition to the recorderEvents variable operated in the recording sequence, the recorderName and recorderName are set to record the name of the recorder and the theme of the recorded content, respectively, the recorderAudio recording identifier is set, and the above three variables are integrated into one Object by the Object method.
In S6, after the interaction operation record of the "product line explanation a" is uploaded successfully, the interaction operation record is displayed in a "playback" list of the panoramic page, and the user clicks the record in the list, and downloads JSON data and a corresponding recording file corresponding to the interaction operation record from the cloud platform.
In S8, the data in the JSON file is parsed by using the JSON. park () method provided by Javascript, and after parsing, the parsed operation array portion is automatically and sequentially executed by using the attribute methods, such as xml.
In S8, the user clicks to end playback or the playback is completed, and then exits the playback. The user may repeat S6-S8 for playback viewing.
The panoramic interaction recording and playback system based on the cloud platform provided by the invention realizes the functions of guiding and watching and provides the recording and playback functions. The operation in the recording process is recorded and stored through the JSON data format, the size is small, the reading speed is high, the universality is high, the limitation of other conditions is basically avoided, and the operation in the recording and playback process is simple and easy to operate.

Claims (5)

1. A panoramic interaction record playback system based on a cloud platform comprises the cloud platform and method steps for storing, loading and executing interaction record playback, and is characterized in that the method steps comprise:
s1, clicking a recording button in the panoramic page to acquire information of an operation user and triggering interactive recording;
s2, recording user operation in an array form according to three categories of clicking, dragging and zooming by the system in a time sequence, and recording at the same time;
s3, clicking a recording stopping button in the panoramic page to finish interactive recording;
s4, integrating the user operation array, the user information and the recording mark which are recorded in sequence into an Object;
s5, converting the Object into a JSON data format by a JSON.stringiness () method, and uploading the Object and the generated sound recording file to a cloud platform for storage;
s6, storing the updated JSON file and the recording file in the cloud platform, and presenting the JSON file and the recording file in a playback list preset in the panoramic page in a project form;
s7, clicking the items in the playback list, and downloading the corresponding JSON file and the recording file from the cloud platform;
s8, analyzing a user operation array, user information and a recording identifier in the JSON file, and then carrying out further operation analysis aiming at the user operation array; sequentially executing through an application programming interface API provided by a corresponding panoramic script program krpano, and simultaneously playing the recording until the playback is finished or the user actively stops the playback;
in said S2:
recording the operation of a user, and the operation time point and time period through an event object event and a Date object Date provided by Javascript; the types of the event object events comprise mouse down, mouse moving, mouse up, click, roller wheel mouse for a PC end browser, touch start, touch process, touch end, click and zoom touch for a mobile end browser;
setting an object for recording according to one operation of a user, and recording a plurality of continuous operations in a set recorderEvents variable of all operation events in an array form; in the object of the single operation, a property event is set to record the event of the operation, a property eventName is set to record the name of the operation, a property eventDefs is set to record the name or ID of a scene before and after switching, and a property eventTime is set to record the time of the event.
2. The panoramic interaction recording and playback system based on the cloud platform as claimed in claim 1,
the panoramic webpage of the S1 is manufactured by taking a panoramic script program krpano as a support; triggering of the record button controls the pop-up input box for inputting user information.
3. The panoramic interaction recording and playback system based on the cloud platform as claimed in claim 1,
the S3 calls the recording function of the device through the API provided by the MediaRecorder.
4. The cloud platform-based panoramic interaction recording and playback system of claim 1, wherein the panoramic interaction recording and playback system is characterized in that
The S4 converts the sound recording into an audio file through an application programming interface API provided by the MediaRecorder.
5. The panoramic interaction recording and playback system based on the cloud platform as claimed in claim 1,
the S4 integrates the variable recorderName for recording the user name, the variable recorderTheme for recording the content topic, the variable recorderEvents for recording the user operation array, and the variable recorderAudio for recording the recording record identifier into one Object by the Object method.
CN202210776395.9A 2022-07-04 2022-07-04 Panoramic interaction record playback system based on cloud platform Pending CN115079914A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210776395.9A CN115079914A (en) 2022-07-04 2022-07-04 Panoramic interaction record playback system based on cloud platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210776395.9A CN115079914A (en) 2022-07-04 2022-07-04 Panoramic interaction record playback system based on cloud platform

Publications (1)

Publication Number Publication Date
CN115079914A true CN115079914A (en) 2022-09-20

Family

ID=83256836

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210776395.9A Pending CN115079914A (en) 2022-07-04 2022-07-04 Panoramic interaction record playback system based on cloud platform

Country Status (1)

Country Link
CN (1) CN115079914A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104572447A (en) * 2014-12-19 2015-04-29 中国电子科技集团公司第十五研究所 Method and system for business process recording and replaying based on Android operation system
CN106303842A (en) * 2015-06-08 2017-01-04 闫冰 A kind of 3D virtual immersive panorama sound recording system
CN107797724A (en) * 2017-06-12 2018-03-13 平安科技(深圳)有限公司 Method, apparatus, computer equipment and computer-readable recording medium are shielded in record of attending a banquet
CN107870725A (en) * 2017-11-30 2018-04-03 广东欧珀移动通信有限公司 Record screen method, apparatus and terminal
CN111741324A (en) * 2020-07-03 2020-10-02 全时云商务服务股份有限公司 Recording playback method and device and electronic equipment
CN112817866A (en) * 2021-02-25 2021-05-18 北京百家科技集团有限公司 Recording playback method, device, system, computer equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104572447A (en) * 2014-12-19 2015-04-29 中国电子科技集团公司第十五研究所 Method and system for business process recording and replaying based on Android operation system
CN106303842A (en) * 2015-06-08 2017-01-04 闫冰 A kind of 3D virtual immersive panorama sound recording system
CN107797724A (en) * 2017-06-12 2018-03-13 平安科技(深圳)有限公司 Method, apparatus, computer equipment and computer-readable recording medium are shielded in record of attending a banquet
CN107870725A (en) * 2017-11-30 2018-04-03 广东欧珀移动通信有限公司 Record screen method, apparatus and terminal
CN111741324A (en) * 2020-07-03 2020-10-02 全时云商务服务股份有限公司 Recording playback method and device and electronic equipment
CN112817866A (en) * 2021-02-25 2021-05-18 北京百家科技集团有限公司 Recording playback method, device, system, computer equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
饶小力: "基于iOS的视唱评测***的设计与实现", 《信息科技》 *

Similar Documents

Publication Publication Date Title
RU2733919C2 (en) Method of recording, editing and recreating a computer session
US11611701B2 (en) Method and apparatus for video shooting, terminal device and storage medium
CA2943975C (en) Method for associating media files with additional content
US9336685B2 (en) Video lesson builder system and method
US20070006063A1 (en) Synchronization aspects of interactive multimedia presentation management
US20240040199A1 (en) Video-based interaction method and apparatus, storage medium and electronic device
US20040010792A1 (en) Method and system for providing flexible time-based control of application appearance and behavior
US8020084B2 (en) Synchronization aspects of interactive multimedia presentation management
CN102143403B (en) Method and device for displaying and processing multimedia service, and multimedia service system
CN101702941A (en) Apparatus and method for low bandwidth play position previewing of video content
US20170048585A1 (en) Method and electronic device for feeding back voice information, and tv set
CN111800668B (en) Barrage processing method, barrage processing device, barrage processing equipment and storage medium
US20240171801A1 (en) Video processing method and apparatus, and electronic device and storage medium
WO2015103636A2 (en) Injection of instructions in complex audiovisual experiences
JP2023539815A (en) Minutes interaction methods, devices, equipment and media
CN113727170A (en) Video interaction method, device, equipment and medium
US20100034515A1 (en) Information processing apparatus and method, and program
KR20140020852A (en) Method for customizing the display of descriptive information about media assets
CN104883614A (en) WEB video playing method based on Adobe FlashPlayer and Jquery frame
CN115079914A (en) Panoramic interaction record playback system based on cloud platform
WO2023088484A1 (en) Method and apparatus for editing multimedia resource scene, device, and storage medium
Meixner Annotated interactive non-linear video-software suite, download and cache management
CN113392260B (en) Interface display control method, device, medium and electronic equipment
CN114925274A (en) Media content playing method, device, equipment, storage medium and product
CN112596732A (en) Electronic teaching material manufacturing method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20220920