CN112312115A - Visual transformation method based on panoramic video interaction - Google Patents

Visual transformation method based on panoramic video interaction Download PDF

Info

Publication number
CN112312115A
CN112312115A CN202010650618.8A CN202010650618A CN112312115A CN 112312115 A CN112312115 A CN 112312115A CN 202010650618 A CN202010650618 A CN 202010650618A CN 112312115 A CN112312115 A CN 112312115A
Authority
CN
China
Prior art keywords
panoramic video
interaction
video
panoramic
method based
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010650618.8A
Other languages
Chinese (zh)
Inventor
朱磊
杨晓光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Yispace Technology Co ltd
Original Assignee
Qingdao Yispace Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Yispace Technology Co ltd filed Critical Qingdao Yispace Technology Co ltd
Priority to CN202010650618.8A priority Critical patent/CN112312115A/en
Publication of CN112312115A publication Critical patent/CN112312115A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/302Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404Methods for optical code recognition
    • G06K7/1408Methods for optical code recognition the method being specifically adapted for the type of code
    • G06K7/14172D bar codes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Electromagnetism (AREA)
  • General Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides a visual conversion method based on panoramic video interaction, wherein a user enters panoramic video for watching and interacting by scanning recognizable graphs on a tangible carrier to realize visual conversion from paper graphs to electronic images; secondly, a new form with interactive experience is added to the tangible carrier; thirdly, the different forms of the graph can be identified, so that the immersion feeling of the user in watching the video is further improved; finally, further, the user can also obtain photos and/or videos, people not only obtain the tangible carrier, but also obtain related photos of graphs on the tangible carrier or videos with more free and rich visual angles through the tangible carrier, and more new forms are given to the tangible carrier.

Description

Visual transformation method based on panoramic video interaction
Technical Field
The invention relates to the field of panoramic interaction, in particular to a visual conversion method based on panoramic video interaction.
Technical Field
With the development of the internet, people can know and know the tourism information all over the world through the modes of picture, character, video sharing and the like without going out, in addition, with the deep development of the tourism industry, the VR postcard with collection value has appeared, the VR postcard combines the VR virtual reality technology and the postcard, a user can watch through VR equipment only by scanning the two-dimensional code of the VR postcard, but the virtual reality scene watched through the VR virtual reality is more vivid and hard, and the user also needs to watch through the VR equipment, and the interactivity is poor.
Disclosure of Invention
The present invention has been made in view of the above problems.
The invention provides a visual transformation method based on panoramic video interaction, which comprises the following steps,
the method comprises the steps of firstly, establishing a cloud material library, wherein the material library comprises one or more panoramic videos;
generating recognizable graphs according to the video content of the panoramic video and placing the recognizable graphs on a tangible carrier; wherein the recognizable figure is a plane figure or a three-dimensional figure;
step three, the user enters the panoramic video to watch and interact by scanning the recognizable graph; the panoramic video interaction comprises the steps that interaction is carried out in a viewing interface through a first dragging interaction module so as to change the field angle and/or the field effect of viewing the panoramic video; and the second interaction module is dragged to interact so as to change the horizontal/vertical viewing angle for watching the panoramic video.
Further, the tangible carrier includes a package of postcards, greeting cards, and mineral water bottles.
Further, the recognizable figure is a two-dimensional code.
Further, the identifiable graphic is a graphic corresponding to a particular scene in the panoramic video.
Further, the recognizable graphics are graphics corresponding to the initial playing picture of the panoramic video.
Further, the visual field effect comprises fish eyes, perspective, asteroids and crystal balls.
Further, the story library includes a panoramic image set corresponding to the panoramic video, wherein an image resolution of the panoramic image set is higher than a video resolution of the panoramic video.
Further, the panoramic video interaction comprises the step of obtaining a photo corresponding to the current video picture by clicking the interaction module III in the viewing interface.
Further, the panoramic video interaction comprises the step of obtaining videos corresponding to the video pictures within the corresponding time by pressing the interaction module III for a long time in the viewing interface.
Further, the panoramic video interaction comprises the step of obtaining a video of a video picture corresponding to the change of the visual angle within the corresponding time by long pressing and dragging the interaction module III in the viewing interface.
The invention relates to a visual conversion method based on panoramic video interaction, wherein a user enters panoramic video for watching and interacting by scanning recognizable graphs on a tangible carrier to realize visual conversion from paper graphs to electronic images; secondly, a new form with interactive experience is added to the tangible carrier; thirdly, the different forms of the graph can be identified, so that the immersion feeling of the user in watching the video is further improved; finally, further, the user can also obtain photos and/or videos, people not only obtain the tangible carrier, but also obtain related photos of graphs on the tangible carrier or videos with more free and rich visual angles through the tangible carrier, and more new forms are given to the tangible carrier.
Detailed Description
Hereinafter, exemplary embodiments of the present invention will be described. In the interest of clarity and conciseness, not all features of an actual implementation are described in the specification. It will of course be appreciated that in the development of any such actual embodiment, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which will vary from one implementation to another. Moreover, it will be appreciated that such a development effort might be complex and time-consuming, but would nevertheless be a routine undertaking for those of ordinary skill in the art having the benefit of this disclosure.
The embodiment of the invention provides a visual transformation method based on panoramic video interaction, which comprises the following steps,
step S110, establishing a cloud material library, wherein the material library comprises one or more panoramic videos;
according to the embodiment of the invention, the panoramic video can be acquired by the panoramic acquisition equipment in scenic spots, urban sightseeing spots and other places, and further, a plurality of high-definition panoramic pictures are shot as a panoramic image set corresponding to the panoramic video while the panoramic video is acquired, and the image resolution is higher than the video resolution of the panoramic video.
As an example, it is assumed that an acquired panoramic video a has 24 frames of video frame images, a corresponding panoramic image set of the acquired panoramic video a is Ap, and a first corresponding situation is that the panoramic image set Ap also has 24 high-definition panoramic images in one-to-one correspondence with the video frames of the panoramic video a; or, the second corresponding case is that the panoramic image set Ap has 2 high-definition panoramic images Ap1 and Ap2 corresponding to the video frames of the panoramic video a, where Ap1 corresponds to the first 12 video frame images of the panoramic video a, and Ap2 corresponds to the last 12 video frame images of the panoramic video a.
It should be noted that the above is merely an example, and the corresponding manner of the panoramic video and the panoramic image set is not limited to the example.
Step S120, generating recognizable graphs according to the video content of the panoramic video and placing the recognizable graphs on a tangible carrier; wherein, the recognizable figure is a plane figure or a three-dimensional figure;
according to an embodiment of the invention, the tangible carrier may be, but is not limited to, a package for postcards, greeting cards, and mineral water bottles; the recognizable figure on the tangible carrier can be a two-dimensional code, and further, the recognizable figure can also be a figure corresponding to a specific scene in the panoramic video, wherein the specific scene is, for example, a certain object or objects (such as statues, buildings and the like).
For example, the cover graphic on the postcard with the tangible carrier may be made based on a panoramic video of each tourist attraction, the cover graphic on the postcard may be a panoramic image, or a partial image of a certain angle of the panoramic image, or a three-dimensional graphic of a specific scenery in the panoramic video, and the cover graphic of the postcard may be a recognizable graphic.
Further, the recognizable figure is a figure corresponding to the initial playing picture of the panoramic video, and is specifically explained as that the initial playing angle of the panoramic video is a near view or a distant view of a specific scene, for example, a cover figure on a postcard with a tangible carrier is used as the recognizable figure, the cover figure displays landmark buildings of the scenic spot such as a plaque and a gate containing the name of the scenic spot, a user enters the panoramic video after scanning the cover figure, and the initial viewing angle when entering is that the user stands in front of the plaque and the gate containing the name of the scenic spot, or the user overlooks the plaque and the gate containing the name of the scenic spot from high altitude. In this way, the user's visual conversion from graphics on a tangible carrier to an immersive panoramic video is more directly compact.
Step S130, a user enters panoramic video watching and interacting by scanning recognizable graphs on a tangible carrier; the panoramic video interaction comprises the steps that interaction is carried out in a viewing interface through a first dragging interaction module so as to change the field angle and/or the field effect of viewing the panoramic video; and the second interaction module is dragged to interact so as to change the horizontal/vertical viewing angle for watching the panoramic video. Wherein, the visual field effect comprises a fisheye, a perspective, a asteroid and a crystal ball.
According to the embodiment of the invention, the user can scan and identify the recognizable graph through the mobile phone or the tablet computer.
According to the embodiment of the present invention, the first interactive module may be a sliding control, the presentation form of the sliding control is, for example, a scaled sliding bar or a semicircular dashboard, and dragging of the sliding control corresponds to a change of the two parameters of the field angle and/or the field effect, where the change of the field angle may be a change of the virtual focal length as the presentation form, for example, 0.5 times of the virtual focal length, 1 times of the virtual focal length, 2 times of the virtual focal length, 4 times of the virtual focal length, and the like. The above representation is merely exemplary, and those skilled in the art can design other forms of sliding control according to the principles of the present invention, and the present invention should not be limited thereto.
According to the embodiment of the invention, the second interaction module can be an analog rocker, the analog rocker can be dragged in any direction from top to bottom, left to right, and corresponds to the continuous change of the horizontal visual angle and the vertical visual angle, the dragging of the analog rocker enables the visual angle to be continuously changed along the dragging direction, so that the playing visual angle of the panoramic video is changed more smoothly, and the change of the visual angle is more flexible and convenient than the change of the visual angle through interaction of a gyroscope and/or a sliding gesture.
The user gets into watching of panoramic video behind the recognizable figure of scanning, carries out the panorama interaction on the basis of watching, and the angle of watching is mastered in a flexible way freely, makes to watch and experiences abundanter comprehensive.
Further, the panoramic video interaction also comprises the step of obtaining a photo corresponding to the current video picture by clicking the interaction module III in the watching interface, or obtaining a video corresponding to the video picture within the corresponding time by pressing the interaction module III.
According to the embodiment of the invention, the third interactive module can be a shooting button, a user clicks or long-presses the shooting button to shoot or record a video on the basis of watching and interacting, and the obtained photos or videos can be a screenshot/screenshot sequence on a video frame or a screenshot/screenshot sequence on a corresponding panoramic image in a panoramic image set. The method for screenshot/screenshot sequence is the prior art and is not described herein again.
Like this, the user has not only obtained the paper postcard as commemoration, can also obtain the photo or the more free abundant video of visual angle of relevant scenery through the paper postcard.
Further, the panoramic video interaction also comprises the step of obtaining the video of the video picture corresponding to the change of the visual angle within the corresponding time by long-time pressing and dragging the interaction module III in the viewing interface.
According to the embodiment of the invention, the shooting button can be dragged up and down within a certain range, the dragging of the shooting button corresponds to the dragging of the slider for changing two parameters of the angle of field and/or the effect of the field of view, namely, the slider can be dragged alone to change the angle of field and/or the effect of the field of view during interaction, and the shooting button can be dragged to change the angle of field and/or the effect of the field of view while shooting the video, so that the visual angle of the shot video is richer. For example, if a shooting button is pressed for a long time and dragged upwards, and the slider moves upwards correspondingly, the virtual focal length corresponding to the shot video gradually increases from 1 time to 4 times, and if dragging is stopped, the virtual focal length stops increasing, and the video shooting is not stopped; the shooting button is pressed for a long time and dragged downwards, the sliding block moves downwards correspondingly, the virtual focal length corresponding to the shot video is gradually reduced from 1 time to 0.5 time, then the downward dragging is carried out, the visual angle of the perspective or fisheye visual effect appears, the visual angle change stops when the dragging is stopped, and the video shooting is not stopped.
It should be noted that the invention does not limit the viewing mode of the panoramic video, and the user can also view the panoramic video through VR equipment or other equipment after scanning and identifying the recognizable figure through a mobile phone or a tablet computer.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as disclosed herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense, and the scope of the present invention is defined by the appended claims.

Claims (10)

1. A visual transformation method based on panoramic video interaction is characterized by comprising the following steps,
the method comprises the steps of firstly, establishing a cloud material library, wherein the material library comprises one or more panoramic videos;
generating recognizable graphs according to the video content of the panoramic video and placing the recognizable graphs on a tangible carrier; wherein the recognizable figure is a plane figure or a three-dimensional figure;
step three, the user enters the panoramic video to watch and interact by scanning the recognizable graph; wherein the panoramic video interaction comprises,
the method comprises the steps that interaction is carried out in a viewing interface through a first dragging interaction module so as to change the field angle and/or the field effect of viewing the panoramic video;
and the second interaction module is dragged to interact so as to change the horizontal/vertical viewing angle for watching the panoramic video.
2. A visual transformation method based on panoramic video interaction as claimed in claim 1, wherein the tangible carrier comprises a package of postcards, greeting cards and mineral water bottles.
3. The visual transformation method based on panoramic video interaction of claim 1, wherein the recognizable graphics are two-dimensional codes.
4. The method of claim 1, wherein the recognizable graphics are graphics corresponding to a specific scene in the panoramic video.
5. The visual transformation method based on panoramic video interaction as claimed in claim 1, wherein the recognizable graphics are graphics corresponding to the initial playing pictures of the panoramic video.
6. The visual transformation method based on panoramic video interaction of claim 1, wherein the visual field effect comprises fisheye, perspective, asteroid and crystal ball.
7. The method of claim 1, wherein the material library comprises a panoramic image set corresponding to the panoramic video, and wherein the image resolution of the panoramic image set is higher than the video resolution of the panoramic video.
8. The visual transformation method based on panoramic video interaction of claim 7, wherein the panoramic video interaction comprises that a photo corresponding to the current video picture is obtained by clicking an interaction module III in a viewing interface.
9. The visual transformation method based on panoramic video interaction of claim 7, wherein the panoramic video interaction comprises that videos corresponding to video pictures in corresponding time are obtained in a viewing interface by pressing an interaction module three for a long time.
10. The visual transformation method based on panoramic video interaction of claim 7, wherein the panoramic video interaction comprises that a video of a video picture corresponding to the change of the view angle within the corresponding time is obtained in a viewing interface by long-pressing and dragging an interaction module three.
CN202010650618.8A 2020-07-08 2020-07-08 Visual transformation method based on panoramic video interaction Pending CN112312115A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010650618.8A CN112312115A (en) 2020-07-08 2020-07-08 Visual transformation method based on panoramic video interaction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010650618.8A CN112312115A (en) 2020-07-08 2020-07-08 Visual transformation method based on panoramic video interaction

Publications (1)

Publication Number Publication Date
CN112312115A true CN112312115A (en) 2021-02-02

Family

ID=74483517

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010650618.8A Pending CN112312115A (en) 2020-07-08 2020-07-08 Visual transformation method based on panoramic video interaction

Country Status (1)

Country Link
CN (1) CN112312115A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101782686A (en) * 2009-09-22 2010-07-21 吉林大学 Manufacturing method of large LED (light emitting diode) screen of 3D (three dimensional) television
CN102404599A (en) * 2011-12-01 2012-04-04 无锡太行电子技术有限公司 Method for making gradually-changing 3D (three-dimensional) video special effect
US20170157512A1 (en) * 2015-12-06 2017-06-08 Sliver VR Technologies, Inc. Methods and systems for computer video game streaming, highlight, and replay
CN106899870A (en) * 2017-02-23 2017-06-27 任刚 A kind of VR contents interactive system and method based on intelligent television and mobile terminal
CN108769739A (en) * 2018-06-27 2018-11-06 哈尔滨市舍科技有限公司 The method that picture and short-sighted frequency are obtained from panoramic video
CN109493088A (en) * 2018-10-31 2019-03-19 周更新 A kind of commodity traceability system that on-line off-line MULTIPLE DYNAMIC is anti-fake
CN110545438A (en) * 2019-09-05 2019-12-06 青岛一舍科技有限公司 Panoramic play interaction device and panoramic play interaction method
CN110588208A (en) * 2019-09-21 2019-12-20 云南大筑科技有限公司 VR postcard method based on Internet

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101782686A (en) * 2009-09-22 2010-07-21 吉林大学 Manufacturing method of large LED (light emitting diode) screen of 3D (three dimensional) television
CN102404599A (en) * 2011-12-01 2012-04-04 无锡太行电子技术有限公司 Method for making gradually-changing 3D (three-dimensional) video special effect
US20170157512A1 (en) * 2015-12-06 2017-06-08 Sliver VR Technologies, Inc. Methods and systems for computer video game streaming, highlight, and replay
CN106899870A (en) * 2017-02-23 2017-06-27 任刚 A kind of VR contents interactive system and method based on intelligent television and mobile terminal
CN108769739A (en) * 2018-06-27 2018-11-06 哈尔滨市舍科技有限公司 The method that picture and short-sighted frequency are obtained from panoramic video
CN109493088A (en) * 2018-10-31 2019-03-19 周更新 A kind of commodity traceability system that on-line off-line MULTIPLE DYNAMIC is anti-fake
CN110545438A (en) * 2019-09-05 2019-12-06 青岛一舍科技有限公司 Panoramic play interaction device and panoramic play interaction method
CN110588208A (en) * 2019-09-21 2019-12-20 云南大筑科技有限公司 VR postcard method based on Internet

Similar Documents

Publication Publication Date Title
CN106101741B (en) Method and system for watching panoramic video on network video live broadcast platform
US9262996B2 (en) Apparatus and method for displaying images
EP3603054B1 (en) Method and apparatus for rendering timed text and graphics in virtual reality video
KR101692335B1 (en) System for augmented reality image display and method for augmented reality image display
US20180160194A1 (en) Methods, systems, and media for enhancing two-dimensional video content items with spherical video content
US11363325B2 (en) Augmented reality apparatus and method
KR20140082610A (en) Method and apaaratus for augmented exhibition contents in portable terminal
JP2012080431A (en) Panoramic image display device and panoramic image display method
CN104834375A (en) Amusement park guide system based on augmented reality
CN105939497B (en) Media streaming system and media streaming method
CN110930517A (en) Panoramic video interaction system and method
US9851868B2 (en) Multi-story visual experience
KR102257132B1 (en) Methods, systems and media for creating and rendering immersive video content
US20230018814A1 (en) Integrating overlaid digital content into displayed data via graphics processing circuitry
US20150026576A1 (en) Visual Storytelling on a Mobile Media-Consumption Device
US20150161799A1 (en) 3d immersion technology
WO2019004073A1 (en) Image placement determination device, display control device, image placement determination method, display control method, and program
CN112312115A (en) Visual transformation method based on panoramic video interaction
US11481933B1 (en) Determining a change in position of displayed digital content in subsequent frames via graphics processing circuitry
KR101965404B1 (en) Caption supporting apparatus and method of user viewpoint centric for Virtual Reality video contents
US20230334790A1 (en) Interactive reality computing experience using optical lenticular multi-perspective simulation
US20230334791A1 (en) Interactive reality computing experience using multi-layer projections to create an illusion of depth
US20230334792A1 (en) Interactive reality computing experience using optical lenticular multi-perspective simulation
DeHart Directing audience attention: cinematic composition in 360 natural history films
US20230326095A1 (en) Overlaying displayed digital content with regional transparency and regional lossless compression transmitted over a communication network via processing circuitry

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210202

RJ01 Rejection of invention patent application after publication