CN113259602B - Method and system for scheduling interactive holographic video - Google Patents
Method and system for scheduling interactive holographic video Download PDFInfo
- Publication number
- CN113259602B CN113259602B CN202110658214.8A CN202110658214A CN113259602B CN 113259602 B CN113259602 B CN 113259602B CN 202110658214 A CN202110658214 A CN 202110658214A CN 113259602 B CN113259602 B CN 113259602B
- Authority
- CN
- China
- Prior art keywords
- video
- holographic video
- holographic
- demonstration
- interactive
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 101
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000003993 interaction Effects 0.000 claims abstract description 39
- 230000009471 action Effects 0.000 claims abstract description 22
- 230000005540 biological transmission Effects 0.000 claims description 28
- 238000001514 detection method Methods 0.000 claims description 8
- 230000000694 effects Effects 0.000 claims description 7
- 238000004519 manufacturing process Methods 0.000 claims description 5
- 230000000007 visual effect Effects 0.000 abstract description 4
- 238000012545 processing Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 5
- 239000012528 membrane Substances 0.000 description 3
- 230000004044 response Effects 0.000 description 2
- 230000001154 acute effect Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000001093 holography Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to a method and a system for scheduling an interactive holographic video, wherein the method comprises the following steps: detecting the current scene type; responding to the fact that the current scene type is a demonstration scene, and sending demonstration holographic videos to a plurality of different-place demonstration areas; the demonstration holographic video is obtained by fusing a product demonstration holographic video and a first holographic video which is made according to a host demonstration action recorded in a studio in real time; and responding to the received live real-time video of the different-place demonstration area, and sending the live real-time video to the studio. The invention can simultaneously perform demonstration and interaction in a plurality of places and has the same visual effect as local demonstration and interaction. The system and the method can be applied to various occasions, such as a plurality of remote product release meetings, exhibition and marketing meetings, exhibit introduction meetings and the like, and are widely applied.
Description
Technical Field
The invention relates to the technical field of holography, in particular to a method and a system for scheduling an interactive holographic video.
Background
With the development of the holographic technology, demonstration scenes such as teaching demonstration, product release and the like are increasingly applied to the holographic technology. Including holographic techniques used in some static display devices, such as the utility model patent with application number 201220151072.2 entitled "a holographic display device," provides a holographic display device that forms a suspended holographic image through holographic imaging glass. Holographic techniques applied in some dynamic scenarios are also included. The utility model discloses a utility model patent of application number 201621281710.7, title "stage with holographic membrane structure" discloses a stage, and it includes two stages, one is the first stage that is located the front end, is used for the actor to perform, and one is the second stage that can be located the rear end, is provided with the holographic membrane frame of slope before first stage and second stage, and spectator can see the virtual image that presents through the holographic membrane. The virtual image is combined with the performance of the actor to thereby exhibit a beautiful stage effect. Holographic techniques may also be used in some teaching systems. The invention application with the name of 'holographic display teaching system' and the application number of 201611177530.9 provides a teaching system for teachers to use in class, which adopts a holographic projector and a holographic projection screen as projection parts, the holographic projector is connected with a data equipment processor, and the data equipment processor is controlled by a play controller. In use, the data device processor is controlled to switch, play or stop the presented holographic image or video by operating the play controller. In the product display system, the invention application with the invention name of 'an interactive holographic system' with the application number of 201621330944.6 provides a system, which acquires a scene image and character action information through a 3D camera, and makes the scene image and the character action information into a holographic image to be superimposed on an original holographic image, thereby forming an interactive holographic image with the original holographic image.
Although the holographic technology is adopted in the various devices and systems to improve the visual effect during display and performance, the holographic projections played in the various schemes are all the holographic pictures or videos recorded in advance, and only need to be played during use. Although the invention application named as an interactive holographic system can adopt a 3D camera to acquire scene images and character action information, and make the scene images and the character action information into holographic images to be superposed into original holographic images, the system only gives the enlightenment of superposing the holographic images recorded on site into the original holographic images played on site, and does not disclose more details for realizing interaction. In addition, for remote demonstration needing interaction, the prior realization method generally comprises the steps that a demonstration host demonstrates in a main meeting place and records a live video to be sent to other branch meeting places, audiences of the branch meeting places watch the live broadcast of the main meeting place through a screen, and the host interacts with the branch meeting places through the video in an interaction link after the demonstration of the host of the main meeting place is finished. Because the realization mode only demonstrates through the screen, the screen demonstration effect is much worse than the holographic demonstration effect from the view point, the branch meeting place can not form effective interaction with the host in the demonstration process from the interaction point, and the demonstration in the special interaction link is only limited to the screen demonstration, which is not visual and comprehensive.
Disclosure of Invention
Aiming at the technical problems in the prior art, the invention provides a method and a system for scheduling an interactive holographic video, which are used for distributing adaptive holographic videos to a studio or a remote demonstration area in different application scenes.
In order to solve the above technical problem, according to an aspect of the present invention, there is provided an interactive holographic video scheduling method, including:
detecting the current scene type;
responding to the fact that the current scene type is a demonstration scene, and sending demonstration holographic videos to a plurality of different-place demonstration areas; the demonstration holographic video is obtained by fusing a product demonstration holographic video and a first holographic video, and the first holographic video is a holographic video manufactured according to a host demonstration action video recorded in a studio in real time; and
and responding to the received live real-time video of the different-place demonstration area, and sending the live real-time video to a studio for playing.
Preferably, the method for scheduling an interactive holographic video further includes: responding to the current scene type as an interactive scene, and sending an interactive holographic video to a different-place demonstration area selected by a host; the interactive holographic video is obtained by fusing a product demonstration holographic video and a second holographic video, and the second holographic video is a holographic video which is manufactured according to an interactive action video which is recorded in real time in a studio and is made by responding to a different-place demonstration area by a host.
Preferably, the method for scheduling an interactive holographic video further includes: and detecting the current scene type according to an instruction sent by a studio or the production process of the holographic video.
Preferably, the method for scheduling an interactive holographic video further comprises the following steps:
calling a third holographic video from the holographic video library, wherein the third holographic video is stored in the database and is used as an interactive substitute holographic video; and
transmitting the third holographic video to the remaining plurality of displaced presentation areas.
Preferably, the method for scheduling an interactive holographic video further comprises the following steps:
when detecting that the host changes the remote demonstration area interacting with the host, sending a fourth holographic video to the remote demonstration area newly selected by the host; the fourth holographic video is a transitional holographic video which is connected with the third holographic video and the interactive holographic video; and
and sending the interactive holographic video to the remote demonstration area newly selected by the host.
Preferably, the method for scheduling an interactive holographic video further comprises the following steps:
recording a video sending record for sending the holographic video to a different-place demonstration area;
querying the video transmission record before transmitting a new third holographic video to the allopatric presentation area; and
and selecting a third holographic video different from the previous holographic video to be sent to the allopatric demonstration area.
Preferably, in the method for scheduling interactive holographic video, the time for playing the third holographic video in each different-place demonstration area is monitored, and when the time for playing the third holographic video in the different-place demonstration area reaches the time set by the preset conditions, a new third holographic video is sent to the different-place demonstration area.
Preferably, the preset condition is a timing time period or a duration of a currently played third holographic video.
Preferably, the third holographic video sent to the remaining plurality of displaced presentation areas is the same or different.
Preferably, the method for scheduling an interactive holographic video further includes:
responding to a playing request of the product demonstration holographic video, and sending the product demonstration holographic video to a display screen of a studio for playing and displaying.
Preferably, the method for scheduling an interactive holographic video further includes:
and responding to the generation of the demonstration/interactive holographic video, and sending the demonstration/interactive holographic video to a display screen of the studio for playing.
According to another aspect of the present invention, the present invention further provides a scheduling system for interactive holographic video, which includes a detection module, a video acquisition module and a video transmission module, wherein the detection module is configured to detect a current scene type and determine a remote presentation area for receiving the holographic video; the video acquisition module is connected with the detection module and is configured to acquire the holographic video which needs to be sent to a different-place demonstration area and/or a studio according to the current scene type; the holographic video comprises a demonstration holographic video obtained by fusing a product demonstration holographic video and a first holographic video which is manufactured according to a host demonstration action video which is recorded in real time in a studio, or an interactive holographic video obtained by fusing a product demonstration holographic video and a second holographic video which is manufactured according to an interactive action video which is recorded in real time in the studio and is made by responding to a different demonstration area by a host, or a third holographic video which is used as an interactive substitute, or a fourth holographic video which is used for connecting the third holographic video and the interactive holographic video; the video transmission module is configured to send the holographic video acquired by the video acquisition module to the corresponding different-place demonstration area and/or the studio respectively, and send the received different-place demonstration area live real-time video to the studio.
Preferably, the detection module receives a demonstration/interaction instruction from the studio and identity information of a remote demonstration area for appointed interaction.
Preferably, the scheduling system of the interactive holographic video further comprises a recording module configured to record the holographic video transmitted to the different-place presentation area, so as to obtain a video transmission record.
Preferably, the interactive holographic video scheduling system further includes a plurality of timers, connected to the video transmission module, configured to send a notification to the video transmission module when the video transmission module sends the third holographic video to each different-place presentation area, and the timer corresponding to the different-place presentation area is timed according to a preset time period or the current time duration of the third holographic video, and when the time duration reaches the set time.
By applying the holographic technology, the invention enables the demonstration and interaction of a plurality of places to be vivid and vivid at the same time, and has the same visual effect as local demonstration and interaction. The invention can be applied to various occasions, such as a multi-place remote product release meeting, an exhibition and marketing meeting, an exhibit introduction meeting and the like, and has wide application.
Drawings
Preferred embodiments of the present invention will now be described in further detail with reference to the accompanying drawings, in which:
FIG. 1 is a block diagram of a remote interactive holographic presentation system according to an embodiment of the present invention;
FIG. 2 is a field schematic of a studio according to one embodiment of the present invention;
FIG. 3 is a functional block diagram of a studio system according to one embodiment of the present invention;
FIG. 4 is a functional block diagram of a video scheduling system according to one embodiment of the present invention;
FIG. 5 is a flow diagram of a method for scheduling interactive holographic video, according to one embodiment of the present invention;
FIG. 6 is a flow diagram of video scheduling when playing a third holographic video, according to one embodiment of the present invention; and
FIG. 7 is a block diagram of a presentation interaction system for a displaced presentation area, according to one embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the following detailed description, reference is made to the accompanying drawings that form a part hereof and in which is shown by way of illustration specific embodiments of the application. In the drawings, like numerals describe substantially similar components throughout the different views. Various specific embodiments of the present application are described in sufficient detail below to enable those skilled in the art to practice the teachings of the present application. It is to be understood that other embodiments may be utilized and structural, logical or electrical changes may be made to the embodiments of the present application.
Fig. 1 is a block diagram of a remote interactive holographic presentation system including a studio system 10 and a plurality of remote presentation area presentation interactive systems 30a-30n for data transmission over a network 20, according to one embodiment of the present invention. Wherein, some devices of the studio system 10 are located in the studio T, some devices are located in a machine room located at the same place as the studio, and the two transmit data and control signals through an internal network; alternatively, some of the devices are cloud platforms provided by a certain service provider, which transmit data and control signals with the studio T through a dedicated transmission line or the internet.
Wherein fig. 2 is a field schematic diagram of a studio according to one embodiment of the present invention, and fig. 3 is a functional block diagram of a studio system according to one embodiment of the present invention. Referring to fig. 3, the studio system 10 includes a video and audio acquisition system 110, a data processing system 120, a video scheduling system 130, and a video playing system 140, wherein the video and audio acquisition system 110 is configured to acquire video images of presenter presentations/interactive actions with depth information and presenter audio information in real time. It comprises a video capturing device 11, such as two high definition cameras or a binocular camera, and a sound pick-up 14. The pickup 14 is, for example, a ceiling-mounted omni-directional microphone, or a wired/wireless head-mounted, clip-on, hand-held microphone, or the like.
The data processing system 120 receives the audio and video information from the audio and video acquisition system 110 and generates a presentation/interactive holographic video. The video acquisition device is connected with the video acquisition device 11, receives the host video shot by the video acquisition device, and generates the host holographic video. In the demonstration process, a video of demonstration action of a presenter is shot, and a first holographic video is generated according to the video; when the host interacts with a different-place demonstration area, a video which is used by the host to make an interactive action in response to the interaction is shot, and a second holographic video is generated according to the video. And then fusing the first/second holographic video which is manufactured currently, the audio of the presenter and the holographic video of the exhibit which is played currently together to generate the demonstration/interactive holographic video.
The video playing system 140 includes a plurality of display screens 12 and a playing control module 141, wherein the playing control module 141 is at least connected to the data processing system 120 and the video scheduling system 130, respectively, and is configured to play the holographic videos of exhibits, the demonstration/interactive holographic videos, and the real-time live videos of a plurality of different demonstration areas on the display screens. Of course, the first or second holographic video generated by the holographic video production module 121 may also be played.
Referring to fig. 2, the studio T includes a stage S, and the stage is further provided with a solid background, such as a green or black background cloth, a background board, and the like. Opposite the stage, facing the stage, video capture devices 11 are provided, such as two high- definition cameras 11a, 11b in the figure. Opposite the stage, a plurality of display screens 12a-12n are also provided facing the stage. Studio T also includes a sound pickup 14. The sound pickup 14 may be sound pickup equipment of various structures, such as a ceiling digital omnidirectional microphone dedicated to pickup sound in a large area as shown in fig. 3, or a wired or wireless head-mounted, clip-on, handheld, or other microphone. The microphone 14 sends the presenter's lecture audio to the data processing system 120.
In addition, in order to facilitate the host to perform operations such as video playing and switching as required, the studio is further provided with an instruction input device 13, which may be an operation desk or a remote controller, on which various control keys, switches, etc. are arranged, and which is connected with the playing control module 141 and the video scheduling system 130 in the video playing system 140 to provide various operation instructions thereto. For example, the instruction input unit 13 may provide instructions for controlling the playing and stopping of videos on the respective display screens to the play control module 141. In one embodiment, when the display holographic video is controlled to be played, the playing time starting time information of the video can be provided, so that the video can be played at a certain position in the display holographic video to meet the mutual display requirement. As another example, the video scheduling system 130 may be provided with the identity information of the designated remote presentation area for interaction through the instruction input device 13. When the host determines a remote demonstration area for interaction, the host can input the identity information of the designated remote demonstration area through the instruction input device 13, and the video scheduling system 130 sends the interactive holographic video generated by the data processing module 120 to the demonstration interactive system of the designated remote demonstration area. In this embodiment, the studio system further includes a holographic database 150 in which the holographic video of the exhibit and the interactive substitute holographic video of the presenter are stored. And the substitute holographic video is used for sending the substitute holographic video to other different demonstration areas in order to enable demonstration of other different demonstration areas to be carried out without influencing the other different demonstration areas when the host interacts with one different demonstration area.
The command inputter 13 shown in fig. 2 is an operating console that is located outside the stage and does not appear in the video captured for the presenter a. During operation, the input of the instruction can be completed through the cooperation of workers. Of course, the command input device 13 may be a small-sized remote controller held or worn by the presenter, and the presenter manipulates the remote controller to issue commands when necessary.
When the presenter A performs a presentation, the presenter A stands on the stage S, and when the presenter A performs a presentation action, the high- definition cameras 11a and 11b are located at positions corresponding to the stage S, and the positions of the high-definition cameras can obtain a shot video with a corresponding depth of field, and the high-definition cameras and the positions of the high-definition cameras shoot an action video of the presenter A in the stage S, and send the shot video to the data processing system 120. Because the high- definition cameras 11a and 11b shoot the same scene at different viewpoints at the same time, two images of the same scene in the videos have binocular parallax, and the data processing system 120 can obtain the depth of field of the same scene through a depth measurement algorithm during processing, so as to generate a first/second holographic video of presenter demonstration/interactive action. The display screens 12a-12n are respectively connected to the play control module 141 for playing different videos. For example, the display 12a plays a holographic video of an exhibit, the display 12b plays a first/second holographic video of a presenter's presentation/interaction action being recorded, the display 12c plays a first/second holographic video which is fused with the holographic video of the exhibit to form a presentation/interaction holographic video, the display 12d plays a stage live video of the allopatric presentation area Ta, and the display 12e plays an audience live video … … of the allopatric presentation area Ta. The presenter A can see the holographic video of the exhibit through the display screen 12a, so that the presenter can conveniently select a proper video clip during demonstration and mutual timing; the demonstration/interactive action made by the user can be seen through the display screen 12 b; the effect that the motion of the host is fused with the exhibit can be seen through the display screen 12c, and the host can conveniently adjust the demonstration and interaction motion of the host according to the demonstration holographic video presented by the display screen 12 c. The presenter can learn the reflection of the presentation being made by the stage scene in the allopatric presentation area Ta and the audience in the audience area through the display 12d and the display 12 e.
Fig. 4 is a functional block diagram of a video scheduling system according to one embodiment of the present invention. The video scheduling system 130 includes a detection module 131, a video acquisition module 132, and a video transmission module 133. The detecting module 131 is connected to the command input device 13 of the studio to receive the demonstration/interaction command from the studio and to specify the different-area demonstration area for interaction, so as to determine that the current scene type is a demonstration scene or an interaction scene, and determine the different-area demonstration area for receiving the video. The video acquiring module 132 is connected to the detecting module 131, and configured to acquire a holographic video that needs to be sent to a different-place demonstration area and/or a studio according to a current scene type, and send the video and a receiver thereof to the video transmitting module 133. The holographic videos comprise a demonstration holographic video obtained by fusing a product demonstration holographic video and a first holographic video made according to a host demonstration action recorded in real time in a studio, a second holographic video made according to a demonstration action made by a host recorded in real time in the studio in response to a different-place demonstration area of the product demonstration holographic video and an interactive holographic video obtained by fusing, and a third holographic video used as an interactive substitute or a fourth holographic video used for connecting the third holographic video and the interactive holographic video.
The video transmission module 133 is connected to the video playing system 140 of the studio and also connected to all the remote presentation areas via the network. The video transmission module 133 receives the video and the receiver sent by the video acquisition module 132, and sends the video according to the receiver. When the video is the interactive holographic video, the receiver may be all the remote demonstration areas and the studio, and when the video is the interactive holographic video, the receiver is the remote demonstration area and the studio selected by the host from the studio, and at this time, the video acquisition module 132 acquires the third holographic video from the video library, and the video transmission module 133 transmits the third holographic video to the remaining remote demonstration areas. When receiving the live real-time video of the allopatric presentation area, the video transmission module 133 sends the live real-time video to the video playing system 140, and plays the live real-time video on a display screen of the studio.
In addition, the scheduling system of the present invention may further include a recording module 134 and a timer 135. The recording module 134 is configured to record a video transmitted by the video transmission module 133 to each different presentation area, such as a presentation holographic video, an interactive holographic video, or a third holographic video transmitted to each different presentation area, and record a transmission time. When a third holographic video is sent to a displaced presentation area, the timer 135 is triggered to time while the video is being sent. When the timer 135 times out, a notification is sent to the video acquisition module 132, the video acquisition module 132 queries the video transmission record of the different-place demonstration area, and when it is determined that the fourth holographic video or the interactive holographic video is not transmitted, a new third holographic video is acquired again and is sent to the different-place demonstration area by the video transmission module 133, so that the waiting video played in the different-place demonstration area is not monotonous, or the situation that the scene effect is influenced by the fact that the playing is interrupted in the different-place demonstration area due to too short duration of the third holographic video is avoided. The timing period of the timer 135 may be a preset time or the duration of the third holographic video currently being played.
Fig. 5 is a flowchart of a scheduling method of an interactive holographic video according to an embodiment of the present invention. The system is summarized, and the method comprises the following steps:
in step S1, the current scene type is detected. For example, the current scene type may be determined by the received instruction and information of the instruction inputter 13 or the production of a holographic video. For example, at the start of a presentation, the presenter presses a scene representing the presentation in the instruction inputter 13, at which time a production presentation holographic video is played, and the video processing module 120 starts generating the presentation holographic video. Alternatively, video processing module 120 may send a notification to video scheduling system 130 upon generating the presentation holographic video, from which it may determine that the presentation scene is currently present.
Step S2, responding to the current scene type as demonstration scene, sending demonstration holographic video to a studio and a plurality of allopatric demonstration areas; the demonstration holographic video is obtained by fusing a product demonstration holographic video and a first holographic video which is made according to a host demonstration action recorded in a studio in real time.
And step S3, responding to the received live real-time video of the allopatric demonstration area, and sending the live real-time video to the studio.
Step S4, determine whether an interaction command is received. The interaction instruction comprises identity information of a remote presentation area which is appointed by the host to interact with. If so, step S5 is executed, and if not, the current state is maintained.
And step S5, sending the generated interactive holographic video to the different-place demonstration area selected by the host.
And step S6, calling a third holographic video from the holographic video library, and sending the third holographic video to the remaining multiple allopatric demonstration areas. The third holographic videos sent to the multiple different demonstration areas can be the same video or different videos.
And step S7, judging whether an instruction of the host for finishing the interaction is received, if so, stopping sending the video to all the allopatric demonstration areas in step S8, and finishing the video scheduling process. If no instruction is received from the moderator to end the interaction, step S9 is performed.
Step S9, determine whether an interaction instruction newly selected by the host has been received. If so, step S10 is performed. If not, the current state is maintained.
And step S10, sending the fourth holographic video to the newly selected allopatric demonstration area to replace the originally sent third holographic video. And simultaneously, sending a third holographic video to the previous interactive allopatric demonstration area.
And step S11, sending the interactive holographic video to the newly selected allopatric demonstration area. Step S7 is executed again.
By the video scheduling method, the corresponding holographic video can be sent to all places according to the interaction.
In the above method, after the video is transmitted to a place, a step of recording, that is, a history of video transmission in which remote presentation area the video is transmitted is described is further included. In addition, when a plurality of different-place demonstration areas exist, in order to ensure that the host can play the holographic videos in the different-place demonstration areas when the host does not interact with the host, one method is to send third holographic videos with longer time duration, and the other method is to monitor the playing time of each third holographic video and send new third holographic videos before or just after the third holographic videos are played.
FIG. 6 is a flow chart of video scheduling when playing a third holographic video according to an embodiment of the present invention. The method comprises the following steps:
in step S61, the timing is started for each different area of the presentation area to which the third hologram video is transmitted. Wherein the timing period is a preset time period which is not longer than the time length of the current third holographic video.
In step S62, it is monitored whether the timer time has reached the timer period. If the timing period has been reached, step S63 is executed. If not, the timer is continuously monitored.
And step S63, inquiring the video transmission record of the allopatric demonstration area. And a video transmission record is stored for each different-place demonstration area, wherein the video transmitted to the different-place demonstration area and the transmission time are recorded.
And step S64, judging whether the fourth holographic video or the interactive holographic video is sent to the allopatric demonstration area, if not, sending a new third holographic video to the allopatric demonstration area in step S65, and returning to step S61.
By the method, the holographic videos can be guaranteed to be played in the process of waiting for interaction in the different-place demonstration area, and the played third holographic videos are different, so that the interest of waiting for interaction is increased, and the boring is avoided.
FIG. 7 is a block diagram of a presentation interaction system for a displaced presentation area, in accordance with one embodiment of the present invention. Referring to fig. 7, the allopatric presentation area Ta includes a holographic presentation stage 300a and an audience area 300 b. The holographic presentation stage 300a includes a stage S2 followed by a holographic projection device including a holographic film 31 and an LED display area 32. The LED display area 32 is a display screen tiled behind the stage S2, and a video signal interface thereof is connected to a playback device, so that a holographic video can be played. The holographic film 31 is fixed by a rigid frame, the bottom end of the holographic film is rotatably fixed on the column body through a rotating shaft, and the top end of the holographic film is pulled by a lifting device (not shown in the figure), so that the holographic film 31 is pulled upwards and fixed on the column body, and an acute angle is formed between the holographic film 31 and the LED display area 32. When the holographic video is played through the LED display area 32, the video presents a three-dimensional stereoscopic hologram thereon through the holographic film 31. A presenter in the presentation area may stand at stage S2 to interact with the three-dimensional stereoscopic hologram presented through the holographic film 31. In order to reflect the scene situation of the allopatric presentation area Ta to the presenter of the studio, one camera 33a, 33b is respectively arranged corresponding to the holographic presentation stage and the audience area, and a stage scene video and an audience scene video are respectively obtained. Meanwhile, in order to obtain audio for live interaction, such as voice of a live host, questions of audiences, a sound pickup is further included in the allopatric presentation area Ta, and is referred to herein as a second sound pickup 34 in order to be distinguished from a sound pickup in a studio. The remote presentation area Ta is further provided with a data processing device 302, which can be located anywhere on the scene as shown in the figure, and which can include a PC, a playing device, a memory, etc., and which is connected to the holographic projection device, the cameras 33a, 33b and the second sound pick-up devices 34a, 34b to implement playing control of the holographic projection device on the scene, receive data of the cameras 33a, 33b and the second sound pick-up devices 34a, 34b, mix the live interactive audio obtained by the second sound pick-up devices 34a, 34b into the corresponding live video, and send the stage live video and the audience live video to the video scheduling system 130, and receive the holographic video from the studio system 10. Of course, the remote demonstration area also comprises other devices, such as a light control system, a sound control system and the like, which are not described in detail herein.
For the audience in the demonstration area, the holographic image of the exhibition demonstrated by the presenter in the studio on the stage is seen firstly. After the interactive questions are presented in the demonstration area, or the presenter is seen to answer the questions, the presenter interacts with the audience or the local presenter in the demonstration area in question and answer mode, and exhibits are presented in the demonstration area; or seeing that the presenter walks and thinks at the stage, then facing the audience, starts to reply the interactive question, demonstrates the exhibit, and interacts with the live audience or the local presenter in question and answer. The whole demonstration process is as same as that a remote studio host is on a local stage, and the image is vivid.
The above embodiments are provided only for illustrating the present invention and not for limiting the present invention, and those skilled in the art can make various changes and modifications without departing from the scope of the present invention, and therefore, all equivalent technical solutions should fall within the scope of the present invention.
Claims (11)
1. A scheduling method of interactive holographic video comprises the following steps:
detecting the current scene type;
responding to the fact that the current scene type is a demonstration scene, and sending demonstration holographic videos to a plurality of different-place demonstration areas; the demonstration holographic video is obtained by fusing a product demonstration holographic video and a first holographic video, and the first holographic video is a holographic video manufactured according to a host demonstration action video recorded in a studio in real time; and
responding to a received live real-time video of a different-place demonstration area, and sending the live real-time video to a studio for playing;
wherein still include: responding to the current scene type as an interactive scene, and sending an interactive holographic video to a different-place demonstration area selected by a host; the interactive holographic video is obtained by fusing a product demonstration holographic video and a second holographic video, and the second holographic video is a holographic video which is manufactured according to an interactive action video which is recorded in real time in a studio and is made by responding to a different-place demonstration area by a host;
wherein still include:
calling a third holographic video from the holographic video library, wherein the third holographic video is stored in the database and is used as an interactive substitute holographic video; and
transmitting the third holographic video to the remaining plurality of displaced presentation areas;
when detecting that the host changes the remote demonstration area interacting with the host, sending a fourth holographic video to the remote demonstration area newly selected by the host; the fourth holographic video is a transitional holographic video which is connected with the third holographic video and the interactive holographic video; and
sending the interactive holographic video to a remote demonstration area newly selected by a host;
wherein still include: the first display screen plays a holographic video of an exhibit, the second display screen plays a first/second holographic video of a presenter demonstration/interactive action which is being recorded, the third display screen plays a first/second holographic video which is fused with the holographic video of the exhibit to form a demonstration/interactive holographic video, and the fourth display screen plays a stage site video of a first different-place demonstration area;
the presenter can see the holographic video of the exhibit through the first display screen, so that the presenter can conveniently select a proper video clip during demonstration and mutual timing; the demonstration/interaction actions made by the user can be seen through the second display screen; the effect that the action of the host is fused with the exhibit can be seen through the third display screen, and the host can conveniently adjust the demonstration and interaction actions according to the demonstration holographic video presented by the third display screen.
2. The method for scheduling interactive holographic video according to claim 1, further comprising: and detecting the current scene type according to an instruction sent by a studio or the production process of the holographic video.
3. The method for scheduling interactive holographic video according to claim 1, further comprising: recording when transmitting holographic videos to a plurality of different-place demonstration areas to generate video transmission records;
querying the video transmission record before transmitting a new third holographic video to the allopatric presentation area; and
and selecting a third holographic video different from the previous holographic video to be sent to the allopatric demonstration area.
4. The interactive holographic video scheduling method of claim 3, wherein the time of playing the third holographic video in each allopatric demonstration area is monitored, and when the time of playing the third holographic video in the allopatric demonstration area reaches the time set by the preset condition, a new third holographic video is sent to the allopatric demonstration area.
5. The interactive holographic video scheduling method of claim 4, wherein said preset condition is a timing time period or a duration of a currently played third holographic video.
6. The method for scheduling interactive holographic video according to claim 1, wherein the third holographic video transmitted to the remaining plurality of displaced presentation areas is the same or different.
7. The method for scheduling interactive holographic video according to claim 1, further comprising:
and responding to the generation of the demonstration/interactive holographic video, and sending the demonstration/interactive holographic video to a display screen of the studio for playing.
8. A scheduling system for interactive holographic video, comprising:
the detection module is configured to detect the current scene type and determine a remote demonstration area for receiving the holographic video;
the video acquisition module is connected with the detection module and is configured to acquire the holographic video which needs to be sent to a different-place demonstration area and/or a studio according to the current scene type; the holographic video comprises a demonstration holographic video obtained by fusing a product demonstration holographic video and a first holographic video which is manufactured according to a host demonstration action video which is recorded in real time in a studio, or an interactive holographic video obtained by fusing a product demonstration holographic video and a second holographic video which is manufactured according to an interactive action video which is recorded in real time in the studio and is made by responding to a different demonstration area by a host, or a third holographic video which is used as an interactive substitute, or a fourth holographic video which is used for connecting the third holographic video and the interactive holographic video; and
the video transmission module is configured to respectively send the holographic videos acquired by the video acquisition module to corresponding different-place demonstration areas and/or studios, and send the received different-place demonstration area field real-time videos to the studios;
wherein still include: responding to the current scene type as an interactive scene, and sending an interactive holographic video to a different-place demonstration area selected by a host; the interactive holographic video is obtained by fusing a product demonstration holographic video and a second holographic video, and the second holographic video is a holographic video which is manufactured according to an interactive action video which is recorded in real time in a studio and is made by responding to a different-place demonstration area by a host;
wherein still include:
calling a third holographic video from the holographic video library, wherein the third holographic video is stored in the database and is used as an interactive substitute holographic video; and
transmitting the third holographic video to the remaining plurality of displaced presentation areas;
when detecting that the host changes the remote demonstration area interacting with the host, sending a fourth holographic video to the remote demonstration area newly selected by the host; the fourth holographic video is a transitional holographic video which is connected with the third holographic video and the interactive holographic video; and
sending the interactive holographic video to a remote demonstration area newly selected by a host;
wherein still include: the first display screen plays a holographic video of an exhibit, the second display screen plays a first/second holographic video of a presenter demonstration/interactive action which is being recorded, the third display screen plays a first/second holographic video which is fused with the holographic video of the exhibit to form a demonstration/interactive holographic video, and the fourth display screen plays a stage site video of a first different-place demonstration area;
the presenter can see the holographic video of the exhibit through the first display screen, so that the presenter can conveniently select a proper video clip during demonstration and mutual timing; the demonstration/interaction actions made by the user can be seen through the second display screen; the effect that the action of the host is fused with the exhibit can be seen through the third display screen, and the host can conveniently adjust the demonstration and interaction actions according to the demonstration holographic video presented by the third display screen.
9. The interactive holographic video scheduling system of claim 8, wherein said detection module receives presentation/interaction instructions from a studio and remote presentation area identity information specifying interactions.
10. The interactive holographic video scheduling system of claim 8, further comprising a recording module configured to record the transmitted video while transmitting the holographic video to the remaining plurality of displaced presentation areas, generating a video transmission record.
11. The interactive holographic video scheduling system of claim 8, further comprising a plurality of timers coupled to said video transmission module and configured to time the timer corresponding to each of said displaced presentation areas according to a preset time period or a current duration of said third holographic video when said video transmission module transmits said third holographic video to each of said displaced presentation areas.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110658214.8A CN113259602B (en) | 2021-06-15 | 2021-06-15 | Method and system for scheduling interactive holographic video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110658214.8A CN113259602B (en) | 2021-06-15 | 2021-06-15 | Method and system for scheduling interactive holographic video |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113259602A CN113259602A (en) | 2021-08-13 |
| CN113259602B true CN113259602B (en) | 2021-11-05 |
Family
ID=77188114
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110658214.8A Active CN113259602B (en) | 2021-06-15 | 2021-06-15 | Method and system for scheduling interactive holographic video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113259602B (en) |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102010028865A1 (en) * | 2010-05-11 | 2011-11-17 | Stephan Overkott | Holographic live presentation system and method for live broadcast of a holographic presentation |
| CN204117555U (en) * | 2013-09-29 | 2015-01-21 | 成都有尔科技有限公司 | Holographic portrait real-time interaction system |
| CN206521965U (en) * | 2017-02-09 | 2017-09-26 | 何星 | Host's interactive holographic Stage System |
| CN108833931A (en) * | 2018-06-28 | 2018-11-16 | 南京曼殊室信息科技有限公司 | A kind of strange land 3D hologram interaction live streaming platform |
| CN108965746A (en) * | 2018-07-26 | 2018-12-07 | 北京竞业达数码科技股份有限公司 | Image synthesizing method and system |
| CN109379610A (en) * | 2018-09-26 | 2019-02-22 | 李胜国 | A kind of long-range marketing network and method |
| CN111935477A (en) * | 2020-09-11 | 2020-11-13 | 深圳市中和智通智能科技有限公司 | Novel three-dimensional exhibition system based on Internet of things |
-
2021
- 2021-06-15 CN CN202110658214.8A patent/CN113259602B/en active Active
Non-Patent Citations (2)
| Title |
|---|
| Digital Holographic Three-Dimensional Video Displays;Levent Onural等;《Proceedings of the IEEE》;20110204;全文 * |
| 全媒体出版环境下全息影像互动技术的应用展望;佟婷等;《数字时代》;20150228;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113259602A (en) | 2021-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106792246B (en) | Method and system for interaction of fusion type virtual scene | |
| US20180048876A1 (en) | Video Capture System Control Using Virtual Cameras for Augmented Reality | |
| US8289367B2 (en) | Conferencing and stage display of distributed conference participants | |
| CN108900857B (en) | Multi-view video stream processing method and device | |
| CN110349456B (en) | Intelligent control system, remote control terminal and classroom terminal of interactive classroom | |
| KR102371031B1 (en) | Apparatus, system, method and program for video shooting in virtual production | |
| WO2017113577A1 (en) | Method for playing game scene in real-time and relevant apparatus and system | |
| CN113115110B (en) | Video synthesis method and device, storage medium and electronic equipment | |
| CN110928416A (en) | Immersive scene interactive experience simulation system | |
| WO2021095573A1 (en) | Information processing system, information processing method, and program | |
| CN112732089A (en) | Virtual reality equipment and quick interaction method | |
| CN109361954A (en) | Method for recording, device, storage medium and the electronic device of video resource | |
| CN105915974A (en) | Intelligent projection playing method and device | |
| KR101839118B1 (en) | A multi-access virtual space provisioning system linked with a multi-user real space location system | |
| CN114356090B (en) | Control method, control device, computer equipment and storage medium | |
| CN110730340A (en) | Lens transformation-based virtual auditorium display method, system and storage medium | |
| CN113315885B (en) | Holographic studio and system for remote interaction | |
| WO2009078909A1 (en) | Virtual object rendering system and method | |
| CN113259544B (en) | Remote interactive holographic demonstration system and method | |
| KR20090044105A (en) | Live-image providing system using contents of 3d virtual space | |
| CN113259602B (en) | Method and system for scheduling interactive holographic video | |
| CN113207008A (en) | AR-based tele-immersive simulation classroom and control method thereof | |
| CN114302221A (en) | Virtual reality equipment and screen-casting media asset playing method | |
| CN112019921A (en) | Body motion data processing method applied to virtual studio | |
| CN113382292B (en) | Court trial open display method for court |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |