CN103533445A - Flying theater playing system based on active interaction - Google Patents

Flying theater playing system based on active interaction Download PDF

Info

Publication number
CN103533445A
CN103533445A CN201310517394.3A CN201310517394A CN103533445A CN 103533445 A CN103533445 A CN 103533445A CN 201310517394 A CN201310517394 A CN 201310517394A CN 103533445 A CN103533445 A CN 103533445A
Authority
CN
China
Prior art keywords
film
spectators
interaction
interactive
mutual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310517394.3A
Other languages
Chinese (zh)
Other versions
CN103533445B (en
Inventor
杨承磊
盖伟
崔婷婷
崔开元
张文浩
吕琳
杨义军
孟祥旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong University
Original Assignee
Shandong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong University filed Critical Shandong University
Priority to CN201310517394.3A priority Critical patent/CN103533445B/en
Publication of CN103533445A publication Critical patent/CN103533445A/en
Application granted granted Critical
Publication of CN103533445B publication Critical patent/CN103533445B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a flying theater playing system based on active interaction. The flying theater playing system has the advantages of simpleness, convenience, easy operation and the like; users do not need additional learning and training, and can interact with a story through common and natural ways such as waving, shouting and the like, so that a stronger and more natural immersive user experience can be created, and the entertainment, funniness and sense of reality of a film can be increased; the flying theater playing system does not require an additional capture device and can directly use a monitoring infrared camera and a microphone in a theater as interactive capture devices, so that hardware resources can be fully used, the device expense is not brought to the theater and the realistic experience of the theater can be improved.

Description

A kind of movie theatre Play System that circles in the air based on initiatively mutual
Technical field
The present invention relates to a kind of movie theatre Play System that circles in the air based on initiatively mutual.
Background technology
In recent years, the development of China theme park is very swift and violent, from the eighties in 20th century so far, 2500, formula tourist spot, theme park is totally developed in the whole nation, infusion of financial resources reaches more than 3,000 hundred million yuan.4D movie theatre is a project common in theme park.
4D movie theatre is on the basis of 3D three-dimensional film, to introduce environmental effects analog simulation and the novel video display product that forms, the space of thinking that three-dimensional three-dimensional film and surrounding environment simulation form.Spectators are when appreciating three-dimensional film, according to the variation of substance film, can experience in real time wind, rain, thunder, electricity, clash into, pat the event corresponding with stereopsis that occurred that wait at one's side, 4D seat has water spray, jet, vibration, sweep the functions such as leg, environmental simulation emulation refers in movie theatre and is provided with and snows, rain, lightning, the special effect devices such as smog, build a kind of environment consistent with substance film, by giving spectators the physical stimulation with movie contents interlock, strengthen the effect of telepresenc, spectators can comprehensive impression from vision, the sense of hearing, the fresh stimulation that sense of touch brings.
Along with the continuous increase of spectators' amusement demand and the continuous progress of technology, huge curtain vault screen cinema is favored gradually.Different from 4D movie theatre, what huge curtain vault screen cinema showed is 2D image, but also can allow spectators well experience the feeling of immersion of vision, can easily allow spectators be dissolved in the atmosphere of film.But, no matter be 4D movie theatre or huge curtain vault screen cinema, do not support the feedback that spectators are mutual.
The movie theatre that circles in the air is a kind of emerging special efficacy amusement film, spectators take the lifting seat controlled by big machinery system to movie theatre center in the air, high-definition digital projector projects huge hemisphere screen by extraordinary fish eye lens by picture, sight line region from the spectators crown to underfooting is all surrounded completely by grand mute, when fully experiencing extremely powerful ball curtain movie and television contents, the stimulation impression of the unsettled flight that can also undergo.Except reaching the effect of 4D movie theatre, huge curtain vault screen cinema, also can add on this basis the telegraphy interactive devices such as simulated flight mechanism, allow spectators at the environment experience of safety to circling in the air, interactive recreation texts.But the current movie theatre that circles in the air only offers spectators' telegraphy and experiences, spectators still can not carry out the mutual or control story of a play or opera with the story of a play or opera.
At present, the problem existing in movie theatre of circling in the air is mainly manifested in:
1. the cinema system technology of circling in the air production domesticization is not enough, import dependency degree is high;
2. circle in the air in movie theatre and lack opening and interactivity, though telegraphy interactive device is provided, only offers spectators' telegraphy and experience, be still alternately one-side, spectators can not be with the story of a play or opera mutual or control role;
3. circle in the air movie theatre as a kind of special screne, real-time and interactivity are had to very high requirement, itself brought huge challenge alternately, principal element comprises:
(1) noisy, the dim environment of movie theatre, the accuracy that severe jamming is mutual;
(2) identification of group behavior interactive instruction in movie theatre.
Summary of the invention
The object of invention is exactly in order to address the above problem, and a kind of movie theatre Play System that circles in the air based on initiatively mutual is provided.This system has simply, the advantage such as convenient, easy to operate, by the natural interactive style of colony's voice and gesture in public arena, realize the class user of circling in the air in movie theatre interactive by voice and gesture and the story of a play or opera, carry out story of a play or opera selection or control, do not need the extra learning training of user, user can be interactive by common natural way and the story of a play or opera such as waving, shout, and creation can allow the more natural immersion more by force that user experiences experience, and increases recreational, interest and the sense of reality of film.And, this system does not need extra capture device, can directly utilize monitoring infrared camera in movie theatre and microphone as mutual capture device, can make full use of hardware resource, not only can not bring cost of device to movie theatre, the sense of reality that can also increase movie theatre is experienced.
To achieve these goals, the present invention adopts following technical scheme:
Initiatively the mutual movie theatre Play System that circles in the air, comprises film preprocessing subsystem and the movie subsystem based on initiatively mutual; Wherein, based on the mutual movie subsystem of active, comprise playing module, interaction feature trapping module, resolve external file module and touch-screen; Film preprocessing subsystem comprises the interactive information generation module relevant to substance film and configuration file generation module;
Described interactive information generation module, comprises interactive mode generation module and interaction locations and film mapping block, wherein:
Interactive mode generation module, is connected with film mapping block with interaction locations, according to different substance films, different film beholder, generates different interactive modes, and the interactive mode of having avoided all films, all beholders is changeless defect all;
Interaction locations and film mapping block, according to film plot, different interaction locations is set, interaction times is not subject to the restriction of system, generate as required different mutual numbers, corresponding two scheduling parameter of each interaction locations, by scheduling parameter, set up and the mapping of dispatching film, communicate by letter with configuration file generation module;
Configuration file generation module, for storing mutual film information, mutual key frame positional information, mutual frame and the mapping of scheduling film and the information of scheduling film, and resolves external file module communication;
Playing module, for providing movie medium, with touch-screen two-way communication;
Interaction feature trapping module, with touch-screen two-way communication, be used for obtaining user profile, and identify colony's user behavior, after analyzing spectators' individual instruction collection, system to individual instruction set analyze, adopt method based on statistics to obtain the general character of individual instruction, be group interaction instruction, for controlling the developing direction of film plot;
Resolve external file module, the interaction feature that reception interaction feature trapping module is caught, the storage information of configuration file generation module, with touch-screen two-way communication, complete the interaction of spectators and substance film;
Touch-screen, receives spectators' program request, the requirement of watching, with playing module, interaction feature trapping module, parsing external file module, interactive information generation module and the two-way communication of configuration file generation module.
Described playing module comprises video player, sound equipment, projector and screen.
Described interaction feature trapping module comprises infrared camera and microphone apparatus.
Interactive control method based on the above-mentioned movie theatre Play System that circles in the air, comprises the following steps:
(1) configuration file is set: Moviemaking person completes the setting to configuration file by film preprocessing subsystem;
(2) open interaction feature trapping module: utilize user profile capture device: infrared camera and microphone apparatus, image, action and the acoustic information set of catching spectators;
(3) open playing module: by touch-screen, the film of watching is wanted in spectators' selection, opens video player, the synchronous trigger of resolving external file module that starts;
(4) whether trigger Real-Time Monitoring reaches the interaction locations that video file is corresponding, if do not arrive interaction locations, continues displaying video; If arrival interaction locations, player starts to carry out alternately by voice and captions prompting user;
(5) select interactive mode: movie theatre keeper can determine whether to carry out mutual and select which kind of interactive mode according to actual conditions, if do not carried out alternately, continues to play selected video, since then, treats that video playback is complete, and whole reciprocal process is complete; Otherwise need to select interactive mode, interactive mode has three kinds, is respectively: gesture interaction, interactive voice and multichannel are mutual;
(6) mutual if step 5 is selected to proceed, the interactive information that the interactive mode of selecting according to keeper is caught user, according to the broadcasting speed of interactive information adjustment video;
(7) player, according to the speed displaying video after adjusting, treats that video playback is complete, and whole reciprocal process is complete.
The gesture feature extracting method of infrared camera in described step (2), specifically comprises the following steps:
(2-1) background extraction image;
(2-2) infrared camera is caught image in real time, and and step 2-1 in the background image that obtains carry out calculus of differences: if difference is greater than the threshold value setting in advance, think that difference synthetic image is foreground image, i.e. spectators' gesture; If difference is not more than the threshold value setting in advance, think that spectators' mutual effect is not ideal enough, ignore the image of now catching, recapture image also carries out calculus of differences, and this process circulates always until difference is greater than the threshold value setting in advance;
(2-3) foreground image is carried out to morphology processing, comprise dilation and erosion operation, object is the assorted point of eliminating in foreground image;
(2-4) calculate the length of the individual arm of spectators in interaction area, and set is analyzed to spectators' personal feature, the method of employing based on statistics obtains the general character of personal feature, it is group interaction feature, from system real time, consider, system is using the average of all spectators' arm length as group interaction feature, thus the broadcasting that touches corresponding film.
In described step (2), Mike's subset extracts the method for phonetic feature, and concrete steps are:
(2-a) statistics background sound volume characteristics: obtain the background sound volume in film during Moviemaking;
(2-b) wave volume of microphones capture and background sound volume are carried out to additive operation, obtain spectators' wave volume, as with the mutual feature of film, thereby touch corresponding movie.
The specific implementation method of adjusting the broadcasting speed of video in described step (6) is:
(a) select gesture interaction, network infra red camera is caught spectators' arm length, adjusts the speed of video playback according to the length of arm;
(b), while selecting interactive voice, microphones capture spectators' yell, according to the speed of the volume adjustment video playback of hubbub;
(c) while selecting multichannel interactive mode, network infra red camera is caught spectators' arm length, and microphones capture spectators' hubbub obtains final mutual information data according to the predetermined weights of system, and according to these data, adjusts the speed of video playback.
In described step (c), choosing of weights, is subject to the constraint of movie theatre scene, film, according to formula:
ω h = a 1 * 1 dim + b 1 * vol ω v = a 2 * dim + b 2 * 1 vol ω h + ω v = 1
dim∈[0,1],vol∈[0,1]
ω wherein h, ω vbe respectively the shared weights of spectators colony gesture and sound; Dim represents the dim degree of movie theatre scene, and dim numerical value is larger, illustrates that scene is more dim, and vice versa; Vol represents the wave volume of substance film, and vol numerical value is larger, illustrates that film self sound is larger, and vice versa; And dim, vol are normalized; a 1, a 2, b 1, b 2be the constant that is less than 1, be used for guaranteeing ω h, ω vbelong to the positive number that is less than 1.
The present invention can arrange different constraints according to different films, for single film design, all ineffective to any 4D film.
Operation principle of the present invention is: spectators enter after film scene, the film interactive information of editing according to Moviemaking person starts to play film, original seat that circles in the air is simulated corresponding film scene, make spectators progressively incorporate in film plot, at this moment according to the setting of film, voice and captions prompting spectators and substance film carry out interaction, and spectators can carry out interaction by brandishing mode and the film of arm, scream.Based on the mutual movie theatre Play System that circles in the air, by infrared camera and microphones capture spectators gesture, voice messaging, resolve external file, and trigger the interaction of spectators and substance film, the scheduling that main manifestations is mutual film.
Beneficial effect of the present invention is:
1, directly utilize the watch-dog in movie theatre, make full use of existing hardware resource, do not bring extra-pay consumption, increased on the contrary recreational, interest and the sense of reality of movie theatre; Science popularization film for juvenile, can bring stronger experience effect.
The ability 2, with the behavior of identification group interaction, the interbehavior in movie theatre is no longer personal behavior, belongs to group behavior, the interaction feature that needs corresponding strategy analysis to catch, thus determine group behavior feature;
3, the advantage such as convenient, easy to operate, do not need the extra learning training of user, user can be interactive by common natural way and the story of a play or opera such as waving, shout, and creation can allow the more natural immersion more by force that user experiences experience, and increases recreational, interest and the sense of reality of film.
Accompanying drawing explanation
Fig. 1 is interactive movie theatre technology overall construction drawing;
Fig. 2 is that interactive cinema system hardware forms structure chart;
Fig. 3 is film preprocessing subsystem structure chart;
Fig. 4 is the movie subsystem structure figure based on initiatively mutual;
Fig. 5 is interactive movie theatre operational flowchart;
Fig. 6 is the gesture feature extracting method based on infrared camera;
Fig. 7 is the Speech Feature Extraction based on microphone;
Fig. 8 is multichannel interactive mode flow chart.
Embodiment:
Below in conjunction with accompanying drawing and embodiment, the invention will be further described.
As shown in Figure 1, a kind ofly based on the mutual movie theatre Play System that circles in the air initiatively, being mainly divided into two parts, is respectively film preprocessing subsystem and the movie subsystem based on initiatively mutual.
Moviemaking person, according to substance film, by film preprocessing subsystem, completes the location to film interaction locations, and sets up and dispatch the mapping relations of film, and the information that responds mutual film is stored in external file, is called configuration file;
Movie subsystem based on initiatively mutual, the ActiveX control that utilizes Windows MCI control and VC6.0 to carry is realized the broadcasting of film, importantly can respond spectators' interactive operation.Based on the mutual movie subsystem of active, by infrared camera and microphone apparatus, catch spectators' population hand attitude and phonetic feature, and show with the form of progress bar; Then by resolving the data in configuration file, complete spectators' interactive operation.
As shown in Figure 2, take encircle curtain be example, after fixing annular screen, it is one group that projector is arranged on to ,Mei Liangtai projector on the ceiling in movie theater or on wall, forms a width stereoscopic picture plane, every group of horizontal view angle in screen is 60 degree, adopts the mounting means of stack up and down; Sound equipment is distributed in movie theatre wall surrounding, to cause shock sense on the spot in person.In order to guarantee good viewing effect, spectators seat is arranged near the center of circle of arc screen.The microphone apparatus of catching spectators' interactive information is arranged on spectators' seat back or wall; Network infra red camera is arranged on upper the place ahead of spectators.
As shown in Figure 3, film preprocessing subsystem is mainly comprised of interactive information generation module and configuration file generation module; Interactive information generation module can be divided into again interactive mode generation module and interaction locations and two parts of film mapping block:
(1) interactive mode generation module
According to the result of broadcast of on-the-spot movie theatre, Moviemaking person can select different interactive modes, comprises gesture interaction, interactive voice and multichannel interactive mode.
(2) interaction locations and film mapping block
According to substance film, Moviemaking person can arrange different interaction locations, and corresponding two scheduling parameter of each interaction locations, set up and the mapping of dispatching film by scheduling parameter; System, is determined by substance film without any constraint completely to the setting of interaction locations.
(3) configuration file generation module
In configuration file, deposit following information in: mutual film information, mutual key frame positional information, mutual frame and the mapping of scheduling film, the information of scheduling film; Configuration file adopts XML file format, by configuration file generation module, is generated, and finally by mutual movie sub system analysis, is used.
As shown in Figure 4, based on the mutual movie subsystem of active, comprise playing module, interaction feature trapping module, resolve external file module and touch-screen.
(1) playing module
The function with general player, comprise open, close, play, suspend, stop, the function such as full frame, progress monitoring, video information are checked.
(2) interaction feature trapping module
System selects infrared camera and microphone apparatus as interaction feature capture device.
Gesture interaction system based on vision is generally that computer obtains hand attitude information by image capture device, and the single-frame static images of obtaining or multiple image sequence are carried out to Treatment Analysis, thereby judgement user view is carried out with user alternately.But this method is affected by change of background, ambient lighting variation etc. easily, gesture performance changes larger, very complicated to the analysis of images of gestures, be difficult to guarantee the real-time of interactive system, and under infrared visual condition, be subject to the interference of these factors smaller.Consider the factors such as movie theatre scene is noisy and dim, and consider the existence of supervisory control system in the movie theatre that circles in the air, the present invention makes full use of hardware resource, selects infrared camera as image capture device, obtains user's image information.
System, by infrared camera and microphones capture spectators' hand attitude and phonetic feature, because interbehavior in movie theatre belongs to group behavior, also needs the feature to catching to carry out group behavior analysis; For guaranteeing the real-time of system, adopt the mean value of all individualities as interaction feature, determine group behavior; In addition, also on the right side of player, show spectators' interaction feature with progress bar and digital form, spectators can intuitively see the interactive information of colony.
(3) external file parsing module
Movie subsystem based on initiatively mutual is by resolving the data in configuration file, and the interaction feature obtaining according to interaction feature trapping module, triggers corresponding interactive operation, completes the interaction of spectators and substance film.
As shown in Figure 5, interactive movie theatre, except having the function of general player, the most important thing is to have introduced mutual control operation, and spectators can carry out interactive operation with substance film, embodies spectators' subjective initiative, and concrete operation step is as follows.
(1) configuration file is set, Moviemaking person completes by film preprocessing subsystem;
(2) open user profile capture device, infrared camera and microphone;
(3) open video player, and select played file;
(4) play selected video file, and synchronously start trigger;
(5) whether trigger Real-Time Monitoring reaches the interaction locations that video file is corresponding, if do not arrive interaction locations, continues displaying video; If arrival interaction locations, player starts to carry out alternately by voice and captions prompting user;
(6) whether keeper can determine to carry out mutual and select which kind of interactive mode according to actual conditions, if do not carried out alternately, continues to play selected video, since then, treats that video playback is complete, and whole reciprocal process is complete; Otherwise need to select interactive mode, interactive mode has three kinds, is respectively: gesture interaction, interactive voice and multichannel are mutual;
(7) mutual if step 6 is selected to proceed, the interactive information that the interactive mode of selecting according to keeper is caught user, according to the broadcasting speed of interactive information adjustment video; Concrete implementing method is: when selecting gesture interaction, network infra red camera is caught spectators' arm length, adjusts the speed of video playback according to the length of arm; When selecting interactive voice, microphones capture spectators' yell, according to the speed of the volume adjustment video playback of hubbub; During elected majority passage interactive mode, network infra red camera is caught spectators' arm length, and microphones capture spectators' hubbub obtains final mutual information data according to the predetermined weights of system, and according to these data, adjusts the speed of video playback;
(8) player, according to the speed displaying video after adjusting, treats that video playback is complete, and whole reciprocal process is complete.
As shown in Figure 6, the Visual Tracking System based on infrared camera, processes in real time to the video of catching, and user's hand attitude is detected in real time, controls corresponding interactive operation.System is mainly comprised of video acquisition part and video processing part.
The emphasis of this part is that the hand attitude of dim background Xia, colony is extracted.
Gesture feature extracting method based on infrared camera, specific implementation process is:
(1) background extraction image;
(2) infrared camera is caught image in real time, and and the first step in the background image that obtains carry out calculus of differences: if difference is greater than the threshold value setting in advance, think that difference synthetic image is foreground image, i.e. spectators' gesture; If difference is not more than the threshold value setting in advance, think that spectators' mutual effect is not ideal enough, ignore the image of now catching, recapture image also carries out calculus of differences, and this process circulates always until difference is greater than the threshold value setting in advance;
(3) foreground image is carried out to morphology processing, mainly comprise dilation and erosion operation, object is the assorted point of eliminating in foreground image;
(4) calculate the length of spectators' arm in interaction area, and by the average of all spectators' arm length as hand attitude interaction feature, thereby touch corresponding movie.
As shown in Figure 7, the performance of speech recognition system is very easily subject to the impact of noise in environment, and particularly in movie theatre under noisy environment, and in actual environment, mostly noise is additive noise, so the difficulty of speech recognition in movie theatre strengthens.Consider the object of this special screne of movie theatre to the requirement of real-time and user interactions amusement, choose user's wave volume as phonetic feature, with simple phonetic feature, realize the object of user interactions amusement.
The specific implementation process that the wave volume of take is feature:
(1) statistics background sound volume characteristics, is mainly the volume in film, when Moviemaking, can obtain;
(2) wave volume of microphones capture and background sound volume are carried out additive operation, obtain spectators' wave volume, as with the mutual feature of film, thereby touch corresponding movie.
As shown in Figure 8: multichannel interactive mode has merged gesture interaction and two kinds of control modes of interactive voice; The weight of two kinds of interactive modes in system analysis configuration file, the feature of utilizing gesture interaction and interactive voice to obtain, then the method for weighted sum obtains new film velocity, thereby triggers the broadcasting of corresponding film.
Although above-mentioned, by reference to the accompanying drawings the specific embodiment of the present invention is described; but be not limiting the scope of the invention; one of ordinary skill in the art should be understood that; on the basis of technical scheme of the present invention, those skilled in the art do not need to pay various modifications that creative work can make or distortion still in protection scope of the present invention.

Claims (8)

1. the movie theatre Play System that circles in the air based on initiatively mutual, is characterized in that: comprise film preprocessing subsystem and the movie subsystem based on initiatively mutual; Wherein, based on the mutual movie subsystem of active, comprise playing module, interaction feature trapping module, resolve external file module and touch-screen; Film preprocessing subsystem comprises the interactive information generation module relevant to substance film and configuration file generation module;
Described interactive information generation module, comprises interactive mode generation module and interaction locations and film mapping block, wherein:
Interactive mode generation module, is connected with film mapping block with interaction locations, according to different substance films, different film beholder, generates different interactive modes, and the interactive mode of having avoided all films, all beholders is changeless defect all;
Interaction locations and film mapping block, according to film plot, different interaction locations is set, interaction times is not subject to the restriction of system, generate as required different mutual numbers, corresponding two scheduling parameter of each interaction locations, by scheduling parameter, set up and the mapping of dispatching film, communicate by letter with configuration file generation module;
Configuration file generation module, for storing mutual film information, mutual key frame positional information, mutual frame and the mapping of scheduling film and the information of scheduling film, and resolves external file module communication;
Playing module, for providing movie medium, with touch-screen two-way communication;
Interaction feature trapping module, with touch-screen two-way communication, be used for obtaining user profile, and identify colony's user behavior, after analyzing spectators' individual instruction collection, system to individual instruction set analyze, adopt method based on statistics to obtain the general character of individual instruction, be group interaction instruction, for controlling the developing direction of film plot;
Resolve external file module, the interaction feature that reception interaction feature trapping module is caught, the storage information of configuration file generation module, with touch-screen two-way communication, complete the interaction of spectators and substance film;
Touch-screen, receives spectators' program request, the requirement of watching, with playing module, interaction feature trapping module, parsing external file module, interactive information generation module and the two-way communication of configuration file generation module.
2. a kind of movie theatre Play System that circles in the air based on initiatively mutual as claimed in claim 1, is characterized in that: described playing module comprises video player, sound equipment, projector and screen.
3. a kind of movie theatre Play System that circles in the air based on initiatively mutual as claimed in claim 1, is characterized in that: described interaction feature trapping module comprises infrared camera and microphone apparatus.
4. the Interactive control method based on the above-mentioned movie theatre Play System that circles in the air, is characterized in that: comprise the following steps:
(1) configuration file is set: Moviemaking person completes the setting to configuration file by film preprocessing subsystem;
(2) open interaction feature trapping module: utilize user profile capture device: infrared camera and microphone apparatus, image, action and the acoustic information set of catching spectators;
(3) open playing module: by touch-screen, the film of watching is wanted in spectators' selection, opens video player, the synchronous trigger of resolving external file module that starts;
(4) whether trigger Real-Time Monitoring reaches the interaction locations that video file is corresponding, if do not arrive interaction locations, continues displaying video; If arrival interaction locations, player starts to carry out alternately by voice and captions prompting user;
(5) select interactive mode: movie theatre keeper can determine whether to carry out mutual and select which kind of interactive mode according to actual conditions, if do not carried out alternately, continues to play selected video, since then, treats that video playback is complete, and whole reciprocal process is complete; Otherwise need to select interactive mode, interactive mode has three kinds, is respectively: gesture interaction, interactive voice and multichannel are mutual;
(6) mutual if step 5 is selected to proceed, the interactive information that the interactive mode of selecting according to keeper is caught user, according to the broadcasting speed of interactive information adjustment video;
(7) player, according to the speed displaying video after adjusting, treats that video playback is complete, and whole reciprocal process is complete.
5. Interactive control method as claimed in claim 4, is characterized in that: the gesture feature extracting method of infrared camera in described step (2), specifically comprises the following steps:
(2-1) background extraction image;
(2-2) infrared camera is caught image in real time, and and step 2-1 in the background image that obtains carry out calculus of differences: if difference is greater than the threshold value setting in advance, think that difference synthetic image is foreground image, i.e. spectators' gesture; If difference is not more than the threshold value setting in advance, think that spectators' mutual effect is not ideal enough, ignore the image of now catching, recapture image also carries out calculus of differences, and this process circulates always until difference is greater than the threshold value setting in advance;
(2-3) foreground image is carried out to morphology processing, comprise dilation and erosion operation, object is the assorted point of eliminating in foreground image;
(2-4) calculate the length of spectators' arm in interaction area, and by the average of all spectators' arm length as hand attitude interaction feature, thereby touch corresponding movie.
6. Interactive control method as claimed in claim 4, is characterized in that: in described step (2), Mike's subset extracts the method for phonetic feature, and concrete steps are:
(2-a) statistics background sound volume characteristics: obtain the background sound volume in film during Moviemaking;
(2-b) wave volume of microphones capture and background sound volume are carried out to additive operation, obtain spectators' wave volume, as with the mutual feature of film, thereby touch corresponding movie.
7. Interactive control method as claimed in claim 4, is characterized in that: the specific implementation method of adjusting the broadcasting speed of video in described step (6) is:
(a) select gesture interaction, network infra red camera is caught spectators' arm length, adjusts the speed of video playback according to the length of arm;
(b), while selecting interactive voice, microphones capture spectators' yell, according to the speed of the volume adjustment video playback of hubbub;
(c) while selecting multichannel interactive mode, network infra red camera is caught spectators' arm length, and microphones capture spectators' hubbub obtains final mutual information data according to the predetermined weights of system, and according to these data, adjusts the speed of video playback.
8. Interactive control method as claimed in claim 7, is characterized in that: in described step (c), choosing of weights, is subject to the constraint of movie theatre scene, film, according to formula:
ω h = a 1 * 1 dim + b 1 * vol ω v = a 2 * dim + b 2 * 1 vol ω h + ω v = 1
dim∈[0,1],vol∈[0,1]
ω wherein h, ω vbe respectively the shared weights of spectators colony gesture and sound; Dim represents the dim degree of movie theatre scene, and dim numerical value is larger, illustrates that scene is more dim, and vice versa; Vol represents the wave volume of substance film, and vol numerical value is larger, illustrates that film self sound is larger, and vice versa; And dim, vol are normalized; a 1, a 2, b 1, b 2be the constant that is less than 1, be used for guaranteeing ω h, ω vbelong to the positive number that is less than 1.
CN201310517394.3A 2013-10-28 2013-10-28 Flying theater playing system based on active interaction Expired - Fee Related CN103533445B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310517394.3A CN103533445B (en) 2013-10-28 2013-10-28 Flying theater playing system based on active interaction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310517394.3A CN103533445B (en) 2013-10-28 2013-10-28 Flying theater playing system based on active interaction

Publications (2)

Publication Number Publication Date
CN103533445A true CN103533445A (en) 2014-01-22
CN103533445B CN103533445B (en) 2014-07-02

Family

ID=49935049

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310517394.3A Expired - Fee Related CN103533445B (en) 2013-10-28 2013-10-28 Flying theater playing system based on active interaction

Country Status (1)

Country Link
CN (1) CN103533445B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105792003A (en) * 2014-12-19 2016-07-20 张鸿勋 Interactive multimedia production system and method
CN107135399A (en) * 2017-03-29 2017-09-05 网易传媒科技(北京)有限公司 Interactive control method, equipment and the computer-readable recording medium of video
CN108701369A (en) * 2015-10-09 2018-10-23 华纳兄弟娱乐公司 For the making and encapsulation of the recreation data of virtual reality
CN109333544A (en) * 2018-09-11 2019-02-15 厦门大学 A kind of image exchange method for the marionette performance that spectators participate in
CN110554766A (en) * 2018-05-31 2019-12-10 柯刚铠 Interaction method and vehicle-mounted interaction device
CN111163304A (en) * 2019-12-27 2020-05-15 扬州哈工科创机器人研究院有限公司 Method and device for fusing film and matrix mechanical unit
CN111479135A (en) * 2020-06-01 2020-07-31 湖南快乐阳光互动娱乐传媒有限公司 Method and device for controlling playing effect of video
CN113490048A (en) * 2021-07-28 2021-10-08 广东金马游乐股份有限公司 Dynamic movie and television system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201168449Y (en) * 2008-04-02 2008-12-24 宁波新文三维股份有限公司 Interactive movie theatre
US20120204203A1 (en) * 2009-06-22 2012-08-09 Cinvolve Bvba Method for interactive digital cinema system
CN102671397A (en) * 2012-04-16 2012-09-19 宁波新文三维股份有限公司 Seven-dimensional cinema and interaction method thereof
CN103055524A (en) * 2013-01-21 2013-04-24 上海恒润数码影像科技有限公司 Positioning device, four-dimensional interactive cinema and interacting method utilizing same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201168449Y (en) * 2008-04-02 2008-12-24 宁波新文三维股份有限公司 Interactive movie theatre
US20120204203A1 (en) * 2009-06-22 2012-08-09 Cinvolve Bvba Method for interactive digital cinema system
CN102671397A (en) * 2012-04-16 2012-09-19 宁波新文三维股份有限公司 Seven-dimensional cinema and interaction method thereof
CN103055524A (en) * 2013-01-21 2013-04-24 上海恒润数码影像科技有限公司 Positioning device, four-dimensional interactive cinema and interacting method utilizing same

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105792003A (en) * 2014-12-19 2016-07-20 张鸿勋 Interactive multimedia production system and method
CN108701369A (en) * 2015-10-09 2018-10-23 华纳兄弟娱乐公司 For the making and encapsulation of the recreation data of virtual reality
CN108701369B (en) * 2015-10-09 2022-10-25 华纳兄弟娱乐公司 Device and method for producing and packaging entertainment data aiming at virtual reality
CN107135399A (en) * 2017-03-29 2017-09-05 网易传媒科技(北京)有限公司 Interactive control method, equipment and the computer-readable recording medium of video
CN110554766A (en) * 2018-05-31 2019-12-10 柯刚铠 Interaction method and vehicle-mounted interaction device
CN109333544A (en) * 2018-09-11 2019-02-15 厦门大学 A kind of image exchange method for the marionette performance that spectators participate in
CN109333544B (en) * 2018-09-11 2020-07-17 厦门大学 Doll interaction method for marionette performance participated by audience
CN111163304A (en) * 2019-12-27 2020-05-15 扬州哈工科创机器人研究院有限公司 Method and device for fusing film and matrix mechanical unit
CN111163304B (en) * 2019-12-27 2021-10-08 扬州哈工科创机器人研究院有限公司 Method and device for fusing film and matrix mechanical unit
CN111479135A (en) * 2020-06-01 2020-07-31 湖南快乐阳光互动娱乐传媒有限公司 Method and device for controlling playing effect of video
CN113490048A (en) * 2021-07-28 2021-10-08 广东金马游乐股份有限公司 Dynamic movie and television system

Also Published As

Publication number Publication date
CN103533445B (en) 2014-07-02

Similar Documents

Publication Publication Date Title
CN103533445B (en) Flying theater playing system based on active interaction
Pavlik Journalism in the age of virtual reality: How experiential media are transforming news
CN106303555B (en) A kind of live broadcasting method based on mixed reality, device and system
WO2021114881A1 (en) Intelligent commentary generation method, apparatus and device, intelligent commentary playback method, apparatus and device, and computer storage medium
US11113884B2 (en) Techniques for immersive virtual reality experiences
CN107750460A (en) The automatic identification of entity in media capture event
CN109333544B (en) Doll interaction method for marionette performance participated by audience
CN109635616A (en) Interactive approach and equipment
CN113709543B (en) Video processing method and device based on virtual reality, electronic equipment and medium
CN116474378A (en) Artificial Intelligence (AI) controlled camera perspective generator and AI broadcaster
CN111654715A (en) Live video processing method and device, electronic equipment and storage medium
US11656682B2 (en) Methods and systems for providing an immersive virtual reality experience
EP4106337A1 (en) Video processing method and apparatus, computer device, and storage medium
Artstein et al. Time-offset interaction with a holocaust survivor
CN104010179A (en) Multi-user clustering and viewpoint calculating system and method based on multiple three-dimensional pictures
CN113687720A (en) Multi-person online virtual reality education system and use method thereof
IJsselsteijn History of telepresence
CN111063024A (en) Three-dimensional virtual human driving method and device, electronic equipment and storage medium
KR102200239B1 (en) Real-time computer graphics video broadcasting service system
CN203606621U (en) 5d interactive multimedia system
CN112843693B (en) Method and device for shooting image, electronic equipment and storage medium
CN111265851B (en) Data processing method, device, electronic equipment and storage medium
CN202929567U (en) Virtual character animation performance system
CN204233735U (en) A kind of 5D body sense interactive game device
CN106331525A (en) Realization method for interactive film

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20140702

Termination date: 20161028