CN107396084A - A kind of MR implementation methods and equipment based on dual camera - Google Patents
A kind of MR implementation methods and equipment based on dual camera Download PDFInfo
- Publication number
- CN107396084A CN107396084A CN201710616657.4A CN201710616657A CN107396084A CN 107396084 A CN107396084 A CN 107396084A CN 201710616657 A CN201710616657 A CN 201710616657A CN 107396084 A CN107396084 A CN 107396084A
- Authority
- CN
- China
- Prior art keywords
- scene
- real time
- background
- virtual
- time scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000009977 dual effect Effects 0.000 title claims abstract description 75
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000002452 interceptive effect Effects 0.000 claims abstract description 75
- 238000009877 rendering Methods 0.000 claims abstract description 70
- 230000004044 response Effects 0.000 claims abstract description 45
- 230000009471 action Effects 0.000 claims description 35
- 230000003993 interaction Effects 0.000 claims description 21
- 238000000926 separation method Methods 0.000 claims description 10
- 238000004891 communication Methods 0.000 claims description 9
- 239000000203 mixture Substances 0.000 claims description 9
- 108010001267 Protein Subunits Proteins 0.000 claims description 2
- 210000000746 body region Anatomy 0.000 claims description 2
- 241000208340 Araliaceae Species 0.000 claims 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims 1
- 235000003140 Panax quinquefolius Nutrition 0.000 claims 1
- 235000008434 ginseng Nutrition 0.000 claims 1
- 230000003190 augmentative effect Effects 0.000 description 10
- 238000003860 storage Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 238000013507 mapping Methods 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 241000222712 Kinetoplastida Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 229910052799 carbon Inorganic materials 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 230000001404 mediated effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
- G06T15/205—Image-based rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Geometry (AREA)
- Computing Systems (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the invention discloses a kind of MR implementation methods based on dual camera and equipment, this method to include:The real time scene of current environment is gathered by dual camera, and the background and prospect entity in the real time scene are separated by default background color, obtain background view and entity scene, being sent to rendering server includes the render request of the background view, and receive rendering server and render response for what the render request returned, the background view that the real time scene includes is substituted for the virtual scene of background view matching, and exports the virtual scene and the entity scene.VR and AR function can be merged by implementing the embodiment of the present invention, by the way that by way of physical surroundings are combined virtual digit space can accurately be recognized into mutual identity between each other when more people interact, improve the security when realizing that more people interact by the virtual scenes of 3D, interactive mode is enriched, more three-dimensional safer diversified Interactive Experience more true to nature is brought to user.
Description
Technical field
The present invention relates to real (Mediated Reality, the MR) technical field of mediation, more particularly to one kind to be taken the photograph based on double
As the MR implementation methods and equipment of head.
Background technology
Currently, with the fast development of electronic technology, the application of virtual reality (Virtual Reality, VR) technology
It is more and more extensive, wherein, the most common application of VR technologies is presented as its application in aspects of game play, i.e., abundant perception with
3D display environment causes VR equipment to become preferable video-game instrument, for example, user can pass through after putting on VR equipment
The stimulation or mutual with the virtual role progress in the virtual scenes of 3D during roller-coaster is sat in the virtual scene experience of 3D that VR equipment is shown
It is dynamic, it can so make user on the spot in person, with the enjoyment of increase game.Practice is found, is realizing that more people interact by VR technologies
During, not only include virtual scene in the virtual scenes of 3D that VR equipment is shown, in addition to for interactive user virtualization after
Virtual role obtain and in the virtual scene, the difference on build and equipment due to virtual role and interactive user be present
It is different, during the virtual scenes of 3D and the virtual role of interactive user that user is shown by VR equipment interact, user
Interactive user can be collided, this gives interaction both sides to bring infliction of body.It can be seen that existing realized by the virtual scenes of 3D
The problem of security is low be present in the mode of more people's interactions.
The content of the invention
, can be to based on double shootings the embodiment of the invention discloses a kind of MR implementation methods and equipment based on dual camera
The real person or scenery that head captures carry out actualization and shown, improve when realizing that more people interact by the virtual scenes of 3D
Security.
First aspect of the embodiment of the present invention discloses a kind of MR implementation methods based on dual camera, and methods described includes:
The real time scene of current environment is gathered by dual camera, and by presetting the reality of background color separation collection
Background in Shi Jingxiang and prospect entity, obtain background view and entity scene, the background color of the background view with it is described
Default background color matches;
Being sent to rendering server includes the render request of the background view, and receives the rendering server and be directed to institute
The response that renders of render request return is stated, the render request is used for the virtual scene that background view described in acquisition request matches,
The virtual scene for rendering the background view of the response including being determined by the rendering server and matching;
The background view that the real time scene is included is substituted for the virtual scene of the background view matching, and defeated
Go out the virtual scene and the entity scene.
As an alternative embodiment, in first aspect of the embodiment of the present invention, it is described by presetting background color
The background and prospect entity in the real time scene of collection are separated, obtains background view and entity scene, including:
Known otherwise by background color, color and default background color phase are identified from the real time scene of collection
The part real time scene of matching, and whether judge in the part real time scene comprising certain for personage in the real time scene
The real time scene of a little body parts;
When judged result is to be, some bodies for being directed to personage in the real time scene will be removed in the part real time scene
The first remaining real time scene outside the real time scene of body region is defined as background view, and by pin in the part real time scene
Entity scape is defined as to the real time scene of some body parts of personage in the real time scene and the second remaining real time scene
As the real time scene of the part real time scene and the second remaining real time scene composition collection.
As an alternative embodiment, in first aspect of the embodiment of the present invention, service is rendered described in the reception
Device for the render request return render response after, and the background view that the real time scene is included
It is substituted for before the virtual scene of the background view matching, methods described also includes:
The virtual of the background view determined by the rendering server matching that response includes is rendered described in judgement
Whether the number of scene is more than 1;
When judging the background view determined by the rendering server matching for rendering response and including
When the number of virtual scene is not more than 1, triggering performs the background view for including the real time scene and is substituted for institute
State the operation of the virtual scene of background view matching;
Methods described also includes:
When judging the background view determined by the rendering server matching for rendering response and including
When the number of virtual scene is more than 1, all virtual scenes that response is rendered described in output to be included select for user;
One of them virtual scene that user selects from all virtual scenes is determined, and by the real time scene
Including the background view be substituted for one of them described virtual scene, and the output entity scene and it is described wherein
One virtual scene.
As an alternative embodiment, in first aspect of the embodiment of the present invention, methods described also includes:
Body-sensing action of the user for the dummy object in the virtual scene is gathered, and judges the dynamic of the body-sensing action
Make whether parameter meets parameter preset condition;
When the action parameter of body-sensing action meets the parameter preset condition, according to the action of body-sensing action
Parameter generation for the dummy object control instruction, and according to the control instruction, control the dummy object perform with
The operation that the control instruction matches.
As an alternative embodiment, in first aspect of the embodiment of the present invention, methods described also includes:
When interaction personage in the entity scene be present, interactive information of the collection for the interactive personage;
Judge whether the interactive information is legal interactive information, when judging that the interactive information is the legal interaction
During information, the interactive information is sent to the rendering server, to trigger the rendering server by the interactive information
It is issued to interactive device corresponding to the interactive personage.
Second aspect of the embodiment of the present invention discloses a kind of MR based on dual camera and realizes equipment, and the equipment includes:
Collecting unit, for gathering the real time scene of current environment by dual camera;
Separative element, the back of the body in the real time scene for separating the collecting unit collection by presetting background color
Scape and prospect entity, obtain background view and entity scene, the background color of the background view and the default background color
Match;
Communication unit, the render request of the background view is included for being sent to rendering server, and receives the wash with watercolours
Dye server renders response for what the render request returned, and the render request is used for background view described in acquisition request
The virtual scene matched somebody with somebody, the virtual scape for rendering the background view of the response including being determined by the rendering server and matching
As;
Replacement unit, the background view for the real time scene to be included are substituted for the background view matching
Virtual scene;
Output unit, for exporting the virtual scene and the entity scene.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the separative element includes:
Subelement is identified, for knowing otherwise by background color, color is identified from the real time scene of collection
The part real time scene to match with default background color;
Judgment sub-unit, personage in the real time scene is directed to for judging whether to include in the part real time scene
The real time scene of some body parts;
Determination subelement, for when the judgment sub-unit judged result for be when, by the part real time scene
The first remaining real time scene in for the real time scene in addition to the real time scene of some body parts of personage is defined as
Background view, and the real time scene for some body parts of personage in the real time scene being directed in the part real time scene
And second remaining real time scene be defined as entity scene, the part real time scene and the second remaining real time scene group
Into the real time scene of collection.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the equipment also includes:
First judging unit, returned for receiving the rendering server in the communication unit for the render request
Render after response and in the background view that the replacement unit includes the real time scene be substituted for the back of the body
Before the virtual scene of scape scene matching aided navigation, the back of the body determined by the rendering server that response includes is rendered described in judgement
Whether the number of the virtual scene of scape scene matching aided navigation is more than 1, when judge it is described render that response includes render service by described
When the number of the virtual scene for the background view matching that device is determined is not more than 1, trigger described in the replacement unit execution
The background view that the real time scene is included is substituted for the operation of the virtual scene of the background view matching;
Output unit, be additionally operable to when first judging unit judge it is described render that response includes render clothes by described
When the number of the virtual scene for the background view matching that business device is determined is more than 1, render what response included described in output
All virtual scenes select for user;
The equipment also includes:
Determining unit, one of them the virtual scene selected for determining user from all virtual scenes;
The replacement unit, the background view for being additionally operable to include the real time scene are substituted for described wherein one
Individual virtual scene;
The output unit, it is additionally operable to export the entity scene and one of them described virtual scene.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the collecting unit, it is additionally operable to adopt
Collect body-sensing action of the user for the dummy object in the virtual scene;
The equipment also includes:
Second judging unit, for judging whether the action parameter of the body-sensing action meets parameter preset condition;
Generation unit, when the action parameter for being acted when the body-sensing meets the parameter preset condition, according to described
Control instruction of the action parameter generation of body-sensing action for the dummy object;
Control unit, for according to the control instruction, controlling the dummy object to perform and the control instruction phase
The operation matched somebody with somebody.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the collecting unit, it is additionally operable to work as
When interaction personage in the entity scene be present, interactive information of the collection for the interactive personage;
The equipment also includes:
3rd judging unit, for judging whether the interactive information is legal interactive information;
The communication unit, it is additionally operable to when the 3rd judging unit judges that the interactive information is the legal interaction
During information, the interactive information is sent to the rendering server, to trigger the rendering server by the interactive information
It is issued to interactive device corresponding to the interactive personage.
Compared with prior art, the embodiment of the present invention possesses following beneficial effect:
In the embodiment of the present invention, the real time scene of current environment is gathered by dual camera, and by presetting background color
The background and prospect entity in the real time scene are separated, obtains background view and entity scene, the background color of the background view
Match with default background color, the render request for including the background view is sent to rendering server, and receive and render service
Device renders response for what the render request returned, and the render request is used for the virtual scape of acquisition request background view matching
As this renders the virtual scene that the background view of response including being determined by rendering server matches, by the real time scene bag
The background view included is substituted for the virtual scene of background view matching, and exports the virtual scene and the entity scene.Can
See, real time scene can be caught by dual camera by implementing the embodiment of the present invention, and be taken the photograph by way of colour recognition for double
The real time scene captured as head realizes the separation of background and prospect entity, and background further can also be substituted for into virtual number
Mapping of the word space (i.e. the virtual scenes of 3D) in physical surroundings, it is this by virtual digit space and physical surroundings (also known as physics
Environment, including personage and scenery) mode that is combined merged the work(of VR and augmented reality (Augmented Reality, AR)
Can, mutual identity can be accurately recognized between each other when more people interact, improve and realized by the virtual scenes of 3D
Security during more people's interactions, enriches interactive mode, and it is interactive to bring more three-dimensional safer variation more true to nature to user
Experience.
Brief description of the drawings
Technical scheme in order to illustrate the embodiments of the present invention more clearly, it will use below required in embodiment
Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for ability
For the those of ordinary skill of domain, on the premise of not paying creative work, it can also be obtained according to these accompanying drawings other attached
Figure.
Fig. 1 is a kind of schematic flow sheet of the MR implementation methods based on dual camera disclosed in the embodiment of the present invention;
Fig. 2 is the schematic flow sheet of MR implementation method of the another kind disclosed in the embodiment of the present invention based on dual camera;
Fig. 3 is the structural representation that a kind of MR based on dual camera disclosed in the embodiment of the present invention realizes equipment;
Fig. 4 is the structural representation that MR of the another kind disclosed in the embodiment of the present invention based on dual camera realizes equipment;
Fig. 5 is the structural representation that another disclosed MR based on dual camera of the embodiment of the present invention realizes equipment;
Fig. 6 is the structural representation that another disclosed MR based on dual camera of the embodiment of the present invention realizes equipment;
Fig. 7 is the structural representation that another disclosed MR based on dual camera of the embodiment of the present invention realizes equipment;
Fig. 8 is the effect diagram that a kind of MR based on dual camera disclosed in the embodiment of the present invention realizes equipment.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.Based on this
Embodiment in invention, the every other reality that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example is applied, belongs to the scope of protection of the invention.
It should be noted that the term " comprising " and " having " of the embodiment of the present invention and their any deformation, it is intended that
Be to cover it is non-exclusive include, for example, containing the process of series of steps or unit, method, system, product or equipment not
Be necessarily limited to those steps or the unit clearly listed, but may include not list clearly or for these processes, side
The intrinsic other steps of method, product or equipment or unit.
The embodiment of the invention discloses a kind of MR implementation methods and equipment based on dual camera, dual camera can be passed through
Real time scene is caught, and realizes that background is real with prospect for the real time scene that dual camera captures by way of colour recognition
The separation of body, and background further can also be substituted for virtual digit space (i.e. the virtual scenes of 3D) reflecting in physical surroundings
Penetrate, this mode for being combined virtual digit space and physical surroundings (also known as physical environment, including personage and scenery) merges
VR and augmented reality (Augmented Reality, AR) function, can accurately be recognized between each other when more people interact
Go out mutual identity, improve the security when realizing that more people interact by the virtual scenes of 3D, interactive mode is enriched, to use
Family brings more three-dimensional safer diversified Interactive Experience more true to nature.Accompanying drawing is combined below to be described in detail.
Embodiment one
Referring to Fig. 1, Fig. 1 is that a kind of flow of the MR implementation methods based on dual camera is shown disclosed in the embodiment of the present invention
It is intended to.Wherein, the method described by Fig. 1 shows equipment suitable for the MR heads with dual camera.As shown in figure 1, should be based on double
The MR implementation methods of camera can include following operation:
101st, MR heads show the real time scene that equipment gathers current environment by dual camera.
In the embodiment of the present invention, MR heads show equipment can have at least three kinds of experience modes, as VR patterns, AR patterns and
VR+AR MR patterns etc., after MR heads show equipment startup, at least three kinds of experience modes can be exported and selected for user, work as inspection
When the experience mode for measuring user's selection is MR patterns, triggering performs step 101- steps 105, and the aobvious equipment of MR heads can also be default
Start MR patterns, the embodiment of the present invention does not limit.
In the embodiment of the present invention, MR heads, which show equipment, has dual camera, and the dual camera is adopted to simulate human eye work
Collect real time scene within the vision, real-time rendering, overlapping portion are carried out to the real time scene (or digital picture) collected
Virtual scene realizes AR patterns, can also be superimposed virtual scene completely and realize VR patterns, can also pass through step 102- steps 105
Operation realize MR patterns, the embodiment of the present invention does not limit.
102nd, MR heads show the background and prospect reality in above-mentioned real time scene of the equipment by presetting background color separation collection
Body, obtain background view and entity scene.
In the embodiment of the present invention, the background color of the background view matches with the default background color, and optionally, this is pre-
Do not limited if background color can be green or blueness, the embodiment of the present invention.Specifically, in actual applications, can be by electricity
It is real with prospect that the green curtain (default background color is green) or blue curtain (default background color is blueness) of shadow special efficacy are applied to background
The separation process of body, you can so that certain specific physical environment is partly or entirely arranged into green curtain or blue curtain in advance, MR heads show
Equipment is under MR patterns by color is identical with default background color or matches scape by way of identifying default background color
As being defined as background view, and scene that is color is different from default background color or not matching that is defined as the reality of prospect entity
Body scene.
In the embodiment of the present invention, optionally, MR heads show the above-mentioned real-time scape that equipment gathers by presetting background color separation
Background and prospect entity as in, obtaining background view and entity scene can include:
MR heads show equipment to be known otherwise by background color, identifies color with presetting from the above-mentioned real time scene of collection
The part real time scene that background color matches, and judge whether to include in the part real time scene and be directed in above-mentioned real time scene
Some body parts of personage are (such as the head and/or personage of the upper part of the body of personage and/or the lower part of the body of personage and/or personage
Foot etc.) real time scene;
When judged result for when being, MR heads, which will show equipment, to be removed in the part real time scene for personage in above-mentioned real time scene
Some body parts real time scene outside the first remaining real time scene be defined as background view, and by the real-time scape in the part
The real time scene of some body parts of personage and the second remaining real time scene in above-mentioned real time scene is directed to as in be defined as
The above-mentioned real time scene of entity scene, the part real time scene and the second remaining real time scene composition collection;
When judged result is no, MR heads show equipment and the part real time scene are defined as into background view, and will be remaining real
Shi Jingxiang is defined as entity scene, the above-mentioned real time scene of the part real time scene and the remaining real time scene composition collection
103rd, MR heads show the render request that equipment includes above-mentioned background view to rendering server transmission, and the render request is used
In the virtual scene of the above-mentioned background view matching of acquisition request.
In the embodiment of the present invention, MR heads, which show the render request that equipment is sent, can also include the equipment mark that MR heads show equipment
Know.Specifically, after the aobvious equipment of MR heads sends the render request for including above-mentioned background view to rendering server, by rendering service
Device performs following operate:
The device identification included by rendering server according to the render request judges that MR heads show whether equipment is to authorize in advance
MR heads show equipment, when judging MR heads to show equipment being that the MR heads that authorize in advance show equipment, identify that the render request includes
Background view in multiple calibration points, and according to the multiple calibration points identified determine MR heads show equipment residing for concrete scene
And MR heads show specific visual angle of the equipment in the concrete scene, and determined according to the concrete scene and the specific visual angle
Corresponding virtual scene, and the virtual scene that the virtual scene determined is matched as above-mentioned background view, and will include
The response that renders for the virtual scene determined returns to the aobvious equipment of MR heads.
104th, the aobvious equipment of MR heads receives rendering server and renders response for what above-mentioned render request returned, and this renders response
Including the virtual scene for the above-mentioned background view matching determined by rendering server.
In the embodiment of the present invention, a variety of background views are stored with the rendering server and matched with background view to
A few virtual scene.
105th, the above-mentioned background view that the aobvious equipment of MR heads includes above-mentioned real time scene is substituted for above-mentioned background view matching
Virtual scene, and export the virtual scene and above-mentioned entity scene.
In the embodiment of the present invention, MR heads show equipment and the background view that above-mentioned real time scene includes are replaced with into background view
The virtual scene of matching, to realize the separation of background and prospect entity, and is substituted for virtual digit space in entity ring by background
Mapping in border.
In the embodiment of the present invention, it is assumed that two users (party A-subscriber and party B-subscriber) show equipment by MR heads and interacted, now,
MR heads show the effect that shows of equipment can with as shown in figure 8, Fig. 8 be disclosed in the embodiment of the present invention it is a kind of based on dual camera
MR realizes the effect diagram of equipment.As shown in figure 8, the wall in physical environment and floor are arranged to the default back of the body in advance
Scape color (green), and multiple calibration points are provided with the wall, the physical environment includes entity tables and chairs and entity hides
Sunshade, party A-subscriber and party B-subscriber with the aobvious equipment of MR heads, the MR heads that party A-subscriber wears show equipment and captured for the physical rings
After the real time scene in border, the real time scene is separated into including party B-subscriber, entity tables and chairs and reality by way of identifying green
The entity scene of body parasols and the background view including wall and floor, and obtain the background view from rendering server
Including multiple calibration points corresponding to virtual scene, and by background mirror image replace with corresponding to virtual scene, finally, party A-subscriber
The visual effect seen by the aobvious equipment of the MR heads of its wearing can be as shown in the lower right-most portion in Fig. 8, i.e., party A-subscriber can pass through
MR heads show the entity scene that equipment sees formed objects, including entity parasols, entity tables and chairs and party B-subscriber.
It can be seen that the MR implementation methods based on dual camera implemented described by Fig. 1 can be caught in real time by dual camera
Scene, and realize background and point of prospect entity for the real time scene that dual camera captures by way of colour recognition
From, and background further can also be substituted for mapping of the virtual digit space (i.e. the virtual scenes of 3D) in physical surroundings, this
Kind by the mode that virtual digit space and physical surroundings (also known as physical environment, including personage and scenery) are combined merged VR and
The function of augmented reality (Augmented Reality, AR), can accurately it be recognized between each other each other when more people interact
Identity, improve the security when realizing that more people interact by the virtual scenes of 3D, enrich interactive mode, brought to user
More three-dimensional safer diversified Interactive Experience more true to nature.
Embodiment two
Referring to Fig. 2, Fig. 2 is that a kind of flow of the MR implementation methods based on dual camera is shown disclosed in the embodiment of the present invention
It is intended to.Wherein, the method described by Fig. 2 shows equipment suitable for the MR heads with dual camera.As shown in Fig. 2 should be based on double
The MR implementation methods of camera can include following operation:
201st, MR heads show the real time scene that equipment gathers current environment by dual camera.
202nd, MR heads show the background and prospect reality in above-mentioned real time scene of the equipment by presetting background color separation collection
Body, obtain background view and entity scene.
In the embodiment of the present invention, the background color of the background view matches with the default background color, and optionally, this is pre-
Do not limited if background color can be green or blueness, the embodiment of the present invention.
In the embodiment of the present invention, optionally, MR heads show the above-mentioned real-time scape that equipment gathers by presetting background color separation
Background and prospect entity as in, obtaining background view and entity scene can include:
MR heads show equipment to be known otherwise by background color, identifies color with presetting from the above-mentioned real time scene of collection
The part real time scene that background color matches, and judge whether to include in the part real time scene and be directed in above-mentioned real time scene
Some body parts of personage are (such as the head and/or personage of the upper part of the body of personage and/or the lower part of the body of personage and/or personage
Foot etc.) real time scene;
When judged result for when being, MR heads, which will show equipment, to be removed in the part real time scene for personage in above-mentioned real time scene
Some body parts real time scene outside the first remaining real time scene be defined as background view, and by the real-time scape in the part
The real time scene of some body parts of personage and the second remaining real time scene in above-mentioned real time scene is directed to as in be defined as
The above-mentioned real time scene of entity scene, the part real time scene and the second remaining real time scene composition collection;
When judged result is no, MR heads show equipment and the part real time scene are defined as into background view, and will be remaining real
Shi Jingxiang is defined as entity scene, the above-mentioned real time scene of the part real time scene and the remaining real time scene composition collection.
203rd, MR heads show the render request that equipment includes above-mentioned background view to rendering server transmission, and the render request is used
In the virtual scene of the above-mentioned background view matching of acquisition request.
In the embodiment of the present invention, MR heads, which show the render request that equipment is sent, can also include the equipment mark that MR heads show equipment
Know.Specifically, after the aobvious equipment of MR heads sends the render request for including above-mentioned background view to rendering server, by rendering service
Device performs following operate:
The device identification included by rendering server according to the render request judges that MR heads show whether equipment is to authorize in advance
MR heads show equipment, when judging MR heads to show equipment being that the MR heads that authorize in advance show equipment, identify that the render request includes
Background view in multiple calibration points, and according to the multiple calibration points identified determine MR heads show equipment residing for concrete scene
And MR heads show specific visual angle of the equipment in the concrete scene, and determined according to the concrete scene and the specific visual angle
Corresponding virtual scene, and the virtual scene that the virtual scene determined is matched as above-mentioned background view, and will include
The response that renders for the virtual scene determined returns to the aobvious equipment of MR heads.
204th, the aobvious equipment of MR heads receives rendering server and renders response for what above-mentioned render request returned, and this renders response
Including the virtual scene for the above-mentioned background view matching determined by rendering server.
205th, MR heads show equipment and judge to render the above-mentioned background view determined by the rendering server matching that response includes
Virtual scene number whether be more than 1, when step 205 judged result for it is no when, trigger step 206, when sentencing for step 205
Disconnected result is when being, triggering performs step 207- steps 208.
206th, the above-mentioned background view that the aobvious equipment of MR heads includes above-mentioned real time scene is substituted for above-mentioned background view matching
Virtual scene, and export the virtual scene and above-mentioned entity scene.
207th, the aobvious equipment output of MR heads, which renders, responds all virtual scenes included for user's selection, and determination user
One of them the virtual scene selected from all virtual scenes.
208th, the above-mentioned background view that the aobvious equipment of MR heads includes above-mentioned real time scene is substituted for above-mentioned one of empty
Intend scene, and export above-mentioned entity scene and one of them above-mentioned virtual scene.
In an optional embodiment, after be finished step 206 or the step 208 that is finished, this is based on
The MR implementation methods of dual camera can also include following operation:
MR heads show equipment, and by the body-sensing sensor in the aobvious equipment of MR heads, (such as gyroscope, gravity sensor and acceleration pass
Sensor etc.) collection user acts for the body-sensing of the dummy object in above-mentioned virtual scene, and judges the action of body-sensing action
Whether parameter meets parameter preset condition;
When the action parameter of body-sensing action meets parameter preset condition, MR heads show equipment and moved according to what the body-sensing acted
Make control instruction of the parameter generation for dummy object, and according to the control instruction, control dummy object performs to be referred to the control
Make the operation to match.
It can be seen that the optional embodiment can act generation according to the body-sensing of user is directed to dummy object in virtual scene
Control instruction, enrich the interactive mode of user and virtual scene so that the aobvious equipment of MR heads is more intelligent, further improves
The usage experience of user.
In another optional embodiment, after be finished step 206 or the step 208 that is finished, this is based on
The MR implementation methods of dual camera can also include following operation:
When interaction personage in above-mentioned entity scene be present, MR heads show interaction letter of the equipment collection for interaction personage
Breath;
MR heads show equipment and judge whether the interactive information is legal interactive information, when judging that the interactive information is legal friendship
During mutual information, the interactive information is sent to rendering server, the interactive information is issued to interaction to trigger rendering server
Interactive device corresponding to personage.Interaction is carried out between the interaction personage that so can allow for occurring in real time scene, is enhanced mutually
Kinetoplast is tested, and can also carry out legitimate verification to interactive information, is conducive to provide a harmonious mutual environment of health, is entered one
Step improves the usage experience of user.
It can be seen that the MR implementation methods based on dual camera implemented described by Fig. 2 can be caught in real time by dual camera
Scene, and realize background and point of prospect entity for the real time scene that dual camera captures by way of colour recognition
From, and background further can also be substituted for mapping of the virtual digit space (i.e. the virtual scenes of 3D) in physical surroundings, this
Kind by the mode that virtual digit space and physical surroundings (also known as physical environment, including personage and scenery) are combined merged VR and
The function of augmented reality (Augmented Reality, AR), can accurately it be recognized between each other each other when more people interact
Identity, improve the security when realizing that more people interact by the virtual scenes of 3D, enrich interactive mode, brought to user
More three-dimensional safer diversified Interactive Experience more true to nature, and can also provide the user what is matched with user's local environment
Virtual scene selects for user, virtual scene when selecting interactive according to self-demand so as to user, personalized strong, further carries
The high usage experience of user.
Embodiment three
Referring to Fig. 3, Fig. 3 is that a kind of MR based on dual camera realizes that the structure of equipment is shown disclosed in the embodiment of the present invention
It is intended to.As shown in figure 3, being somebody's turn to do the MR based on dual camera realizes that equipment can apply to have the MR heads of dual camera to show equipment
In.As shown in figure 3, being somebody's turn to do the MR based on dual camera realizes that equipment can include:
Collecting unit 301, for gathering the real time scene of current environment by dual camera.
Separative element 302, the background in real time scene for separating the collection of collecting unit 301 by presetting background color
With prospect entity, background view and entity scene are obtained, wherein, the background color of the background view and default background color phase
Match somebody with somebody.
Communication unit 303, the render request of above-mentioned background view is included for being sent to rendering server, and receive and render
Server renders response for what the render request returned, and the render request is used for the virtual scape of acquisition request background view matching
As this renders the virtual scene that background view of the response including being determined by rendering server matches.
Replacement unit 304, the above-mentioned background view for above-mentioned real time scene to be included are substituted for above-mentioned background view
The virtual scene matched somebody with somebody.
Output unit 305, for exporting above-mentioned virtual scene and above-mentioned entity scene.
It can be caught in real time by dual camera it can be seen that the MR heads based on dual camera described by implementing Fig. 3 show equipment
Scene, and realize background and point of prospect entity for the real time scene that dual camera captures by way of colour recognition
From, and background further can also be substituted for mapping of the virtual digit space (i.e. the virtual scenes of 3D) in physical surroundings, this
Kind by the mode that virtual digit space and physical surroundings (also known as physical environment, including personage and scenery) are combined merged VR and
The function of augmented reality (Augmented Reality, AR), can accurately it be recognized between each other each other when more people interact
Identity, improve the security when realizing that more people interact by the virtual scenes of 3D, enrich interactive mode, brought to user
More three-dimensional safer diversified Interactive Experience more true to nature.
In an optional embodiment, separative element 302 can include identification subelement 3021, judgment sub-unit 3022
And determination subelement 3023, now, it is somebody's turn to do the MR based on dual camera and realizes that the structure of equipment can be with as shown in figure 4, Fig. 4 be this
MR of the another kind disclosed in inventive embodiments based on dual camera realizes the structural representation of equipment.Wherein:
Subelement 3021 is identified, for being known otherwise by background color, is identified from the above-mentioned real time scene of collection
The part real time scene that color matches with default background color.
Judgment sub-unit 3022, for judging identify in the part real time scene that identifies of subelement 3021 whether include pin
To the real time scene of some body parts of personage in real time scene.
Determination subelement 3023, for when judgment sub-unit 3022 judged result for be when, by the real-time scape in above-mentioned part
The first remaining real time scene as in for above-mentioned real time scene in addition to the real time scene of some body parts of personage is true
It is set to background view, and will be remaining real for the real time scene of some body parts of personage in above-mentioned real time scene and second
Shi Jingxiang is defined as entity scene, wherein, the reality of above-mentioned part real time scene and the second remaining real time scene composition collection
Shi Jingxiang.
Determination subelement 3023, it is additionally operable to when the judged result of judgment sub-unit 3022 is no, by the real-time scape in the part
It is defined as entity scene as being defined as background view, and by remaining real time scene, the part real time scene and the residue are real-time
The above-mentioned real time scene of scene composition collection.
It can be seen that the MR based on dual camera implemented described by Fig. 4 realizes that equipment can also ensure that the entity scape collected
As the integrality of middle personage, security during more people's interactions is further ensured.
In another optional embodiment, it is somebody's turn to do the MR based on dual camera and realizes that equipment can also include first and judge list
Member 306 and determining unit 307, now, it is somebody's turn to do the MR based on dual camera and realizes that the structure of equipment can be with as shown in figure 5, Fig. 5 be
Another MR based on dual camera disclosed in the embodiment of the present invention realizes the structural representation of equipment.Wherein:
First judging unit 306, rendered for receiving rendering server in communication unit 303 for what render request returned
The virtual scene of background view matching is substituted for after response and in the background view that replacement unit 304 includes real time scene
Before, judge whether the number for rendering the virtual scene for the background view determined by the rendering server matching that response includes is big
In 1, when the virtual scene for judging to render the background view determined by the rendering server matching that response includes number not
During more than 1, triggering replacement unit 304 performs the void that the above-mentioned background view for including real time scene is substituted for background view matching
Intend the operation of scene.
Output unit 305, be additionally operable to when the first judging unit 306 judge to render response include it is true by rendering server
When the number of the virtual scene for the background view matching made is more than 1, all virtual scenes that output renders response and included supply
User selects.
Determining unit 307, one of them the virtual scene selected for determining user from all virtual scenes.
Replacement unit 304, the background view for being additionally operable to include real time scene are substituted for one of them virtual scene.
Output unit 305, it is additionally operable to export entity scene and one of them virtual scene.
It can be seen that the MR based on dual camera implemented described by Fig. 5 realizes that equipment can also provide the user and user institute
The virtual scene that place's environment matches selects for user, and virtual scene when selecting interactive according to self-demand so as to user is individual
Propertyization is strong, further increases the usage experience of user.
In another optional embodiment, it is somebody's turn to do the MR based on dual camera and realizes that equipment can also include second and judge list
Member 308, generation unit 309 and control unit 310, now, should MR based on dual camera realize that the structure of equipment can be as
Shown in Fig. 6, Fig. 6 is the structural representation that another disclosed MR based on dual camera of the embodiment of the present invention realizes equipment.Its
In:
Collecting unit 301, it can be also used for gathering body-sensing action of the user for the dummy object in above-mentioned virtual scene.
Second judging unit 308, for judging whether the action parameter of above-mentioned body-sensing action meets parameter preset condition.
Generation unit 309, the action parameter for judging above-mentioned body-sensing action when the second judging unit 308 meet default
During Parameter Conditions, the control instruction according to the action parameter generation that above-mentioned body-sensing acts for dummy object.
Control unit 310, for performing the behaviour to match with control instruction according to above-mentioned control instruction, control dummy object
Make.
It can be seen that the MR based on dual camera implemented described by Fig. 6 realizes that equipment can also act according to the body-sensing of user
Generation is directed to the control instruction of dummy object in virtual scene, enriches the interactive mode of user and virtual scene so that MR heads
Aobvious equipment is more intelligent, further increases the usage experience of user.
In another optional embodiment, it is somebody's turn to do the MR based on dual camera and realizes that equipment can also include the 3rd and judge list
Member 311, now, it is somebody's turn to do the MR based on dual camera and realizes that the structure of equipment can be with as shown in fig. 7, Fig. 7 be public affairs of the embodiment of the present invention
MR of another opened based on dual camera realizes the structural representation of equipment.Wherein:
Collecting unit 301, it can be also used for when interaction personage in above-mentioned entity scene be present, collection is directed to interaction people
The interactive information of thing.
3rd judging unit 311, for judging whether the interactive information that collecting unit 301 collects is legal interaction letter
Breath.
Communication unit 303, it can be also used for when the 3rd judging unit 311 judges that above-mentioned interactive information is believed for legal interaction
During breath, above-mentioned interactive information is sent to rendering server, interactive information is issued to interactive personage to trigger rendering server
Corresponding interactive device.
It can be seen that the MR based on dual camera implemented described by Fig. 7 realizes that equipment can also allow to occur in real time scene
Interaction personage between carry out interactive, enhance Interactive Experience, and legitimate verification can also be carried out to interactive information, be advantageous to
One harmonious mutual environment of health is provided, further increases the usage experience of user.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can
To instruct the hardware of correlation to complete by program, the program can be stored in a computer-readable recording medium, storage
Medium include read-only storage (Read-Only Memory, ROM), random access memory (Random Access Memory,
RAM), programmable read only memory (Programmable Read-only Memory, PROM), erasable programmable is read-only deposits
Reservoir (Erasable Programmable Read Only Memory, EPROM), disposable programmable read-only storage (One-
Time Programmable Read-Only Memory, OTPROM), the electronics formula of erasing can make carbon copies read-only storage
(Electrically-Erasable Programmable Read-Only Memory, EEPROM), read-only optical disc (Compact
Disc Read-Only Memory, CD-ROM) or other disk storages, magnetic disk storage, magnetic tape storage or can
For carrying or any other computer-readable medium of data storage.
A kind of MR implementation methods and equipment based on dual camera disclosed in the embodiment of the present invention have been carried out in detail above
Introduce, specific case used herein is set forth to the principle and embodiment of the present invention, the explanation of above example
It is only intended to help the method and its core concept for understanding the present invention;Meanwhile for those of ordinary skill in the art, according to this
The thought of invention, there will be changes in specific embodiments and applications, in summary, this specification content should
It is interpreted as limitation of the present invention.
Claims (10)
1. a kind of MR implementation methods based on dual camera, it is characterised in that methods described includes:
The real time scene of current environment is gathered by dual camera, and by presetting the real-time scape of background color separation collection
Background and prospect entity as in, obtain background view and entity scene, and the background color of the background view is preset with described
Background color matches;
Being sent to rendering server includes the render request of the background view, and receives the rendering server and be directed to the wash with watercolours
What dye request returned renders response, and the render request is used for the virtual scene that background view described in acquisition request matches, described
The virtual scene that the background view that rendering response includes being determined by the rendering server matches;
The background view that the real time scene is included is substituted for the virtual scene of the background view matching, and exports institute
State virtual scene and the entity scene.
2. the MR implementation methods according to claim 1 based on dual camera, it is characterised in that described by presetting background
Background and prospect entity in the real time scene of color separated collection, obtain background view and entity scene, including:
Known otherwise by background color, identify that color matches with default background color from the real time scene of collection
Part real time scene, and judge in the part real time scene whether to include some bodies for being directed to personage in the real time scene
The real time scene of body region;
When judged result is to be, some body for being directed to personage in the real time scene will be removed in the part real time scene
The first remaining real time scene outside the real time scene of position is defined as background view, and institute will be directed in the part real time scene
State the real time scene of some body parts of personage and the second remaining real time scene in real time scene and be defined as entity scene, institute
State part real time scene and the real time scene of the second remaining real time scene composition collection.
3. the MR implementation methods according to claim 1 or 2 based on dual camera, it is characterised in that described in the reception
Rendering server for the render request return render response after, and it is described the real time scene is included described in
Background view is substituted for before the virtual scene of the background view matching, and methods described also includes:
The virtual scene for the background view determined by the rendering server matching that response includes is rendered described in judgement
Number whether be more than 1;
When judging the virtual of the background view determined by the rendering server matching for rendering response and including
When the number of scene is not more than 1, triggering performs the background view for including the real time scene and is substituted for the back of the body
The operation of the virtual scene of scape scene matching aided navigation;
Methods described also includes:
When judging the virtual of the background view determined by the rendering server matching for rendering response and including
When the number of scene is more than 1, all virtual scenes that response is rendered described in output to be included select for user;
One of them virtual scene that user selects from all virtual scenes is determined, and the real time scene is included
The background view be substituted for one of them described virtual scene, and the output entity scene and it is described one of them
Virtual scene.
4. the MR implementation methods based on dual camera according to claim any one of 1-3, it is characterised in that methods described
Also include:
Body-sensing action of the user for the dummy object in the virtual scene is gathered, and judges the action ginseng of the body-sensing action
Whether number meets parameter preset condition;
When the action parameter of body-sensing action meets the parameter preset condition, according to the action parameter of body-sensing action
Generation for the dummy object control instruction, and according to the control instruction, control the dummy object perform with it is described
The operation that control instruction matches.
5. the MR implementation methods based on dual camera according to claim any one of 1-4, it is characterised in that methods described
Also include:
When interaction personage in the entity scene be present, interactive information of the collection for the interactive personage;
Judge whether the interactive information is legal interactive information, when judging that the interactive information is the legal interactive information
When, the interactive information is sent to the rendering server, issued the interactive information with triggering the rendering server
To interactive device corresponding to the interactive personage.
6. a kind of MR based on dual camera realizes equipment, it is characterised in that the equipment includes:
Collecting unit, for gathering the real time scene of current environment by dual camera;
Separative element, for by preset background color separate background in the real time scene that the collecting unit gathers with
Prospect entity, obtain background view and entity scene, the background color of the background view and the default background color phase
Match somebody with somebody;
Communication unit, the render request of the background view is included for being sent to rendering server, and clothes are rendered described in reception
Business device renders response for what the render request returned, and the render request is used for what background view described in acquisition request matched
Virtual scene, the virtual scene for rendering the background view of the response including being determined by the rendering server and matching;
Replacement unit, the background view for the real time scene to be included are substituted for the virtual of the background view matching
Scene;
Output unit, for exporting the virtual scene and the entity scene.
7. the MR according to claim 6 based on dual camera realizes equipment, it is characterised in that the separative element bag
Include:
Identify subelement, for being known otherwise by background color, identified from the real time scene of collection color with it is pre-
If the part real time scene that background color matches;
Judgment sub-unit, some of personage in the real time scene are directed to for judging in the part real time scene whether to include
The real time scene of body part;
Determination subelement, for when the judged result of the judgment sub-unit is is, pin being removed in the part real time scene
Background is defined as to the first remaining real time scene outside the real time scene of some body parts of personage in the real time scene
Scene, and will in the part real time scene be directed to the real time scene in personage some body parts real time scene and
Second remaining real time scene is defined as entity scene, and the part real time scene and the second remaining real time scene composition are adopted
The real time scene of collection.
8. the MR based on dual camera according to claim 6 or 7 realizes equipment, it is characterised in that the equipment is also wrapped
Include:
First judging unit, for receiving wash with watercolours of the rendering server for render request return in the communication unit
The background scape is substituted for after dye response and in the background view that the replacement unit includes the real time scene
As matching virtual scene before, the background scape determined by the rendering server that includes of response is rendered described in judgement
As whether the number of the virtual scene of matching is more than 1, when judge it is described render response include it is true by the rendering server
When the number of the virtual scene for the background view matching made is not more than 1, it is described by institute to trigger the replacement unit execution
The background view that stating real time scene includes is substituted for the operation of the virtual scene of the background view matching;
Output unit, be additionally operable to when first judging unit judge it is described render that response includes by the rendering server
When the number of the virtual scene for the background view matching determined is more than 1, render described in output response include it is all
Virtual scene selects for user;
The equipment also includes:
Determining unit, one of them the virtual scene selected for determining user from all virtual scenes;
The replacement unit, the background view for being additionally operable to include the real time scene are substituted for described one of empty
Intend scene;
The output unit, it is additionally operable to export the entity scene and one of them described virtual scene.
9. the MR based on dual camera according to claim any one of 6-8 realizes equipment, it is characterised in that the collection
Unit, it is additionally operable to gather body-sensing action of the user for the dummy object in the virtual scene;
The equipment also includes:
Second judging unit, for judging whether the action parameter of the body-sensing action meets parameter preset condition;
Generation unit, when the action parameter for being acted when the body-sensing meets the parameter preset condition, according to the body-sensing
Control instruction of the action parameter generation of action for the dummy object;
Control unit, for according to the control instruction, controlling the dummy object to perform what is matched with the control instruction
Operation.
10. the MR based on dual camera according to claim any one of 6-9 realizes equipment, it is characterised in that described to adopt
Collecting unit, being additionally operable to when interaction personage in the entity scene be present, interactive information of the collection for the interactive personage;
The equipment also includes:
3rd judging unit, for judging whether the interactive information is legal interactive information;
The communication unit, it is additionally operable to when the 3rd judging unit judges that the interactive information is the legal interactive information
When, the interactive information is sent to the rendering server, issued the interactive information with triggering the rendering server
To interactive device corresponding to the interactive personage.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710616657.4A CN107396084A (en) | 2017-07-20 | 2017-07-20 | A kind of MR implementation methods and equipment based on dual camera |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710616657.4A CN107396084A (en) | 2017-07-20 | 2017-07-20 | A kind of MR implementation methods and equipment based on dual camera |
Publications (1)
Publication Number | Publication Date |
---|---|
CN107396084A true CN107396084A (en) | 2017-11-24 |
Family
ID=60341213
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710616657.4A Pending CN107396084A (en) | 2017-07-20 | 2017-07-20 | A kind of MR implementation methods and equipment based on dual camera |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107396084A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110012229A (en) * | 2019-04-12 | 2019-07-12 | 维沃移动通信有限公司 | A kind of image processing method and terminal |
CN110730340A (en) * | 2019-09-19 | 2020-01-24 | 天脉聚源(杭州)传媒科技有限公司 | Lens transformation-based virtual auditorium display method, system and storage medium |
CN113223186A (en) * | 2021-07-07 | 2021-08-06 | 江西科骏实业有限公司 | Processing method, equipment, product and device for realizing augmented reality |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3927965B2 (en) * | 2004-05-12 | 2007-06-13 | キヤノン株式会社 | Video processing apparatus and method |
CN101727182A (en) * | 2010-01-28 | 2010-06-09 | 南京航空航天大学 | Method and system for visualizing real hand of participant in helmet-type virtual reality environment |
CN204989626U (en) * | 2015-07-22 | 2016-01-20 | 杭州睿唯投资管理有限公司 | Smart spectacles |
CN105955456A (en) * | 2016-04-15 | 2016-09-21 | 深圳超多维光电子有限公司 | Virtual reality and augmented reality fusion method, device and intelligent wearable equipment |
CN106055113A (en) * | 2016-07-06 | 2016-10-26 | 北京华如科技股份有限公司 | Reality-mixed helmet display system and control method |
CN106097435A (en) * | 2016-06-07 | 2016-11-09 | 北京圣威特科技有限公司 | A kind of augmented reality camera system and method |
CN106873778A (en) * | 2017-01-23 | 2017-06-20 | 深圳超多维科技有限公司 | A kind of progress control method of application, device and virtual reality device |
-
2017
- 2017-07-20 CN CN201710616657.4A patent/CN107396084A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3927965B2 (en) * | 2004-05-12 | 2007-06-13 | キヤノン株式会社 | Video processing apparatus and method |
CN101727182A (en) * | 2010-01-28 | 2010-06-09 | 南京航空航天大学 | Method and system for visualizing real hand of participant in helmet-type virtual reality environment |
CN204989626U (en) * | 2015-07-22 | 2016-01-20 | 杭州睿唯投资管理有限公司 | Smart spectacles |
CN105955456A (en) * | 2016-04-15 | 2016-09-21 | 深圳超多维光电子有限公司 | Virtual reality and augmented reality fusion method, device and intelligent wearable equipment |
CN106097435A (en) * | 2016-06-07 | 2016-11-09 | 北京圣威特科技有限公司 | A kind of augmented reality camera system and method |
CN106055113A (en) * | 2016-07-06 | 2016-10-26 | 北京华如科技股份有限公司 | Reality-mixed helmet display system and control method |
CN106873778A (en) * | 2017-01-23 | 2017-06-20 | 深圳超多维科技有限公司 | A kind of progress control method of application, device and virtual reality device |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110012229A (en) * | 2019-04-12 | 2019-07-12 | 维沃移动通信有限公司 | A kind of image processing method and terminal |
CN110012229B (en) * | 2019-04-12 | 2021-01-08 | 维沃移动通信有限公司 | Image processing method and terminal |
CN110730340A (en) * | 2019-09-19 | 2020-01-24 | 天脉聚源(杭州)传媒科技有限公司 | Lens transformation-based virtual auditorium display method, system and storage medium |
CN110730340B (en) * | 2019-09-19 | 2023-06-20 | 北京拉近众博科技有限公司 | Virtual audience display method, system and storage medium based on lens transformation |
CN113223186A (en) * | 2021-07-07 | 2021-08-06 | 江西科骏实业有限公司 | Processing method, equipment, product and device for realizing augmented reality |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107370831A (en) | Show the multiusers interaction realization method and system of equipment based on MR heads | |
CN105556508B (en) | The devices, systems, and methods of virtual mirror | |
CN105528799B (en) | Virtual fitting device and virtual fitting method thereof | |
CN107396084A (en) | A kind of MR implementation methods and equipment based on dual camera | |
CN107590859A (en) | A kind of mixed reality picture processing method and service equipment | |
CN109218619A (en) | Image acquiring method, device and system | |
CN107077755A (en) | Virtually with real fusion method, system and virtual reality device | |
CN106354251A (en) | Model system and method for fusion of virtual scene and real scene | |
CN107123160A (en) | Simulation lift face system, method and mobile terminal based on three-dimensional image | |
CN106445131B (en) | Virtual target operating method and device | |
WO2013185714A1 (en) | Method, system, and computer for identifying object in augmented reality | |
CN106327589A (en) | Kinect-based 3D virtual dressing mirror realization method and system | |
CN106791389A (en) | Image processing method, image processing apparatus and terminal | |
CN102647606A (en) | Stereoscopic image processor, stereoscopic image interaction system and stereoscopic image display method | |
CN111640200B (en) | AR scene special effect generation method and device | |
CN107578435A (en) | A kind of picture depth Forecasting Methodology and device | |
CN110189202A (en) | A kind of three-dimensional virtual fitting method and system | |
CN109316747A (en) | Game auxiliary information reminding method, device and electronic equipment | |
CN107507280A (en) | Show the switching method and system of the VR patterns and AR patterns of equipment based on MR heads | |
JP2013190974A (en) | Information processing apparatus, information processing method, and program | |
CN106791769A (en) | Virtual reality realization method and system | |
CN105929538A (en) | Virtual reality equipment display method and device | |
CN106054627A (en) | Control method and device based on gesture recognition and air conditioner | |
CN108109037A (en) | Simulation fitting method, apparatus, system and storage medium based on mobile terminal | |
CN107146275A (en) | A kind of method and device of setting virtual image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171124 |
|
RJ01 | Rejection of invention patent application after publication |