EP3022517A1 - Virtual objects in a real 3-d scenario - Google Patents
Virtual objects in a real 3-d scenarioInfo
- Publication number
- EP3022517A1 EP3022517A1 EP14741267.0A EP14741267A EP3022517A1 EP 3022517 A1 EP3022517 A1 EP 3022517A1 EP 14741267 A EP14741267 A EP 14741267A EP 3022517 A1 EP3022517 A1 EP 3022517A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- exercise
- scenario
- real
- participants
- objects
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
- G09B9/003—Simulators for teaching or training purposes for military purposes and tactics
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F41—WEAPONS
- F41G—WEAPON SIGHTS; AIMING
- F41G3/00—Aiming or laying means
- F41G3/26—Teaching or practice apparatus for gun-aiming or gun-laying
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F41—WEAPONS
- F41G—WEAPON SIGHTS; AIMING
- F41G3/00—Aiming or laying means
- F41G3/26—Teaching or practice apparatus for gun-aiming or gun-laying
- F41G3/2605—Teaching or practice apparatus for gun-aiming or gun-laying using a view recording device cosighted with the gun
- F41G3/2611—Teaching or practice apparatus for gun-aiming or gun-laying using a view recording device cosighted with the gun coacting with a TV-monitor
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F41—WEAPONS
- F41J—TARGETS; TARGET RANGES; BULLET CATCHERS
- F41J9/00—Moving targets, i.e. moving when fired at
- F41J9/14—Cinematographic targets, e.g. moving-picture targets
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/003—Repetitive work cycles; Sequence of movements
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
Definitions
- the invention relates to a method for simulating real combat actions in a scenario for training purposes with persons and in the vicinity, wherein exercise participants compete with each other with practice weapons and the real action of the participants during the exercise by imaging systems and recorded as a quasi-real-time changing 3D
- a weapon effect is calculated and displayed via an object recognition of the weapon, via the change of state and orientation during a shot as well as over the objects located in the direction of action and their wounding models.
- the invention has for its object to provide a comparison with the prior art improved method.
- the method should reduce the complexity and increase the effectiveness of the simulation.
- three-dimensional models in their intact, struck and destroyed states as well as animations of the corresponding state transitions including the associated acoustic effects are generated and stored in a database before a start of the exercise of all relevant individual objects of the scenario.
- the sounds are picked up during the exercise in a surround sound recording method via at least one microphone, in particular a plurality of microphones, in the scenario.
- the sounds during the exercise are therefore recorded in a suitable surround sound recording method.
- the computer system disclosed in DE 10 2012 207 112.1 it is expanded by a multi-channel audio-video transceiver system.
- the present invention may, but need not be based on the subject invention of the application DE 10 2012 207 112.1 or be used in combination with the system disclosed therein. However, an application with any alternative system is conceivable, provided that it is compatible with the present invention.
- the exercise participants also wear spectacle-shaped and wireless transceiver units for image and sound with earphones and a combination of suitable small and fast display systems (video glasses, retina projectors or the like) with looking in the direction of video cameras ,
- This combination of devices is built in such a way that it obstructs the view into the real scenario and fades out the original sounds.
- the exercise participants are shown the 3D scenario mode generated by one or more central computers [
- the cameras worn by the viewer preferably serve to additionally record the scenario directly in front of the eyes of the exerciser, in the event that he himself obscures this the imaging system, as disclosed for example in DE 10 2012 207 112.1.
- the cameras are preferably used as a very accurate tool to determine the viewing direction of the viewer and accurately create the corresponding view of the 3D model and display in the helmet display, in the event that the calculation of the position and posture of the practitioner in 3D Model should not be enough.
- the participants do not use the real picture, but rather the photo-realistic 3D-Modefl of the scenario with the corresponding background noise presented to them by the central computer or computers.
- the shown model representation first agrees with the real existing world, the corresponding objects in it can be touched, moved and heard by the practice participants.
- the scenario can be modified as desired using the stored 3D models. For example, when a calculated hit a flower pot shows or the calculator the shattering shards, struck persons are exchanged for behaving accordingly avatars, matching the corresponding sounds are played in each case.
- all other participants such as one's own powers, opponents, animals (e.g. completely represented by artificial actors (avatars).
- avatars e.g. completely represented by artificial actors (avatars).
- a very significant advantage of the present invention is that the problems described above in the cooperative interaction of opposing goals are solved cost-effectively and realistically. Depending on the system variant, considerable costs can be saved in the construction and use of exercise rooms and provision of appropriate performers in the exercise. Next, the invention allows the complete manipulation of the scenario and thus more dynamic actions and training opportunities, such as strong weapons effects in the near field (explosion and destruction) and associated extreme injuries.
- the exercise users are in a real, walk-in and interactive scenario and do not need to stand in front of e.g. Video screens act. There is no need for any further tracking method for determining the position and direction of the participant. This is inherent in the system and, so to speak, self-adjusting in the system according to the invention.
- the real image of the viewer is exchanged for the image generated by a computer with a display system.
- a display system There are therefore no artifacts such as transparent and floating objects against a real background, as they arise, for example, in display systems based on partially transparent mirror.
- the system described here can be used to change the image at any point in the room, not just at the predetermined and colored areas.
- the depiction is dependent on the viewing angle and also acts plastically in extreme oblique view.
- FIG. 1 An overview and an apparatus for carrying out the method according to the invention for simulating real combat operations in a scenario Exercises with people and in the vicinity is described below and explained with reference to the figures.
- an exercise room is shown in the upper left, in which there is an exercise participants. Of course, more than one exercise participant can stay in this exercise room.
- individual objects of the scenario such as other exercise participants, exercises, weapons and the like.
- the real action in the exercise room in which the exercise participants compete against each other with training weapons, is recorded during the exercise and calculated with a computer system (not shown) as a quasi-real-time-changing 3D model
- a weapon effect is calculated and displayed via an object recognition of the weapon, via the state change and alignment during a shot either in the direction of an exercise participant, another object or another person or in the void, and over the objects in the direction of action and their wound models .
- microphones 2 are installed in the training room, which record the prevailing acoustics there.
- Appendix 3 which includes the microphones, pictures are also taken. These images, which are recorded for example by means of video cameras in the training room, and by means of the microphones 2 is calculated by the computer system 9 in quasi-real time prevailing in the exercise room 3D model, which changes due to the exercise at any time.
- the calculated by means of the computer system 3D model is stored in a database 1 of the computer system 9. It can then be made available to the exercise facilitator by means of suitable reproduction so that the exercise participant receives corresponding information about all states of the relevant individual objects of the exercise Scenarios, such as participants, weapons, equipment, room furniture and the like, depending on the current state of the scenario in their intact, hit or destroyed states receives.
- This has the advantage that the exercise participant no longer has to interact directly with the other exercise participants or objects of the scenario, but that he gets these virtual objects, which in and of themselves would be present in the practice room, shown in a purely virtual manner and can interact with them. This is shown in Figure 1 at the top right through the practice room, where the ball shown there is symbolic of the virtual representation of the now no longer existing real events.
- the recording of the scenario is controlled and / or monitored and / or monitored by means of the audio-video transceiver 3 by an observation system.
- the respective exercise participant In order to enable the participants to act virtually in the exercise room shown in FIG. 1, it is not only necessary for the respective exercise participant to represent the constantly stored virtual scenario stored in the database 1 in a suitable manner, but also by an interaction of the actions of the exercise participant, which must also be included, to give the computer system 9 information where the respective exercise participant is located within the practice room and how he interacts with the existing practice participants, opponents and objects.
- a device is shown in Figure 2, which is designed as glasses that can be worn by at least one participant, preferably each exercise participants.
- This device is designed as a wireless and wireless transmitting / receiving unit 4 for image and sound with earphones 5 and a combination of suitable small and fast display systems 6 directed in the viewing direction video cameras 7.
- This unit to be carried by the exercise participant is designed to block the view into the real world and to preserve the original Noise during the exercise. This makes it possible for the respective exercise participant to be able to move freely in the exercise room, where, due to his or her movement, a real scenario is generated which can be recorded, processed by the computer system 9 and stored in the database 1.
- the computer system 9 operates in a corresponding manner with the brilh-shaped unit of the exercise participant, in which the virtual acoustic scenario and the display systems 7 and the video camera required for capturing the scenario as well as the transmitters required for the data transmission are transmitted via the earphones 5.
- receiver unit 4 in a helmet.
- the display system 6 and the video cameras 7 in a pair of glasses and to connect via cable to the transceiver 4, which then elsewhere in the exercise participant, eg his clothing (eg a protective vest, a combat suit or the like) to order.
- his clothing eg a protective vest, a combat suit or the like
- the microphones 2 are arranged statically in the training room and wired to the computer system 9. Since the exercise participant moves in the training room, it is of particular advantage to transmit the data between him and the computer system 9 wirelessly, preferably by radio.
- the observation unit 8 is likewise connected to the computer system 9 for the purpose of data transmission. This makes it possible to represent the real and / or virtual events of the scenario in the exercise room for an observer and / or it is possible for the observer to intervene in the event, eg by changing the data stored in the database 1.
- the Observation unit 8 correspondingly designed playback devices (eg screens) and / or appropriately designed input units (eg, keyboards, joysticks or the like) on.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Entrepreneurship & Innovation (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102013213821 | 2013-07-15 | ||
PCT/EP2014/065151 WO2015007732A1 (en) | 2013-07-15 | 2014-07-15 | Virtual objects in a real 3-d scenario |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3022517A1 true EP3022517A1 (en) | 2016-05-25 |
Family
ID=51211215
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14741267.0A Withdrawn EP3022517A1 (en) | 2013-07-15 | 2014-07-15 | Virtual objects in a real 3-d scenario |
Country Status (9)
Country | Link |
---|---|
US (1) | US20160148525A1 (en) |
EP (1) | EP3022517A1 (en) |
KR (1) | KR20160037162A (en) |
AU (1) | AU2014292134B2 (en) |
CA (1) | CA2917582A1 (en) |
DE (1) | DE102014109921A1 (en) |
MY (1) | MY176169A (en) |
SG (1) | SG11201600325UA (en) |
WO (1) | WO2015007732A1 (en) |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5742263A (en) * | 1995-12-18 | 1998-04-21 | Telxon Corporation | Head tracking system for a head mounted display system |
US5641288A (en) * | 1996-01-11 | 1997-06-24 | Zaenglein, Jr.; William G. | Shooting simulating process and training device using a virtual reality display screen |
US6630915B1 (en) * | 1999-01-26 | 2003-10-07 | Lsa. Inc. | Wireless transmission system for transmitting data to a simulation system user |
US6579097B1 (en) * | 2000-11-22 | 2003-06-17 | Cubic Defense Systems, Inc. | System and method for training in military operations in urban terrain |
US20020064764A1 (en) * | 2000-11-29 | 2002-05-30 | Fishman Lewis R. | Multimedia analysis system and method of use therefor |
WO2006023647A1 (en) * | 2004-08-18 | 2006-03-02 | Sarnoff Corporation | Systeme and method for monitoring training environment |
US8624924B2 (en) * | 2008-01-18 | 2014-01-07 | Lockheed Martin Corporation | Portable immersive environment using motion capture and head mounted display |
JP5138520B2 (en) * | 2008-09-16 | 2013-02-06 | 株式会社バンダイナムコゲームス | Program and game device |
US20120142415A1 (en) * | 2010-12-03 | 2012-06-07 | Lindsay L Jon | Video Show Combining Real Reality and Virtual Reality |
US20120156652A1 (en) * | 2010-12-16 | 2012-06-21 | Lockheed Martin Corporation | Virtual shoot wall with 3d space and avatars reactive to user fire, motion, and gaze direction |
US8920172B1 (en) * | 2011-03-15 | 2014-12-30 | Motion Reality, Inc. | Method and system for tracking hardware in a motion capture environment |
-
2014
- 2014-07-15 EP EP14741267.0A patent/EP3022517A1/en not_active Withdrawn
- 2014-07-15 AU AU2014292134A patent/AU2014292134B2/en not_active Ceased
- 2014-07-15 DE DE102014109921.4A patent/DE102014109921A1/en not_active Withdrawn
- 2014-07-15 KR KR1020167000926A patent/KR20160037162A/en not_active Application Discontinuation
- 2014-07-15 WO PCT/EP2014/065151 patent/WO2015007732A1/en active Application Filing
- 2014-07-15 US US14/903,839 patent/US20160148525A1/en not_active Abandoned
- 2014-07-15 MY MYPI2015704818A patent/MY176169A/en unknown
- 2014-07-15 SG SG11201600325UA patent/SG11201600325UA/en unknown
- 2014-07-15 CA CA2917582A patent/CA2917582A1/en not_active Abandoned
Non-Patent Citations (2)
Title |
---|
None * |
See also references of WO2015007732A1 * |
Also Published As
Publication number | Publication date |
---|---|
WO2015007732A1 (en) | 2015-01-22 |
DE102014109921A1 (en) | 2015-01-15 |
US20160148525A1 (en) | 2016-05-26 |
AU2014292134A1 (en) | 2016-02-18 |
AU2014292134B2 (en) | 2017-06-08 |
SG11201600325UA (en) | 2016-02-26 |
KR20160037162A (en) | 2016-04-05 |
MY176169A (en) | 2020-07-24 |
CA2917582A1 (en) | 2015-01-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE69812912T2 (en) | Missile shooting simulator with immersion of the shooter in a virtual space | |
DE69630037T2 (en) | DEVICE AND METHOD FOR SURROUNDING A USER WITH VIRTUAL REALITY | |
EP2758804B1 (en) | System and method for detecting a user-dependent state of a sports object | |
DE102017116558B4 (en) | Method for guiding motion sequences and training device for guiding motion sequences | |
DE102016104186A1 (en) | Simulator for training a team of a helicopter crew | |
EP2678849A1 (en) | Simulator for training a team, in particular for training a helicopter crew | |
DE102011052836A1 (en) | Interactive training system for rehabilitation of patients with movement impairments of extremities, has input and output units with part interacting with patient, so that physiotherapeutic training program is interactively completed | |
DE202015000225U1 (en) | Device for controlling game play in the dart game | |
Kleygrewe et al. | Virtual reality training for police officers: A comparison of training responses in VR and real-life training | |
EP2841870A1 (en) | 3d scenario recording with weapon effect simulation | |
EP1393286A2 (en) | Reality simulation system (rss) | |
CN107909879B (en) | Virtual simulation system for armed police two-purpose attendance service | |
EP1262213A1 (en) | Method of locating an object, a person and/or a part of it | |
EP3420539B1 (en) | Method for operating a display device and system for displaying actual image contents of an actual environment overlayed with virtual image contents | |
WO2015007732A1 (en) | Virtual objects in a real 3-d scenario | |
DE102010017700A1 (en) | Virtual interactive live remote coaching- and training system i.e. sports remote coaching- and training system, for coaching-and training e.g. yoga for student in fitness studio, has reproducing unit reproducing audio signal | |
DE102011009952A1 (en) | Method for determining position and location of astronaut in spacecraft, involves transmitting three-dimensional co-ordinates of detected three-dimensional position of each point from spacecraft to control station | |
EP3682631A1 (en) | Equipment and method for audio/visual recording and reproduction of images/films | |
WO2013167254A1 (en) | Apparatus for visualizing military operations | |
Knerr et al. | An assessment of the virtual-integrated MOUT training system (V-IMTS) | |
DE4413628A1 (en) | Film projector operation esp. in cinema e.g. for firearms training | |
CN115569341B (en) | Multi-person collaborative fire-fighting training method and system based on virtual reality | |
EP4241037A1 (en) | Training apparatus including a weapon | |
Kehring | Immersive Simulations for Dismounted Soldier Research | |
Kleygrewe et al. | VU Research Portal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20151202 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAX | Request for extension of the european patent (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20190513 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20190924 |