WO2022227288A1 - 增强现实的环境体验方法、装置、电子设备及存储介质 - Google Patents
增强现实的环境体验方法、装置、电子设备及存储介质 Download PDFInfo
- Publication number
- WO2022227288A1 WO2022227288A1 PCT/CN2021/106083 CN2021106083W WO2022227288A1 WO 2022227288 A1 WO2022227288 A1 WO 2022227288A1 CN 2021106083 W CN2021106083 W CN 2021106083W WO 2022227288 A1 WO2022227288 A1 WO 2022227288A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- environment
- experience
- simulated
- user
- augmented reality
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 78
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 33
- 238000003860 storage Methods 0.000 title claims description 18
- 230000009471 action Effects 0.000 claims abstract description 25
- 230000007613 environmental effect Effects 0.000 claims description 26
- 238000004088 simulation Methods 0.000 claims description 24
- 230000008569 process Effects 0.000 claims description 19
- 230000003993 interaction Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 13
- 238000012937 correction Methods 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 7
- 230000002452 interceptive effect Effects 0.000 abstract description 3
- 230000035807 sensation Effects 0.000 abstract 1
- 241000282452 Ailuropoda melanoleuca Species 0.000 description 28
- 239000011521 glass Substances 0.000 description 8
- 230000033001 locomotion Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 230000008859 change Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 235000013305 food Nutrition 0.000 description 4
- 230000006399 behavior Effects 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 235000017166 Bambusa arundinacea Nutrition 0.000 description 1
- 235000017491 Bambusa tulda Nutrition 0.000 description 1
- 208000025174 PANDAS Diseases 0.000 description 1
- 208000021155 Paediatric autoimmune neuropsychiatric disorders associated with streptococcal infection Diseases 0.000 description 1
- 240000004718 Panda Species 0.000 description 1
- 235000016496 Panda oleosa Nutrition 0.000 description 1
- 244000082204 Phyllostachys viridis Species 0.000 description 1
- 235000015334 Phyllostachys viridis Nutrition 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 239000011425 bamboo Substances 0.000 description 1
- 238000007664 blowing Methods 0.000 description 1
- 230000009194 climbing Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000003631 expected effect Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000032696 parturition Effects 0.000 description 1
- 229920001690 polydopamine Polymers 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
Definitions
- the present application relates to the technical field of digital projection display, and in particular, to an augmented reality environment experience method, device and electronic device.
- virtual reality simulates real-world objects, scenes, etc. through computer three-dimensional modeling, but this simulation is static, and when the relevant variables of the real environment change, it cannot be reflected immediately; From the perspective of virtual reality content experience, when the environmental variables involved in the content change, the real environment in which the experiencer lives will not change, which reduces the experiencer's sense of immersion in the virtual reality screen. There is currently no technology that allows users to immerse themselves in the natural environment indoors.
- the main technical problem to be solved by the embodiments of the present application is that there is currently no technology capable of allowing users to experience the natural environment immersively.
- an embodiment of the present application provides an augmented reality environment experience method, the method comprising:
- the generation of the simulation environment for the specified project according to the project selection instruction includes:
- the simulated environment is projected.
- the generating a simulated image and applying it to the simulated environment includes:
- the simulated figure is mapped to the simulated environment.
- the method further includes: receiving an experience time setting instruction from the user, and planning a project experience process according to the experience time setting instruction.
- the method further includes: recording and storing the user's experience process, including video information and sound information of the experience process.
- the method further includes:
- an embodiment of the present application further provides an augmented reality environment experience device, the device comprising:
- the item selection module is used to receive the item selection instruction
- an environment generation module for generating a simulation environment of a specified project according to the project selection instruction
- an image generation module for generating a simulated image and applying it to the simulated environment
- An interaction response module configured to receive user interaction actions and respond to the interaction actions.
- the environment generation module includes:
- an environmental information acquisition unit used to acquire environmental information of a specified project
- a simulated environment generating unit configured to generate a simulated environment according to the environmental information
- a simulated environment projection unit for projecting the simulated environment.
- the image generation module includes:
- Personal information setting unit used to receive personal information setting instructions
- a simulated image generating unit configured to generate a simulated image according to the personal information setting instruction
- the simulation image application unit is used for corresponding the simulation image to the simulation environment.
- an embodiment of the present application further provides an electronic device, the electronic device comprising:
- the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the above-mentioned augmented reality environment experience method.
- an embodiment of the present application further provides a non-volatile computer-readable storage medium, where the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by an electronic device, The electronic device is caused to perform the method as described above.
- an embodiment of the present application further provides a computer program product
- the computer program product includes a computer program stored on a non-volatile computer-readable storage medium
- the computer program includes program instructions, when the When the program instructions are executed by the electronic device, the electronic device is caused to execute the method as described above.
- the augmented reality environment experience method, device and electronic device provided by the embodiments of the present application can create a simulated environment that is close to the real by simulating the environment of the user-specified experience item, acquiring the user's actions and responding in real time. Provide users with an immersive natural environment experience.
- FIG. 1 is a schematic flowchart of an augmented reality environment experience method provided by an embodiment of the present application
- Fig. 2 is the concrete flow chart of S12 in Fig. 1;
- Fig. 3 is the concrete flow chart of S13 in Fig. 2;
- FIG. 4 is a flowchart of an augmented reality environment experience method provided by another embodiment of the present application.
- FIG. 5 is a schematic structural diagram of an augmented reality environment experience device provided by an embodiment of the present application.
- FIG. 6 is a schematic diagram of a hardware structure of an electronic device for performing a processing method for a list item operation provided by an embodiment of the present application.
- FIG. 1 is a schematic flowchart of an augmented reality environment experience method provided by an embodiment of the present application. The method can be applied to an electronic device, and the method includes:
- S11 Receive an item selection instruction.
- the user selects the item he wants to experience through the input device, including the user manually selecting or inputting the item he wants to experience through the touch screen, or the user selecting the item he wants to experience through a voice input device, or selecting the item he wants to experience through a remote control handle and other devices.
- the display screen or the touch screen displays the selectable items for the user to select, and after receiving the user's item selection instruction, the item is locked and displayed.
- the simulation environment for generating the specified item according to the item selection instruction Before generating the simulated environment, first determine the spatial scope of the actual indoor venue. For example, you can cooperate with cameras, sensors or other measuring equipment to pre-determine the boundaries of the actual indoor venue, receive the user's project selection instructions, and determine the project environment to be simulated, combined with the actual indoor venue. The spatial extent of the site generates a simulated environment and presents it to the user.
- the simulation environment for generating the specified project according to the project selection instruction specifically includes:
- the environmental information of the specified item can be obtained from the database of the system, or the environmental information of the specified item can be obtained through the Internet after being connected to the Internet. For example, if a user wants to experience a skiing event and chooses to experience the skiing event of Xiling Snow Mountain Ski Resort, the device obtains the environmental information near the Xiling Snow Mountain Ski Resort from the database or through the Internet, including the number of ski slopes in the ski resort, the trend of the slopes, or Information about nearby obstacles, etc., and information on weather conditions suitable for skiing, including wind speed, snowfall conditions, and temperature suitable for skiing.
- S122 Generate a simulated environment according to the environment information. After acquiring the environmental information, the device simulates a virtual scene according to the environmental information, creating an environment that is closer to the real world, and creating an immersive atmosphere for the user.
- the device simulates a virtual scene according to the environmental information, creating an environment that is closer to the real world, and creating an immersive atmosphere for the user.
- the actual indoor venue When it is not large, it provides skiing scenes with a small field of view. It can also cooperate with distance sensors and other equipment to detect the boundaries of indoor venues.
- the user's action range is controlled within the scope of the indoor venue to ensure that users will not experience the actual experience.
- the device can also restore the ambient weather as realistic as possible according to the set weather information. For example, if the set environment is low temperature and snowing, the device can simulate a thick snow layer covering the building in the environment. There will be pieces of snow falling from the branches to give the user the feeling of experiencing the skiing event in person.
- S123 Project the simulated environment. Project the simulated environment on the wall or its place, and cooperate with the AR glasses or similar equipment worn by the user to show the simulated scene to the user. The user can see the simulated environment similar to the real environment through the AR glasses and other equipment, such as skiing.
- the simulation environment of the project experience can display the dynamic effect of the wind blowing the branches, the footprints on the snow on the snow road, etc.
- S13 Generate a simulated image and apply it to the simulated environment.
- Users can set their own personal information, and the device generates a simulated image of the user according to the set personal information, and corresponds to the simulated scene to simulate a near-real experience scene for the user.
- the simulated image can be a simulated image with the user as the main body, or a virtual teammate image set by the user. For example, if the user wants to set the image of a friend, an idol, or even a stranger, he can play a skiing competition at the same time as himself. Set up the simulated images of yourself and your teammates.
- the device simulates a three-dimensional image based on the information input by the user, maps it to the environment, and displays it to the user with AR glasses and other devices.
- the generating and applying a simulated image to the simulated environment specifically include:
- a personal information setting instruction Users can set personal information through an input device.
- personal information setting instructions include but are not limited to setting their own ski suit style and other information, or personal information such as the gender, height or appearance of virtual teammates, and the electronic device receives them.
- a simulated image is simulated based on the personal information.
- S132 Generate a simulated image according to the personal information setting instruction.
- Users can set their favorite simulation images on the simulation image setting interface. For example, in skiing events, users can select their favorite ski clothing or ski equipment in the database, and the electronic device analyzes and simulates the received user personal information. Appropriately sized ski clothing and ski equipment are projected onto the user's body, and combined with AR glasses and other equipment to provide a real three-dimensional display effect, bringing a real three-dimensional sense to the user and improving the user experience. Users can also choose to add virtual teammates, and can set the image of virtual teammates. There are some initial simulated image models stored in the database.
- the user does not want to set the virtual teammate image by himself, he can also directly select the simulated image model in the database as the virtual image model.
- the simulated image of the teammate or choose to modify it on the basis of a simulated image model, and finally obtain the simulated image of the virtual teammate.
- the user can also select a snow track, and the electronic device corresponds the snow track selected by the user to the feet of the simulated image of the user or the virtual teammate, and determines the starting position of the user and the virtual teammate to ski on the snow track.
- users can set the skiing mode at will, such as single-piste skiing practice or multi-person skiing competition, etc., and can also set the start and end time of skiing, and the skiing path, which can be short-distance skiing. Mode skiing or unlimited skiing mode skiing, etc., you can also set the difficulty of skiing, such as the number of curves, slope of the slope or the attributes of the obstacles on the slope.
- the electronic device receives an interaction action of the user and respond to the interaction action.
- the electronic device captures the user's actions in real time, and changes the simulated environment according to the user's actions, so as to integrate the simulated information with the real information.
- the electronic device can receive the user's skiing action in real time through the motion capture system, and project the real-time changing scene of the ski resort according to the skiing action. Accelerated backward environment.
- the electronic device randomly selects and simulates the skiing state process in which the virtual teammate accompanies the user in a skiing competition.
- the electronic device can also receive the user's voice command and respond to the voice command. For example, the user Cheer on yourself and your teammates before the skiing competition starts, and your teammates will also respond to the user's cheers, improving the authenticity of the user experience project.
- FIG. 4 is a flowchart of an augmented reality environment experience method provided by another embodiment of the present application.
- the method can be applied to an electronic device, and the method specifically includes:
- S21 Receive an item selection instruction.
- the user selects the item information they want to experience through the input device. For example, the user wants to observe the living state of giant pandas in the natural environment.
- the electronic device searches the database for one or more observation items of the living state of giant pandas and displays them to the user. The user selects the option.
- the specific experience project in the project observes the living conditions of giant pandas in the Wolong Giant Panda Nature Reserve in Sichuan.
- the electronic device can acquire the environmental information of the specified item from the database.
- the living information of various giant pandas including Sichuan Wolong Giant Panda Nature Reserve can be obtained through the Internet. Based on this, the normal living conditions of giant pandas can be simulated and three-dimensional images can be displayed to users. , including simulating the common behaviors of giant pandas, such as eating, climbing trees or playing.
- the electronic device can also trigger environmental details by receiving some specific motion signals of the user, for example, when it detects that the user has the action intention of approaching and stroking the giant panda, triggering the giant panda's escape action, or detecting that the user has the action of feeding food, Then, the giant panda's action of approaching food and eating is triggered by the thrown food image, which can increase the user's sense of real experience.
- the electronic device shows the simulated scene for the user.
- the living environment of the giant panda can be simulated and projected through the projection device.
- the three-dimensional giant panda can be presented.
- the images correspond to the projection environment to simulate the daily behavior of giant pandas; stereo sound effects can also be simulated through audio and other equipment when giant pandas gnaw on food or climb trees to play.
- S24 Receive a time setting instruction.
- the user can set the experience time, including the time to enter the experience project and the time to end the experience.
- the experience time needs to be set before the experience project starts.
- the experience time period set by the user cannot exceed the specified time period.
- the maximum experience time within the range.
- S25 Receive and respond to the user interaction action.
- electronic equipment cooperates with AR glasses and other equipment to display a three-dimensional image of giant pandas in a simulated environment.
- the user's movements are detected at any time through motion capture equipment or cameras and other equipment, and the simulation results are changed according to the user's movements.
- the environment and giant panda images are convenient for users to observe the status of giant pandas from different angles. For example, when it is detected that the user is approaching the giant panda, the projected simulated environment changes with the user's movement, the field of vision is drawn closer to the giant panda, and the response of the giant panda when someone approaches it in real situations is simulated.
- the electronic device randomly selects and simulates the behavior of the virtual passerby when observing the living state of the giant panda.
- the electronic device can also receive the user's voice command and respond to the voice command, and can support the user to have a dialogue with the virtual passerby and control the virtual passerby to respond randomly to the user's language.
- S251. Receive and respond to a user correction instruction.
- the electronic device may have unclear projection or unsatisfactory response effect.
- the user can correct it through input devices such as a mobile phone or a remote control, and can correct it through function keys, or through text or Enter the correction code by voice, or enter the problem details to search for correction solutions through the Internet.
- the user finds that the projected environment picture is not clear, and sends a correction command to adjust the picture, and the electronic device responds in time after receiving the user's correction command, such as adjusting the clarity of the simulated projected picture; for example, the user finds that When the motion of the projected image of the object is stuck or not smooth, a correction command is sent through the input device to adjust the smoothness of the image, and the electronic device responds in time after receiving the user's correction command, which can be a simulation of the detection image. Whether there is an error in the process, detect whether there is a delay in network transmission, detect whether the projection equipment is faulty, etc., and then adjust the transmission data information to achieve the expected effect of the user.
- the electronic device also supports recording the user's experience items and experience process, including actions and voices during the user's experience.
- the electronic device records the actions and voices of the user during the observation process in real time through recording devices such as cameras or microphones, and obtains the simulated and projected image information in the same period, corresponds it with the user's experience process, and synthesizes the user's experience process. And stored in the storage device, it is convenient for the user to review the experience process at that time later.
- the user can also experience a certain project online with real friends or other strangers who want to experience a certain project at the same time.
- the user and the friend make an appointment to observe the living environment of the giant panda together.
- Friends can observe together in the same indoor experience venue, or experience them separately in different indoor experience venues, establish a real-time connection through the network, obtain the friend's simulated image information, and display the friend's simulated image next to the user to obtain the real-time friend's real-time image information.
- you can also communicate and discuss the observation situation with your friend in real time.
- the electronic device obtains the range information of the indoor venue in advance.
- the range information can be manually input by the user, or the actual distance can be measured by a detection device such as a camera, and then the range boundary of the indoor venue can be calculated.
- the electronic device can change the display of the simulated scene according to the scope of the indoor venue. For example, the electronic device detects that the user is approaching the boundary of the indoor venue, and simulates the scene of the giant panda walking to the other side. , guide users to move within the indoor venue, and provide users with a better environmental experience effect.
- FIG. 5 is a schematic structural diagram of an augmented reality environment experience device provided by an embodiment of the present application.
- the apparatus 300 can be applied to electronic equipment, and the apparatus 300 includes: an item selection module 31 , an environment generation module 32 , an image generation module 33 and an interactive response module 34 .
- the item selection module 31 is used for receiving an item selection instruction.
- the user selects the item he wants to experience through the input device, including the user manually selecting or inputting the item he wants to experience through the touch screen, or the user selecting the item he wants to experience through a voice input device, or selecting the item he wants to experience through a remote control handle and other devices.
- the display screen or the touch screen displays the selectable items for the user to select, and the item selection module 31 locks the item and displays it to the user after receiving the user's item selection instruction.
- the environment generation module 32 is configured to generate a simulation environment of a specified project according to the project selection instruction. After receiving the user's item selection instruction and confirming the user's experience item, the environment generating module 32 may acquire the environment information of the specified item from the database. Before generating the simulation environment, it is necessary to determine the spatial scope of the actual indoor venue. For example, you can cooperate with cameras, sensors or other measuring equipment to pre-determine the boundaries of the actual indoor venue, receive the user's project selection instructions, and determine the project environment that needs to be simulated. The spatial extent of the indoor venue generates a simulated environment and presents it to the user.
- the environment generation module 32 further includes an environment information acquisition unit 321 , a simulated environment generation unit 322 and a simulated environment projection unit 323 .
- the environmental information acquisition unit 321 is used to acquire the environmental information of the specified item.
- the environmental information acquisition unit 321 receives the user's item selection instruction, and after confirming the user's experience item, can acquire the environmental information of the specified item from the database of the system, or can acquire the environmental information of the specified item through the Internet after being connected to the Internet, including: Building information, road information, or weather information in some environments.
- the simulated environment generating unit 322 is configured to generate a simulated environment according to the environment information.
- the simulated environment generation unit 322 simulates a virtual scene according to the environmental information after acquiring the environmental information.
- an appropriate simulated environment can be selected according to the actual indoor venue range, so as to create an environment that is closer to the real environment, so that the user has an immersive experience. sense of experience.
- the simulated environment projection unit 323 is used for projecting the simulated environment.
- the simulated environment projection unit 323 projects the simulated environment on the wall or its place, and cooperates with the AR glasses or similar equipment worn by the user to display the simulated scene for the user, and the user can see a relatively real scene through the AR glasses and other equipment. Simulate the environment.
- the image generating module 33 is used to generate a simulated image and apply it to the simulated environment. Users can set their own personal information, and the device generates a simulated image of the user according to the set personal information, and corresponds to the simulated scene to simulate a near-real experience scene for the user.
- the simulated image may be a simulated image with the user as the main body, or may be an image of a virtual character set by the user. For example, if a user wants to experience the feeling of exploring the virgin forest with his idol, he can set up a virtual character of the idol and experience the project of exploring the virgin forest with him.
- the image generation module 33 further includes a personal information setting unit 331 , a simulated image generation unit 332 and a simulated image application unit 333 .
- the user sets personal information through the input device, and after the personal information setting unit 331 receives the personal information setting instruction, the simulated image generating unit 332 generates a simulated image according to the personal information input by the user, including the image with itself as the main body and the For the simulated image set by the user, the simulated image application unit 333 corresponds the simulated image to the simulated environment, and determines the starting position of the user and the virtual teammate in the experience process.
- the interaction response module 34 is configured to receive user interaction actions and respond to the interaction actions.
- the interaction response module 34 can capture the user's actions in real time through a device such as a motion capture device or a camera, and change the simulated environment according to the user's actions, so as to integrate the simulated information with the real information. If the user sets an avatar image to accompany the experience, it will randomly choose to simulate the experience process of the avatar. At the same time, it can also receive the user's voice commands and respond to the voice commands, which can support the user to communicate with the avatar and control the avatar. Randomly react to the user's language.
- FIG. 6 is a structural block diagram of an electronic device 400 provided by an embodiment of the present application.
- the electronic device 400 includes at least one processor 41.
- one processor 41 is used as an example; the memory 42 to which the at least one processor 41 is communicatively connected;
- the memory 42 stores instructions that can be executed by the at least one processor 41, and the instructions are executed by the at least one processor 41, so that the at least one processor 41 can execute the instructions in the above embodiments. Any of the augmented reality environmental experience methods described above.
- the processor 41 and the memory 42 can be connected through a bus or other means.
- the connection through a bus is taken as an example.
- Volatile computer-executable programs and modules such as program instructions/modules (for example, the modules and units in FIG. 5 ) corresponding to the augmented reality environment experience apparatus 300 in the embodiments of the present application.
- the processor 41 executes various functional applications and data processing of the server by running the non-volatile software programs, instructions and modules stored in the memory 42, that is, implementing the augmented reality environment experience method in the above method embodiments.
- the memory 42 may include a storage program area and a storage data area, wherein the storage program area may store an application program required for operating the device and at least one function; the storage data area may store data created according to the use of the augmented reality environment experience device 300 Wait. Additionally, memory 42 may include high speed random access memory, and may also include nonvolatile memory, such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some embodiments, memory 42 may optionally include memory 42 located remotely from processor 41 . These remote storages may be connected to the electronic device 400 through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
- the one or more modules are stored in the memory 42, and when executed by the one or more processors 41, execute the augmented reality environment experience method in any of the foregoing embodiments, for example, execute FIG. 1, FIG. 2 and the method steps in Figure 3.
- the above-mentioned product can execute the method provided by the embodiment of the present application, and has functional modules corresponding to executing the augmented reality environment experience method.
- functional modules corresponding to executing the augmented reality environment experience method For technical details not described in detail in this embodiment, reference may be made to the augmented reality environment experience method provided by the embodiment of this application.
- the electronic devices of the embodiments of the present application exist in various forms, including but not limited to:
- Mobile communication equipment This type of equipment is characterized by having mobile communication functions, and its main goal is to provide voice and data communication.
- Such terminals include: smart phones (eg iPhone), multimedia phones, feature phones, and low-end phones.
- Ultra-mobile personal computer equipment This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has the characteristics of mobile Internet access.
- Such terminals include: PDAs, MIDs, and UMPC devices, such as iPads.
- Portable entertainment equipment This type of equipment can display and play multimedia content.
- Such devices include: audio and video players (eg iPod), handheld game consoles, e-books, as well as smart toys and portable car navigation devices.
- the composition of the server includes a processor, a hard disk, a memory, a system bus, etc.
- the server is similar to a general computer architecture, but due to the need to provide highly reliable services, the processing power, stability , reliability, security, scalability, manageability and other aspects of high requirements.
- Embodiments of the present application provide a non-volatile computer-readable storage medium, where the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors, for example, as shown in FIG. 6
- One processor 41 of the above-mentioned one or more processors can execute the augmented reality environment experience method in any of the above-mentioned method embodiments, for example, to execute the above-described method steps S11 to S14 in FIG. 1 , and FIG. 2
- An embodiment of the present application provides a computer program product, where the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, the computer program includes program instructions, and when the program instructions are executed by the When the electronic device executes, the electronic device can execute the augmented reality environment experience method in any of the above method embodiments, for example, execute the above-described method steps S11 to S14 in FIG. 1 , and method step S121 in FIG. 2 .
- step S123 the method steps S131 to S133 in FIG. 3, and the method steps S21-S26 in FIG. 4, the functions of the modules 31-34, units 321-323, and units 331-333 in FIG. 5 are realized.
- the device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
- each embodiment can be implemented by means of software plus a general hardware platform, and certainly can also be implemented by hardware.
- Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and the program is During execution, it may include the processes of the embodiments of the above-mentioned methods.
- the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM) or the like.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Architecture (AREA)
- Processing Or Creating Images (AREA)
Abstract
本申请实施例涉及数字投影显示技术领域,特别涉及一种增强现实的环境体验方法、装置及电子设备。所述方法包括:接收项目选择指令;根据所述项目选择指令生成指定项目的模拟环境;生成模拟形象并应用于所述模拟环境中;接收用户的交互动作并响应于所述交互动作。本申请通过模拟用户指定的体验环境,获取用户的动作并实时做出响应,可以营造出近似真实的模拟环境,给用户带来真切的立体感,在室内就能为用户提供沉浸式的自然环境体验。
Description
相关申请的交叉参考
本申请要求于2021年4月27日提交中国专利局,申请号为2021104591547,发明名称为“一种增强现实的环境体验方法、装置及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及数字投影显示技术领域,特别涉及一种增强现实的环境体验方法、装置及电子设备。
近年来,虚拟现实通过计算机三维建模,对真实世界的物品、场景等进行模拟仿真,但是这种仿真是静态的,当真实环境的相关变量发生改变时,并不能第一时间反应出来;从对虚拟现实内容体验角度来看,当内容涉及的环境变量发生改变时,体验者所处的真实环境并不会因此发生改变,降低了体验者对虚拟现实画面的带入感。目前还没有在室内就可以让用户沉浸式体验自然环境的技术。
发明内容
针对现有技术的上述缺陷,本申请实施例主要解决的技术问题是目前没有能够让用户沉浸式体验自然环境的技术。
第一方面,本申请实施例提供了一种增强现实的环境体验方法,所述方法包括:
接收项目选择指令;
根据所述项目选择指令生成指定项目的模拟环境;
生成模拟形象并应用于所述模拟环境中;
接收用户的交互动作并响应于所述交互动作。
可选的,所述根据所述项目选择指令生成指定项目的模拟环境包括:
获取指定项目的环境信息;
根据所述环境信息生成模拟环境;
投影出所述模拟环境。
可选的,所述生成模拟形象并应用于所述模拟环境中包括:
接收个人信息设置指令;
根据所述个人信息设置指令生成模拟形象;
将所述模拟形象对应到所述模拟环境中。
可选的,所述方法还包括:接收用户的体验时间设定指令,并根据所述体验时间设定指令规划项目体验流程。
可选的,所述方法还包括:记录并储存用户的体验过程,包括体验过程的影像信息和声音信息。
可选的,所述方法还包括:
接收用户的校正指令并实时响应于所述校正指令。
第二方面,本申请实施例还提供了一种增强现实的环境体验装置,所述装置包括:
项目选择模块,用于接收项目选择指令;
环境生成模块,用于根据所述项目选择指令生成指定项目的模拟环境;
形象生成模块,用于生成模拟形象并应用于所述模拟环境中;
交互响应模块,用于接收用户的交互动作并响应于所述交互动作。
可选的,所述环境生成模块包括:
环境信息获取单元,用于获取指定项目的环境信息;
模拟环境生成单元,用于根据所述环境信息生成模拟环境;
模拟环境投影单元,用于投影出所述模拟环境。
可选的,所述形象生成模块包括:
个人信息设置单元,用于接收个人信息设置指令;
模拟形象生成单元,用于根据所述个人信息设置指令生成模拟形象;
模拟形象应用单元,用于将所述模拟形象对应到所述模拟环境中。
第三方面,本申请实施例还提供了一种电子设备,所述电子设备包括:
至少一个处理器;
以及,与所述至少一个处理器通信连接的存储器;
其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行上述所述的增 强现实的环境体验方法。
第四方面,本申请实施例还提供了一种非易失性计算机可读存储介质,所述计算机可读存储介质存储有计算机可执行指令,当所述计算机可执行指令被电子设备执行时,使所述电子设备执行如上所述的方法。
第五方面,本申请实施例还提供了一种计算机程序产品,所述计算机程序产品包括存储在非易失性计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被电子设备执行时,使所述电子设备执行如上所述的方法。
本申请实施例提供的增强现实的环境体验方法、装置及电子设备,通过模拟用户指定体验项目的环境,获取用户的动作并实时做出响应,可以营造出近似真实的模拟环境,在室内就能为用户提供沉浸式的自然环境体验。
一个或多个实施例通过与之对应的附图中的图片进行示例性说明,这些示例性说明并不构成对实施例的限定,附图中具有相同参考数字标号的元件表示为类似的元件,除非有特别申明,附图中的图不构成比例限制。
图1是本申请实施例提供的增强现实的环境体验方法流程示意图;
图2是图1中S12的具体流程图;
图3是图2中S13的具体流程图;
图4是本申请另一实施例提供的增强现实的环境体验方法的流程图;
图5是本申请实施例提供的增强现实的环境体验装置的结构示意图;
图6是本申请实施例提供的执行列表项操作的处理方法的电子设备的硬件结构示意图。
为了便于理解本申请,下面结合具体实施例对本申请进行详细说明。以下实施例将有助于本领域的技术人员进一步理解本申请,但不以任何形式限制本申请。应当指出的是,对本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进。这些都属于本申请的保护范围。除非另有定义,本说明书所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同。在本申请的说明书中所使用的术语只是为了描 述具体的实施例的目的,不是用于限制本申请。
需要说明的是,如果不冲突,本申请实施例中的各个特征可以相互结合,均在本申请的保护范围之内。另外,虽然在装置示意图中进行了功能模块划分,但是在某些情况下,可以以不同于装置中的模块划分。
请参阅图1,图1是本申请实施例提供的一种增强现实的环境体验方法的流程示意图,该方法可应用于电子设备,该方法包括:
S11、接收项目选择指令。用户通过输入设备选择想体验的项目,包括用户手动通过触屏选择或输入想体验的项目,或者用户通过语音输入设备选择想体验的项目,或者通过遥控手柄等设备选择想体验的项目等。显示屏或者触控屏将可选择的项目显示出来供用户挑选,在接收到用户的项目选择指令后锁定该项目并显示出来。
S12、根据所述项目选择指令生成指定项目的模拟环境。生成模拟环境前,先确定实际室内场地的空间范围,例如可以配合摄像头、传感器或者其他测量设备预先确定好实际室内场地的边界,接收用户的项目选择指令并确定需要模拟的项目环境,结合实际室内场地的空间范围生成模拟环境并展现给用户。其中,请参阅图2,所述根据所述项目选择指令生成指定项目的模拟环境具体包括:
S121、获取指定项目的环境信息。接收到用户的项目选择指令,确认用户的体验项目后,可以从***的资料库中获取指定项目的环境信息,或者可以联网后通过互联网获取指定项目的环境信息。例如用户想体验滑雪项目,选择了体验西岭雪山滑雪场的滑雪项目,设备从资料库中或者通过互联网获取西岭雪山滑雪场附近的环境信息,包括滑雪场的雪道数量、雪道走势或者附近的障碍物等信息,还可以获取适合滑雪的天气情况信息,包括适合滑雪的风速、降雪情况和气温等信息。
S122、根据所述环境信息生成模拟环境。设备获取到环境信息后根据所述环境信息模拟出虚拟场景,营造出更接近真实的环境,为用户营造身临其境的氛围。模拟环境时可以根据实际室内场地范围选择合适的模拟环境,以体验滑雪项目为例,实际室内场地较大时可以模拟出多条雪道供用户选择,并提供更大的视野范围,实际室内场地不大时则提供视野范围较小的滑雪场景,还可以配合距离传感器等设备检测室内场地的边界,在模拟环境时将用户的行动范围控制在室内场地范围内,确保用户在实际体验时不会超出体验场地。设备还可 以根据设定的天气信息还原出尽量真实的环境天气,例如设定的环境是低气温且正在下雪的天气,则设备可以模拟出环境中有厚雪层覆盖在建筑物上,偶尔会有雪块从树枝上掉落,以给用户提供亲身体验滑雪项目的感觉。
S123、投影出所述模拟环境。将模拟出的环境投影在墙壁或其地方,配合用户佩戴的AR眼镜或类似的设备,为用户展现出模拟的场景,用户通过AR眼镜等设备能看到近似真实环境的模拟环境,例如在滑雪项目体验的模拟环境中可以显示出风吹动树枝的动效、雪道积雪上的脚印等。
S13、生成模拟形象并应用于所述模拟环境中。用户可以自行设置个人信息,设备根据设置好的个人信息生成用户的模拟形象,并对应到模拟的场景中,为用户模拟出接近真实的体验场景。所述模拟形象可以是以用户自己为主体的模拟形象,也可以是用户设置的虚拟队友形象,例如用户想设置一个朋友或者偶像甚至陌生人的形象,和自己同时来一场滑雪比赛,就可以设置自己和队友的模拟形象,设备根据用户输入的信息模拟出立体形象,将其对应到环境中,并配合AR眼镜等设备展现给用户。
可选的,请参阅图3,所述生成模拟形象并应用于所述模拟环境中具体包括:
S131、接收个人信息设置指令。用户可以通过输入设备设置个人信息,例如在滑雪体验项目中,个人信息设置指令包括但不限于设置自己的滑雪服样式等信息,或者虚拟队友的性别、身高或样貌等个人信息,电子设备接收到个人信息设置指令后基于这些个人信息模拟出模拟形象。
S132、根据所述个人信息设置指令生成模拟形象。用户可以在模拟形象的设置界面设定自己喜欢的模拟形象,例如在滑雪项目中,用户在资料库中选择自己喜欢的滑雪服装或者滑雪装备,电子设备根据接收到的用户个人信息分析和模拟出大小合适的滑雪服装和滑雪装备,并投影到用户身体上,配合AR眼镜等设备提供实现真实的三维立体的显示效果,给用户带来真切的立体感,提升用户体验。用户还可以选择添加虚拟队友,并且可以设置虚拟队友的形象,资料库中储存有一些初始的模拟形象模型,若是用户不想自己设置虚拟队友形象,也可以直接选择资料库中的模拟形象模型作为虚拟队友的模拟形象,或者选择在某个模拟形象模型的基础上进行修改,最终得到虚拟队友的模拟形象。
S133、将所述模拟形象对应到所述模拟环境中。例如在滑雪项目体验中,用户还可以选择雪道,电子设备将用户选择的雪道对应到用户或者虚拟队友的 模拟形象的脚下,确定用户和虚拟队友在雪道上滑雪的起始位置。此外,用户可以随意设定滑雪的模式,例如设定为单人单雪道滑雪练习或者多人滑雪比赛等,还可以设定滑雪的开始和结束时间,滑雪的路径,可以是短距离雪道模式滑雪或者无限雪道模式滑雪等,还可以设置滑雪的难度,例如弯道数量、雪道坡度或者雪道障碍物属性等。
S14、接收用户的交互动作并响应于所述交互动作。电子设备实时捕捉用户的动作,并根据用户的动作改变模拟出的环境,做到模拟信息与现实信息的融合。以体验滑雪项目为例,电子设备可以通过动作捕捉***实时接收用户的滑雪动作,并根据滑雪动作投影出滑雪场的实时变化场景,例如在用户挥动雪仗加速滑雪时模拟出雪道两旁的景物加速后退的环境。同时,若用户设置有陪同滑雪的虚拟队友,则电子设备随机选择模拟出虚拟队友陪同用户进行滑雪比赛的滑雪状态过程,电子设备还可以接收用户的语音指令并对语音指令做出响应,例如用户在滑雪比赛开始前为自己和队友加油打气,则队友也会回应用户的加油,提高用户体验项目的真实性。
请参阅图4,图4是本申请另一实施例提供的一种增强现实的环境体验方法的流程图,所述方法可以应用于电子设备,所述方法具体包括:
S21、接收项目选择指令。用户通过输入设备选择想体验的项目信息,例如用户想观察自然环境中的大熊猫生活状态,电子设备在资料库中搜索到一个或多个大熊猫生活状态观察项目并展示给用户,用户选择选项内的具体体验项目观察四川卧龙大熊猫自然保护区内大熊猫的生活状态。
S22、生成指定项目的模拟环境。电子设备接收到用户的项目选择指令,确认用户的体验项目后,可以从资料库中获取指定项目的环境信息。以观察大熊猫生活状态为例,可以通过互联网获取包括四川卧龙大熊猫自然保护区在内的各个大熊猫的生活信息,以此为基础模拟出大熊猫平时的生活状态并将立体影像展现给用户,包括模拟出大熊猫的常见行为,吃东西、爬树或者玩耍的动作等。同时,电子设备还可以通过接收用户一些特定的动作信号触发环境细节,例如检测到用户有靠近抚摸大熊猫的动作意图时,触发大熊猫逃跑的动作,或者检测到用户有投喂食物的动作,则通过抛出的食物影像触发大熊猫靠近食物和进食的动作,能增加用户的真实体验感。
S23、生成模拟形象并应用于模拟环境。电子设备为用户展现出模拟的场景, 以观察大熊猫的生活状态为例,通过投影设备可以模拟出大熊猫的生活环境并投影出来,结合用户佩戴的AR眼镜或类似设备呈现出大熊猫的立体影像并对应到投影环境中,模拟出大熊猫的日常行为动作;还可以通过音响等设备模拟出大熊猫啃咬食物或者爬树玩耍时的立体音效等。
S24、接收时间设定指令。用户可以设置体验时间,包括进入体验项目的时间和体验结束的时间,为了防止用户过度沉迷于体验项目,在体验项目开始前需要设定好体验时间,同时,用户设置的体验时间段不能超过规定范围内的最大体验时间,体验时间结束时电子设备停止体验项目或做出提示以提醒用户退出体验项目。
S25、接收并响应用户交互动作。以观察大熊猫的生活环境为例,电子设备配合AR眼镜等设备在模拟环境中展现出大熊猫的立体影像,通过动作捕捉设备或者摄像头等设备随时检测用户的动作,根据用户的动作改变模拟出的环境和大熊猫的影像,方便用户从不同角度观察大熊猫的状态。例如检测到用户靠近大熊猫时,跟随用户的移动改变投影出的模拟环境,将视野拉近大熊猫,并模拟真实情况下有人靠近时大熊猫的反应。同时,若用户设置有陪同体验的虚拟路人,则电子设备随机选择模拟出虚拟路人观察大熊猫生活状态时的行为。电子设备还可以接收用户的语音指令并对语音指令做出响应,可以支持用户与虚拟路人进行对话并控制虚拟路人对用户的语言做出随机反应。
S251、接收并响应用户校正指令。在某些情况中电子设备可能会有投影不清晰或者响应效果不理想的情况,此时,用户可以通过手机或者遥控器等输入设备对其进行校正,可以通过功能按键进行校正,或者通过文字或语音输入校正码,或者输入问题详情通过联网搜索校正方案等。例如用户发现投影出的环境画面不清晰,发送了校正指令以对画面进行调整,电子设备在接收到用户的校正指令后及时做出响应,例如调整模拟投影的画面的清晰度等;例如用户发现投影出的事物影像的动作有卡顿或者不流畅时,通过输入设备发送校正指令以对影像的流畅度进行调整,电子设备接收到用户的校正指令后及时做出响应,可以是检测影像的模拟过程是否出现错误,检测网络传输是否有延迟,检测投影设备是否有故障等,进而调整传输数据信息以达到用户的预期效果。
S26、记录并储存用户的体验过程。电子设备还支持记录下用户的体验项目和体验过程,包括用户体验时的动作和语音。电子设备通过摄像头或者麦克风 等记录设备实时记录下用户观察过程中的动作和语音,并获取同时段内模拟和投影的影像信息,将其与用户的体验过程对应起来,合成用户体验过程的影像,并储存在存储设备中,方便用户后续回看当时的体验过程。以观察大熊猫的生活状态为例,用户在体验过程中错过了大熊猫吃竹子的某些细节,就可以通过看回放来仔细观察错过的细节,又例如用户在体验过程中看见了很难得的大熊猫产仔的影像想和朋友分享,就可以截取存储的回放影像中的片段并发送给朋友。
在其他一些实施例中,用户还可以和现实中的朋友或者其他同时要体验某个项目的陌生人联机体验某个项目,例如用户和朋友约好一块观察大熊猫的生活环境,可以是用户和朋友在同一个室内体验场地共同观察,也可以是在不同的室内体验场地分别体验,通过网络建立实时连接,获取朋友的模拟形象信息,并在用户身旁显示朋友的模拟形象,获取朋友的实时动作并控制朋友的模拟形象做出相同反应,观察过程中还可以和朋友实时交流讨论观察情况。电子设备事先获取有室内场地的范围信息,所述范围信息可以是由用户手动输入,也可以是通过摄像头等检测设备测量出实际距离,再计算出室内场地的范围边界。以观察大熊猫的生活习惯为例,电子设备可以根据室内场地的范围改变模拟场景的显示,例如电子设备检测到用户在向室内场地的边界处靠近,则模拟出大熊猫向另一边走动的场景,引导用户在室内场地范围内移动,为用户提供更好的环境体验效果。
请参阅图5,图5是本申请实施例提供的一种增强现实的环境体验装置的结构示意图。该装置300可应用于电子设备,该装置300包括:项目选择模块31、环境生成模块32、形象生成模块33和交互响应模块34。
其中,所述项目选择模块31用于接收项目选择指令。用户通过输入设备选择想体验的项目,包括用户手动通过触屏选择或输入想体验的项目,或者用户通过语音输入设备选择想体验的项目,或者通过遥控手柄等设备选择想体验的项目等。显示屏或者触控屏将可选择的项目显示出来供用户挑选,所述项目选择模块31在接收到用户的项目选择指令后锁定该项目并显示给用户。
所述环境生成模块32用于根据所述项目选择指令生成指定项目的模拟环境。在接收到用户的项目选择指令,确认用户的体验项目后,所述环境生成模块32可以从资料库中获取指定项目的环境信息。在生成模拟环境前需要先确定 实际室内场地的空间范围,例如可以配合摄像头、传感器或者其他测量设备预先确定好实际室内场地的边界,接收用户的项目选择指令并确定需要模拟的项目环境,结合实际室内场地的空间范围生成模拟环境并展现给用户。
可选的,所述环境生成模块32还包括环境信息获取单元321、模拟环境生成单元322和模拟环境投影单元323。
其中,所述环境信息获取单元321用于获取指定项目的环境信息。所述环境信息获取单元321接收到用户的项目选择指令,确认用户的体验项目后,可以从***的资料库中获取指定项目的环境信息,或者可以联网后通过互联网获取指定项目的环境信息,包括某些环境中的建筑信息、道路信息或者天气信息等。
所述模拟环境生成单元322用于根据所述环境信息生成模拟环境。所述模拟环境生成单元322获取到环境信息后根据所述环境信息模拟出虚拟场景,具体可以根据实际室内场地范围选择合适的模拟环境,营造出更接近真实的环境,使得用户有身临其境的体验感。
所述模拟环境投影单元323用于投影出所述模拟环境。所述模拟环境投影单元323将模拟出的环境投影在墙壁或其地方,配合用户佩戴的AR眼镜或类似的设备,为用户展现出模拟的场景,用户通过AR眼镜等设备能看到相对真实的模拟环境。
所述形象生成模块33用于生成模拟形象并应用于所述模拟环境中。用户可以自行设置个人信息,设备根据设置好的个人信息生成用户的模拟形象,并对应到模拟的场景中,为用户模拟出接近真实的体验场景。所述模拟形象可以是以用户自己为主体的模拟形象,也可以是用户设置的虚拟人物的形象。例如用户想体验和自己的偶像一起探索原始森林的感觉,就可以设置一个偶像的虚拟人物,在与其一起体验探索原始森林的项目。
可选的,所述形象生成模块33还包括个人信息设置单元331、模拟形象生成单元332和模拟形象应用单元333。
其中,用户通过输入设备设置个人信息,所述个人信息设置单元331接收到个人信息设置指令后,所述模拟形象生成单元332根据用户输入的个人信息生成模拟形象,包括以自己为主体的形象和用户自行设置的模拟形象,所述模拟形象应用单元333将所述模拟形象对应到所述模拟环境中,确定用户和虚拟 队友体验过程中的起始位置。
所述交互响应模块34用于接收用户的交互动作并响应于所述交互动作。所述交互响应模块34可以通过动作捕捉设备或者摄像头等设备实时捕捉用户的动作,并根据用户的动作改变模拟出的环境,做到模拟信息与现实信息的融合。若用户设置有陪同体验的虚拟人物形象,则随机选择模拟出虚拟人物的体验过程,同时还可以接收用户的语音指令并对语音指令做出响应,可以支持用户与虚拟人物进行对话并控制虚拟人物对用户的语言做出随机反应。
请参阅图6,图6是本申请实施例提供的一种电子设备400的结构框图,所述电子设备400包括至少一个处理器41,图6中以一个处理器41为例;以及,与所述至少一个处理器41通信连接的存储器42;
其中,所述存储器42存储有可被所述至少一个处理器41执行的指令,所述指令被所述至少一个处理器41执行,以使所述至少一个处理器41能够执行上述实施例中所述的任一增强现实的环境体验方法。
处理器41和存储器42可以通过总线或其他方式连接,图6中以通过总线连接为例,存储器42作为一种非易失性计算机可读存储介质,可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块,如本申请实施例中的增强现实的环境体验装置300对应的程序指令/模块(例如图5中的模块和单元)。处理器41通过运行存储在存储器42中的非易失性软件程序、指令以及模块,从而执行服务器的各种功能应用以及数据处理,即实现上述方法实施例中的增强现实的环境体验方法。
存储器42可以包括存储程序区和存储数据区,其中,存储程序区可存储操作装置、至少一个功能所需要的应用程序;存储数据区可存储根据增强现实的环境体验装置300的使用所创建的数据等。此外,存储器42可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中,存储器42可选包括相对于处理器41远程设置的存储器42。这些远程存储器可以通过网络连接至电子设备400。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
所述一个或者多个模块存储在所述存储器42中,当被所述一个或者多个处理器41执行时,执行上述任意实施例中的增强现实的环境体验方法,例如,执 行图1、图2和图3中的方法步骤。
上述产品可执行本申请实施例所提供的方法,具备执行所述增强现实的环境体验方法相应的功能模块。未在本实施例中详尽描述的技术细节,可参见本申请实施例所提供的增强现实的环境体验方法。
本申请实施例的电子设备以多种形式存在,包括但不限于:
(1)移动通信设备:这类设备的特点是具备移动通信功能,并且以提供话音、数据通信为主要目标。这类终端包括:智能手机(例如iPhone)、多媒体手机、功能性手机,以及低端手机等。
(2)超移动个人计算机设备:这类设备属于个人计算机的范畴,有计算和处理功能,一般也具备移动上网特性。这类终端包括:PDA、MID和UMPC设备等,例如iPad。
(3)便携式娱乐设备:这类设备可以显示和播放多媒体内容。该类设备包括:音频、视频播放器(例如iPod),掌上游戏机,电子书,以及智能玩具和便携式车载导航设备。
(4)服务器:提供计算服务的设备,服务器的构成包括处理器、硬盘、内存、***总线等,服务器和通用的计算机架构类似,但是由于需要提供高可靠的服务,因此在处理能力、稳定性、可靠性、安全性、可扩展性、可管理性等方面要求较高。
(5)其他具有数据交互功能的电子装置。
本申请实施例提供了一种非易失性计算机可读存储介质,所述计算机可读存储介质存储有计算机可执行指令,该计算机可执行指令被一个或多个处理器执行,例如图6中的一个处理器41,可使得上述一个或多个处理器可执行上述任意方法实施例中的增强现实的环境体验方法,例如,执行以上描述的图1中的方法步骤S11至步骤S14,图2中的方法步骤S121至步骤S123,图3中的方法步骤S131至步骤S133,图4中的方法步骤S21-S26,实现图5中的模块31-34、单元321-323、单元331-333的功能。
本申请实施例提供了一种计算机程序产品,所述计算机程序产品包括存储在非易失性计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被所述电子设备执行时,使所述电子设备能够执行上述任意方法实施例中的增强现实的环境体验方法,例如,执行以上描述的图1中的 方法步骤S11至步骤S14,图2中的方法步骤S121至步骤S123,图3中的方法步骤S131至步骤S133,图4中的方法步骤S21-S26,实现图5中的模块31-34、单元321-323、单元331-333的功能。
以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。
通过以上的实施方式的描述,本领域普通技术人员可以清楚地了解到各实施方式可借助软件加通用硬件平台的方式来实现,当然也可以通过硬件。本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;在本申请的思路下,以上实施例或者不同实施例中的技术特征之间也可以进行组合,步骤可以以任意顺序实现,并存在如上所述的本申请的不同方面的许多其它变化,为了简明,它们没有在细节中提供;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。
Claims (12)
- 一种增强现实的环境体验方法,所述方法应用于电子设备,所述方法包括:接收项目选择指令;根据所述项目选择指令生成指定项目的模拟环境;生成模拟形象并应用于所述模拟环境中;接收用户的交互动作并响应于所述交互动作。
- 根据权利要求1所述的增强现实的环境体验方法,其特征在于,所述根据所述项目选择指令生成指定项目的模拟环境包括:获取指定项目的环境信息;根据所述环境信息生成模拟环境;投影出所述模拟环境。
- 根据权利要求1所述的增强现实的环境体验方法,其特征在于,所述生成模拟形象并应用于所述模拟环境中包括:接收个人信息设置指令;根据所述个人信息设置指令生成模拟形象;将所述模拟形象对应到所述模拟环境中。
- 根据权利要求1所述的增强现实的环境体验方法,其特征在于,所述方法还包括:接收用户的体验时间设定指令,并根据所述体验时间设定指令规划项目体验流程。
- 根据权利要求1所述的增强现实的环境体验方法,其特征在于,所述方法还包括:记录并储存用户的体验过程,包括体验过程的影像信息和声音信息。
- 根据权利要求1所述的增强现实的环境体验方法,其特征在于,所述方法还包括:接收用户的校正指令并实时响应于所述校正指令。
- 一种增强现实的环境体验装置,其特征在于,所述装置包括:项目选择模块,用于接收项目选择指令;环境生成模块,用于根据所述项目选择指令生成指定项目的模拟环境;形象生成模块,用于生成模拟形象并应用于所述模拟环境中;交互响应模块,用于接收用户的交互动作并响应于所述交互动作。
- 根据权利要求7所述的增强现实的环境体验装置,其特征在于,所述环境生成模块包括:环境信息获取单元,用于获取指定项目的环境信息;模拟环境生成单元,用于根据所述环境信息生成模拟环境;模拟环境投影单元,用于投影出所述模拟环境。
- 根据权利要求7所述的增强现实的环境体验装置,其特征在于,所述形象生成模块包括:个人信息设置单元,用于接收个人信息设置指令;模拟形象生成单元,用于根据所述个人信息设置指令生成模拟形象;模拟形象应用单元,用于将所述模拟形象对应到所述模拟环境中。
- 一种电子设备,其特征在于,所述电子设备包括:至少一个处理器;以及,与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行如权利要求1至6中任一项所述的增强现实的环境体验方法。
- 一种非易失性计算机可读存储介质,其特征在于,所述非易失性计算机可读存储介质存储有计算机可执行指令,当所述计算机可执行指令被电子设备执行时,使所述电子设备执行权利要求1-6任一项所述的方法。
- 一种计算机程序产品,其特征在于,所述计算机程序产品包括存储在非易失性计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被电子设备执行时,使所述电子设备执行权利要求1-6任一项所述的方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18/379,245 US20240037876A1 (en) | 2021-04-27 | 2023-10-12 | Environment experiencing method and apparatus in augmented reality, and electronic device and storage medium thereof |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110459154.7A CN113313837A (zh) | 2021-04-27 | 2021-04-27 | 一种增强现实的环境体验方法、装置及电子设备 |
CN202110459154.7 | 2021-04-27 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/379,245 Continuation US20240037876A1 (en) | 2021-04-27 | 2023-10-12 | Environment experiencing method and apparatus in augmented reality, and electronic device and storage medium thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022227288A1 true WO2022227288A1 (zh) | 2022-11-03 |
Family
ID=77370919
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/106083 WO2022227288A1 (zh) | 2021-04-27 | 2021-07-13 | 增强现实的环境体验方法、装置、电子设备及存储介质 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20240037876A1 (zh) |
CN (1) | CN113313837A (zh) |
WO (1) | WO2022227288A1 (zh) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107741809A (zh) * | 2016-12-21 | 2018-02-27 | 腾讯科技(深圳)有限公司 | 一种虚拟形象之间的互动方法、终端、服务器及*** |
US20180165877A1 (en) * | 2016-12-08 | 2018-06-14 | Nathaniel Winckler | Method and apparatus for virtual reality animation |
CN109144244A (zh) * | 2018-07-03 | 2019-01-04 | 世雅设计有限公司 | 一种增强现实辅助的方法、装置、***及增强现实设备 |
CN110688008A (zh) * | 2019-09-27 | 2020-01-14 | 贵州小爱机器人科技有限公司 | 虚拟形象交互方法和装置 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111408137A (zh) * | 2020-02-28 | 2020-07-14 | 苏州叠纸网络科技股份有限公司 | 一种基于增强现实的场景交互方法、装置、设备和介质 |
-
2021
- 2021-04-27 CN CN202110459154.7A patent/CN113313837A/zh active Pending
- 2021-07-13 WO PCT/CN2021/106083 patent/WO2022227288A1/zh active Application Filing
-
2023
- 2023-10-12 US US18/379,245 patent/US20240037876A1/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180165877A1 (en) * | 2016-12-08 | 2018-06-14 | Nathaniel Winckler | Method and apparatus for virtual reality animation |
CN107741809A (zh) * | 2016-12-21 | 2018-02-27 | 腾讯科技(深圳)有限公司 | 一种虚拟形象之间的互动方法、终端、服务器及*** |
CN109144244A (zh) * | 2018-07-03 | 2019-01-04 | 世雅设计有限公司 | 一种增强现实辅助的方法、装置、***及增强现实设备 |
CN110688008A (zh) * | 2019-09-27 | 2020-01-14 | 贵州小爱机器人科技有限公司 | 虚拟形象交互方法和装置 |
Also Published As
Publication number | Publication date |
---|---|
CN113313837A (zh) | 2021-08-27 |
US20240037876A1 (en) | 2024-02-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11948260B1 (en) | Streaming mixed-reality environments between multiple devices | |
US9914057B2 (en) | Immersive storytelling environment | |
US10203838B2 (en) | Avatar personalization in a virtual environment | |
CN107096221B (zh) | 用于提供时移智能同步游戏视频的***和方法 | |
US9244533B2 (en) | Camera navigation for presentations | |
TWI786700B (zh) | 利用第二螢幕裝置掃描3d物件以***虛擬環境中 | |
US11666830B2 (en) | Local game execution for spectating and spectator game play | |
WO2019130864A1 (ja) | 情報処理装置、情報処理方法およびプログラム | |
US20160012640A1 (en) | User-generated dynamic virtual worlds | |
CN102473320A (zh) | 通过学习到的来自用户的输入使视觉表示生动化 | |
JP2011512054A (ja) | 模倣した演技をシーンに挿入し、同一性の評価を付与するスキーム | |
US10279260B2 (en) | Cut-scene gameplay | |
US10617945B1 (en) | Game video analysis and information system | |
US9025832B2 (en) | Automated sensor driven friending | |
US8696461B2 (en) | Automated sensor driven match-making | |
EP4306192A1 (en) | Information processing device, information processing terminal, information processing method, and program | |
KR102200239B1 (ko) | 실시간 cg 영상 방송 서비스 시스템 | |
US20230218984A1 (en) | Methods and systems for interactive gaming platform scene generation utilizing captured visual data and artificial intelligence-generated environment | |
WO2022227288A1 (zh) | 增强现实的环境体验方法、装置、电子设备及存储介质 | |
US20220254082A1 (en) | Method of character animation based on extraction of triggers from an av stream | |
US20230381673A1 (en) | eSPORTS SPECTATOR ONBOARDING | |
US20230381674A1 (en) | Triggering virtual help or hindrance based on audience participation tiers | |
KR20220093204A (ko) | 정보 처리 장치, 정보 처리 방법 및 프로그램 | |
JP2023181567A (ja) | 情報処理装置、情報処理方法、情報処理システム、及びデータ生成方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21938755 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21938755 Country of ref document: EP Kind code of ref document: A1 |