CN114650443B - Playing method and device of head-mounted display device and head-mounted display device - Google Patents
Playing method and device of head-mounted display device and head-mounted display device Download PDFInfo
- Publication number
- CN114650443B CN114650443B CN202011506648.8A CN202011506648A CN114650443B CN 114650443 B CN114650443 B CN 114650443B CN 202011506648 A CN202011506648 A CN 202011506648A CN 114650443 B CN114650443 B CN 114650443B
- Authority
- CN
- China
- Prior art keywords
- user
- target object
- positioning information
- playing
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000005259 measurement Methods 0.000 claims abstract description 14
- 238000010586 diagram Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 6
- 238000012216 screening Methods 0.000 claims description 5
- 230000000007 visual effect Effects 0.000 claims description 4
- 239000000758 substrate Substances 0.000 claims 2
- 230000003993 interaction Effects 0.000 abstract description 8
- 239000000463 material Substances 0.000 description 13
- 230000006870 function Effects 0.000 description 6
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000011022 operating instruction Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application relates to the field of wearable display equipment, in particular to a playing method and device of the wearable display equipment, a head-mounted display equipment, a computer device and a computer readable storage medium, wherein the method comprises the following steps: acquiring real-time images of all objects in front of the vision of a user, and if the real-time images are matched with a first pre-stored image, confirming that the objects are first target objects; acquiring the actual measurement distance between a user and the first target object, and generating a play instruction of introduction data corresponding to the first target object when the actual measurement distance is smaller than a set distance threshold; and playing the introduction data corresponding to the first target object on the head-mounted display device according to the playing instruction. The application can provide a more free interaction mode for the user to use the head-mounted display device so as to improve the use experience of the user.
Description
Technical Field
The application relates to the field of head-mounted display devices, in particular to a playing method and device of a head-mounted display device, the head-mounted display device, a computer device and a computer readable storage medium.
Background
In the existing head-mounted display device, the content which can be seen by the user at present can be a landscape or an article, and relevant introduction materials can be played. At present, a user is usually required to click a corresponding control case through a handle to trigger the playing of a corresponding introduction material in the current playing mode. In the above method for playing the introduction material of the head-mounted display device, when the user views the played content by wearing the head-mounted display device, the user must use the hands to control the playing of the corresponding introduction material, and both hands cannot be liberated, so that the user cannot be provided with the most free interaction mode.
Disclosure of Invention
In order to overcome the technical problems, aiming at the problem that the prior head-mounted display equipment can not provide free interaction modes for users, the following technical scheme is specifically provided:
in a first aspect, the present application provides a playing method of a head-mounted display device, including the steps of:
Acquiring real-time images of all objects in front of the vision of a user, and if the real-time images are matched with a first pre-stored image, confirming that the objects are first target objects;
Acquiring the actual measurement distance between a user and the first target object, and generating a play instruction of introduction data corresponding to the first target object when the actual measurement distance is smaller than a set distance threshold;
And playing the introduction data corresponding to the first target object on the head-mounted display device according to the playing instruction.
In a preferred embodiment provided in the first aspect, the step of acquiring a real-time image of an object in front of the user's vision comprises:
Shooting a visual front area of a user, and acquiring real-time images of all objects;
And if the real-time image is matched with the first pre-stored image, before the step of confirming that the object is the first target object, the method further comprises the following steps:
when the continuous presentation duration of the real-time image of any object reaches a first time threshold, matching the real-time image of the object with a first pre-stored image.
In a preferred embodiment of the first aspect, before the step of generating the play instruction of the introduction corresponding to the first object, the method further includes:
deleting the real-time image of any object when the continuous presentation duration of the real-time image of the object does not reach the second time threshold;
wherein the first time threshold is greater than the second time threshold.
In a preferred embodiment provided in the first aspect, the step of obtaining the measured distance between the user and the first target object includes:
Acquiring user positioning information, and receiving object positioning information of a close-range object within a preset distance from the user positioning information;
Matching the second pre-stored image of the close-range object with the first pre-stored image of the first target object, and screening out object positioning information of the first target object within a preset distance;
And calculating the measured distance between the user and the first target object through the object positioning information of the first target object and the user positioning information.
In a preferred embodiment of the first aspect, after the step of playing the introduction material corresponding to the first object on the display device according to the playing instruction, the method further includes:
Acquiring a moving track of a user;
according to the current distribution route map of the display area and the object positioning information of the unplayed object and the first object, identifying the unplayed object which is on the distribution route map and is closest to the first object as a second object, and generating the forecast information of the second object;
And playing the forenotice data of the second target object on the head-mounted display equipment according to the forenotice information.
In a preferred embodiment provided in the first aspect, the step of acquiring a movement track of the user includes:
acquiring object positioning information of objects passed by a user in the display area, and drawing to obtain the moving track according to the passing sequence of the user;
The positioning information of the entrance of the display area where the first target object is located is origin coordinates, and the object positioning information corresponding to all objects in the display area is coordinate information set relative to the origin coordinates.
In a preferred embodiment provided in the first aspect, before the step of acquiring the movement track of the user, the method further includes:
when the current user positioning information is detected to be the origin coordinates, generating a tracking instruction;
and acquiring the user positioning information and the coordinate information of the object through which the user passes according to the tracking instruction.
In a second aspect, the present application provides a playing apparatus of a head-mounted display device, including:
The first target object confirming module is used for acquiring real-time images of all objects in front of the vision of a user, and confirming that the objects are first target objects if the real-time images are matched with a first pre-stored image;
the play instruction generation module is used for acquiring the actual measurement distance between the user and the first target object, and generating a play instruction of introduction data corresponding to the first target object when the actual measurement distance is smaller than a set distance threshold value;
And the playing module is used for playing the introduction data corresponding to the first target object on the head-mounted display device according to the playing instruction.
In a preferred embodiment provided in the second aspect, the playing device of the head-mounted display device further includes:
The mobile track acquisition module is used for acquiring the mobile track of the user;
the forenotice information generation module is used for confirming an unplayed object which is on the distribution route diagram and is closest to the first target object as a second target object according to the distribution route diagram of the current display area and the object positioning information of the unplayed object and the first target object, and generating forenotice information of the second target object;
And the forenotice module is used for playing the forenotice data of the second target object on the head-mounted display equipment according to the forenotice information.
In a third aspect, the present application also provides a head-mounted display device, comprising: the device comprises a front camera device, a positioning device, a display and a processor;
The front camera device is used for shooting real-time images of all objects in front of the vision of a user;
the positioning device is used for acquiring user positioning information of a user and receiving object positioning information in the display area;
the display is used for displaying real-time images of all objects in front of the vision of a user and playing introduction information corresponding to the first target object;
The processor weight is used for executing the playing method of the head-mounted display device.
In a fourth aspect, there is provided an electronic device comprising:
one or more processors;
A memory;
One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications configured to: a playing method of the head-mounted display device implementing the first aspect of the embodiments of the present disclosure is performed.
In a fifth aspect, a computer readable storage medium is provided, where a computer program is stored on the computer readable storage medium, where the program when executed by a processor implements a playing method of the head-mounted display device according to the first aspect of the embodiment of the disclosure.
Compared with the prior art, the application has the following beneficial effects:
According to the playing scheme of the head-mounted display device, the first target object is obtained by matching and confirming the image of each object in the real-time image with the first pre-stored image through the currently acquired real-time image; when the detected actual measurement distance between the user and the first target object is smaller than the set distance threshold value, generating a playing instruction corresponding to the introduction data, and playing the introduction data corresponding to the first target object on the head-mounted display device according to the playing instruction. According to the scheme provided by the application, a user can acquire the first target object through the head-mounted display device, and can also automatically acquire the corresponding introduction material, so that a more free interaction mode for using the head-mounted display device is provided for the user, and the use experience of the user is improved.
Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.
Drawings
The foregoing and/or additional aspects and advantages of the application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
Fig. 1 is a flowchart illustrating a playing method of a head-mounted display device according to an embodiment of the present application;
Fig. 2 is a flowchart of a playing method of a head-mounted display device according to another embodiment of the present application;
Fig. 3 is a schematic diagram of a playing method of a head-mounted display device according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a playing device of a head-mounted display device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a playing device of a head-mounted display device according to another embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device for executing a playing method of a head-mounted display device according to an embodiment of the present application.
Detailed Description
Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are illustrative only and are not to be construed as limiting the application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless expressly stated otherwise, as understood by those skilled in the art. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, but do not preclude the presence or addition of one or more other features, integers, steps, operations.
It will be understood by those skilled in the art that all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs unless defined otherwise. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
The playing method of the head-mounted display device provided by the application can be applied to the head-mounted display device. For the playing method of the head-mounted display device provided by the application, the application provides a corresponding head-mounted display device, which specifically comprises the following steps: the device comprises a front-end camera device, a positioning device, a display and a processor, wherein the front-end camera device is used for shooting real-time images of all objects in front of the vision of a user; the positioning device is used for acquiring user positioning information of a user and receiving object positioning information in the display area; the display is used for displaying real-time images of all objects in front of the vision of a user and playing introduction information corresponding to the first target object; the processor right is used for executing the playing method of the head-mounted display device.
Referring to fig. 1, fig. 1 is a flowchart illustrating a playing method of a head-mounted display device according to an embodiment of the application.
In order to more clearly explain the execution process of the playing method of the head-mounted display device, in the following detailed description of the playing method of the head-mounted display device, the head-mounted display device provided above is exemplified as an execution subject. However, the illustration is not intended to represent that the method of playing the provided head-mounted display device can only be applied to the provided head-mounted display device, and can also be applied to other devices composed of modules having the functions described above; or by other modules of the head mounted display device having the above functions.
As shown in fig. 1, an embodiment of the present application provides a playing method of a head-mounted display device, where the method includes the following steps:
S110: and acquiring real-time images of all objects in front of the vision of the user, and if the real-time images are matched with the first pre-stored image, confirming that the objects are first target objects.
The playing method provided by the application is executed when the user wears the head-mounted display device.
The playing method provided by the application is executed on the premise of confirming the target object. In an embodiment, a real-time image located in front of the user's vision, that is, in front of the head-mounted display device, may be captured by a front-mounted image capturing apparatus of the head-mounted display device having a capturing function. And inputting the real-time image, acquiring each object in the real-time image, and matching the image of each object with the first pre-stored image. The first pre-stored image includes images pre-stored corresponding to all introductory content to be played.
And screening an object corresponding to the playing content from the real-time image according to the matching result, and confirming the object as a first target object played by the playing method.
In this embodiment, the object provided by the present application may be an exhibit in an exhibition place, where the exhibition place may be a museum, an expo, or the like; or scenic spots in scenic spots or identification marks of scenic spots. The first object is an object which exists in the real-time image and can be matched with the first pre-stored image.
S120: and acquiring the actual measurement distance between the user and the first target object, and generating a play instruction of the introduction data corresponding to the first target object when the actual measurement distance is smaller than a set distance threshold.
In this embodiment, the measured distance may obtain, through the positioning device of the head-mounted display device, user positioning information of the user and object positioning information of the first target object, and calculate, according to the positioning information of the user and the first target object, the measured distance between the user and the first target object.
The set distance threshold refers to a maximum distance sufficient to identify the first object therein by the real-time image. When the measured distance is smaller than a set distance threshold, that is, when the user gets enough real-time images from the first object to identify the first object, the comparison result that the measured distance is smaller than the set distance threshold is used for triggering and generating a play instruction of introduction data corresponding to the first object.
In this embodiment, the introduction data corresponding to the first object is stored corresponding to the first pre-stored image.
S130: and playing the introduction data corresponding to the first target object on the head-mounted display device according to the playing instruction.
According to the playing instruction obtained in the step S120, the introduction material is played on the head-mounted display device according to the attribute of the introduction material.
The attribute of the introduction material may refer to the format in which the content is played. If wmv and avi are video formats, or if tif and gif are picture formats, the video formats can be played through a display of the head-mounted display device, and the playing content is added to the display, so that the playing video acquired by the playing picture can be superimposed on the real-time image acquired by the user through the head-mounted display device. If the format of the played content is the audio format such as wav, mp3 and the like, the corresponding audio content can be played through an audio playing device, and the audio playing device can be arranged on the head-mounted display equipment or can be used for carrying out information interaction with the head-mounted display equipment. The audio playing device extracts the information of the first object according to the received playing instruction, acquires the audio file of the corresponding introduction data, and plays the audio file through the audio playing device.
According to the playing method of the head-mounted display device, the first target object is obtained by matching and confirming the image of each object in the real-time image with the first pre-stored image through the currently acquired real-time image; when the detected actual measurement distance between the user and the first target object is smaller than the set distance threshold value, generating a playing instruction corresponding to the introduction data, and playing the introduction data corresponding to the first target object on the head-mounted display device according to the playing instruction. According to the scheme provided by the application, a user can acquire the first target object through the head-mounted display device, and can also automatically acquire the corresponding introduction material, so that a more free interaction mode for using the head-mounted display device is provided for the user, and the use experience of the user is improved.
On the premise of the above-described embodiment of the present application, acquiring real-time images of respective objects in front of the user' S vision in step S110 includes:
Shooting a visual front area of a user, and acquiring real-time images of all objects;
Based on this, before the step of confirming that the object is the first target object if the real-time image in step S110 matches with the first pre-stored image, the method further includes:
when the continuous presentation duration of the real-time image of any object reaches a first time threshold, matching the real-time image of the object with a first pre-stored image.
In this embodiment, the front area of the user's vision may be captured by the front camera of the head-mounted display device, and a real-time image may be obtained, where the real-time image may include a plurality of objects, and the objects may include corresponding objects that can be matched with the first pre-stored image and cannot be successfully matched. The difference in depth of field of each object in the live image can be used to decompose the live image into live images of each object.
In the same period of time, real-time images of several consecutive frames are acquired. And obtaining the presentation time length of each object in the real-time images according to the continuous frames of real-time images. If the presentation duration of the object appearing in the real-time image reaches the first time threshold, the user is defaulted to watch the corresponding object. The real-time image of the object is matched with the first pre-stored image.
The object currently watched by the user is confirmed by the duration presented by each object in the acquired real-time image, and the object is further matched with the first pre-stored image, so that the increased data processing amount for matching all the objects in the real-time image can be avoided.
Correspondingly, before the step of generating the play instruction of the introduction data corresponding to the first object in step S120, the method further includes:
deleting the real-time image of any object when the continuous presentation duration of the real-time image of the object does not reach the second time threshold;
wherein the first time threshold is greater than the second time threshold.
Before generating a play instruction corresponding to the first target object, determining the presentation time length of each object in the real-time image and comparing the presentation time length with a second time threshold by using the mode for obtaining the presentation time length of the object in the real-time image. The second time threshold is smaller than the first time threshold, and the second time threshold is used for measuring whether the duration of the corresponding object appearing in the real-time image is too short or not so as to judge that the corresponding object is not the object to be watched by the user. And triggering the real-time image corresponding to the object to be deleted when the continuous presentation duration of the real-time image of the object does not reach the second time threshold value, so as to save the data storage space.
The step of obtaining the measured distance between the user and the first target in step S120 includes:
Acquiring user positioning information, and receiving object positioning information of a close-range object within a preset distance from the user positioning information;
Matching the second pre-stored image of the close-range object with the first pre-stored image of the first target object, and screening out object positioning information of the first target object within a preset distance;
And calculating the measured distance between the user and the first target object through the object positioning information of the first target object and the user positioning information.
In this embodiment, the user positioning information of the user may be determined using the positioning device of the head-mounted display apparatus, and the object positioning information of each object may be received. The preset distance can be set according to the identification parameters of the display device of the head-mounted display device and/or the general viewing range of the user, so as to confirm the identification range of the first object, thereby ensuring that the first object can be clearly identified and can be clearly seen by the user.
Specifically, according to the user positioning information, object positioning information of each object within the range of the position and the preset distance is obtained, and the object positioning information of the object within the preset distance of the user positioning information is obtained through calculation of the two positioning information. In this embodiment, since the object confirmed by the positioning information does not necessarily appear in the real-time image, the object within the preset distance from the user positioning information is set as a close object for the convenience of distinction.
For a short-distance object whose object positioning information can be acquired, a corresponding pre-stored image is also set corresponding to the object positioning information, and in this embodiment, the pre-stored image of the short-distance object is set as a second pre-stored image.
And matching the first target object determined by the real-time image with the second target object determined by the positioning information, and particularly matching the corresponding first pre-stored image and the corresponding second pre-stored image. If the two are in agreement, the object appears in the real-time image and can be clearly identified and clearly seen by the user. And confirming the first target object with the consistent matching as the unique first target object, and calculating the measured distance between the user and the unique first target object.
If more than one first object is determined according to the above mode, the first object with the smallest measured distance is confirmed as the unique first object.
Referring to fig. 2, fig. 2 is a flowchart illustrating a playing method of a head-mounted display device according to another embodiment of the present application.
After step S130, further includes:
S140, acquiring a movement track of a user;
S150, according to the distribution route of the current display area and the object positioning information of the unplayed object and the first object in the set distance value, determining the object which is on the distribution route and is closest to the first object as a second object, and generating the forecast information of the second object;
and S160, playing the forenotice data of the second target object on the head-mounted display device according to the forenotice information.
The display area is an area where all objects capable of being matched with the first pre-stored image are located, and in the following description of the embodiment of the movement track, the objects capable of being matched with the first pre-stored image are to be displayed. If the display area is a museum, the displayed object is all exhibits in the museum.
When a user passes through an object, a movement track of the user is formed according to user positioning information of the user, and in the embodiment, the movement track is named as a movement track.
And obtaining a distribution roadmap of the display area where the user is located according to the user positioning information of the user. In the display area, the displayed objects are distributed on the corresponding distribution route in the distribution route map.
And according to the object positioning information of the first object determined by the user and the object positioning information of the object which is not played in the display area, comparing the distribution roadmap, and determining the object which is not played and is closest to the first object as a second object. The determined second target object is actually the result of predicting the object watched next by the user according to the distribution roadmap of the display area.
And generating corresponding forenotice information according to the determined second target object. The forenotice information may include: the relative position information of the second object and the current first object, the first pre-stored image of the second object and related information, the displayed object which is convenient for recommending corresponding to the next watching to the user, and the like.
If the object which is not played is an object comprising different categories, according to the category attribute of the object and the first object, preferentially recommending the object with the same category attribute as the first object as the second object, or according to the association degree of the theme, preferentially recommending the object with higher association degree to the first object as the second object. And then, combining the measured distance between the first target object and the second target object to finally determine the second target object to be recommended.
Referring to fig. 3, fig. 3 is a schematic diagram of a playing method of a head-mounted display device according to an embodiment of the present application.
As shown in fig. 3, the first target is denoted as T1. Setting the first target object as an A-type object, wherein the obtained unplayed object comprises an A-type object and a B-type object. In fig. 3, the unplayed class a object and unplayed class B object are labeled a and B, respectively. And according to the category attribute, tentatively setting the unreleased A-type object as the second target object, obtaining the actual measurement distance between the unreleased A-type object and the first target object according to the object positioning information of the unreleased A-type object and the first target object, and judging whether the unreleased A-type object is suitable as the second target object or not according to the actual measurement distance. If the measured distance between the first target object and the unplayed class B object is far smaller than the measured distance between the first target object and the unplayed class a object, and the first target object meets the condition that the distance between the first target object and the unplayed class B object is closest to the first target object, the unplayed class B object can be determined to be a second target object.
For the step of step S140, the method may further include:
acquiring object positioning information of objects passed by a user in the display area, and drawing to obtain the moving track according to the passing sequence of the user;
the entrance of the display area where the first target object is located is an origin coordinate, and object positioning information corresponding to all objects in the display area is coordinate information set relative to the origin coordinate.
The user passes through different displayed objects in the process of moving the displayed objects in the display area and watching the displayed objects. And object positioning information corresponding to different displayed objects. The moving track is depicted according to the route passed by the user, such as a route formed by the displayed objects marked as T1, T2 and T3 in the figure 3, which are passed and watched by the user, wherein the route comprises the object positioning information of the passed displayed objects and the passed sequence of the displayed objects, such as the track represented by the black thick line in the figure 3.
In this embodiment, the positioning information of the first object, that is, the entrance of the display area where the object for display is located, may be set as the origin coordinate, such as the O point (0, 0) in fig. 3. With respect to the positioning information of the entrance, object positioning information corresponding to all objects in the display area where the entrance is located is set, and object positioning information of the displayed object 10 meters away from the entrance is set to (10, 0), such as the displayed object corresponding to the symbol T1 in fig. 3.
Further, before step S140, the method further includes:
when the current user positioning information is detected to be the origin coordinates, generating a tracking instruction;
and acquiring the user positioning information and the coordinate information of the object through which the user passes according to the tracking instruction.
In the two steps, according to the setting of the positioning information of the display area, if the current user positioning information is detected to be the origin coordinates, the user is identified to start entering the display area. Then, the generation of the tracking command is triggered by the generation of the origin coordinates. Triggering the positioning function of the head-mounted display device according to the tracking instruction, and in this embodiment, triggering the starting of the positioning device according to the tracking instruction, to obtain real-time user positioning information of the user and coordinate information of an object through which the user passes.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a playing device of a head-mounted display device according to an embodiment of the present application.
As shown in fig. 4, in another embodiment, the present application provides a playing apparatus 400 of a head-mounted display device, including:
A first target object confirmation module 410, configured to obtain real-time images of objects in front of the user's vision, and confirm that the objects are first target objects if the real-time images are matched with a first pre-stored image;
the play instruction generating module 420 is configured to obtain a measured distance between a user and the first target object, and generate a play instruction of introduction data corresponding to the first target object when the measured distance is less than a set distance threshold;
And the playing module 430 is configured to play the introduction data corresponding to the first object on the head-mounted display device according to the playing instruction.
Referring to fig. 5, fig. 5 is a schematic structural diagram of a playing device of a head-mounted display device according to another embodiment of the present application.
The playing apparatus 400 of the head-mounted display device provided above further includes:
A movement track acquisition module 440, a forenotice information generation module 450, and a forenotice module 460.
The movement track acquisition module 440 is configured to acquire a movement track of a user;
The forenotice information generating module 450 is configured to determine, according to a distribution route map of a current display area and object positioning information of an unplayed object and the first target object, the unplayed object that is on the distribution route map and is closest to the first target object as a second target object, and generate forenotice information of the second target object;
And the forenotice module 460 is configured to play the forenotice material of the second target object on the head-mounted display device according to the forenotice information.
Based on the same principle as the method shown in the embodiment of the present application, there is also provided an electronic device in the embodiment of the present application, where the electronic device may include, but is not limited to: a processor and a memory; a memory for storing computer operating instructions; and the processor is used for executing the method shown in the embodiment by calling the computer operation instruction. Compared with the prior art, the electronic equipment provided by the embodiment of the application enables a user to acquire the first target object through the head-mounted display equipment, and also can automatically acquire the corresponding introduction material, thereby providing the user with a more free interaction mode for using the head-mounted display equipment and improving the use experience of the user.
Referring to fig. 6, fig. 6 is a schematic structural diagram of an electronic device for executing a playing method of a head-mounted display device according to an embodiment of the present application.
In an alternative embodiment, an electronic device is provided, as shown in fig. 6, the electronic device 600 shown in fig. 6 includes: a processor 601 and a memory 603. The processor 601 is coupled to a memory 603, such as via a bus 602. Optionally, the electronic device 600 may also include a transceiver 604. It should be noted that, in practical applications, the transceiver 604 is not limited to one, and the structure of the electronic device 600 is not limited to the embodiment of the present application.
Among them, electronic devices include, but are not limited to: mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 6 is only an example and should not be construed as limiting the functionality and scope of use of the embodiments of the application.
Embodiments of the present application provide a computer-readable storage medium having a computer program stored thereon, which when run on a computer, causes the computer to perform the corresponding method embodiments described above. Compared with the prior art, the computer readable storage medium in the embodiment of the application enables a user to acquire the first target object through the head-mounted display device, and also can automatically acquire the corresponding introduction material, thereby providing the user with a more free interaction mode for using the head-mounted display device and improving the use experience of the user.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.
The computer-readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above-described embodiments.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the flowcharts of the figures may include a plurality of sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily being sequential, but may be performed in turn or alternately with other steps or at least a portion of the other steps or stages.
The above description is only illustrative of the preferred embodiments of the present application and of the principles of the technology employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in the present application is not limited to the specific combinations of technical features described above, but also covers other technical features formed by any combination of the technical features described above or their equivalents without departing from the spirit of the disclosure. Such as the above-mentioned features and the technical features disclosed in the present application (but not limited to) having similar functions are replaced with each other.
Claims (9)
1. A method for playing a head-mounted display device, comprising the steps of:
acquiring real-time images of objects in front of the vision of a user, comprising: shooting a visual front area of a user, and acquiring real-time images of each object with a plurality of frames continuously in a current time period according to the depth of field of each object in the shot image;
When the continuous presentation duration of the real-time image of any object reaches a first time threshold, matching the real-time image of the object with a first pre-stored image, and if the real-time image is matched with the first pre-stored image, confirming that the object is a first target object;
Deleting the real-time image of any object when the continuous presentation duration of the real-time image of the object does not reach the second time threshold; the first time threshold is greater than the second time threshold;
Obtaining the measured distance between the user and the first target object, including: acquiring user positioning information, and receiving object positioning information of a close-range object within a preset distance from the user positioning information; matching the second pre-stored image of the close-range object with the first pre-stored image of the first target object, and screening out object positioning information of the first target object within a preset distance; calculating to obtain the actual measurement distance between the user and the first target object through the object positioning information of the first target object and the user positioning information;
When the measured distance is smaller than a set distance threshold, generating a play instruction of introduction data corresponding to the first target object;
And playing the introduction data corresponding to the first target object on the head-mounted display device according to the playing instruction.
2. The method of claim 1, wherein the step of determining the position of the substrate comprises,
After the step of playing the introduction data corresponding to the first target object on the display device according to the playing instruction, the method further includes:
Acquiring a moving track of a user;
according to the current distribution route map of the display area and the object positioning information of the unplayed object and the first object, identifying the unplayed object which is on the distribution route map and is closest to the first object as a second object, and generating the forecast information of the second object;
And playing the forenotice data of the second target object on the head-mounted display equipment according to the forenotice information.
3. The method of claim 2, wherein the step of determining the position of the substrate comprises,
The step of obtaining the movement track of the user comprises the following steps:
acquiring object positioning information of objects passed by a user in the display area, and drawing to obtain the moving track according to the passing sequence of the user;
The positioning information of the entrance of the display area where the first target object is located is origin coordinates, and the object positioning information corresponding to all objects in the display area is coordinate information set relative to the origin coordinates.
4. The method of claim 3, wherein the step of,
Before the step of obtaining the movement track of the user, the method further comprises the following steps:
when the current user positioning information is detected to be the origin coordinates, generating a tracking instruction;
and acquiring the user positioning information and the coordinate information of the object through which the user passes according to the tracking instruction.
5. A playback apparatus for a head-mounted display device, comprising:
The first target object confirming module is used for acquiring real-time images of all objects in front of the vision of a user, and comprises the following components: shooting a visual front area of a user, and acquiring real-time images of each object with a plurality of frames continuously in a current time period according to the depth of field of each object in the shot image;
When the continuous presentation duration of the real-time image of any object reaches a first time threshold, matching the real-time image of the object with a first pre-stored image, and if the real-time image is matched with the first pre-stored image, confirming that the object is a first target object;
Deleting the real-time image of any object when the continuous presentation duration of the real-time image of the object does not reach the second time threshold; the first time threshold is greater than the second time threshold;
The play instruction generating module is configured to obtain a measured distance between a user and the first target object, and includes: acquiring user positioning information, and receiving object positioning information of a close-range object within a preset distance from the user positioning information; matching the second pre-stored image of the close-range object with the first pre-stored image of the first target object, and screening out object positioning information of the first target object within a preset distance; calculating to obtain the actual measurement distance between the user and the first target object through the object positioning information of the first target object and the user positioning information;
When the measured distance is smaller than a set distance threshold, generating a play instruction of introduction data corresponding to the first target object;
And the playing module is used for playing the introduction data corresponding to the first target object on the head-mounted display device according to the playing instruction.
6. The apparatus as recited in claim 5, further comprising:
The mobile track acquisition module is used for acquiring the mobile track of the user;
the forenotice information generation module is used for confirming an unplayed object which is on the distribution route diagram and is closest to the first target object as a second target object according to the distribution route diagram of the current display area and the object positioning information of the unplayed object and the first target object, and generating forenotice information of the second target object;
And the forenotice module is used for playing the forenotice data of the second target object on the head-mounted display equipment according to the forenotice information.
7. A head-mounted display device, comprising: the device comprises a front camera device, a positioning device, a display and a processor;
The front camera device is used for shooting real-time images of all objects in front of the vision of a user;
the positioning device is used for acquiring user positioning information of a user and receiving object positioning information in the display area;
the display is used for displaying real-time images of all objects in front of the vision of a user and playing introduction information corresponding to the first target object;
The processor configured to perform the method of playing a head mounted display device of any one of claims 1-4.
8. An electronic device, comprising:
one or more processors;
A memory;
One or more computer programs, wherein the one or more computer programs are stored in the memory and configured to be executed by the one or more processors, the one or more computer programs configured to perform the method of playing a head mounted display device according to any one of claims 1 to 4.
9. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the method of playing a head mounted display device according to any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011506648.8A CN114650443B (en) | 2020-12-18 | 2020-12-18 | Playing method and device of head-mounted display device and head-mounted display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011506648.8A CN114650443B (en) | 2020-12-18 | 2020-12-18 | Playing method and device of head-mounted display device and head-mounted display device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114650443A CN114650443A (en) | 2022-06-21 |
| CN114650443B true CN114650443B (en) | 2024-04-19 |
Family
ID=81990035
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011506648.8A Active CN114650443B (en) | 2020-12-18 | 2020-12-18 | Playing method and device of head-mounted display device and head-mounted display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114650443B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103309034A (en) * | 2012-03-07 | 2013-09-18 | 精工爱普生株式会社 | Head-mounted display device and control method for the head-mounted display device |
| CN105681918A (en) * | 2015-09-16 | 2016-06-15 | 乐视致新电子科技（天津）有限公司 | Method and system for presenting article relevant information in video stream |
| WO2017113194A1 (en) * | 2015-12-30 | 2017-07-06 | 深圳市柔宇科技有限公司 | Head-mounted display apparatus, head-mounted display system, and input method |
| CN107767460A (en) * | 2016-08-18 | 2018-03-06 | 深圳市劲嘉数媒科技有限公司 | The methods of exhibiting and device of augmented reality |
| CN107885823A (en) * | 2017-11-07 | 2018-04-06 | 广东欧珀移动通信有限公司 | Player method, device, storage medium and the electronic equipment of audio-frequency information |
| WO2019196133A1 (en) * | 2018-04-09 | 2019-10-17 | 杭州瑞杰珑科技有限公司 | Head-mounted visual aid device |
| CN110430459A (en) * | 2019-07-22 | 2019-11-08 | 上海掌门科技有限公司 | Video name card display method and apparatus |
| WO2020001151A1 (en) * | 2018-06-26 | 2020-01-02 | 朱光 | Split-type head-mounted display system and interaction method |
| CN110811537A (en) * | 2019-11-12 | 2020-02-21 | 赵成玉 | Functional glasses system |
| CN111510701A (en) * | 2020-04-22 | 2020-08-07 | Oppo广东移动通信有限公司 | Virtual content display method and device, electronic equipment and computer readable medium |
| CN111580652A (en) * | 2020-05-06 | 2020-08-25 | Oppo广东移动通信有限公司 | Control method and device for video playing, augmented reality equipment and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10136124B2 (en) * | 2015-04-27 | 2018-11-20 | Microsoft Technology Licensing, Llc | Stereoscopic display of objects |
| TWI620098B (en) * | 2015-10-07 | 2018-04-01 | 財團法人資訊工業策進會 | Head mounted device and guiding method |
| US9992423B2 (en) * | 2015-10-14 | 2018-06-05 | Qualcomm Incorporated | Constant field of view for image capture |
| US10949882B2 (en) * | 2016-04-03 | 2021-03-16 | Integem Inc. | Real-time and context based advertisement with augmented reality enhancement |
-
2020
- 2020-12-18 CN CN202011506648.8A patent/CN114650443B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103309034A (en) * | 2012-03-07 | 2013-09-18 | 精工爱普生株式会社 | Head-mounted display device and control method for the head-mounted display device |
| CN105681918A (en) * | 2015-09-16 | 2016-06-15 | 乐视致新电子科技（天津）有限公司 | Method and system for presenting article relevant information in video stream |
| WO2017113194A1 (en) * | 2015-12-30 | 2017-07-06 | 深圳市柔宇科技有限公司 | Head-mounted display apparatus, head-mounted display system, and input method |
| CN107767460A (en) * | 2016-08-18 | 2018-03-06 | 深圳市劲嘉数媒科技有限公司 | The methods of exhibiting and device of augmented reality |
| CN107885823A (en) * | 2017-11-07 | 2018-04-06 | 广东欧珀移动通信有限公司 | Player method, device, storage medium and the electronic equipment of audio-frequency information |
| WO2019196133A1 (en) * | 2018-04-09 | 2019-10-17 | 杭州瑞杰珑科技有限公司 | Head-mounted visual aid device |
| WO2020001151A1 (en) * | 2018-06-26 | 2020-01-02 | 朱光 | Split-type head-mounted display system and interaction method |
| CN110430459A (en) * | 2019-07-22 | 2019-11-08 | 上海掌门科技有限公司 | Video name card display method and apparatus |
| CN110811537A (en) * | 2019-11-12 | 2020-02-21 | 赵成玉 | Functional glasses system |
| CN111510701A (en) * | 2020-04-22 | 2020-08-07 | Oppo广东移动通信有限公司 | Virtual content display method and device, electronic equipment and computer readable medium |
| CN111580652A (en) * | 2020-05-06 | 2020-08-25 | Oppo广东移动通信有限公司 | Control method and device for video playing, augmented reality equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114650443A (en) | 2022-06-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110286773B (en) | Information providing method, device, equipment and storage medium based on augmented reality | |
| CN109313812B (en) | Shared experience with contextual enhancements | |
| CN107633241B (en) | Method and device for automatically marking and tracking object in panoramic video | |
| CN106331732B (en) | Generate, show the method and device of panorama content | |
| CN107872731B (en) | Panoramic video playing method and device | |
| WO2018036456A1 (en) | Method and device for tracking and recognizing commodity in video image and displaying commodity information | |
| CN106575361B (en) | Method for providing visual sound image and electronic equipment for implementing the method | |
| CN111147878B (en) | Stream pushing method and device in live broadcast and computer storage medium | |
| CN108198098B (en) | Self-service tourism method and mobile terminal | |
| CN110163066B (en) | Multimedia data recommendation method, device and storage medium | |
| US9141190B2 (en) | Information processing apparatus and information processing system | |
| CN110215706B (en) | Method, device, terminal and storage medium for determining position of virtual object | |
| US11211097B2 (en) | Generating method and playing method of multimedia file, multimedia file generation apparatus and multimedia file playback apparatus | |
| US20190130193A1 (en) | Virtual Reality Causal Summary Content | |
| CN110830704A (en) | Method and device for generating rotating image | |
| CN114650443B (en) | Playing method and device of head-mounted display device and head-mounted display device | |
| CN111405382B (en) | Video abstract generation method and device, computer equipment and storage medium | |
| US8238608B2 (en) | Tracking workflow in manipulating media items | |
| KR20150047694A (en) | Electronic device and method for providing advertisement data in electronic device | |
| CN110213307B (en) | Multimedia data pushing method and device, storage medium and equipment | |
| CN115407879A (en) | Information display method, device, equipment and storage medium | |
| CN113377271A (en) | Text acquisition method and device, computer equipment and medium | |
| US20040027365A1 (en) | Controlling playback of a temporal stream with a user interface device | |
| KR20140033667A (en) | Apparatus and method for video edit based on object | |
| CN115905374A (en) | Application function display method and device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |