WO2017167032A1 - 目标对象展示方法和装置 - Google Patents
目标对象展示方法和装置 Download PDFInfo
- Publication number
- WO2017167032A1 WO2017167032A1 PCT/CN2017/077042 CN2017077042W WO2017167032A1 WO 2017167032 A1 WO2017167032 A1 WO 2017167032A1 CN 2017077042 W CN2017077042 W CN 2017077042W WO 2017167032 A1 WO2017167032 A1 WO 2017167032A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- interpretation data
- target object
- image
- image interpretation
- stored
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
- A63F13/65—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- A63F13/655—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition by importing photos, e.g. of the player
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
- A63F13/69—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor by enabling or updating specific game elements, e.g. unlocking hidden features, items, levels or versions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/80—2D [Two Dimensional] animation, e.g. using sprites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/255—Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/761—Proximity, similarity or dissimilarity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
- G06V30/41—Analysis of document content
- G06V30/413—Classification of content, e.g. text, photographs or tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/028—Multiple view windows (top-side-front-sagittal-orthogonal)
Definitions
- the present application relates to the field of computer technologies, and in particular, to a method and apparatus for displaying a target object.
- target objects need to be displayed in more scenarios, such as target objects in games, personnel models in personnel management systems, and traffic road models in the traffic field.
- the corresponding interface of the application needs to be opened according to the open mode of the application, and the user inputs the relevant target object in the corresponding interface.
- the parameter the application matches the corresponding target object according to the parameter and displays it.
- the embodiment of the present application provides a target object display method and apparatus.
- the technical solution is as follows:
- the embodiment of the present application provides a target object display method, which is applied to an electronic device including a camera and a display screen, and the method includes:
- the target object Acquiring the stored target object corresponding to the pre-stored image interpretation data matching the image interpretation data, and displaying the target object on the display screen, the target object being a virtual two-dimensional model or a virtual three-dimensional model.
- the embodiment of the present application provides a target object display device, which is applied to an electronic device including a camera and a display screen, and the device includes:
- a first acquiring module configured to capture a physical card by using the camera, and acquire a target recognition image printed on the physical card captured by the camera perspective;
- a second acquisition module configured to acquire image interpretation data of the target recognition image acquired by the first acquisition module, where the image interpretation data is used to reflect a feature of the target recognition image acquired by the first acquisition module;
- a matching module configured to match image interpretation data acquired by the second acquiring module with pre-stored image interpretation data
- a display module configured to acquire a target object corresponding to the stored pre-stored image interpretation data that matches the image interpretation data, where the target object is displayed on a display screen, where the target object is a virtual two-dimensional model or Virtual 3D model.
- the virtual target object corresponding to the target recognition image is obtained by acquiring the target recognition image printed on the physical card, and the target object is displayed on the display screen of the electronic device. Since the camera angle is only aimed at the target recognition image on the physical card, the virtual target object is automatically hit and displayed, and the user does not need to perform complicated operations, thereby solving the related technology in which the user is viewing the application.
- a target object in the process requires more complicated operations, it leads to technical problems that are less efficient.
- the technical solution provided by the embodiment of the present application the complexity of the operation can be reduced, and the display efficiency can be improved.
- FIG. 1 is a flowchart of a target object display method provided by an embodiment of the present application.
- FIG. 2A is a flowchart of a target object display method provided by another embodiment of the present application.
- 2B is a flowchart of a method for matching image interpretation data with pre-stored image interpretation data according to an embodiment of the present application
- FIG. 3A is a flowchart of a target object display method according to another embodiment of the present application.
- FIG. 3B is a flowchart of a method for displaying an image frame of an animation as a pre-stored image according to an embodiment of the present application
- FIG. 4 is a schematic structural diagram of a target object display device according to an embodiment of the present application.
- FIG. 5 is a schematic structural diagram of a target object display device according to another embodiment of the present application.
- FIG. 6 is a schematic diagram of a hardware structure of an electronic device for implementing a target object display method according to another embodiment of the present application.
- electronic device may include Smartphones, tablets, smart TVs, e-book readers, multimedia players, laptops and desktop computers, and more.
- FIG. 1 is a flowchart of a target object display method provided by an embodiment of the present application.
- the method is applied to an electronic device including a camera and a display screen, and the target object display method may include the following steps:
- step 101 the physical card is captured by the camera, and the target recognition image printed on the physical card captured in the perspective of the camera is obtained.
- the physical card can be independent of the electronic device after power-on, and the physical card here can be a card of paper, plastic material or the like.
- the image printed on the card may be an image generated by the three-dimensional entity in the projection direction and printed on the card; or the virtual two-dimensional image may be printed on the card; or the virtual three-dimensional model may be generated in the projection direction.
- the image was printed on the card.
- a three-dimensional hero model designed by a game company an image generated in each projection direction of the three-dimensional hero model is printed on a card and distributed to a user; for example, an image taken by a real estate company from different angles of a house entity And printed on the card, released to the user; for example, a two-dimensional poster designed by the advertising company, and printed on the card and released.
- the image on the card is referred to as a target recognition image.
- Step 102 Acquire image interpretation data of the target recognition image, where the image interpretation data is used to reflect characteristics of the target recognition image.
- the same three-dimensional model produces multiple images in different projection directions, and the image interpretation data of these images are similar, that is, the difference between the image interpretation data of any two of the images is less than the predetermined difference threshold. .
- step 103 the image interpretation data is matched with the pre-stored image interpretation data.
- Step 104 Acquire a stored target object corresponding to the pre-stored image interpretation data that matches the image interpretation data, and display the target object on a display screen of the electronic device, where the target object is a virtual two-dimensional model or a virtual three-dimensional model. .
- the target object here is the virtual model (ie, the above-mentioned virtual two-dimensional image or virtual three-dimensional model) on which the image on the physical card is formed, or is corresponding to the three-dimensional entity on which the image on the physical card is formed.
- Virtual model ie, the above-mentioned virtual two-dimensional image or virtual three-dimensional model
- the target object when the image printed on the card is obtained by the three-dimensional entity, the target object is a virtual two-dimensional model or a virtual three-dimensional model corresponding to the three-dimensional entity; when the image printed on the card is through the virtual two
- the target object when the dimension image is obtained, the target object is the virtual two-dimensional image or a virtual three-dimensional model corresponding to the virtual two-dimensional image; when the image printed on the card is obtained by the virtual three-dimensional model, the target object is the target object A virtual three-dimensional model or a virtual two-dimensional image formed by the virtual three-dimensional model in a predetermined projection direction.
- the virtual target object corresponding to the target recognition image is obtained by acquiring the target recognition image printed on the physical card, and displayed on the display screen of the electronic device.
- the target object Since the camera angle is only aimed at the target recognition image on the physical card, the virtual target object is automatically hit and displayed, and the user does not need to perform complicated operations, thereby solving the related art in the user viewing the application.
- more complex operations are required, resulting in technical problems that are less efficient.
- the complexity of the operation can be reduced, and the display efficiency can be improved.
- FIG. 2A is a flowchart of a target object display method provided by another embodiment of the present application.
- the method is applied to an electronic device including a camera and a display screen.
- the target object display method may include the following steps:
- Step 201 Acquire a pre-stored image corresponding to the target object.
- the target object is a virtual two-dimensional model or a virtual three-dimensional model.
- the target object can be a static virtual model or a dynamic virtual model.
- the virtual model here can be understood as: the virtual model needs to be displayed by the powered electronic device, such as displaying the target object through the display screen of the powered electronic device, or performing the two-dimensional or three-dimensional target object through the projection function of the powered electronic device. Projection display.
- the target object is a static virtual model.
- it can be implemented in the following two ways according to the type of the target object:
- the pre-stored image corresponding to the target object is the image corresponding to the two-dimensional model
- the pre-stored image corresponding to the target object is an image formed by the three-dimensional model in a predetermined projection direction.
- the pre-stored image corresponding to the target object is an electronic image.
- the target object is a virtual three-dimensional sofa model
- the system developer can use the electronic image of the virtual three-dimensional sofa model such as a side view, a front view, a rear view, a plan view, and the like as a pre-stored image of the virtual three-dimensional sofa model.
- some elements on the target object may be changed, and the pre-stored image corresponding to the target object may be determined according to the target object whose element is changed.
- the pre-stored image corresponding to the target object may be determined according to the target object whose element is changed.
- the game developer can use the electronic image of each different image of the virtual character as a pre-stored image of the virtual character.
- the different images mentioned herein may refer to A virtual character that wears different clothing (that is, changes in clothing elements). It is also possible to use an electronic image such as a projected image of each different perspective of the virtual character as a pre-stored image of the virtual character.
- any frame image or any of the frames of the image displayed by the dynamic virtual model may be acquired when acquiring the pre-stored image corresponding to the target object.
- the key frame image serves as a pre-stored image of the target object.
- the pre-stored image is preset by the system developer, and the correspondence between the target object and the pre-stored image is also set by the system developer.
- the system developer can select multiple pre-stored images to correspond to the virtual hero.
- the setting manner of the correspondence relationship between the target object and the pre-stored image is not specifically limited, and may be set according to actual conditions.
- the pre-stored image can be printed on the physical card directly by printing or burning, so that the camera that subsequently uses the electronic device can take an impromptu shot of the physical card and obtain an image printed on the card.
- Step 202 Process the pre-stored image to generate image interpretation data, which is used to reflect the characteristics of the pre-stored image.
- the electronic device may upload the pre-stored image to a software tool development package, such as an augmented reality software (eg, Vuforia) development kit, to generate image interpretation data of the pre-stored image.
- a software tool development package such as an augmented reality software (eg, Vuforia) development kit
- the image interpretation data is used to reflect characteristics of the pre-stored image.
- the image interpretation data is used to reflect at least one of a pixel, a color, a gray value, and the like of the pre-stored image.
- Step 203 Store the image interpretation data and the target object as a set of correspondences.
- the target object corresponding to the pre-stored image may be acquired, and then the image interpretation data is stored as a set of correspondence relationship with the target object.
- the image interpretation data and the target object may be associated with each other according to a pairing instruction issued by the system developer, and then stored.
- the main view of the sofa model is a pre-stored image, and the system developer stores the image interpretation data of the main view of the sofa model and the virtual sofa model as a set of correspondence.
- the system developer associates the image interpretation data with the target object, so that the electronic device or the server can determine the target object corresponding to the image to be identified according to the interpretation data of the image to be recognized in steps 205 and 206.
- Step 204 The physical card is captured by the camera, and the target recognition image captured on the physical card captured in the perspective of the camera is obtained.
- the physical card is used as the target to be identified, and the user points the camera view of the electronic device to the physical card, and the electronic device acquires the target recognition image printed on the physical card.
- the electronic device after the camera captures an image, the electronic device performs foreground recognition on the image to obtain the target recognition image.
- the pixel corresponding to the target recognition image is the foreground of the image.
- Step 205 Acquire image interpretation data of the target recognition image.
- the electronic device can upload the target recognition image to the server, and the server generates image interpretation data according to the target recognition image, so that the server can retrieve the image interpretation data matching the generated image interpretation data in the database.
- the electronic device directly generates image interpretation data according to the target recognition image, and transmits the image interpretation data to the server, so that the server can retrieve the image interpretation data matching the received image interpretation data in the database.
- the electronic device generates interpretation data according to the target recognition image, and the electronic device retrieves the image interpretation data matching the generated image interpretation data in the local database.
- step 202 For the manner of generating the image interpretation data of the target image, refer to step 202.
- Step 206 Match image interpretation data with pre-stored image interpretation data to obtain The stored target object corresponding to the pre-stored image interpretation data matching the image interpretation data is displayed on the display screen of the electronic device, and the target object is a virtual two-dimensional model or a virtual three-dimensional model.
- matching the image interpretation data with the pre-stored image interpretation data in this step may be implemented by several sub-steps as shown in FIG. 2B, and FIG. 2B is an implementation provided by an embodiment of the present application.
- FIG. 2B is an implementation provided by an embodiment of the present application.
- Step 206a calculating the similarity between the image interpretation data and each of the pre-stored image interpretation data.
- step 206b the pre-stored image interpretation data with the highest degree of similarity is determined as pre-stored image interpretation data that successfully matches the image interpretation data.
- the pre-stored image interpretation data with the similarity greater than the predetermined threshold is determined as the pre-stored image interpretation data that successfully matches the image interpretation data.
- the server determines the pre-stored information stored by the server that matches the image interpretation data according to the correspondence between the pre-stored image interpretation data and the target object.
- the image interprets the target object corresponding to the data and transmits the target object to the electronic device.
- the electronic device receives the target object and displays the target object on a display screen of the electronic device.
- the electronic device determines the locality according to the correspondence between the pre-stored image interpretation data and the target object.
- the stored pre-stored image matching the image interpretation data interprets the target object corresponding to the data, and displays the target image on the display screen of the electronic device.
- a user needs to present a virtual three-dimensional sofa model on an electronic device.
- the system developer determines the pre-stored image corresponding to the virtual three-dimensional sofa model
- the main view of the three-dimensional sofa entity is used as a pre-stored image, and the corresponding relationship between the pre-stored image and the virtual three-dimensional sofa model is stored, and the pre-stored image is printed.
- the corresponding relationship between the image interpretation data of the main view of the three-dimensional sofa entity and the virtual three-dimensional sofa model is also stored on the electronic device.
- the camera of the electronic device is aimed at the physical card, and after searching and matching in the database, the virtual three-dimensional sofa model is finally displayed on the electronic device.
- the camera of the electronic device can be aligned with the hero card to obtain the target recognition image on the hero card and the image interpretation data of the recognized image.
- the server retrieves pre-stored image interpretation data matching the image interpretation data of the identification image in the database, determines a stored target object corresponding to the pre-stored image interpretation data that matches the image interpretation data, and transmits the target object to the electronic device.
- the virtual hero corresponding to the hero card is also sent to the electronic device, and the electronic device displays the virtual hero.
- the virtual target object corresponding to the target recognition image is obtained by acquiring the target recognition image printed on the physical card, and displayed on the display screen of the electronic device.
- the target object Since the camera angle is only aimed at the target recognition image on the physical card, the virtual target object is automatically hit and displayed, and the user does not need to perform complicated operations, thereby solving the related art in the user viewing the application.
- more complex operations are required, resulting in technical problems that are less efficient.
- the complexity of the operation can be reduced, and the display efficiency can be improved.
- FIG. 3A is a flowchart of a target object display method provided by another embodiment of the present application, which is applied to an electronic device including a camera and a display screen, the target The object display method can include the following steps:
- step 301 the physical card is captured by the camera, and the target recognition image captured on the physical card captured in the perspective of the camera is obtained.
- Step 302 Acquire image interpretation data of the target recognition image.
- Step 303 Match the image interpretation data with the pre-stored image interpretation data, and acquire the stored target object corresponding to the pre-stored image interpretation data that matches the image interpretation data.
- Steps 301 to 303 can be respectively referred to the explanations in steps 204 to 206 shown in FIG. 2A, and details are not described in this embodiment.
- Step 304 Display the target object on the display screen of the electronic device according to the display animation corresponding to the image interpretation data, and the target object is a virtual two-dimensional model or a virtual three-dimensional model.
- the system developer can also set the display animation to be played when the target object is displayed, that is, the system developer interprets each image, the target object corresponding to the image interpretation data, and the display animation corresponding to the image interpretation data as one.
- the group correspondence is stored.
- the image interpretation data has a corresponding relationship with the display animation
- the display animation corresponding to the image interpretation data is acquired, and the target object is displayed according to the display animation.
- the virtual target object corresponding to the target recognition image is obtained by acquiring the target recognition image printed on the physical card, and displayed on the display screen of the electronic device.
- the target object Since the camera angle is only aimed at the target recognition image on the physical card, the virtual target object is automatically hit and displayed, and the user does not need to perform complicated operations, thereby solving the related art in the user viewing the application.
- more complex operations are required, resulting in technical problems that are less efficient.
- the complexity of the operation can be reduced, and the display efficiency can be improved.
- FIG. 3B is a flowchart of a method for displaying an image frame of an animation as a pre-stored image according to an embodiment of the present application.
- Step 305 Acquire an image frame in the display animation of the target object.
- the target object can be displayed in a variety of display animations.
- the hero can be displayed in the form of a hero jumping animation, or can be displayed in a hero running animation.
- the system developer can use an image frame of the hero jump animation as a pre-stored image, so that the user can align the physical card corresponding to the pre-stored image through the camera of the electronic device, and after searching and matching in the database, the electronic device will eventually be a hero.
- Jump animation shows the hero.
- the system developer can also use an image frame of the hero running animation as a pre-stored image.
- Each of the image frames in the image frame has a foreground corresponding to the target object as the foreground of the image.
- the area of the foreground in the image frame is larger than the area of the background; or the gray value of the area of the background in the image frame is (255, 255), that is, the background area of the image frame is white.
- Step 306 processing the image frame to generate image interpretation data, the image interpretation data being used to reflect characteristics of the image frame.
- the electronic device may upload the pre-stored image to a software tool development kit, such as an augmented reality software (eg, Vuforia) development kit, to generate image interpretation data of the pre-stored image.
- a software tool development kit such as an augmented reality software (eg, Vuforia) development kit
- the image interpretation data is used to reflect the characteristics of the pre-stored image.
- the similarity between the two image interpretation data is higher, the similarity of the images corresponding to the two image interpretation data is higher; when the two image interpretation data are identical, the images corresponding to the two image interpretation data are illustrated. It's exactly the same.
- Step 307 the image interpretation data, the target object, and the display animation are regarded as a set of corresponding The system is stored.
- the system developer sets the correspondence between the image interpretation data, the target object, and the display animation.
- the system stores each image interpretation data, a target object corresponding to the image interpretation data, and a presentation animation corresponding to the image interpretation data as a set of correspondences in a database, so that the electronic device can be based on the steps 303 and 304
- the image interpretation data and the presentation animation corresponding to the image interpretation data show the target object.
- the developer uses an image frame of the hero jump animation as a pre-stored image, prints the image frame on a hero card, and stores the image interpretation data of the image frame and the hero and hero jump animation in the server. Correspondence relationship.
- the electronic device uses the camera of the electronic device to align the hero card, the electronic device performs retrieval and matching in the data, and finally the electronic device displays the hero in a hero jump animation in the display screen.
- FIG. 4 is a schematic structural diagram of a target object display device according to an embodiment of the present disclosure.
- the target object display device is applied to an electronic device including a camera and a display screen, and the target object display device may include: An acquisition module 410, a second acquisition module 420, a matching module 430, and a presentation module 440.
- the first obtaining module 410 is configured to capture a physical card by using a camera, and acquire a target recognition image printed on the physical card captured by the camera perspective;
- the second acquisition module 420 is configured to acquire image interpretation data of the target recognition image acquired by the first acquisition module 410, where the image interpretation data is used to reflect the feature of the target recognition image acquired by the first acquisition module 410.
- the matching module 430 is configured to match the image interpretation data acquired by the second obtaining module 420 with the pre-stored image interpretation data.
- the display module 440 is configured to acquire the stored target object corresponding to the pre-stored image interpretation data that matches the image interpretation data, and display the target object on the display screen, where the target object is a virtual two-dimensional model or a virtual three-dimensional model.
- the target object display device provided in this embodiment can obtain a virtual target object corresponding to the target recognition image by acquiring the target recognition image printed on the physical card, and display the target on the display screen of the electronic device.
- Object Since the camera angle is only aimed at the target recognition image on the physical card, the virtual target object is automatically hit and displayed, and the user does not need to perform complicated operations, thereby solving the related art in the user viewing the application.
- targeting objects more complex operations are required, resulting in technical problems that are less efficient.
- the complexity of the operation can be reduced, and the display efficiency can be improved.
- FIG. 5 is a schematic structural diagram of a target object display device according to another embodiment of the present application.
- the target object display device is applied to an electronic device including a camera and a display screen.
- the target object display device may include: The first obtaining module 501, the second obtaining module 502, the matching module 503, and the displaying module 504.
- the first obtaining module 501 is configured to capture a physical card by using a camera, and acquire a target recognition image printed on the physical card captured by the camera perspective;
- the second obtaining module 502 is configured to acquire image interpretation data of the target recognition image acquired by the first acquiring module 501, where the image interpretation data is used to reflect the feature of the target recognition image acquired by the first acquiring module 501.
- the matching module 503 is configured to match the image interpretation data acquired by the second obtaining module 502 with the pre-stored image interpretation data.
- the display module 504 is configured to acquire the stored target object corresponding to the pre-stored image interpretation data that matches the image interpretation data, and display the target object on the display screen, where the target object is a virtual two-dimensional model or a virtual three-dimensional model.
- the target object display device further includes: a third obtaining module 505, a first processing module 506, and a first storage module 507.
- the third obtaining module 505 is configured to acquire a pre-stored image corresponding to the target object.
- the first processing module 506 is configured to process the pre-stored image acquired by the third obtaining module 505 to generate image interpretation data.
- the first storage module 507 is configured to store the image interpretation data generated by the first processing module 506 and the target object as a set of correspondences.
- the target object display device further includes: a fourth obtaining module 508, a second processing module 509, and a second storage module 510.
- the fourth obtaining module 508 is configured to acquire an image frame in the display animation of the target object.
- the second processing module 509 is configured to process the image frame acquired by the fourth obtaining module 508 to generate image interpretation data.
- the second storage module 510 is configured to store the image interpretation data, the target object, and the display animation as a set of correspondences.
- the display module 504 is further configured to display the target object on the display screen according to the display animation corresponding to the target object.
- the matching module 503 further includes: a calculating unit 503a and a determining unit 503b.
- the calculating unit 503a is configured to calculate the similarity between the image interpretation data and each of the pre-stored image interpretation data.
- the determining unit 503b is configured to determine the image interpretation data with the highest degree of similarity calculated by the calculating unit 503a as pre-stored image interpretation data that successfully matches the image interpretation data.
- the target object display device can obtain a virtual target object corresponding to the target recognition image by acquiring the target recognition image printed on the physical card, and display the target on the display screen of the electronic device.
- Object Since the camera angle is only aimed at the target recognition image on the physical card, the virtual target object is automatically hit and displayed, and the user does not need to perform complicated operations, thereby solving the related art in the user viewing the application.
- Target objects require more complex operations, resulting in display efficiency Lower technical issues.
- the complexity of the operation can be reduced, and the display efficiency can be improved.
- the target object display device provided in the above embodiment is only illustrated by the division of the above functional modules when performing the target object display. In actual applications, the function distribution may be completed by different functional modules as needed, that is, the electronic The internal structure of the device is divided into different functional modules to perform all or part of the functions described above.
- the target object display device provided by the foregoing embodiment is the same as the target object display method embodiment, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.
- FIG. 6 is a schematic diagram showing the hardware structure of an electronic device for implementing a target object display method according to another embodiment of the present application.
- the electronic device includes a processor 601, a memory 602, a system bus 603, a camera 604, a display screen 605, and a network interface 606.
- processor 601 is a hardware for executing computer program instructions through basic arithmetic and logic operations in a computer system.
- Memory 602 is a physical device used to temporarily or permanently store computer programs or data, such as volatile or non-volatile memory.
- Network interface 606 is used to transfer data between the electronic device and a server or other device.
- the processor 601 can communicate with the camera 604 through the system bus 603 to instruct the camera 604 to capture the physical card; the processor 601 can also communicate with the memory 602 through the system bus 603 to execute the storage in the memory 602. Machine readable instructions comprising a first fetch instruction, a second fetch instruction, a match instruction, and a display instruction; the processor 601 can also communicate with the display screen 605 via the system bus 603 to instruct the display screen 605 to display target.
- the processor 601 is configured to read the first acquisition instruction, the second acquisition instruction, the matching instruction, and the display instruction stored in the memory 602 to perform the object shown in FIG. 1 .
- the computer readable instructions further include a third fetch instruction, a first process instruction, and a first store instruction that are executable by the processor 601.
- the processor 601 is configured to read the foregoing instructions stored in the memory 602 to perform steps 201-203 in the target object display method shown in FIG. 2A and the third acquisition module 505 in the target object display device shown in FIG. A function of the processing module 506 and the first storage module 507.
- the computer readable instructions further include fourth fetch instructions, second process instructions, and second store instructions that are executable by the processor 601.
- the processor 601 is configured to read the above instructions stored in the memory 602 to perform the steps in the method of displaying an image frame of the animation shown in FIG. 3B as a pre-stored image and the fourth in the target object display device shown in FIG.
- the functions of the module 508, the second processing module 509, and the second storage module 510 are obtained.
- a person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium.
- the storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Evolutionary Computation (AREA)
- Computer Graphics (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Quality & Reliability (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (10)
- 一种目标对象展示方法,其特征在于,应用于包含有摄像头和显示屏的电子设备中,所述方法包括:利用所述摄像头对实体卡片进行拍摄,获取所述摄像头视角内摄取到的印刷在所述实体卡片上的目标识别图像;获取所述目标识别图像的图像解释数据,所述图像解释数据用于反映所述目标识别图像的特征;将所述图像解释数据与预存的图像解释数据进行匹配;获取存储的与所述图像解释数据匹配的预存的图像解释数据所对应的目标对象,在所述显示屏上展示所述目标对象,所述目标对象为虚拟的二维模型或虚拟的三维模型。
- 根据权利要求1所述的方法,其特征在于,所述方法还包括:获取所述目标对象所对应的预存图像;对所述预存图像进行处理生成图像解释数据;将所述图像解释数据与所述目标对象作为一组对应关系进行存储。
- 根据权利要求1所述的方法,其特征在于,所述方法还包括:获取所述目标对象的展示动画中的一个图像帧;对所述图像帧进行处理生成图像解释数据;将所述图像解释数据、所述目标对象、所述展示动画作为一组对应关系进行存储。
- 根据权利要求1所述的方法,其特征在于,所述在所述显示屏上展示所述目标对象,包括:按照与所述目标对象对应的展示动画,在所述显示屏上展示所述目标对象。
- 根据权利要求1至4中任一所述的方法,其特征在于,所述将所述图像解释数据与预存的图像解释数据进行匹配,包括:计算所述图像解释数据与所述各个预存的图像解释数据之间的相似度;将相似度最大的图像解释数据确定为与所述图像解释数据匹配成功的预存的图像解释数据。
- 一种目标对象展示装置,其特征在于,应用于包含有摄像头和显示屏的电子设备中,所述装置包括:第一获取模块,用于利用所述摄像头对实体卡片进行拍摄,获取所述摄像头视角内摄取到的印刷在所述实体卡片上的目标识别图像;第二获取模块,用于获取所述第一获取模块获取到的目标识别图像的图像解释数据,所述图像解释数据用于反映所述第一获取模块获取到的目标识别图像的特征;匹配模块,用于将所述第二获取模块获取到的图像解释数据与预存的图像解释数据进行匹配;展示模块,用于获取存储的与所述图像解释数据匹配的预存的图像解释数据所对应的目标对象,在所述显示屏上展示所述目标对象,所述目标对象为虚拟的二维模型或虚拟的三维模型。
- 根据权利要求6所述的装置,其特征在于,所述装置还包括:第三获取模块,用于获取所述目标对象所对应的预存图像;第一处理模块,用于对所述第三获取模块获取到的预存图像进行处理生成图像解释数据;第一存储模块,用于将所述第一处理模块生成的图像解释数据与所述目标对象作为一组对应关系进行存储。
- 根据权利要求6所述的装置,其特征在于,所述装置还包括:第四获取模块,用于获取所述目标对象的展示动画中的一个图像帧;第二处理模块,用于对所述第四获取模块获取到的图像帧进行处理生成图像解释数据;第二存储模块,用于将所述图像解释数据、所述目标对象、所述展示动画作为一组对应关系进行存储。
- 根据权利要求6所述的装置,其特征在于,所述展示模块,还用于按照与所述目标对象对应的展示动画,在所述显示屏上展示所述目标对象。
- 根据权利要求6至9中任一所述的装置,其特征在于,所述匹配模块,包括:计算单元,用于计算所述图像解释数据与所述各个预存的图像解释数据之间的相似度;确定单元,用于将所述计算单元计算得到相似度最大的图像解释数据确定为与所述图像解释数据匹配成功的预存的图像解释数据。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020187025999A KR102118000B1 (ko) | 2016-03-29 | 2017-03-17 | 타겟 대상 표시 방법 및 디바이스 |
US16/112,486 US10832086B2 (en) | 2016-03-29 | 2018-08-24 | Target object presentation method and apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610188631.X | 2016-03-29 | ||
CN201610188631.XA CN105869216A (zh) | 2016-03-29 | 2016-03-29 | 目标对象展示方法和装置 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/112,486 Continuation-In-Part US10832086B2 (en) | 2016-03-29 | 2018-08-24 | Target object presentation method and apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017167032A1 true WO2017167032A1 (zh) | 2017-10-05 |
Family
ID=56626427
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2017/077042 WO2017167032A1 (zh) | 2016-03-29 | 2017-03-17 | 目标对象展示方法和装置 |
Country Status (4)
Country | Link |
---|---|
US (1) | US10832086B2 (zh) |
KR (1) | KR102118000B1 (zh) |
CN (1) | CN105869216A (zh) |
WO (1) | WO2017167032A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109993192A (zh) * | 2018-01-03 | 2019-07-09 | 北京京东尚科信息技术有限公司 | 目标对象识别方法及装置、电子设备、存储介质 |
Families Citing this family (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105869216A (zh) * | 2016-03-29 | 2016-08-17 | 腾讯科技(深圳)有限公司 | 目标对象展示方法和装置 |
US11043042B2 (en) * | 2016-05-16 | 2021-06-22 | Hewlett-Packard Development Company, L.P. | Generating a shape profile for a 3D object |
CN106355153B (zh) * | 2016-08-31 | 2019-10-18 | 上海星视度科技有限公司 | 一种基于增强现实的虚拟对象显示方法、装置以及*** |
CN106454229A (zh) * | 2016-09-27 | 2017-02-22 | 成都理想境界科技有限公司 | 一种监测方法、摄像装置和图像处理设备和监测*** |
CN106791789A (zh) * | 2016-11-28 | 2017-05-31 | 深圳哈乐派科技有限公司 | 一种3d影像展示方法及一种机器人 |
CN107085592A (zh) * | 2017-03-02 | 2017-08-22 | 深圳市创想天空科技股份有限公司 | 基于认知卡片的早教方法及装置 |
CN108764135B (zh) * | 2018-05-28 | 2022-02-08 | 北京微播视界科技有限公司 | 图像生成方法、装置,及电子设备 |
CN108871314B (zh) * | 2018-07-18 | 2021-08-17 | 江苏实景信息科技有限公司 | 一种定位定姿方法及装置 |
CN109492607B (zh) * | 2018-11-27 | 2021-07-09 | Oppo广东移动通信有限公司 | 一种信息推送方法、信息推送装置及终端设备 |
CN112231186B (zh) * | 2019-07-15 | 2024-03-15 | 深圳市腾讯网域计算机网络有限公司 | 一种性能数据的处理方法、装置、电子设备及介质 |
CN110456901A (zh) * | 2019-08-16 | 2019-11-15 | 上海电气集团股份有限公司 | 展会中对象展示的控制方法、***、电子设备和存储介质 |
CN110827333B (zh) * | 2019-10-31 | 2022-05-03 | 国网河北省电力有限公司电力科学研究院 | 一种继电保护的压板拼接识别方法、***及介质 |
CN111062435A (zh) * | 2019-12-13 | 2020-04-24 | 北京奇艺世纪科技有限公司 | 图像分析方法、装置及电子设备 |
CN111638793B (zh) * | 2020-06-04 | 2023-09-01 | 浙江商汤科技开发有限公司 | 飞行器的展示方法、装置、电子设备及存储介质 |
CN111694164B (zh) * | 2020-06-24 | 2022-05-20 | 重庆电子工程职业学院 | 智能文物展示*** |
CN111882660A (zh) * | 2020-07-23 | 2020-11-03 | 广联达科技股份有限公司 | 基于cad图纸的三维显示方法和三维显示装置 |
CN113140028A (zh) * | 2021-04-08 | 2021-07-20 | 广州三七互娱科技有限公司 | 虚拟物体渲染方法、装置及电子设备 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103294918A (zh) * | 2013-05-30 | 2013-09-11 | 佛山电视台南海分台 | 一种在现实图像中进行虚拟游戏的方法和*** |
CN103310099A (zh) * | 2013-05-30 | 2013-09-18 | 佛山电视台南海分台 | 一种利用图像捕获和识别技术实现增强现实的方法和*** |
CN105260409A (zh) * | 2015-09-23 | 2016-01-20 | 惠州Tcl移动通信有限公司 | 智能终端的图片搜索方法以及智能终端 |
CN105869216A (zh) * | 2016-03-29 | 2016-08-17 | 腾讯科技(深圳)有限公司 | 目标对象展示方法和装置 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20120010041A (ko) * | 2010-07-23 | 2012-02-02 | 세종대학교산학협력단 | 이동 단말 환경에서 증강 현실 콘텐츠를 저작하는 방법 및 시스템 |
US20120092329A1 (en) * | 2010-10-13 | 2012-04-19 | Qualcomm Incorporated | Text-based 3d augmented reality |
JP6283168B2 (ja) * | 2013-02-27 | 2018-02-21 | 任天堂株式会社 | 情報保持媒体および情報処理システム |
CN103929597B (zh) * | 2014-04-30 | 2018-02-09 | 杭州摩图科技有限公司 | 一种辅助拍摄的方法及其装置 |
CN104463055A (zh) * | 2014-12-29 | 2015-03-25 | 重庆甲虫网络科技有限公司 | 基于无线智能标签的增强现实***及其控制方法 |
CN105405168A (zh) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | 一种实现三维增强现实的方法及装置 |
-
2016
- 2016-03-29 CN CN201610188631.XA patent/CN105869216A/zh active Pending
-
2017
- 2017-03-17 WO PCT/CN2017/077042 patent/WO2017167032A1/zh active Application Filing
- 2017-03-17 KR KR1020187025999A patent/KR102118000B1/ko active IP Right Grant
-
2018
- 2018-08-24 US US16/112,486 patent/US10832086B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103294918A (zh) * | 2013-05-30 | 2013-09-11 | 佛山电视台南海分台 | 一种在现实图像中进行虚拟游戏的方法和*** |
CN103310099A (zh) * | 2013-05-30 | 2013-09-18 | 佛山电视台南海分台 | 一种利用图像捕获和识别技术实现增强现实的方法和*** |
CN105260409A (zh) * | 2015-09-23 | 2016-01-20 | 惠州Tcl移动通信有限公司 | 智能终端的图片搜索方法以及智能终端 |
CN105869216A (zh) * | 2016-03-29 | 2016-08-17 | 腾讯科技(深圳)有限公司 | 目标对象展示方法和装置 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109993192A (zh) * | 2018-01-03 | 2019-07-09 | 北京京东尚科信息技术有限公司 | 目标对象识别方法及装置、电子设备、存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN105869216A (zh) | 2016-08-17 |
US20180365518A1 (en) | 2018-12-20 |
US10832086B2 (en) | 2020-11-10 |
KR102118000B1 (ko) | 2020-06-02 |
KR20180111970A (ko) | 2018-10-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017167032A1 (zh) | 目标对象展示方法和装置 | |
US10789622B2 (en) | Generating and providing augmented reality representations of recommended products based on style compatibility in relation to real-world surroundings | |
US10580148B2 (en) | Graphical coordinate system transform for video frames | |
US10186084B2 (en) | Image processing to enhance variety of displayable augmented reality objects | |
US12020383B2 (en) | Facial synthesis in augmented reality content for third party applications | |
US11816926B2 (en) | Interactive augmented reality content including facial synthesis | |
US20220254143A1 (en) | Method and apparatus for determining item name, computer device, and storage medium | |
US20180182171A1 (en) | Systems and Methods for Real-time Multimedia Augmented Reality | |
US20230353520A1 (en) | Providing post-capture media overlays for post-capture processing in a messaging system | |
US20220319231A1 (en) | Facial synthesis for head turns in augmented reality content | |
US20220319060A1 (en) | Facial synthesis in augmented reality content for advertisements | |
US12003883B2 (en) | Facial synthesis in overlaid augmented reality content | |
CN114153548A (zh) | 一种展示方法、装置、计算机设备及存储介质 | |
US11657568B2 (en) | Methods and systems for augmented reality tracking based on volumetric feature descriptor data | |
Molyneaux et al. | Projected interfaces: enabling serendipitous interaction with smart tangible objects | |
CN111556338B (zh) | 视频中区域的检测方法、信息融合方法、装置和存储介质 | |
CN108628914B (zh) | 移动装置及其操作方法、非挥发性计算机可读取记录媒体 | |
Zhao et al. | 3D model enhanced face recognition | |
Lin et al. | A Multi‐Person Selfie System via Augmented Reality | |
US20170228915A1 (en) | Generation Of A Personalised Animated Film | |
US20200051533A1 (en) | System and method for displaying content in association with position of projector | |
Pagani | Modeling reality for camera registration in augmented reality applications | |
Habib et al. | Magic mirror using kinect | |
TW202247105A (zh) | 立體圖像呈現系統、裝置與方法 | |
Li-Chee-Ming et al. | A Scene-Based Augmented Reality Framework for Exhibits |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 20187025999 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020187025999 Country of ref document: KR |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17773062 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17773062 Country of ref document: EP Kind code of ref document: A1 |