WO2024108528A1 - 物理物体和计算机相结合的显示***及出题*** - Google Patents

物理物体和计算机相结合的显示***及出题*** Download PDF

Info

Publication number
WO2024108528A1
WO2024108528A1 PCT/CN2022/134244 CN2022134244W WO2024108528A1 WO 2024108528 A1 WO2024108528 A1 WO 2024108528A1 CN 2022134244 W CN2022134244 W CN 2022134244W WO 2024108528 A1 WO2024108528 A1 WO 2024108528A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
image
display
mark
recognizes
Prior art date
Application number
PCT/CN2022/134244
Other languages
English (en)
French (fr)
Inventor
毕振名
Original Assignee
毕振名
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 毕振名 filed Critical 毕振名
Priority to PCT/CN2022/134244 priority Critical patent/WO2024108528A1/zh
Publication of WO2024108528A1 publication Critical patent/WO2024108528A1/zh

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A63F13/525—Changing parameters of virtual cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features

Definitions

  • the invention relates to a display system combining a physical object and a computer, and a question-setting system combining a physical object and a computer.
  • Non-Patent Document 1 discloses that an English word can be obtained by selecting any faces of a plurality of blocks on which letters are drawn and arranging them.
  • Patent Document 1 discloses that radicals and radical names are marked on each face of a regular 12-sided polygon, and Chinese characters are written using the radicals displayed on the faces obtained by rotation (Chinese character dice).
  • Patent Document 2 discloses that characters of the 50 sounds of Hiragana are assigned to each face of nine hexahedrons, and a word game is played using the characters displayed on the faces obtained by rotation.
  • Patent Document 1 Japanese Patent Application Publication No. 2009-291570
  • Patent Document 2 Japanese Patent Application Publication No. 2011-78549
  • Non-Patent Literature 1 Samuel L. Hill, “US 21798A”, [online], Google Patents, [retrieved on December 10, 2017], Internet ⁇ URL: https://www.***.com/patents/US21798>
  • an electronic device such as a tablet computer can be placed in front of oneself, and a front camera can be used to photograph the multiple blocks arranged by the user and display them on a display screen, and the electronic device can be used to identify the multiple blocks photographed, so that the electronic device can determine whether the results obtained from the multiple blocks arranged by the user are correct.
  • the back part of the block is displayed on the display screen, rather than the front part seen by the user (e.g., a child), and the text captured by the front camera is in a reverse mirror state, that is, the image of the block displayed on the display screen is inconsistent with the words to be expressed by the blocks arranged by the user. For children, this inconsistency may cause confusion when they are playing and learning, and the electronic device cannot determine whether the words arranged by the user are correct.
  • the present invention is proposed in view of the above-mentioned problems, and its purpose is to provide a display system and a question-setting system that combine physical objects and computers.
  • the system performs non-reverse mirroring processing on the image captured by the front camera according to the characteristics of the three-dimensional model of the object stored in advance, so that the image perspective that is the same as the image perspective seen from the user side when observing the object can be displayed on the display unit, so that users such as children will not be confused when playing and learning, and the electronic device can also determine whether the words arranged by the user are correct, which can greatly improve the user's experience of playing and learning alone.
  • the display system combining a physical object and a computer involved in the first aspect of the present invention includes: an object, which is a polyhedron and has marks displayed on each face; a camera unit, which is used to photograph the object at a predetermined position between a user and the camera unit as a first image; a control unit, which includes: a storage unit, which stores the input features of a three-dimensional model of the object; a recognition unit, which recognizes the first image captured by the camera unit; and an image conversion unit, which performs non-reverse mirroring processing on the recognized image to generate a second image based on the features of the three-dimensional model of the object stored in the storage unit; and a display unit, which is used to display the second image generated by the image conversion unit.
  • the object is a hexahedron.
  • the storage unit stores the features of the three-dimensional models of the multiple objects inputted respectively
  • the recognition unit recognizes the multiple first images of the multiple objects captured by the camera unit respectively
  • the image conversion unit performs non-reverse mirroring processing on the recognized multiple images according to the features of the three-dimensional models of the multiple objects stored in the storage unit to generate multiple second images.
  • the recognition unit recognizes the rotated mark as having a second specific meaning different from the first specific meaning.
  • the recognition unit recognizes the mark obtained after the rotation as still having the first specific meaning.
  • the marks displayed on the 24 faces of the 4 objects are A, B, C, D, E, F, G, H, I, J, K, L, M, N, O, P, Q, R, S, T, U, V, X, and Y, respectively.
  • the recognition unit recognizes it as Z; when the face of the object displaying M is rotated 180°, the recognition unit recognizes it as W.
  • the recognition unit still recognizes it as O; when the surface of an object marked with H is rotated by 180°, the recognition unit still recognizes it as H; and when the surface of an object marked with S is rotated by 180°, the recognition unit still recognizes it as S.
  • the second image displayed on the display unit changes from large to small.
  • the second aspect of the present invention relates to a question-generating system that combines a physical object and a computer, comprising: an object that is a polyhedron and has marks displayed on each face; a camera unit that is used to capture the object at a predetermined position between a user and the camera unit as a first image; a control unit that includes: a storage unit that stores features of a three-dimensional model of the object that has been input; a recognition unit that recognizes the first image captured by the camera unit and recognizes marks on specified faces of the object based on the features of the three-dimensional model of the object stored in the storage unit; an image conversion unit that performs non-reverse mirroring processing on the recognized image to generate a second image based on the features of the three-dimensional model of the object stored in the storage unit; and a question-generating unit that generates a second image from the features displayed on the three-dimensional model of the object.
  • a method for detecting a mark on the object comprising: selecting at least one mark from among all the marks on the object, and causing a display unit to display the at least one mark selected; a determination unit, which determines whether the content of the mark on the specified surface identified by the identification unit is consistent with the content of the mark selected by the question-setting unit; and a result notification unit, which causes a display unit to display the result determined by the determination unit; a display unit, which is used to display the mark selected by the question-setting unit, the second image generated by the image conversion unit, and the result determined by the determination unit.
  • system further includes a speaker, and the result notification unit outputs the result determined by the determination unit through the speaker.
  • the image captured by the front camera is processed in a non-reverse mirroring manner according to the characteristics of the three-dimensional model of the object stored in advance, so that the image perspective that is the same as the image perspective seen when observing the object from the user side can be displayed on the display unit, so that children and other users will not be confused when playing and learning, and the electronic device can also determine whether the words arranged by the user are correct, which can greatly improve the user's experience of playing and learning alone.
  • FIG. 1 is a schematic diagram showing an example of a display system in which a physical object and a computer are combined according to an embodiment of the present invention.
  • FIG. 2 is a block diagram showing a structure of a control unit in a display system combining a physical object and a computer according to an embodiment of the present invention.
  • FIG. 3 is a flowchart showing a non-reverse mirror image process performed by a control unit in a display system combining a physical object and a computer according to an embodiment of the present invention.
  • FIG. 4 is a block diagram showing the structure of a control unit in a question-setting system combining a physical object and a computer according to an embodiment of the present invention.
  • FIG. 5 is a flowchart showing the process of setting questions by a control unit in the question setting system combining a physical object and a computer according to the embodiment of the present invention.
  • FIG. 6 is a schematic diagram showing an actual demonstration of a display system and a question-generating system combining a physical object and a computer according to an embodiment of the present invention.
  • FIG. 7 is a planar development diagram showing an example of a case where the object in the display system and question-setting system combining a physical object and a computer according to an embodiment of the present invention is a hexahedron.
  • FIG. 8A is a schematic diagram showing a letter N displayed on one surface of an object in a display system and a question-posing system combining a physical object and a computer according to an embodiment of the present invention, when the letter N is rotated.
  • FIG. 8B is a schematic diagram showing a letter W displayed on one surface of an object in a display system and a question-posing system combining a physical object and a computer according to an embodiment of the present invention, when the letter W is rotated.
  • FIG. 9 is a schematic diagram showing an example of an image obtained when a front camera of a general electronic device captures an image of objects arranged by a user.
  • FIG. 10 is a schematic diagram showing that when a front camera of a general electronic device photographs an object arranged by a user, the object changes from small to large when the object moves from the user side to the electronic device side.
  • spatially relative terms such as “under,” “below,” “down,” “above,” “on,” etc., may be used herein to describe the relationship of one element or feature relative to another element or feature as shown in the figures. It should be understood that spatially relative terms are intended to include different orientations of the device in use or operation other than the orientation shown in the figures. For example, if the device in the figure is turned over, elements described as being “under” or “below” other elements or features will be oriented “above” the other elements or features.
  • FIG. 1 is a schematic diagram showing an example of a display system in which a physical object and a computer are combined according to an embodiment of the present invention.
  • the display system combining a physical object and a computer involved in embodiment 1 of the present invention includes: an object 200A, which is a polyhedron and has marks displayed on each face; a camera unit 102, which is used to capture the object 200A at a predetermined position between the user 300 and the camera unit 102 as a first image; a control unit 101; and a display unit 103, which is used to display a second image 200B generated by the control unit 101.
  • control unit 101, the camera unit 102, and the display unit 103 are all included in the electronic device 100, but the present invention is not limited thereto, and the control unit 101, the camera unit 102, and the display unit 103 may also be three independent components.
  • the control unit 101, the camera unit 102, and the display unit 103 may also be three independent components.
  • the camera unit and the display unit may also be two independent components.
  • the camera unit 102 an independent camera may be used, or a camera mounted on a tablet computer, a smart phone, a notebook PC, a desktop PC, etc. may be used, and the present invention has no particular limitation.
  • the display unit 103 an independent television or display capable of video input may be used, or a display screen of a tablet computer, a smart phone, a notebook PC, a desktop PC, etc. equipped with the camera unit 102 may be used, and the present invention has no particular limitation.
  • the object 200A is a hexahedron, but the present invention is not limited thereto, and other polyhedrons other than hexahedrons may also be used.
  • the marks displayed on each face of the object 200A are English letters, but the present invention is not limited thereto, and other letters, numbers, radicals, Chinese characters, etc. may also be displayed without any particular limitation.
  • the material of the object 200A is not particularly limited, but it is preferred to use a material with a certain strength and not easily damaged.
  • FIG. 2 is a block diagram showing a structure of a control unit in a display system combining a physical object and a computer according to an embodiment of the present invention.
  • the control unit 101 in the display system combining a physical object and a computer of the present invention includes: a storage unit 1013, which stores the features of the three-dimensional model of the input object 200A; a recognition unit 1011, which recognizes the first image captured by the camera unit 102; and an image conversion unit 1012, which performs non-reverse mirroring processing on the recognized image according to the features of the three-dimensional model of the object stored in the storage unit 1013 to generate a second image 200B.
  • FIG. 3 is a flowchart showing a non-reverse mirror image process performed by a control unit in a display system combining a physical object and a computer according to an embodiment of the present invention.
  • step ST10 the features of the three-dimensional model of the object 200A are stored in advance in the storage unit 1013.
  • the features of the three-dimensional model of the object 200A include the marks displayed on each surface of the object 200A, the direction of the marks, and the positional relationship of the marks displayed on each surface.
  • step ST10 only needs to be performed once in advance, that is, the features of the three-dimensional model of the object 200A only need to be stored in the storage unit 1013 once in advance, and the features of the three-dimensional model of the object 200A stored in the storage unit 1013 can be repeatedly read and used later.
  • step ST11 a first image obtained by photographing the object 200A is obtained from the camera unit 102.
  • step ST12 after the above-mentioned first image is recognized, in step ST13, the state of the object 200A is determined.
  • determining the state of the object 200A essentially refers to performing perspective transformation (Perspective Transformation) on each surface (such as the back, side, etc.) of the recognized object 200A to obtain a three-dimensional stereoscopic image at a frontal angle.
  • step ST14 when the side of the object 200A obtained and recognized by the camera unit 102 is tilted at a certain angle, the above-mentioned side can be projected onto a new plane that is not tilted by perspective transformation to obtain a three-dimensional stereoscopic image at a frontal angle.
  • step ST15 according to the characteristics of the stereoscopic model of the object pre-stored in the storage unit 1013, after the state of the determined object 200A is non-reverse mirrored, in step ST15, the stereoscopic model of the object 200A is imaged according to the state of the object after the non-reverse mirroring process as the second image 200B.
  • steps ST11 to ST15 may be repeatedly executed at predetermined time intervals, so that even if the object 200A moves, the viewing angle of the image displayed on the display unit 103 and the viewing angle of the image viewed from the user's perspective of the object 200A can always be the same.
  • the present invention is not limited thereto, and there may be multiple objects 200A.
  • the storage unit 1013 stores the features of the three-dimensional models of the input multiple objects
  • the recognition unit 1011 recognizes the multiple first images of the multiple objects captured by the camera unit 102
  • the image conversion unit 1012 performs non-reverse mirror processing on the recognized multiple images according to the features of the three-dimensional models of the multiple objects stored in the storage unit 1013 to generate multiple second images.
  • the image captured by the front camera is non-reverse mirrored according to the characteristics of the three-dimensional model of the object stored in advance, so that the image perspective that is the same as the image perspective seen when observing the object from the user side can be displayed on the display unit.
  • the electronic device can also determine whether the words arranged by the user are correct, which can greatly improve the user's experience of playing and learning alone.
  • the display system combining a physical object and a computer of the present invention
  • the object when the object is moved from the user side to the camera side, by making the second image displayed on the display unit change from large to small, compared with the situation in which the object changes from small to large when moving from the user side to the electronic device side when shooting using the front camera of a general electronic device as shown in FIG. 10, the same image size change as the image size change seen when observing the object from the user's perspective can be displayed on the display unit, which can further enhance the user's experience of playing and learning alone.
  • Fig. 4 is a block diagram showing the structure of a control unit in a question-setting system combining a physical object and a computer according to an embodiment of the present invention.
  • the same reference numerals as those in the first embodiment are used to describe the same parts in the second embodiment as those in the first embodiment.
  • the question-setting system combining a physical object and a computer involved in Implementation Example 2 of the present invention also includes: an object 200A, which is a polyhedron and has marks displayed on each face; a camera unit 102, which is used to photograph the object 200A located at a predetermined position between the user 300 and the camera unit 102 as a first image; a control unit 101'; and a display unit 103.
  • control unit 101 ', the camera unit 102, and the display unit 103 are all included in the electronic device 100, but the present invention is not limited thereto, and the control unit 101 ', the camera unit 102, and the display unit 103 may also be three independent components.
  • the control unit 101 ', the camera unit 102, and the display unit 103 may also be three independent components.
  • the camera unit and the display unit may also be two independent components.
  • the camera unit 102 an independent camera may be used, or a camera mounted on a tablet computer, a smart phone, a notebook PC, a desktop PC, etc. may be used, and the present invention has no particular limitation.
  • the display unit 103 an independent television or display capable of video input may be used, or a display screen of a tablet computer, a smart phone, a notebook PC, a desktop PC, etc. equipped with the camera unit 102 may be used, and the present invention has no particular limitation.
  • the object 200A is a hexahedron, but the present invention is not limited thereto, and other polyhedrons other than hexahedrons may also be used.
  • the marks displayed on each face of the object 200A are English letters, but the present invention is not limited thereto, and other letters, numbers, radicals, Chinese characters, etc. may also be displayed without any particular limitation.
  • the material of the object 200A is not particularly limited, but it is preferred to use a material with a certain strength and not easily damaged.
  • the physical object and computer-combined question-posing system involved in Embodiment 2 of the present invention is different from Embodiment 1 in that the control unit 101' involved in Embodiment 2 of the present invention includes: a storage unit 1013', which stores the input features of the three-dimensional model of the object; a recognition unit 1011', which recognizes the first image captured by the camera unit 102 and recognizes the mark on the specified surface of the object 200A based on the features of the three-dimensional model of the object 200A stored in the storage unit 1013'; an image conversion unit 1012', which converts the image into the three-dimensional model of the object 200A based on the features of the three-dimensional model of the object 200A stored in the storage unit 1013'.
  • the recognized image is processed in a non-reverse mirror image to generate a second image 200B; a question generating unit 1014', which selects at least one mark from all marks displayed on the object 200A and causes the display unit 103 to display the selected at least one mark; a determination unit 1015', which determines whether the content of the mark on the specified surface recognized by the recognition unit 1011' is consistent with the content of the mark selected by the question generating unit 1014'; and a result notification unit 1016', which causes the display unit 103 to display the result determined by the determination unit 1015'.
  • the display unit 103 is used to display the mark selected by the question generating unit 1014', the second image generated by the image conversion unit 1012', and the result determined by the determination unit 1015'.
  • FIG. 5 is a flowchart showing the process of setting questions by a control unit in the question setting system combining a physical object and a computer according to the embodiment of the present invention.
  • step ST20 after the user selects to start presenting a question, in step ST21, the presenting unit 1014 ′ selects a mark from the marks displayed on the object 200A, and displays the selected mark on the display unit 103.
  • step ST22 the object 200A arranged by the user is recognized (i.e., the first image captured by the camera unit 102 is recognized, and the mark on the specified surface of the object 200A is recognized according to the characteristics of the three-dimensional model of the object 200A stored in the storage unit 1013 ′), and the display unit 103 displays the image after the non-reverse mirror processing shown in FIG3 .
  • step ST23 the determination unit 1015 ′ determines whether the content of the mark on the specified surface (e.g., the upper surface of the object 200A) recognized by the recognition unit 1011 ′ is consistent with the content of the mark selected by the presenting unit 1014 ′. If the determination in step ST23 is “yes”, in step ST24, the display unit 103 displays the content indicating that the user arrangement is “correct”. If the determination in step ST23 is "NO”, in step ST25, the display unit 103 displays a message indicating that the user's arrangement is "wrong”. Then, after the user rearranges the objects 200A, the rearranged objects are recognized again (ie, ST22 is executed again).
  • the determination unit 1015 ′ determines whether the content of the mark on the specified surface (e.g., the upper surface of the object 200A) recognized by the recognition unit 1011 ′ is consistent with the content of the mark selected by the presenting unit 1014 ′. If the determination in step ST23 is “yes”, in step ST24, the display unit
  • the storage unit 1013' stores the features of the three-dimensional models of the multiple objects that are input
  • the recognition unit 1011' recognizes the multiple first images of the multiple objects captured by the camera unit 102, and recognizes the arrangement positions of the multiple objects and the marks on the specified surfaces of the multiple objects based on the features of the three-dimensional models of the multiple objects stored in the storage unit 1013'
  • the image conversion unit 1012' performs non-reverse mirror processing on the recognized multiple images to generate multiple second images based on the features of the three-dimensional models of the multiple objects stored in the storage unit 1013'
  • the determination unit 1015' determines whether the arrangement positions of the multiple objects and the contents of the marks on the specified surfaces of the multiple objects recognized by the recognition unit 1011' are consistent with the arrangement positions of the multiple marks and the contents of the marks selected by the question setting unit 10
  • the recognition unit 1011' when the content of the mark on the prescribed surface recognized by the recognition unit 1011' is inconsistent with the content of the mark selected by the question setting unit 1014', it is also possible to display which object 200A is wrong, or display which object 200A is correct, etc. For example, it is conceivable to color the correct and incorrect objects 200A so that the correct and incorrect can be identified, or it is conceivable to use arrow marks or circular marks, etc. to identify the correct and incorrect.
  • the question-setting system combining a physical object and a computer of the present invention may also include a speaker, and the result notification unit 1016' can output the result determined by the determination unit 1015' through the speaker.
  • an independent speaker may be used, or a speaker mounted on a tablet computer, a smart phone, a notebook PC, a desktop PC, etc. may be used, and the present invention has no particular limitation.
  • the image captured by the front camera is non-reverse mirrored according to the characteristics of the three-dimensional model of the object stored in advance, so that the image perspective that is the same as the image perspective seen when observing the object from the user side can be displayed on the display unit.
  • the electronic device can also determine whether the words arranged by the user are correct, which can greatly improve the user's experience of playing and learning alone.
  • the recognition unit 1011 when the surface of the object 200A displaying a mark having a first specific meaning is rotated by a predetermined angle, the recognition unit 1011 preferably recognizes the rotated mark as having a second specific meaning different from the first specific meaning.
  • the recognition unit 1011 when the surface of the object 200A displaying a mark having the first specific meaning is rotated by a predetermined angle, the recognition unit 1011 preferably recognizes the rotated mark as still having the first specific meaning.
  • Fig. 8A is a schematic diagram showing a rotation of a letter N displayed on one surface of an object in a display system and a question-generating system combining a physical object and a computer according to an embodiment of the present invention.
  • Fig. 8B is a schematic diagram showing a rotation of a letter W displayed on one surface of an object in a display system and a question-generating system combining a physical object and a computer according to an embodiment of the present invention.
  • the marks displayed on the 24 faces of the four objects are A, B, C, D, E, F, G, H, I, J, K, L, M, N, O, P, Q, R, S, T, U, V, X, and Y, respectively.
  • the recognition unit 1011 recognizes it as Z, and when the face of the object displaying N is rotated 180°, the recognition unit 1011 still recognizes it as N; when the face of the object displaying M is rotated 180°, the recognition unit 1011 recognizes it as W.
  • N and M can also be appropriately adjusted, such as making the width between the vertical lines on the left and right sides of N larger, and making the vertical lines on the left and right sides of M tilted to the left and right at a certain angle respectively.
  • the number of hexahedral objects 200A displaying the 26 English letters can be reduced (i.e., the number of hexahedral objects 200A required to display the 26 English letters can be reduced from 5 hexahedral objects 200A to only 4 hexahedral objects 200A), and the user can find the required letters more quickly, and can also add fun by rotating the blocks, which can further enhance the user's experience of playing and learning alone.
  • the recognition unit 1011 when the surface of an object marked with O is rotated by any angle, the recognition unit 1011 still recognizes it as O, when the surface of an object marked with H is rotated by 180°, the recognition unit 1011 still recognizes it as H, and when the surface of an object marked with S is rotated by 180°, the recognition unit 1011 still recognizes it as S.
  • the probability of the user obtaining the correct letter by rotation can be increased, which can further improve the user's experience of playing and learning alone.
  • the display system combining a physical object and a computer, and the question-setting system combining a physical object and a computer of the present invention can be applied to fields such as children's educational games and learning.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明涉及一种物理物体和计算机相结合的显示***，包括：物体，该物体为多面体且在各个面上显示有标记；摄像头部，该摄像头部用于对位于用户和所述摄像头部之间的预定位置的所述物体进行拍摄以作为第一图像；控制部，该控制部包括：存储部，该存储部存储有所输入的所述物体的立体模型的特征；识别部，该识别部对由所述摄像头部拍摄到的所述第一图像进行识别；以及图像转换部，该图像转换部根据所述存储部所存储的所述物体的立体模型的特征，对识别后的图像进行非反向镜像处理以生成第二图像；以及显示部，该显示部用于对由所述图像转换部生成的所述第二图像进行显示。

Description

物理物体和计算机相结合的显示***及出题*** 技术领域
本发明涉及一种物理物体和计算机相结合的显示***、以及物理物体和计算机相结合的出题***。
背景技术
以往，已知有在各个面上画有文字或数字等的像骰子一样的块体。通过旋转各个块体以选择任意的面进行排列，从而可用于游戏或学习。
例如，在非专利文献1中公开了：通过选择多个画有字母的块体的任意面进行排列，从而可得到英文单词。
另外，在专利文献1中公开了：在正12面体的各个面上标记有部首和部首名称，使用通过旋转所得到的面上显示的部首来写出汉字(汉字骰子)。在专利文献2中公开了：在9个6面体的各个面上分配平假名50音的文字，使用通过旋转所得到的面上显示的文字来进行文字游戏。
现有技术文献
专利文献1：日本特开2009-291570号公报
专利文献2：日本特开2011-78549号公报
非专利文献1：Samuel L.Hi ll，“US 21798A”，[online]，谷歌Patents，[2017年12月10日检索]，互联网<URL：https://www.***.com/patents/US21798>
发明内容
然而，在用户(例如儿童)将表面显示有文字或部首的多个块体进行排列之后，需要其他人(例如监护人)来判断对错并告知用户，或者需要用户自己从写有正确答案的纸等中找出答案并判断对错，不管是哪种情况都比较浪费时间，因此仅仅只是准备表面显示有文字或部首的多个块体，用户 自己学习游玩的体验较差。
针对上述问题，本发明的发明人想到：可将平板电脑等电子设备放置于自己的前方，利用前置摄像头拍摄用户自己所排列的多个块体并在显示屏上进行显示，并且利用电子设备对所拍摄到的多个块体进行识别，从而电子设备可判断出用户所排列的多个块体所得到的结果是否正确。
然而，一般的平板电脑等电子设备的前置摄像头所拍摄到的图像中，如图9所示，在显示屏上显示的是块体的背面部分，而并不是用户(例如儿童)所看到的前面部分，并且前置摄像头所拍摄到的文字呈现反向镜像的状态，也就是说，在显示屏上显示的块体的图像与用户自己所排列的块体所要表达的单词并不一致。对于儿童而言，这种不一致可能会使其在游玩学习时产生混乱，并且电子设备也无法判断用户所排列的单词是否正确。
本发明是鉴于上述问题而提出的，其目的在于，提供一种物理物体和计算机相结合的显示***及出题***，其通过根据预先所存储的物体的立体模型的特征对前置摄像头所拍摄到的图像进行非反向镜像处理，从而能够使得在显示部上显示与从用户侧观察物体所看到的图像视角相同的图像视角，能够使得儿童等用户不会在游玩学习时产生混乱，并且电子设备也能够判断出用户所排列的单词等是否正确，可大幅提高用户单独进行游玩及学习的体验。
本发明的第一方面所涉及的物理物体和计算机相结合的显示***包括：物体，该物体为多面体且在各个面上显示有标记；摄像头部，该摄像头部用于对位于用户和所述摄像头部之间的预定位置的所述物体进行拍摄以作为第一图像；控制部，该控制部包括：存储部，该存储部存储有所输入的所述物体的立体模型的特征；识别部，该识别部对由所述摄像头部拍摄到的所述第一图像进行识别；以及图像转换部，该图像转换部根据所述存储部所存储的所述物体的立体模型的特征，对识别后的图像进行非反向镜像处理以生成第二图像；以及显示部，该显示部用于对由所述图像转换部生成的所述第二图像进行显示。
进一步地，所述物体为六面体。
进一步地，在所述物体有多个的情况下，所述存储部存储有所输入的 多个物体各自的立体模型的特征，所述识别部对由所述摄像头部拍摄到的多个物体各自的多个第一图像分别进行识别，所述图像转换部根据所述存储部所存储的多个物体各自的立体模型的特征，分别对识别后的多个图像进行非反向镜像处理以生成多个第二图像。
进一步地，当所述物体的显示有具有第一特定含义的某个标记的面旋转规定角度时，所述识别部将该旋转后得到的标记识别为具有与所述第一特定含义不同的第二特定含义。
进一步地，当所述物体的显示有具有第一特定含义的某个标记的面旋转规定角度时，所述识别部将该旋转后得到的标记识别为仍具有所述第一特定含义。
进一步地，所述物体有4个，4个物体的24个面上显示的标记分别为A、B、C、D、E、F、G、H、I、J、K、L、M、N、O、P、Q、R、S、T、U、V、X、Y，其中当显示有N的物体的面旋转90°或270°时，所述识别部将其识别为Z；当显示有M的物体的面旋转180°时，所述识别部将其识别为W。
进一步地，当显示有标记O的物体的面旋转任意角度时，所述识别部仍将其识别为O，当显示有标记H的物体的面旋转180°时，所述识别部仍将其识别为H，当显示有标记S的物体的面旋转180°时，所述识别部仍将其识别为S。
进一步地，在使所述物体从所述用户侧向所述摄像头部侧移动时，所述显示部所显示的所述第二图像由大变小。
本发明的第二方面所涉及的物理物体和计算机相结合的出题***包括：物体，该物体为多面体且在各个面上显示有标记；摄像头部，该摄像头部用于对位于用户和所述摄像头部之间的预定位置的所述物体进行拍摄以作为第一图像；控制部，该控制部包括：存储部，该存储部存储有所输入的所述物体的立体模型的特征；识别部，该识别部对由所述摄像头部拍摄到的所述第一图像进行识别，并且根据所述存储部所存储的所述物体的立体模型的特征对所述物体的规定面上的标记进行识别；图像转换部，该图像转换部根据所述存储部所存储的所述物体的立体模型的特征，对识别后的图像进行非反向镜像处理以生成第二图像；出题部，该出题部从显示在所 述物体上的所有标记中选择至少一个以上的标记，并使显示部显示所选择的至少一个以上的标记；判定部，该判定部对由所述识别部识别出的规定面上的标记的内容与由所述出题部所选择的标记的内容是否一致进行判断；以及结果通知部，该结果通知部使显示部显示由所述判定部判断出的结果；显示部，该显示部用于对由所述出题部所选择的标记、由所述图像转换部生成的所述第二图像、由所述判定部判断出的结果进行显示。
进一步地，还包括扬声器，所述结果通知部使由所述判定部判断出的结果通过所述扬声器输出。
发明效果
根据本发明的物理物体和计算机相结合的显示***及出题***，通过根据预先所存储的物体的立体模型的特征对前置摄像头所拍摄到的图像进行非反向镜像处理，从而能够使得在显示部上显示与从用户侧观察物体所看到的图像视角相同的图像视角，能够使得儿童等用户不会在游玩学习时产生混乱，并且电子设备也能够判断出用户所排列的单词等是否正确，可大幅提高用户单独进行游玩及学习的体验。
附图说明
图1是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***的一个示例的示意图。
图2是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***中的控制部的结构框图。
图3是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***中的控制部进行非反向镜像处理时的流程图。
图4是示出本发明的实施方式所涉及的物理物体和计算机相结合的出题***中的控制部的结构框图。
图5是示出本发明的实施方式所涉及的物理物体和计算机相结合的出题***中的控制部进行出题时的流程图。
图6是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***及出题***进行实际演示时的示意图。
图7是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***及出题***中的物体为六面体时的一个示例的平面展开图。
图8A是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***及出题***中的物体的一个面上显示的字母N进行旋转时的示意图。
图8B是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***及出题***中的物体的一个面上显示的字母W进行旋转时的示意图。
图9是示出一般的电子设备的前置摄像头对用户所排列的物体进行拍摄时所得到的图像的一个示例的示意图。
图10是示出一般的电子设备的前置摄像头对用户所排列的物体进行拍摄时使物体从用户侧向电子设备侧移动时物体由小变大的示意图。
标号说明
100 电子设备
101、101’ 控制部
102 摄像头部(前置镜头)
103 显示部
200A 物体
200B 显示部上显示的物体图像
300 用户
1011、1011’ 识别部
1012、1012’ 图像转换部
1013、1013’ 存储部
1014、1014’ 出题部
1015、1015’ 判定部
1016、1016’ 结果通知部
具体实施方式
下面结合附图和具体实施方式对本发明进行详细说明。本实施方式在以本发明技术方案为前提下进行实施，给出了详细的实施方式和具体的操作过程，但本发明的保护范围不限于下述的实施方式。
为了描述的方便，可在此使用空间相对术语，例如“之下”、“下方”、“下”、“上方”、“上”等，来描述如图所示的一个元件或特性相对于另一元件或特性的关系。应理解，空间相对术语旨在包括除了在图中所示的指向之外的使用或操作的器件不同指向。例如，如果将图中的器件翻转，描述为在其它元件或特性“之下”或“下”的元件将被定向为在其它元件或特性“之上”。
除非另外限定，在此使用的术语具有与本发明所属领域的普通技术人员所通常理解相同的含义。术语应理解为具有与相关技术的上下文中的含义一致的含义，并不应以理想化或过度形式化来理解，除非在此明显地这样限定。
实施方式1
<物理物体和计算机相结合的显示***>
图1是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***的一个示例的示意图。
如图1所示，本发明的实施方式1所涉及的物理物体和计算机相结合的显示***包括：物体200A，该物体200A为多面体且在各个面上显示有标记；摄像头部102，该摄像头部102用于对位于用户300和摄像头部102之间的预定位置的物体200A进行拍摄以作为第一图像；控制部101；以及显示部103，该显示部103用于对由控制部101生成的第二图像200B进行显示。
图1的示例中，控制部101、摄像头部102、显示部103都包括在电子设备100中，但本发明不限于此，控制部101、摄像头部102、显示部103也可为分别独立的三个部件。例如，如图6所示，摄像头部和显示部也可以为彼此独立的两个部件。
即，作为摄像头部102，可以采用独立的摄像头，也可采用平板电脑、智能手机、笔记本PC、台式PC等所搭载的摄像头，本发明并无特别的限制。此外，作为显示部103，可以采用能够进行视频输入的独立的电视机或显示器，也可采用搭载了摄像头部102的平板电脑、智能手机、笔记本PC、台式PC等的显示屏，本发明并无特别的限制。
此外，图1和图6的示例中，物体200A为六面体，但本发明不限于此，也可采用六面体以外的其他多面体。另外，图6和图7的示例中，物体200A的各个面上显示的标记为英文字母，但本发明不限于此，也可显示其他字母、数字、部首、汉字等，并没有特别的限制。此外，物体200A的材料也没有特别的限制，但优选使用具有一定强度且不易损坏的材料。
图2是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***中的控制部的结构框图。
如图2所示，本发明的物理物体和计算机相结合的显示***中的控制部101包括：存储部1013，该存储部1013存储有所输入的物体200A的立体模型的特征；识别部1011，该识别部1011对由摄像头部102拍摄到的第一图像进行识别；以及图像转换部1012，该图像转换部1012根据存储部1013所存储的物体的立体模型的特征，对识别后的图像进行非反向镜像处理以生成第二图像200B。
图3是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***中的控制部进行非反向镜像处理时的流程图。
具体而言，首先，在步骤ST10中，预先将物体200A的立体模型的特征存储在存储部1013中，物体200A的立体模型的特征包括物体200A的各个面上显示的标记、该标记的方向以及各个面上显示的标记的位置关系。其中，对于同一物体200A，只需要预先执行步骤ST10一次即可，即只需要预先将物体200A的立体模型的特征存储在存储部1013中一次即可，后续可重复读取并使用上述存储在存储部1013中的物体200A的立体模型的特征。
然后，在步骤ST11中，从摄像头部102获取对物体200A进行拍摄得到的第一图像。接着，在步骤ST12中，对上述第一图像进行识别之后，在步骤ST13中，对物体200A的状态进行判定。这里，对物体200A的状态进行判定实质上是指对识别出的物体200A的各个表面(例如背面、侧面等)进行透视变换(Perspective Transformation)，以获得正视角度的三维立体图像。例如，在由摄像头部102获取并识别出的物体200A的侧面倾斜一定角度时，可通过透视变换将上述侧面投影到不倾斜的新平面上，以获得 正视角度的三维立体图像。然后，在步骤ST14中，根据预先存储在存储部1013中的物体的立体模型的特征，对判定的物体200A的状态进行非反向镜像处理之后，在步骤ST15中，依据非反向镜像处理后的物体状态对物体200A的立体模型进行成像以作为第二图像200B。
此外，可以以预定的时间间隔重复执行步骤ST11～ST15，从而即使物体200A进行移动，也能够使得在显示部103上显示的图像视角与从用户的视角观察物体200A所看到的图像视角一直相同。
此外，上述的图1的示例中，物体200A仅有一个，但本发明并不局限于此，也可具有多个物体200A。本发明的实施方式1中，在物体200A有多个的情况下，存储部1013存储有所输入的多个物体各自的立体模型的特征，识别部1011对由摄像头部102拍摄到的多个物体各自的多个第一图像分别进行识别，图像转换部1012根据存储部1013所存储的多个物体各自的立体模型的特征，分别对识别后的多个图像进行非反向镜像处理以生成多个第二图像。
根据本发明的物理物体和计算机相结合的显示***，通过根据预先所存储的物体的立体模型的特征对前置摄像头所拍摄到的图像进行非反向镜像处理，从而能够使得在显示部上显示与从用户侧观察物体所看到的图像视角相同的图像视角，与图9所示的利用一般的平板电脑等电子设备的前置摄像头所拍摄到的图像相比，能够使得儿童等用户不会在游玩学习时产生混乱，并且电子设备也能够判断出用户所排列的单词等是否正确，可大幅提高用户单独进行游玩及学习的体验。
此外，本发明的物理物体和计算机相结合的显示***中，在使物体从用户侧向摄像头部侧移动时，通过使得显示部所显示的第二图像由大变小，从而与如图10所示的利用一般的电子设备的前置摄像头进行拍摄时使物体从用户侧向电子设备侧移动时物体由小变大的情况相比，能够使得在显示部上显示与从用户的视角观察物体所看到的图像大小变化相同的图像大小变化，可进一步提高用户单独进行游玩及学习的体验。
实施方式2
<物理物体和计算机相结合的出题***>
图4是示出本发明的实施方式所涉及的物理物体和计算机相结合的出题***中的控制部的结构框图。此外，对于实施方式2中与实施方式1相同的部分，使用与实施方式1相同的标号进行说明。
与实施方式1的图1相类似地，本发明的实施方式2所涉及的物理物体和计算机相结合的出题***也包括：物体200A，该物体200A为多面体且在各个面上显示有标记；摄像头部102，该摄像头部102用于对位于用户300和摄像头部102之间的预定位置的物体200A进行拍摄以作为第一图像；控制部101’；以及显示部103。
此外，与实施方式1相类似地，图1的示例中，控制部101’、摄像头部102、显示部103都包括在电子设备100中，但本发明不限于此，控制部101’、摄像头部102、显示部103也可为分别独立的三个部件。例如，如图6所示，摄像头部和显示部也可以为彼此独立的两个部件。
即，作为摄像头部102，可以采用独立的摄像头，也可采用平板电脑、智能手机、笔记本PC、台式PC等所搭载的摄像头，本发明并无特别的限制。此外，作为显示部103，可以采用能够进行视频输入的独立的电视机或显示器，也可采用搭载了摄像头部102的平板电脑、智能手机、笔记本PC、台式PC等的显示屏，本发明并无特别的限制。
此外，图1和图6的示例中，物体200A为六面体，但本发明不限于此，也可采用六面体以外的其他多面体。另外，图6和图7的示例中，物体200A的各个面上显示的标记为英文字母，但本发明不限于此，也可显示其他字母、数字、部首、汉字等，并没有特别的限制。此外，物体200A的材料也没有特别的限制，但优选使用具有一定强度且不易损坏的材料。
本发明的实施方式2所涉及的物理物体和计算机相结合的出题***与实施方式1的不同之处在于，本发明的实施方式2所涉及的控制部101’包括：存储部1013’，该存储部1013’存储有所输入的所述物体的立体模型的特征；识别部1011’，该识别部1011’对由摄像头部102拍摄到的第一图像进行识别，并且根据存储部1013’所存储的物体200A的立体模型的特征对物体200A的规定面上的标记进行识别；图像转换部1012’，该图像转换部1012’根据存储部1013’所存储的物体200A的立体模型的特征，对 识别后的图像进行非反向镜像处理以生成第二图像200B；出题部1014’，该出题部1014’从显示在物体200A上的所有标记中选择至少一个以上的标记，并使显示部103显示所选择的至少一个以上的标记；判定部1015’，该判定部1015’对由识别部1011’识别出的规定面上的标记的内容与由出题部1014’所选择的标记的内容是否一致进行判断；以及结果通知部1016’，该结果通知部1016’使显示部103显示由判定部1015’判断出的结果。此外，显示部103用于对由出题部1014’所选择的标记、由图像转换部1012’生成的第二图像、由判定部1015’判断出的结果进行显示。
图5是示出本发明的实施方式所涉及的物理物体和计算机相结合的出题***中的控制部进行出题时的流程图。
如图5所示，作为一个示例，首先，在步骤ST20中，用户选择开始出题之后，在步骤ST21中，出题部1014’从物体200A上所显示的标记中选择一个标记，并使显示部103显示所选择的标记。然后，在步骤ST22中，对用户所排列的物体200A进行识别(即对由摄像头部102拍摄到的第一图像进行识别，并且根据存储部1013’所存储的物体200A的立体模型的特征对物体200A的规定面上的标记进行识别)，并使显示部103显示经过图3所示的非反向镜像处理后的图像。然后，在步骤ST23中，判定部1015’对由识别部1011’识别出的规定面(例如物体200A的上表面)上的标记的内容与由出题部1014’所选择的标记的内容是否一致进行判断。在步骤ST23中判断为“是”的情况下，在步骤ST24中使显示部103显示表示用户排列“正确”的含义的内容。在步骤ST23中判断为“否”的情况下，在步骤ST25中使显示部103显示表示用户排列“错误”的含义的内容。然后，在用户对物体200A重新进行排列之后，对用户重新排列后的物体再次进行识别(即再次执行ST22)。
此外，上述的示例中，物体200A仅有一个，但本发明并不局限于此，也可具有多个物体200A。本发明的实施方式2中，在物体200A有多个的情况下，存储部1013’存储有所输入的多个物体各自的立体模型的特征，识别部1011’对由摄像头部102拍摄到的多个物体各自的多个第一图像分别进行识别，并且根据存储部1013’所存储的多个物体各自的立体模型的特 征对多个物体各自的排列位置以及各个物体的规定面上的标记进行识别，图像转换部1012’根据存储部1013’所存储的多个物体各自的立体模型的特征，分别对识别后的多个图像进行非反向镜像处理以生成多个第二图像，判定部1015’对由识别部1011’识别出的多个物体各自的排列位置以及各个物体的规定面上的标记的内容、与由出题部1014’所选择的多个标记的排列位置以及各个标记的内容是否一致进行判断。
此外，在由识别部1011’识别出的规定面上的标记的内容与由出题部1014’所选择的标记的内容不一致的情况下，还可以显示哪个物体200A错误，或者显示哪个物体200A正确等。例如，可以考虑将正误的物体200A着色以使得能够识别正误，或者可以考虑用箭头标记或圆形标记等来识别正误。
此外，本发明的物理物体和计算机相结合的出题***还可包括扬声器，结果通知部1016’可使由判定部1015’判断出的结果通过扬声器输出。
作为扬声器，可以采用独立的扬声器，也可采用平板电脑、智能手机、笔记本PC、台式PC等所搭载的扬声器，本发明并无特别的限制。
根据本发明的物理物体和计算机相结合的出题***，通过根据预先所存储的物体的立体模型的特征对前置摄像头所拍摄到的图像进行非反向镜像处理，从而能够使得在显示部上显示与从用户侧观察物体所看到的图像视角相同的图像视角，与图9所示的利用一般的平板电脑等电子设备的前置摄像头所拍摄到的图像相比，能够使得儿童等用户不会在游玩学习时产生混乱，并且电子设备也能够判断出用户所排列的单词等是否正确，可大幅提高用户单独进行游玩及学习的体验。
此外，本发明的物理物体和计算机相结合的出题***中，在使物体从用户侧向摄像头部侧移动时，通过使得显示部所显示的第二图像由大变小，从而与如图10所示的利用一般的电子设备的前置摄像头进行拍摄时使物体从用户侧向电子设备侧移动时物体由小变大的情况相比，能够使得在显示部上显示与从用户的视角观察物体所看到的图像大小变化相同的图像大小变化，可进一步提高用户单独进行游玩及学习的体验。
<英文字母旋转时的识别切换>
本发明中，优选为，当物体200A的显示有具有第一特定含义的某个标记的面旋转规定角度时，识别部1011将该旋转后得到的标记识别为具有与第一特定含义不同的第二特定含义。
此外，本发明中，优选为，当物体200A的显示有具有第一特定含义的某个标记的面旋转规定角度时，识别部1011将该旋转后得到的标记识别为仍具有所述第一特定含义。
图8A是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***及出题***中的物体的一个面上显示的字母N进行旋转时的示意图。图8B是示出本发明的实施方式所涉及的物理物体和计算机相结合的显示***及出题***中的物体的一个面上显示的字母W进行旋转时的示意图。
本发明中，优选为，物体200A有4个，4个物体的24个面上显示的标记分别为A、B、C、D、E、F、G、H、I、J、K、L、M、N、O、P、Q、R、S、T、U、V、X、Y，其中如图8A和图8B所示，当显示有N的物体的面旋转90°或270°时，识别部1011将其识别为Z，当显示有N的物体的面旋转180°时，识别部1011仍将其识别为N；当显示有M的物体的面旋转180°时，识别部1011将其识别为W。
此外，为了使得当N旋转90°或270°时更容易被识别为Z，当M旋转180°时更容易被识别为W，也可对N和M的形状进行适当的调整，例如使N的左右两侧的竖线之间的宽度更大，使M的左右两侧的竖线分别向左右倾斜一定的角度等。
由此，通过使得显示有N的物体的面通过旋转还可被识别为Z，使得显示有M的物体的面通过旋转还可被识别为W，从而能够减少显示26个英文字母的6面体物体200A的数量(即，可从原来的为了显示26个英文字母需要5个6面体物体200A减少为仅需要4个6面体物体200A)，用户可以更快地找到需要的字母，并且还可通过旋转方块来添加趣味性，能够进一步提高用户单独进行游玩及学习的体验。
此外，本发明中，优选为，当显示有标记O的物体的面旋转任意角度时，识别部1011仍将其识别为O，当显示有标记H的物体的面旋转180°时，识别部1011仍将其识别为H，当显示有标记S的物体的面旋转180° 时，识别部1011仍将其识别为S。
由此，对于字母O、H、S，能够使得用户通过旋转得到正确字母的概率提高，能够进一步提高用户单独进行游玩及学习的体验。
工业上的实用性
本发明的物理物体和计算机相结合的显示***、以及物理物体和计算机相结合的出题***可应用于例如儿童的益智类游玩和学习等领域。

Claims (10)

  1. 一种物理物体和计算机相结合的显示***，包括：
    物体，该物体为多面体且在各个面上显示有标记；以及
    摄像头部，该摄像头部用于对位于用户和所述摄像头部之间的预定位置的所述物体进行拍摄以作为第一图像；
    控制部，该控制部包括：
    存储部，该存储部存储有所输入的所述物体的立体模型的特征；
    识别部，该识别部对由所述摄像头部拍摄到的所述第一图像进行识别；以及
    图像转换部，该图像转换部根据所述存储部所存储的所述物体的立体模型的特征，对识别后的图像进行非反向镜像处理以生成第二图像；以及
    显示部，该显示部用于对由所述图像转换部生成的所述第二图像进行显示。
  2. 如权利要求1所述的显示***，其特征在于，
    所述物体为六面体。
  3. 如权利要求1或2所述的显示***，其特征在于，
    在所述物体有多个的情况下，
    所述存储部存储有所输入的多个物体各自的立体模型的特征，
    所述识别部对由所述摄像头部拍摄到的多个物体各自的多个第一图像分别进行识别，
    所述图像转换部根据所述存储部所存储的多个物体各自的立体模型的特征，分别对识别后的多个图像进行非反向镜像处理以生成多个第二图像。
  4. 如权利要求1或2所述的显示***，其特征在于，
    当所述物体的显示有具有第一特定含义的某个标记的面旋转规定角度时，所述识别部将该旋转后得到的标记识别为具有与所述第一特定含义不同的第二特定含义。
  5. 如权利要求1或2所述的显示***，其特征在于，
    当所述物体的显示有具有第一特定含义的某个标记的面旋转规定角度时，所述识别部将该旋转后得到的标记识别为仍具有所述第一特定含义。
  6. 如权利要求2所述的显示***，其特征在于，
    所述物体有4个，
    4个物体的24个面上显示的标记分别为A、B、C、D、E、F、G、H、I、J、K、L、M、N、O、P、Q、R、S、T、U、V、X、Y，
    其中当显示有N的物体的面旋转90°或270°时，所述识别部将其识别为Z，当显示有N的物体的面旋转180°时，所述识别部仍将其识别为N；
    当显示有M的物体的面旋转180°时，所述识别部将其识别为W。
  7. 如权利要求6所述的显示***，其特征在于，
    当显示有标记O的物体的面旋转任意角度时，所述识别部仍将其识别为O，
    当显示有标记H的物体的面旋转180°时，所述识别部仍将其识别为H，
    当显示有标记S的物体的面旋转180°时，所述识别部仍将其识别为S。
  8. 如权利要求1或2所述的显示***，其特征在于，
    在使所述物体从所述用户侧向所述摄像头部侧移动时，所述显示部所显示的所述第二图像由大变小。
  9. 一种物理物体和计算机相结合的出题***，包括：
    物体，该物体为多面体且在各个面上显示有标记；
    摄像头部，该摄像头部用于对位于用户和所述摄像头部之间的预定位置的所述物体进行拍摄以作为第一图像；
    控制部，该控制部包括：
    存储部，该存储部存储有所输入的所述物体的立体模型的特征；
    识别部，该识别部对由所述摄像头部拍摄到的所述第一图像进行识别，并且根据所述存储部所存储的所述物体的立体模型的特征对所述物体的规定面上的标记进行识别；
    图像转换部，该图像转换部根据所述存储部所存储的所述物体的立体模型的特征，对识别后的图像进行非反向镜像处理以生成第二图像；
    出题部，该出题部从显示在所述物体上的所有标记中选择至少一个以上的标记，并使显示部显示所选择的至少一个以上的标记；
    判定部，该判定部对由所述识别部识别出的规定面上的标记的内容与由所述出题部所选择的标记的内容是否一致进行判断；以及
    结果通知部，该结果通知部使显示部显示由所述判定部判断出的结果；以及
    显示部，该显示部用于对由所述出题部所选择的标记、由所述图像转换部生成的所述第二图像、由所述判定部判断出的结果进行显示。
  10. 如权利要求9所述的出题***，其特征在于，
    还包括扬声器，
    所述结果通知部使由所述判定部判断出的结果通过所述扬声器输出。
PCT/CN2022/134244 2022-11-25 2022-11-25 物理物体和计算机相结合的显示***及出题*** WO2024108528A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/134244 WO2024108528A1 (zh) 2022-11-25 2022-11-25 物理物体和计算机相结合的显示***及出题***

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/134244 WO2024108528A1 (zh) 2022-11-25 2022-11-25 物理物体和计算机相结合的显示***及出题***

Publications (1)

Publication Number Publication Date
WO2024108528A1 true WO2024108528A1 (zh) 2024-05-30

Family

ID=91194984

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/134244 WO2024108528A1 (zh) 2022-11-25 2022-11-25 物理物体和计算机相结合的显示***及出题***

Country Status (1)

Country Link
WO (1) WO2024108528A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010026818A (ja) * 2008-07-18 2010-02-04 Geisha Tokyo Entertainment Inc 画像処理プログラム、画像処理装置及び画像処理方法
US20170182412A1 (en) * 2014-02-20 2017-06-29 Sony Interactive Entertainment Inc. Information processing apparatus and information processing method
US20170296913A1 (en) * 2014-10-08 2017-10-19 Sony Corporation Information processing device and information processing method
JP2019148719A (ja) * 2018-02-27 2019-09-05 振名 畢 物理的物体と計算機とを組み合わせた出題システム
US20210125303A1 (en) * 2019-10-23 2021-04-29 Gopro, Inc. Methods and apparatus for hardware accelerated image processing for spherical projections

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010026818A (ja) * 2008-07-18 2010-02-04 Geisha Tokyo Entertainment Inc 画像処理プログラム、画像処理装置及び画像処理方法
US20170182412A1 (en) * 2014-02-20 2017-06-29 Sony Interactive Entertainment Inc. Information processing apparatus and information processing method
US20170296913A1 (en) * 2014-10-08 2017-10-19 Sony Corporation Information processing device and information processing method
JP2019148719A (ja) * 2018-02-27 2019-09-05 振名 畢 物理的物体と計算機とを組み合わせた出題システム
US20210125303A1 (en) * 2019-10-23 2021-04-29 Gopro, Inc. Methods and apparatus for hardware accelerated image processing for spherical projections

Similar Documents

Publication Publication Date Title
TWI434242B (zh) 互動式資訊系統、互動式資訊方法及其電腦程式產品
JP3851907B2 (ja) 画像表示システム及びビデオゲームシステム
KR102292775B1 (ko) 학습 서비스 시스템 및 방법
JP5325311B2 (ja) ゲーム装置、ゲーム装置の制御方法、ならびに、プログラム
KR102521989B1 (ko) 한글 교육용 카드 게임 도구 및 이를 포함한 한글 교육용 카드 게임 서비스 제공 시스템
US10755382B2 (en) System for piecing image Chinese characters into a word and mobile terminal
WO2024108528A1 (zh) 物理物体和计算机相结合的显示***及出题***
TWM407458U (en) Interactive question-and-answer teaching materials which utilize augmented reality technology
JP6795534B2 (ja) 物理的物体と計算機とを組み合わせた出題システム
JP2006318385A (ja) 画像生成システム、プログラムおよび情報記憶媒体
WO2022262389A1 (zh) 交互方法、装置、计算机设备及程序产品、存储介质
JP2018165978A (ja) 授業システム、授業サーバ、授業支援方法、及び授業支援プログラム
JP2005078413A (ja) 電子機器及び電子機器における応答情報出力方法
KR102178894B1 (ko) 매트 및 증강현실을 이용한 학습시스템 및 학습방법
US20160279517A1 (en) Image identification game
JP4746074B2 (ja) 画像処理システム
JP4797055B2 (ja) 認証装置、認証方法、及び、プログラム
JP4436345B2 (ja) 画像表示システム、画像処理システム及びビデオゲームシステム
JP7057520B2 (ja) 情報処理装置、情報処理システム、及びプログラム
KR20190036819A (ko) Ar을 활용한 창업학습 카드게임 교구
JP6733027B1 (ja) コンテンツ制御システム、コンテンツ制御方法、およびコンテンツ制御プログラム
US20230334738A1 (en) Method For Generating And Using Electronic Card Book
TWI700003B (zh) 客製化動態影音場景生成系統
JP2022156996A (ja) 情報処理方法、プログラム、及び情報処理装置
Hernández Chasing Papi: A Study in Virulence and Virtuality