WO2017156949A1 - 透明显示方法和透明显示装置 - Google Patents

透明显示方法和透明显示装置 Download PDF

Info

Publication number
WO2017156949A1
WO2017156949A1 PCT/CN2016/091504 CN2016091504W WO2017156949A1 WO 2017156949 A1 WO2017156949 A1 WO 2017156949A1 CN 2016091504 W CN2016091504 W CN 2016091504W WO 2017156949 A1 WO2017156949 A1 WO 2017156949A1
Authority
WO
WIPO (PCT)
Prior art keywords
display screen
relative
viewer
spatial position
eye
Prior art date
Application number
PCT/CN2016/091504
Other languages
English (en)
French (fr)
Inventor
林涉
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US15/519,894 priority Critical patent/US20180102077A1/en
Publication of WO2017156949A1 publication Critical patent/WO2017156949A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/363—Image reproducers using image projection screens
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10—Beam splitting or combining systems
    • G02B27/14—Beam splitting or combining systems operating by reflection only
    • G02B27/144—Beam splitting or combining systems operating by reflection only using partially transparent surfaces without spectral selectivity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/31—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
    • H04N13/315—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers the parallax barriers being time-variant
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/388—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
    • H04N13/39—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume the picture elements emitting light at places where a pair of light beams intersect in a transparent material
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels

Definitions

  • the present disclosure relates to the field of display technologies, and in particular, to a transparent display method and a transparent display device.
  • a transparent display device can be placed in front of an actual object to enhance expressiveness by displaying an image corresponding to an actual object.
  • the name of the place corresponding to each position of the building model can be displayed, so that the exhibitor can see the architectural model while seeing the transparent display in the building.
  • the name of the place marked on the model greatly enhances the exhibition effect.
  • the transparent display device since the transparent display device has a certain distance from the actual object behind, after the viewer changes his own viewing position, the content displayed on the transparent display device will not match the actual object, for example, the location of the location will be in the architectural model. An offset occurs on the actual display effect.
  • the present disclosure provides a transparent display method and a transparent display device, which can solve the problem that an image displayed by a transparent display device does not match an actual object at the rear after the viewer changes the viewing position.
  • the present disclosure provides a transparent display method, including:
  • the image displayed on the display screen is adjusted according to the projection position.
  • calculating the at least one key point in the display according to a spatial position of the viewer's eye relative to the display screen and a spatial position of the at least one key point relative to the display screen The projected position of the screen relative to the viewer's eye includes:
  • the spatial position of the eye of the viewer on one side of the display screen relative to the display screen is obtained, which specifically includes:
  • An observer on one side of the display screen is photographed by a camera module fixed at a preset position of the display screen to determine a spatial position of a viewer's eye relative to the display screen in the captured image.
  • the spatial position of the object on the other side of the display screen relative to at least one key point of the display screen is obtained, which specifically includes:
  • the adjusting an image displayed on the display screen according to the projection position is specifically:
  • the manner of adjusting the at least one graphic includes at least one of panning, rotating, enlarging, reducing, redrawing, segmenting, deleting, and adding.
  • the present disclosure also provides a transparent display device, including:
  • a first acquiring unit configured to acquire a spatial position of a viewer's eye on a display screen side with respect to the display screen
  • a second acquiring unit configured to acquire a spatial position of at least one key point of the object on the other side of the display screen relative to the display screen;
  • a calculating unit configured to calculate, according to a spatial position of the viewer's eye relative to the display screen and a spatial position of the at least one key point relative to the display screen, the at least one key point is a projected position on the display screen relative to the viewer's eye;
  • an adjusting unit configured to adjust an image displayed on the display screen according to the projection position.
  • the calculating unit specifically includes:
  • mapping module configured to map a spatial position of the viewer's eye relative to the display screen, a spatial position of the at least one key point relative to the display screen, and a face of the display screen to In the same space coordinate system;
  • a calculation module configured to calculate, in the spatial coordinate system, a intersection position of a line between each of the key points and an eye of the viewer and a face of the display screen, respectively, to obtain the At least one projection point;
  • a transformation module configured to change a position of the at least one projection point in the space coordinate system to a position on a face of the display screen as the projection position.
  • the first acquiring unit is specifically configured to:
  • An observer on one side of the display screen is photographed by a camera module fixed at a preset position of the display screen to determine a spatial position of a viewer's eye relative to the display screen in the captured image.
  • the second obtaining unit is specifically configured to:
  • the adjusting unit is specifically configured to:
  • the manner of adjusting the at least one graphic includes at least one of panning, rotating, enlarging, reducing, redrawing, segmenting, deleting, and adding.
  • the present disclosure also provides a transparent display method, including:
  • the first image and the first image do not overlap.
  • the present disclosure is based on the spatial position of the viewer's eye, and can calculate the projection position of each key point on the object on the display surface in combination with the spatial position of the object, so that the projection position can be adjusted according to the projection position.
  • the image displayed on the display screen solves the problem that the image displayed by the transparent display device does not match the actual object behind when the observer changes position.
  • the present disclosure can not only ensure the matching of the display image and the actual object, but also realize various display special effects according to the movement of the human eye, thereby greatly improving the display effect.
  • FIG. 1 is a schematic flow chart of a transparent display method in an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram of a principle of a transparent display method in an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of still another principle of a transparent display method in an embodiment of the present disclosure.
  • FIG. 4 is a schematic diagram of a principle of photographing a transparent display device in a side view according to an embodiment of the present disclosure
  • FIG. 5 is a schematic flow chart of a step of calculating a position of a projection point in an embodiment of the present disclosure
  • FIG. 6 is a structural block diagram of a transparent display device in an embodiment of the present disclosure.
  • FIG. 1 is a schematic flow chart of a transparent display method in an embodiment of the present disclosure.
  • a transparent display method of an embodiment of the present disclosure includes:
  • Step 101 Acquire a spatial position of a viewer's eye on one side of the display screen with respect to the display screen;
  • Step 102 Acquire a spatial position of at least one key point of an object on the other side of the display screen relative to the display screen;
  • Step 103 Calculate the at least one key point on the display screen according to a spatial position of the viewer's eye relative to the display screen and a spatial position of the at least one key point relative to the display screen a projected position on the eye relative to the viewer;
  • Step 104 Adjust an image displayed on the display screen according to the projection position.
  • the steps 101 and 102 in the embodiment of the present disclosure may be performed at the same time, or may be performed sequentially, and are not limited herein.
  • the transparent display method of the embodiment of the present disclosure is applicable to any transparent display device including a display screen, and a viewer located in front of the display screen (corresponding to the “display side”, ie, the positive side) can see the display screen.
  • the image displayed above can also be seen through the display screen behind the display (corresponding to the "other side of the display", that is, the back side).
  • the manner of acquiring the spatial position of the viewer's eye relative to the display screen may be, for example, eye recognition and spatial position measurement of an image taken in front of the display screen, or measuring the viewer's eye.
  • the spatial position of the function of the external device's signal input It can be understood that the spatial position of the viewer's eye refers to the relative position between the viewer and the display screen, which can be represented by three-dimensional coordinates, or by azimuth and distance, and can be in other coordinate systems. Table It may be the spatial position in the center of both eyes or the spatial position of each eye, and there is no limitation here.
  • the process of obtaining the spatial position of the viewer's eye relative to the display screen by recognizing the viewer's eye in the captured image may include a process of recognizing the human eye feature in the captured image, and capturing the image The process of measuring the distance between the human eye and the display screen.
  • An embodiment of the present invention is: capturing an observer in front of the display screen by a camera module fixed at a preset position of the display screen, to determine a viewer's eye in the captured image relative to the The spatial position of the display.
  • the camera module captures the front of the display screen in real time with a predetermined position and viewing angle, and performs face detection according to the facial features in the captured image, and locks the detected face and tracks it.
  • the position of the human eye of the viewer is located according to the characteristics of the structure, shape, and gradation of the human eye, and the pupil parameters of the human eye are estimated.
  • the spatial position of the viewer's eye relative to the display screen is estimated in real time as a reference for adjusting the image displayed on the display screen. .
  • the object on the other side of the display screen may be preset to have a predetermined relative positional relationship with the display screen, so that at least one key point on the object relative to the display screen can be obtained based on the position information of the object acquired in advance.
  • the location of the space may be from a pre-stored database or a digital model of a pre-stored object, such as location information of the object may be stored in the transparent display device together with the distance information in the form of a three-dimensional digital model, thereby For the selected key points, the three-dimensional digital model and distance information can be combined and calculated.
  • the spatial location of at least one of the above-mentioned key points may also be derived from an external input of a third party device (such as a central computer or network server that manages the three-dimensional digital model of the object).
  • a third party device such as a central computer or network server that manages the three-dimensional digital model of the object.
  • the spatial position of at least one key point on the object can also be obtained based on the image processing in a manner similar to determining the spatial position of the human eye, which is not limited in the embodiment of the present disclosure.
  • the projection point of the at least one key point relative to the viewer's eye can be obtained by the operation of the spatial geometry in the same coordinate system.
  • the position on the face of the display the image to be displayed on the display screen can be adaptively adjusted based on the position of the projection point of the at least one key point with respect to the viewer's eye on the face of the display screen. For example, because of the human eye The position of the image of the object seen on the display screen is determined, so that at least one of the images to be displayed can be translated, rotated, enlarged, reduced, redrawn, divided, removed, and added.
  • the determination process of the projection point can have different calculation and formation under the same geometric principle, and the specific manner in which the adjustment can be selected according to the different display effects required by the transparent display device in the specific application scenario, the present disclosure
  • the embodiment does not limit this.
  • the embodiment of the present disclosure calculates the projection point of the visual position of the viewer's eye combined with the spatial position of the object on the surface of the display on the display screen based on the step flow of the above steps 101 to 104. And adjusting the display image according to the position of the projection point can solve the problem that the image displayed by the transparent display device does not match the actual object at the rear after the observer changes the position. Compared with the related art, the embodiment of the present disclosure can not only ensure the matching of the display image and the actual object, but also realize various display special effects according to the movement of the human eye, thereby greatly improving the display effect.
  • FIG. 2 and FIG. 3 are schematic diagrams showing the principle of a transparent display method in one embodiment of the present disclosure.
  • Figures 2 and 3 respectively show images displayed by the viewer at the first viewing position and the second viewing position at the second viewing position.
  • the transparent display device acquires the spatial position of the viewer's eye.
  • the transparent display device acquires the spatial positions of the three key points P1, P2, and P3 on the architectural model; thus, step 103
  • the position of the three key points P1, P2, P3 relative to the eye of the viewer on the face of the display screen is determined in the manner shown by the broken line in the figure, and the three projection points are in accordance with step 104.
  • the position on the face of the display adjusts a dimension graphic and a text box graphic in the image to be displayed.
  • the position pointed by the arrow marking the graphic corresponds to the key point P1 on the building model, that is, the labeling graphic is intended to identify the specific structure or position of the building model; the text box graphic is located at the bottom of the image to be displayed. The corner of the building is intended to illustrate the entire building model.
  • the position pointed by the graphic arrow will be It is separated from the key point P1 on the building model and is misaligned.
  • the text box graphic overlaps with the image of the building model in the human eye, causing visual confusion.
  • the transparent display The display device is based on the position tracking of the projection point corresponding to the key point P1, and the annotation graphic is translated such that the position pointed by the arrow still corresponds to the key point P1 on the architectural model. Therefore, in the eyes of the moving person, the arrow on the surface of the display screen always points to the key point P1 of the building model, and the marking function of the label graphic can be maintained.
  • the transparent display device can also adjust the size of the logo pattern according to the distance of the viewer from the display screen, so that the position of the logo pattern viewed by the human eye in the space is fixed.
  • the transparent display device removes the text box graphic at the lower right corner of the screen, and adds a text box graphic with the same meaning in the lower left corner of the screen, thereby avoiding the text box graphic from the human eye.
  • the manner of adjusting at least one of the images in the above step 104 may include, without limitation, at least one of panning, rotating, enlarging, reducing, redrawing, segmenting, deleting, and adding.
  • the translation of the graphic can realize the tracking of the key points on the object by the planar graphic as exemplified in the above-mentioned annotation graphic; the enlargement and reduction of the graphic can realize the stereoscopic effect of the near and far small as illustrated in the above; the redrawing of the graphic It can be used to display stereoscopic graphics from different perspectives; the removal and addition of graphics can avoid the overlap of objects and displayed graphics at the human eye, as shown in the text box diagram above, and can also achieve different viewing angles and distances.
  • the animation effect of the screen; in addition, the adjustment manners of the above various images may also be combined to form a desired display effect by various combinations, which is not limited in the embodiment of the present disclosure.
  • FIG. 4 is a schematic diagram showing a principle of photographing of a transparent display device in a side view in one embodiment of the present disclosure.
  • the transparent display device includes a display panel 11 and a camera module 12, and the camera module 12 is disposed below the display panel 11, and the position of the camera module 12 is relatively fixed with the display screen, so that the above step 101 is The image captured on the first display side can be obtained by the camera module 12 facing the first display side in the shooting direction.
  • the setting position of the camera module as shown in FIG.
  • the image taken by the first display side can also be obtained and used for the acquisition of the spatial position of the viewer's eye.
  • FIG. 5 is a flow chart showing the steps of calculating the position of the projection point in one embodiment of the present disclosure.
  • the above step 103 according to the spatial position of the viewer's eye relative to the display screen and the at least one The position of the at least one key point on the display screen relative to the eye of the viewer is calculated, which may include:
  • Step 501 Map a spatial position of the viewer's eye relative to the display screen, a spatial position of the at least one key point relative to the display screen, and a face of the display screen to the same space In the coordinate system;
  • Step 502 Calculate, in the spatial coordinate system, respectively, a intersection position of a line between each of the key points and an eye of the viewer and a face of the display screen to obtain the at least one Projection point
  • Step 503 Convert a position of the at least one projection point in the space coordinate system to a position on a face of the display screen as the projection position.
  • the above step 501 may include mapping the spatial positions of the key points P1, P2, and P3 and the spatial position of the eyes of the viewer obtained in step 101 to the face of the display screen.
  • the YZ plane is in the XYZ space rectangular coordinate system.
  • the above step 502 may include respectively calculating an expression of the connection between the key points P1, P2, P3 and the eye of the viewer (three dashed lines as shown in FIG. 2-3) in the above-described XYZ space Cartesian coordinate system.
  • the above step 503 may include changing the position of the three projection points in the X-Y-Z space rectangular coordinate system to the Y-Z coordinate system of the display screen, thereby obtaining the positions of the three projection points on the display screen.
  • the embodiment of the present disclosure can obtain the object about the human eye according to the spatial position of the eye of the viewer, the spatial position of the at least one key point, and the spatial position of the face of the display screen by the calculation of steps 501 to 503.
  • the projection position on the face of the display screen is suitable for calculation programs or circuit structures with calculation functions.
  • FIG. 6 is a structural block diagram of a transparent display device in an embodiment of the present disclosure.
  • the transparent display device of the embodiment of the present disclosure includes:
  • a first acquiring unit 61 configured to acquire a spatial position of a viewer's eye on a display screen side with respect to the display screen;
  • a second acquiring unit 62 configured to acquire a spatial position of at least one key point of the object on the other side of the display screen relative to the display screen;
  • a calculating unit 63 configured to calculate, according to a spatial position of the viewer's eye relative to the display screen and a spatial position of the at least one key point relative to the display screen, the at least one key point is calculated a projected position on the display screen relative to the viewer's eye;
  • the adjusting unit 64 is configured to adjust an image displayed on the display screen according to the projection position.
  • the spatial position of the viewer's eye can be combined with the spatial position of the object to calculate a projection point with each key point on the object on the display screen.
  • adjusting the display image according to the position of the projection point can solve the problem that the image displayed by the transparent display device does not match the actual object at the rear after the observer changes the position.
  • the embodiment of the present disclosure can not only ensure the matching of the display image and the actual object, but also realize various display special effects according to the movement of the human eye, thereby greatly improving the display effect.
  • the calculation unit 63 may specifically include the following structure:
  • mapping module configured to map a spatial position of the viewer's eye relative to the display screen, a spatial position of the at least one key point relative to the display screen, and a face of the display screen to In the same space coordinate system;
  • a calculation module configured to calculate, in the spatial coordinate system, a intersection position of a line between each of the key points and an eye of the viewer and a face of the display screen, respectively, to obtain the At least one projection point;
  • a transformation module configured to change a position of the at least one projection point in the space coordinate system to a position on a face of the display screen as the projection position.
  • the mapping module may be specifically configured to map the spatial positions of the key points P1, P2, and P3 and the spatial positions of the eyes of the viewer obtained by the first acquiring unit 11 to display
  • the plane of the screen is in the XYZ space Cartesian coordinate system of the YZ plane. Therefore, the calculation module may be specifically configured to calculate a connection between the key points P1, P2, P3 and the eye of the viewer (three dashed lines as shown in FIG. 2-3) in the XYZ space rectangular coordinate system.
  • the expression thus calculating the position of the intersection of the three projection points in the XYZ space Cartesian coordinate system by calculating the intersection position with the YZ plane as the plane on which the display screen is located.
  • the above transformation module can be specifically used to transform the position of three projection points in the XYZ space rectangular coordinate system to the YZ coordinate system of the display screen, thereby obtaining three projection points on the display screen. s position.
  • the embodiment of the present disclosure can obtain the object about the human eye according to the spatial position of the viewer's eye, the spatial position of the at least one key point, and the spatial position of the face of the display screen by the calculation of the calculation unit 63.
  • the projection position on the face of the display is suitable for calculation programs or circuit structures with calculation functions.
  • the adjusting unit 64 may be specifically configured to adjust at least one graphic in the current image according to the projection position, and the manner of adjusting the at least one graphic includes: panning, rotating, enlarging, reducing, redrawing, dividing, deleting, and Add at least one of them.
  • the translation of the graphic can realize the tracking of the key points on the object by the planar graphic as exemplified in the above-mentioned annotation graphic; the enlargement and reduction of the graphic can realize the stereoscopic effect of the near and far small as illustrated in the above; the redrawing of the graphic It can be used to display stereoscopic graphics from different perspectives; the removal and addition of graphics can avoid the overlap of objects and displayed graphics at the human eye, as shown in the text box diagram above, and can also achieve different viewing angles and distances.
  • the animation effect of the screen; in addition, the adjustment manners of the above various images may also be combined to form a desired display effect by various combinations, which is not limited in the embodiment of the present disclosure.
  • the first acquiring unit 61 may specifically include a camera module, and the camera module is disposed on a preset fixed relative to the display screen. At the position, the image captured on the first display side is obtained by the camera module facing the first display side.
  • the spatial position of the at least one key point is from a pre-stored database or a digital model of a pre-stored object; or the spatial position of the at least one key point is derived from an external input signal. Reception.
  • the spatial position of at least one key point on the object can also be obtained based on the image processing in a manner similar to determining the spatial position of the human eye, which is not limited in the embodiment of the present disclosure.
  • the functions implemented by the transparent display device of the embodiment of the present disclosure are in one-to-one correspondence with the step flow of the transparent display method shown in FIG. 1 , and may have the structure of any of the above transparent display devices, and no longer Narration.
  • the transparent display device in this embodiment may be any display product, component such as a display panel, an electronic paper, a mobile phone, a tablet computer, a television, a notebook computer, a digital photo frame, a navigator, and the like.
  • orientation or positional relationship of the terms “upper”, “lower” and the like is based on the orientation or positional relationship shown in the drawings, and is merely for the convenience of the description of the disclosure and the simplified description, rather than indicating or implying that the device or component referred to must be
  • the specific orientation and construction of the specific orientation are not to be construed as limiting the disclosure.
  • the terms “mounted,” “connected,” and “connected” are used in a broad sense, and may be, for example, a fixed connection, a detachable connection, or an integral connection; it may be a mechanical connection, It can also be an electrical connection; it can be directly connected, or it can be connected indirectly through an intermediate medium, which can be the internal connection of two components.
  • the specific meanings of the above terms in the present disclosure can be understood by those skilled in the art on a case-by-case basis.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Hardware Design (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种透明显示方法和透明显示装置。透明显示方法包括：获取显示屏一侧的观看者的眼部相对于显示屏的空间位置（101）；获取显示屏另一侧的物体的至少一个关键点相对于显示屏的空间位置（102）；根据观看者的眼部相对于显示屏的空间位置和至少一个关键点相对于显示屏的空间位置，计算得到至少一个关键点在显示屏上相对于观看者的眼部的投影位置（103）；根据投影位置调整显示屏上显示的图像（104）。解决观看者改变位置后透明显示装置所显示的影像会与后方实际物体不匹配的问题。

Description

透明显示方法和透明显示装置
相关申请的交叉引用
本申请主张在2016年3月18日在中国提交的中国专利申请号No.201610159083.8的优先权，其全部内容通过引用包含于此。
技术领域
本公开涉及显示技术领域，具体涉及一种透明显示方法和透明显示装置。
背景技术
相关技术中，透明显示设备可以放置在实际物体的前方，通过显示与实际物体相对应的图像来增强表现力。例如，在建筑模型的展览柜前设置的透明显示屏上，可以显示与建筑模型各位置点相对应的地点名称，使参展者在看到建筑模型的同时还可以看到由透明显示屏在建筑模型上标注出来的地点名称，大大提升展览效果。
然而，由于透明显示设备距离后方的实际物体有一定的距离，所以在观看者改变自身观看位置之后，透明显示设备上显示的内容就会与实际物体不匹配，比如地点的标注位置会在建筑模型上发生偏移，影响实际的展示效果。
发明内容
针对相关技术中的缺陷，本公开提供一种透明显示方法和透明显示装置，可以解决观察者改变观看位置后透明显示设备所显示的影像会与后方实际物体不匹配的问题。
第一方面，本公开提供了一种透明显示方法，包括：
获取显示屏一侧的观看者的眼部相对于所述显示屏的空间位置；
获取显示屏另一侧的物体的至少一个关键点相对于所述显示屏的空间位置；
根据所述观看者的眼部相对于所述显示屏的空间位置和所述至少一个关 键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述观看者的眼部的投影位置；
根据所述投影位置调整所述显示屏上显示的图像。
可选地，根据所述观看者的眼部相对于所述显示屏的空间位置和所述至少一个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述观看者的眼部的投影位置，包括：
将所述观看者的眼部相对于所述显示屏的空间位置、所述至少一个关键点相对于所述显示屏的空间位置，以及所述显示屏的所在面均映射至同一空间坐标系中；
在所述空间坐标系中，分别计算每一所述关键点和所述观看者的眼部之间的连线与所述显示屏的所在面的相交位置，以得到所述至少一个投影点；
将所述至少一个投影点在所述空间坐标系中的位置变换至在所述显示屏的所在面上的位置，作为所述投影位置。
可选地，获取显示屏一侧的观看者的眼部相对于所述显示屏的空间位置，具体包括：
通过固定在所述显示屏的预设位置处的摄像模组对所述显示屏一侧的观测者进行拍摄，以在拍摄图像中确定观看者的眼部相对于所述显示屏的空间位置。
可选地，获取显示屏另一侧的物体相对于所述显示屏的至少一个关键点的空间位置，具体包括：
获取预先存储的至少一个关键点相对于所述显示屏的空间位置；或者，获取第三方设备提供的所述至少一个关键点相对于所述显示屏的空间位置。
可选地，所述根据所述投影位置调整所述显示屏上显示的图像，具体为：
根据所述投影位置调整当前图像中的至少一个图形；
其中，对所述至少一个图形的调整方式包括平移、旋转、放大、缩小、重绘、分割、删除，和添加中的至少之一。
第二方面，本公开还提供了一种透明显示装置，包括：
第一获取单元，用于获取显示屏一侧的观看者的眼部相对于所述显示屏的空间位置；
第二获取单元，用于获取显示屏另一侧的物体的至少一个关键点相对于所述显示屏的空间位置；
计算单元，用于根据所述观看者的眼部相对于所述显示屏的空间位置和所述至少一个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述观看者的眼部的投影位置；
调整单元，用于根据所述投影位置调整所述显示屏上显示的图像。
可选地，所述计算单元具体包括：
映射模块，用于将所述观看者的眼部相对于所述显示屏的空间位置、所述至少一个关键点相对于所述显示屏的空间位置，以及所述显示屏的所在面均映射至同一空间坐标系中；
计算模块，用于在所述空间坐标系中，分别计算每一所述关键点和所述观看者的眼部之间的连线与所述显示屏的所在面的相交位置，以得到所述至少一个投影点；
变换模块，用于将所述至少一个投影点在所述空间坐标系中的位置变换至在所述显示屏的所在面上的位置，作为所述投影位置。
可选地，所述第一获取单元具体用于：
通过固定在所述显示屏的预设位置处的摄像模组对所述显示屏一侧的观测者进行拍摄，以在拍摄图像中确定观看者的眼部相对于所述显示屏的空间位置。
可选地，所述第二获取单元具体用于：
获取预先存储的至少一个关键点相对于所述显示屏的空间位置；或者，获取第三方设备提供的所述至少一个关键点相对于所述显示屏的空间位置。
可选地，所述调整单元具体用于：
根据所述投影位置调整当前图像中的至少一个图形；
其中，对所述至少一个图形的调整方式包括平移、旋转、放大、缩小、重绘、分割、删除，和添加中的至少之一。
本公开还提供了一种透明显示方法，包括：
获取显示屏的第一侧的第一观看者的眼部相对于所述显示屏的第一空间位置以及所述显示屏的第一侧的第二观看者的眼部相对于所述显示屏的第二 空间位置；
获取显示屏另一侧的物体的至少一个关键点相对于所述显示屏的空间位置；
根据第一空间位置和所述至少一个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述第一观看者的眼部的第一投影位置；并根据第二空间位置和所述至少一个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述第二观看者的眼部的第二投影位置；
根据所述第一投影位置调整所述显示屏上针对所述第一观看者显示的第一图像，并根据所述第二投影位置调整所述显示屏上针对所述第二观看者显示的第二图像。
可选地，所述第一图像和所述第一图像不重叠。
由上述技术方案可知，本公开基于观看者的眼部的空间位置，可以结合物体的空间位置计算出与物体上各关键点在显示屏的所在面上的投影位置，从而可以根据投影位置来调整显示屏上显示的图像，解决观察者改变位置后透明显示设备所显示的影像会与后方实际物体不匹配的问题。与相关技术相比，本公开不仅能保障显示图像与实际物体的匹配，还能随人眼的移动实现各种显示特效，大大提升展示效果。
附图说明
为了更清楚地说明本公开实施例或相关技术中的技术方案，下面将对实施例或相关技术描述中所需要使用的附图作一简单的介绍，显而易见地，下面描述中的附图是本公开的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本公开一个实施例中一种透明显示方法流程示意图；
图2是本公开一个实施例中一种透明显示方法的原理示意图；
图3是本公开一个实施例中一种透明显示方法的又一原理示意图；
图4是本公开一个实施例中一种透明显示器件在侧视下的拍摄原理示意图；
图5是本公开一个实施例中一种投影点位置计算的步骤流程示意图；
图6是本公开一个实施例中一种透明显示装置的结构框图。
具体实施方式
为使本公开实施例的目的、技术方案和优点更加清楚，下面将结合本公开实施例中的附图，对本公开实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本公开一部分实施例，而不是全部的实施例。基于本公开中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本公开保护的范围。
图1是本公开一个实施例中一种透明显示方法的流程示意图。参见图1，本公开实施例的透明显示方法包括：
步骤101：获取显示屏一侧的观看者的眼部相对于所述显示屏的空间位置；
步骤102：获取显示屏另一侧的物体的至少一个关键点相对于所述显示屏的空间位置；
步骤103：根据所述观看者的眼部相对于所述显示屏的空间位置和所述至少一个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述观看者的眼部的投影位置；
步骤104：根据所述投影位置调整所述显示屏上显示的图像。
需要说明的而是，本公开实施例中的步骤101与步骤102可以同时执行，也可以先后执行，此处不做限定。而且，本公开实施例的透明显示方法适用于任意一种包括显示屏的透明显示器件，位于显示屏前方(对应于上述“显示屏一侧”，即正侧)的观看者可以看到显示屏上显示的图像，还可以透过显示屏看到位于显示屏后方(对应于上述“显示屏另一侧”，即背侧)的物体。
上述步骤101中，观看者的眼部相对于所述显示屏的空间位置的获取方式可以例如是对显示屏前方拍摄得到的图像的眼部识别和空间位置测定，或是具有测定观看者眼部空间位置的功能的外部设备的信号输入。可以理解的是，观看者的眼部的空间位置指的是其与显示屏之间的相对位置，可以由三维空间坐标表示，也可以由方位角和距离来表示，还可以在其他坐标系下表 示；其可以是双眼中央的空间位置，也可以是双眼各自的空间位置，在此均不做限制。
作为一种示例，通过对拍摄图像中的观看者的眼部的识别得到观看者的眼部相对于显示屏的空间位置的过程可以包括在拍摄图像中识别人眼特征的过程，以及在拍摄图像中测量人眼与显示屏之间的距离的过程。其中一种实施方式为：通过固定在所述显示屏的预设位置处的摄像模组对所述显示屏前方的观测者进行拍摄，以在拍摄图像中确定观看者的眼部相对于所述显示屏的空间位置。
比如，摄像模组以预定的位置和视角实时拍摄显示屏前方，并在拍摄图像中根据人脸特征进行人脸检测，锁定检测到的人脸并对其进行跟踪。在所跟踪的人脸区域中，根据人眼的结构、形状、灰度等特性，定位出观看者的人眼位置，并估计出人眼瞳孔参数。根据定位人眼瞳孔在空间以及图像上的坐标位置和形状结构等特征，实时估计出观看者的眼部相对于所述显示屏的空间位置，以作为调整显示屏上显示的图像的一项基准。
上述步骤102中，预先设置显示屏另一侧的物体可以与显示屏之间具有预先确定的相对位置关系，从而基于预先获取的物体的位置信息，可以得到物体上至少一个关键点相对于显示屏的空间位置。例如，至少一个关键点的空间位置可以来自于预先存储的数据库或者预先存储的物体的数字模型，比如物体的位置信息可以以三维数字模型的形式与距离信息一并存储在透明显示器件中，从而对于所选定的关键点，可以结合三维数字模型与距离信息通过计算得到。再如，上述至少一个关键点的空间位置也可以来源于第三方设备的外部输入(比如管理物体三维数字模型的中央计算机或者网络服务器)。当然，也可以通过与确定人眼的空间位置类似的方式基于图像处理来获取物体上至少一个关键点的空间位置，本公开实施例对此不做限制。
上述步骤103中，基于观看者的眼部的空间位置以及至少一个关键点的空间位置，可以在同一坐标系下通过空间几何的运算得到至少一个关键点相对于观看者的眼部的投影点在显示屏的所在面上的位置。上述步骤104中，基于至少一个关键点相对于观看者的眼部的投影点在显示屏的所在面上的位置，可以将显示屏所要显示的图像进行适应性地调整。举例来说，由于人眼 看到的物体的像在显示屏所在面上的位置已经确定，因而可以将所要显示的图像中的至少一个图形进行平移、旋转、放大、缩小、重绘、分割、去除和添加等操作，以适应于物体的像。可以理解的是，投影点的确定过程可以在同样的几何原理下具有不同的计算形成，而且具体应用场景下可以依照透明显示器件所需要呈现的不同的显示效果来选取调整的具体方式，本公开实施例对此均不做限制。
可以看出，本公开实施例基于上述步骤101至步骤104的步骤流程，将观看者的眼部的空间位置结合物体的空间位置计算出与物体上各关键点在显示屏所在面上的投影点，并根据投影点的位置来调整显示图像，可以解决观察者改变位置后透明显示设备所显示的影像会与后方实际物体不匹配的问题。与相关技术相比，本公开实施例不仅能保障显示图像与实际物体的匹配，还能随人眼的移动实现各种显示特效，大大提升展示效果。
作为一种具体示例，图2和图3是本公开一个实施例中一种透明显示方法的原理示意图。参见图2和图3，图2和图3分别示出了观看者在第一观看位置处和第二观看位置处透明显示器件所显示出来的图像。具体来说，步骤101中透明显示器件获取到了观看者的眼部的空间位置，步骤102中透明显示器件获取到了建筑模型上的三个关键点P1、P2、P3的空间位置；从而，步骤103中由图中虚线示出的方式确定了三个关键点P1、P2、P3相对于观看者的眼部的三个投影点在显示屏所在面上的位置，步骤104中依照三个投影点在显示屏所在面上的位置对所要显示的图像中的一个标注图形和一个文本框图形进行了调整。
可以看出的是，标注图形的箭头所指向的位置对应于建筑模型上的关键点P1，即标注图形意在对建筑模型的特定结构或位置进行标识；文本框图形位于所要显示的图像的底部的一角，即意在对整个建筑模型进行说明。然而可以理解的是，如果观看者从第一观看位置移动至第二观看位置，而透明显示器件按照相关技术的方式仍显示如图2所示的画面，那么显然标注图形箭头所指向的位置会与建筑模型上的关键点P1相互分离而错位，同时文本框图形还会与建筑模型的像在人眼中交叠，引起视觉效果上的错乱。
然而在本公开实施例中，在第一观看位置与第二观看位置之间，透明显 示器件基于对关键点P1所对应的投影点的位置追踪，将标注图形进行了平移，使得其箭头指向的位置仍对应于建筑模型上的关键点P1。从而在移动中的人眼看来，显示屏所在面上标识图形的箭头始终指向建筑模型的关键点P1，可以保持标注图形的标识作用。在此基础之上，透明显示器件还可以依照观看者距离显示屏的远近调整标识图形的大小，使人眼观看到的标识图形在空间中的位置固定。而对于文本框图形而言，透明显示器件将画面右下角处的文本框图形去除，并在画面左下角处添加了具有同样表示含义的文本框图形，由此避免了文本框图形在人眼看来与建筑模型交叠的情况。
此外，上述步骤104中对图像中的至少一个图形进行调整的方式可以包括而不限于平移、旋转、放大、缩小、重绘、分割、删除，和添加中的至少之一。其中，图形的平移可以如上述标注图形所示例的那样实现平面图形对物体上关键点的追踪；图形的放大和缩小可以如上文所示例的那样实现近大远小的立体效果；图形的重绘可以用于展示不同视角下的立体图形；图形的去除和添加除了可以如上述文本框图形所示例的那样避免物体与所显示图形在人眼处的交叠，还可以实现不同视角和距离下不同画面的动画效果；此外，上述各种图像的调整方式还可以通过各种组合以形成所需要的显示效果，本公开实施例对此不做限制。
作为一种获取在显示屏一侧的观看者的眼部相对于显示屏的空间位置的示例，图4是本公开一个实施例中一种透明显示器件在侧视下的拍摄原理示意图。如图所示，透明显示器件包括显示面板11和摄像模组12，摄像模组12设置在显示面板11的下方，且摄像模组12的设置位置与上述显示屏相对固定，从而上述步骤101中在第一显示侧拍摄得到的图像可以由拍摄方向朝向第一显示侧的摄像模组12得到。然而可以理解的是，如图4所示的摄像模组的设置位置仅是一种示例，其除了可以设置在显示面板11下方之外，还可以设置在任何一个与显示屏相对固定的预设位置处，而同样可以得到第一显示侧拍摄得到的图像并用于观看者的眼部的空间位置的获取。
作为一种计算上述显示屏的所在面上的投影点位置的示例，图5是本公开一个实施例中一种投影点位置计算的步骤流程示意图。参见图5，上述步骤103：根据所述观看者的眼部相对于所述显示屏的空间位置和所述至少一 个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述观看者的眼部的投影位置，可以具体包括：
步骤501：将所述观看者的眼部相对于所述显示屏的空间位置、所述至少一个关键点相对于所述显示屏的空间位置，以及所述显示屏的所在面均映射至同一空间坐标系中；
步骤502：在所述空间坐标系中，分别计算每一所述关键点和所述观看者的眼部之间的连线与所述显示屏的所在面的相交位置，以得到所述至少一个投影点；
步骤503：将所述至少一个投影点在所述空间坐标系中的位置变换至在所述显示屏的所在面上的位置，作为所述投影位置。
举例来说，参见图2和图3，上述步骤501可以包括将关键点P1、P2、P3的空间位置和步骤101得到的观看者的眼部的空间位置均映射到以显示屏的所在面为Y-Z平面的X-Y-Z空间直角坐标系下。从而，上述步骤502可以包括在上述X-Y-Z空间直角坐标系下分别计算关键点P1、P2、P3和观看者的眼部之间的连线(如图2-3所示的三条虚线)的表达式，从而通过计算其与作为显示屏所在面的Y-Z平面的相交位置，得到三个投影点在X-Y-Z空间直角坐标系下的位置。基于此，上述步骤503可以包括将三个投影点在X-Y-Z空间直角坐标系下的位置变换到显示屏所在面的Y-Z坐标系下，从而得到三个投影点在显示屏所在面上的位置。
可以看出的是，本公开实施例可以通过步骤501至步骤503的计算根据观看者的眼部的空间位置、至少一个关键点的空间位置，以及显示屏所在面的空间位置得到物体关于人眼在显示屏所在面上的投影位置，适于计算程序或具有计算功能的电路结构实现。
基于同样的发明构思，图6是本公开一个实施例中一种透明显示装置的结构框图。参见图6，本公开实施例的透明显示装置包括：
第一获取单元61，用于获取显示屏一侧的观看者的眼部相对于所述显示屏的空间位置；
第二获取单元62，用于获取显示屏另一侧的物体的至少一个关键点相对于所述显示屏的空间位置；
计算单元63，用于根据所述观看者的眼部相对于所述显示屏的空间位置和所述至少一个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述观看者的眼部的投影位置；
调整单元64，用于根据所述投影位置调整所述显示屏上显示的图像。
可以看出，本公开实施例基于图6所示出的结构，可以将观看者的眼部的空间位置结合物体的空间位置计算出与物体上各关键点在显示屏所在面上的投影点，并根据投影点的位置来调整显示图像，可以解决观察者改变位置后透明显示设备所显示的影像会与后方实际物体不匹配的问题。与相关技术相比，本公开实施例不仅能保障显示图像与实际物体的匹配，还能随人眼的移动实现各种显示特效，大大提升展示效果。
作为一种计算上述显示屏的所在面上的投影点位置的示例，上述计算单元63可以具体包括下述结构：
映射模块，用于将所述观看者的眼部相对于所述显示屏的空间位置、所述至少一个关键点相对于所述显示屏的空间位置，以及所述显示屏的所在面均映射至同一空间坐标系中；
计算模块，用于在所述空间坐标系中，分别计算每一所述关键点和所述观看者的眼部之间的连线与所述显示屏的所在面的相交位置，以得到所述至少一个投影点；
变换模块，用于将所述至少一个投影点在所述空间坐标系中的位置变换至在所述显示屏的所在面上的位置，作为所述投影位置。
举例来说，参见图2和图3，上述映射模块可以具体用于将关键点P1、P2、P3的空间位置和第一获取单元11得到的观看者的眼部的空间位置均映射到以显示屏的所在面为Y-Z平面的X-Y-Z空间直角坐标系下。从而，上述计算模块可以具体用于在上述X-Y-Z空间直角坐标系下分别计算关键点P1、P2、P3和观看者的眼部之间的连线(如图2-3所示的三条虚线)的表达式，从而通过计算其与作为显示屏的所在面的Y-Z平面的相交位置，得到三个投影点在X-Y-Z空间直角坐标系下的位置。基于此，上述变换模块可以具体用于将三个投影点在X-Y-Z空间直角坐标系下的位置变换到显示屏的所在面的Y-Z坐标系下，从而得到三个投影点在显示屏的所在面上的位置。
可以看出的是，本公开实施例可以通过计算单元63的计算根据观看者的眼部的空间位置、至少一个关键点的空间位置，以及显示屏的所在面的空间位置得到物体关于人眼在显示屏的所在面上的投影位置，适于计算程序或具有计算功能的电路结构实现。
此外，上述调整单元64可以具体用于根据所述投影位置调整当前图像中的至少一个图形，对所述至少一个图形的调整方式包括平移、旋转、放大、缩小、重绘、分割、删除，和添加中的至少之一。其中，图形的平移可以如上述标注图形所示例的那样实现平面图形对物体上关键点的追踪；图形的放大和缩小可以如上文所示例的那样实现近大远小的立体效果；图形的重绘可以用于展示不同视角下的立体图形；图形的去除和添加除了可以如上述文本框图形所示例的那样避免物体与所显示图形在人眼处的交叠，还可以实现不同视角和距离下不同画面的动画效果；此外，上述各种图像的调整方式还可以通过各种组合以形成所需要的显示效果，本公开实施例对此不做限制。
作为一种获取在第一显示侧拍摄得到的图像的方式示例，如图4所示，上述第一获取单元61可以具体包括摄像模组，该摄像模组设置在与显示屏相对固定的预设位置处，而上述在第一显示侧拍摄得到的图像由朝向第一显示侧的摄像模组得到。此外，对于上述第二获取单元62来说，上述至少一个关键点的空间位置来自于预先存储的数据库或者预先存储的物体的数字模型；或者，至少一个关键点的空间位置来源于对外部输入信号的接收。当然，也可以通过与确定人眼的空间位置类似的方式基于图像处理来获取物体上至少一个关键点的空间位置，本公开实施例对此不做限制。
可以理解的是，本公开实施例的透明显示装置所实现的功能与图1所示的透明显示方法的步骤流程一一对应，并可以具有上述任意一种透明显示器件的结构，在此不再赘述。需要说明的是，本实施例中的透明显示装置可以为：显示面板、电子纸、手机、平板电脑、电视机、笔记本电脑、数码相框、导航仪等任何具有显示功能的产品或部件。
需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、 “包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。术语“上”、“下”等指示的方位或位置关系为基于附图所示的方位或位置关系，仅是为了便于描述本公开和简化描述，而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作，因此不能理解为对本公开的限制。除非另有明确的规定和限定，术语“安装”、“相连”、“连接”应做广义理解，例如，可以是固定连接，也可以是可拆卸连接，或一体地连接；可以是机械连接，也可以是电连接；可以是直接相连，也可以通过中间媒介间接相连，可以是两个元件内部的连通。对于本领域的普通技术人员而言，可以根据具体情况理解上述术语在本公开中的具体含义。
本公开的说明书中，说明了大量具体细节。然而能够理解的是，本公开的实施例可以在没有这些具体细节的情况下实践。在一些实例中，并未详细示出公知的方法、结构和技术，以便不模糊对本说明书的理解。类似地，应当理解，为了精简本公开公开并帮助理解各个发明方面中的一个或多个，在上面对本公开的示例性实施例的描述中，本公开的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。
最后应说明的是：以上各实施例仅用以说明本公开的技术方案，而非对其限制；尽管参照前述各实施例对本公开进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本公开各实施例技术方案的范围，其均应涵盖在本公开的说明书的范围当中。

Claims (12)

  1. 一种透明显示方法，包括：
    获取显示屏一侧的观看者的眼部相对于所述显示屏的空间位置；
    获取显示屏另一侧的物体的至少一个关键点相对于所述显示屏的空间位置；
    根据所述观看者的眼部相对于所述显示屏的空间位置和所述至少一个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述观看者的眼部的投影位置；
    根据所述投影位置调整所述显示屏上显示的图像。
  2. 根据权利要求1所述的透明显示方法，其中，根据所述观看者的眼部相对于所述显示屏的空间位置和所述至少一个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述观看者的眼部的投影位置，包括：
    将所述观看者的眼部相对于所述显示屏的空间位置、所述至少一个关键点相对于所述显示屏的空间位置，以及所述显示屏的所在面均映射至同一空间坐标系中；
    在所述空间坐标系中，分别计算每一所述关键点和所述观看者的眼部之间的连线与所述显示屏的所在面的相交位置，以得到所述至少一个投影点；
    将所述至少一个投影点在所述空间坐标系中的位置变换至在所述显示屏的所在面上的位置，作为所述投影位置。
  3. 根据权利要求1所述的透明显示方法，其中，获取显示屏一侧的观看者的眼部相对于所述显示屏的空间位置，具体包括：
    通过固定在所述显示屏的预设位置处的摄像模组对所述显示屏一侧的观测者进行拍摄，以在拍摄图像中确定观看者的眼部相对于所述显示屏的空间位置。
  4. 根据权利要求1所述的透明显示方法，其中，获取显示屏另一侧的物体相对于所述显示屏的至少一个关键点的空间位置，具体包括：
    获取预先存储的至少一个关键点相对于所述显示屏的空间位置；或者， 获取第三方设备提供的所述至少一个关键点相对于所述显示屏的空间位置。
  5. 根据权利要求1至4中任意一项所述的透明显示方法，其中，所述根据所述投影位置调整所述显示屏上显示的图像，具体为：
    根据所述投影位置调整当前图像中的至少一个图形；
    其中，对所述至少一个图形的调整方式包括平移、旋转、放大、缩小、重绘、分割、删除，和添加中的至少之一。
  6. 一种透明显示装置，包括：
    第一获取单元，用于获取显示屏一侧的观看者的眼部相对于所述显示屏的空间位置；
    第二获取单元，用于获取显示屏另一侧的物体的至少一个关键点相对于所述显示屏的空间位置；
    计算单元，用于根据所述观看者的眼部相对于所述显示屏的空间位置和所述至少一个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述观看者的眼部的投影位置；
    调整单元，用于根据所述投影位置调整所述显示屏上显示的图像。
  7. 根据权利要求6所述的透明显示装置，其中，所述计算单元具体包括：
    映射模块，用于将所述观看者的眼部相对于所述显示屏的空间位置、所述至少一个关键点相对于所述显示屏的空间位置，以及所述显示屏的所在面均映射至同一空间坐标系中；
    计算模块，用于在所述空间坐标系中，分别计算每一所述关键点和所述观看者的眼部之间的连线与所述显示屏的所在面的相交位置，以得到所述至少一个投影点；
    变换模块，用于将所述至少一个投影点在所述空间坐标系中的位置变换至在所述显示屏的所在面上的位置，作为所述投影位置。
  8. 根据权利要求6所述的透明显示装置，其中，所述第一获取单元具体用于：
    通过固定在所述显示屏的预设位置处的摄像模组对所述显示屏一侧的观测者进行拍摄，以在拍摄图像中确定观看者的眼部相对于所述显示屏的空间位置。
  9. 根据权利要求6所述的透明显示装置，其中，所述第二获取单元具体用于：
    获取预先存储的至少一个关键点相对于所述显示屏的空间位置；或者，获取第三方设备提供的所述至少一个关键点相对于所述显示屏的空间位置。
  10. 根据权利要求6至9中任意一项所述的透明显示装置，其中，所述调整单元具体用于：
    根据所述投影位置调整当前图像中的至少一个图形；
    其中，对所述至少一个图形的调整方式包括平移、旋转、放大、缩小、重绘、分割、删除，和添加中的至少之一。
  11. 一种透明显示方法，包括：
    获取显示屏的第一侧的第一观看者的眼部相对于所述显示屏的第一空间位置以及所述显示屏的第一侧的第二观看者的眼部相对于所述显示屏的第二空间位置；
    获取显示屏另一侧的物体的至少一个关键点相对于所述显示屏的空间位置；
    根据第一空间位置和所述至少一个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述第一观看者的眼部的第一投影位置；并根据第二空间位置和所述至少一个关键点相对于所述显示屏的空间位置，计算得到所述至少一个关键点在所述显示屏上相对于所述第二观看者的眼部的第二投影位置；
    根据所述第一投影位置调整所述显示屏上针对所述第一观看者显示的第一图像，并根据所述第二投影位置调整所述显示屏上针对所述第二观看者显示的第二图像。
  12. 根据权利要求11所述的透明显示方法，其中，所述第一图像和所述第一图像不重叠。
PCT/CN2016/091504 2016-03-18 2016-07-25 透明显示方法和透明显示装置 WO2017156949A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/519,894 US20180102077A1 (en) 2016-03-18 2016-07-25 Transparent display method and transparent display device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610159083.8A CN105719586A (zh) 2016-03-18 2016-03-18 透明显示方法和透明显示装置
CN201610159083.8 2016-03-18

Publications (1)

Publication Number Publication Date
WO2017156949A1 true WO2017156949A1 (zh) 2017-09-21

Family

ID=56158779

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/091504 WO2017156949A1 (zh) 2016-03-18 2016-07-25 透明显示方法和透明显示装置

Country Status (3)

Country Link
US (1) US20180102077A1 (zh)
CN (1) CN105719586A (zh)
WO (1) WO2017156949A1 (zh)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105719586A (zh) * 2016-03-18 2016-06-29 京东方科技集团股份有限公司 透明显示方法和透明显示装置
US11134181B2 (en) * 2017-01-03 2021-09-28 Gopro, Inc. Remote image capture and mounting ecosystem
CN107392162B (zh) * 2017-07-27 2020-08-21 京东方科技集团股份有限公司 危险人物识别方法及装置
CN107300900A (zh) * 2017-08-01 2017-10-27 上海上实龙创智慧能源科技股份有限公司 基于knx技术的触控屏智慧楼宇展示柜的控制***
CN108021300A (zh) * 2018-01-18 2018-05-11 京东方科技集团股份有限公司 一种画面显示方法及画面显示装置
TWI636381B (zh) * 2017-10-19 2018-09-21 財團法人工業技術研究院 互動顯示系統及互動顯示控制方法
CN112748796B (zh) * 2019-10-30 2024-02-20 京东方科技集团股份有限公司 显示方法及显示装置
TWI767232B (zh) * 2020-05-20 2022-06-11 財團法人工業技術研究院 透明顯示系統、視差校正方法與圖像輸出方法
TWI766316B (zh) 2020-07-22 2022-06-01 財團法人工業技術研究院 可透光顯示系統及其圖像輸出方法與處理裝置
CN113625872A (zh) * 2021-07-30 2021-11-09 深圳盈天下视觉科技有限公司 一种展示方法、***、终端及存储介质
JP2024000858A (ja) * 2022-06-21 2024-01-09 株式会社ジャパンディスプレイ 電子機器

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2447757A1 (en) * 2010-10-26 2012-05-02 BAE Systems PLC Display assembly, in particular a head-mounted display
CN102908783A (zh) * 2012-08-20 2013-02-06 友达光电股份有限公司 娱乐显示***及其互动式立体显示方法
US20140063052A1 (en) * 2012-08-29 2014-03-06 Samsung Display Co., Ltd. Transparent display apparatus and method of driving the same
CN103985334A (zh) * 2014-05-04 2014-08-13 京东方科技集团股份有限公司 透明显示***以及设置有该透明显示***的设备
CN104054027A (zh) * 2012-01-20 2014-09-17 微软公司 用于移动设备的透明显示器
CN104272371A (zh) * 2012-04-08 2015-01-07 三星电子株式会社 透明显示设备及其方法
CN105719586A (zh) * 2016-03-18 2016-06-29 京东方科技集团股份有限公司 透明显示方法和透明显示装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4725595B2 (ja) * 2008-04-24 2011-07-13 ソニー株式会社 映像処理装置、映像処理方法、プログラム及び記録媒体
KR101699922B1 (ko) * 2010-08-12 2017-01-25 삼성전자주식회사 하이브리드 사용자 추적 센서를 이용한 디스플레이 시스템 및 방법
KR102051656B1 (ko) * 2013-01-22 2019-12-03 삼성전자주식회사 투명 디스플레이 장치 및 그 디스플레이 방법
CN104581350A (zh) * 2015-02-04 2015-04-29 京东方科技集团股份有限公司 一种显示方法和显示装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2447757A1 (en) * 2010-10-26 2012-05-02 BAE Systems PLC Display assembly, in particular a head-mounted display
CN104054027A (zh) * 2012-01-20 2014-09-17 微软公司 用于移动设备的透明显示器
CN104272371A (zh) * 2012-04-08 2015-01-07 三星电子株式会社 透明显示设备及其方法
CN102908783A (zh) * 2012-08-20 2013-02-06 友达光电股份有限公司 娱乐显示***及其互动式立体显示方法
US20140063052A1 (en) * 2012-08-29 2014-03-06 Samsung Display Co., Ltd. Transparent display apparatus and method of driving the same
CN103985334A (zh) * 2014-05-04 2014-08-13 京东方科技集团股份有限公司 透明显示***以及设置有该透明显示***的设备
CN105719586A (zh) * 2016-03-18 2016-06-29 京东方科技集团股份有限公司 透明显示方法和透明显示装置

Also Published As

Publication number Publication date
CN105719586A (zh) 2016-06-29
US20180102077A1 (en) 2018-04-12

Similar Documents

Publication Publication Date Title
WO2017156949A1 (zh) 透明显示方法和透明显示装置
US11393173B2 (en) Mobile augmented reality system
EP3864491B1 (en) Method for hmd camera calibration using synchronised image rendered on external display
US8970690B2 (en) Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
EP2160714B1 (en) Augmenting images for panoramic display
WO2020076396A1 (en) Real-world anchor in a virtual-reality environment
US10606347B1 (en) Parallax viewer system calibration
JP4253567B2 (ja) データオーサリング処理装置
WO2019043568A1 (en) ASSISTED ENHANCED REALITY
US11012616B2 (en) Image processing system for augmented reality and method thereof
US9749612B2 (en) Display device and display method for three dimensional displaying
TWI603225B (zh) 液晶顯示器顯示視角的調整方法和裝置
CN111179407A (zh) 虚拟场景的创建方法、投影方法及***、智能设备
Andersen et al. A hand-held, self-contained simulated transparent display
JP6168597B2 (ja) 情報端末装置
TW202001805A (zh) 影像處理系統及影像處理方法
US20230005213A1 (en) Imaging apparatus, imaging method, and program
TWI792106B (zh) 資訊顯示方法及其處理裝置與顯示系統
TWI469066B (zh) 商品型錄展示系統及方法
CN114723923B (zh) 一种传动解决方案模拟展示***和方法
CN112419508B (zh) 基于大范围空间精准定位实现混合现实的方法
WO2017101420A1 (zh) 基于全景视频的区域识别方法及设备
CN108731644A (zh) 基于铅直辅助线的倾斜摄影测图方法及其***
JP2013222190A (ja) カメラと顔認識システムで画面へ立体を表現する方法

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 15519894

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16894110

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 16894110

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 17/05/2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16894110

Country of ref document: EP

Kind code of ref document: A1