WO2015165181A1 - 控制可穿戴设备投影的方法及装置、可穿戴设备 - Google Patents

控制可穿戴设备投影的方法及装置、可穿戴设备 Download PDF

Info

Publication number
WO2015165181A1
WO2015165181A1 PCT/CN2014/085210 CN2014085210W WO2015165181A1 WO 2015165181 A1 WO2015165181 A1 WO 2015165181A1 CN 2014085210 W CN2014085210 W CN 2014085210W WO 2015165181 A1 WO2015165181 A1 WO 2015165181A1
Authority
WO
WIPO (PCT)
Prior art keywords
projection
screen
component
plane
projected
Prior art date
Application number
PCT/CN2014/085210
Other languages
English (en)
French (fr)
Inventor
赵星星
陈炎顺
许秋实
李耀辉
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US14/437,112 priority Critical patent/US9872002B2/en
Priority to KR1020157013331A priority patent/KR101669780B1/ko
Priority to JP2017508721A priority patent/JP2017520026A/ja
Priority to EP14853154.4A priority patent/EP3139599B1/en
Publication of WO2015165181A1 publication Critical patent/WO2015165181A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3185—Geometric adjustment, e.g. keystone or convergence
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141—Constructional details thereof
    • H04N9/315—Modulator illumination systems
    • H04N9/3155—Modulator illumination systems for controlling the light source
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141—Constructional details thereof
    • H04N9/317—Convergence or focusing systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141—Constructional details thereof
    • H04N9/3173—Constructional details thereof wherein the projection device is specially adapted for enhanced portability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141—Constructional details thereof
    • H04N9/3173—Constructional details thereof wherein the projection device is specially adapted for enhanced portability
    • H04N9/3176—Constructional details thereof wherein the projection device is specially adapted for enhanced portability wherein the projection device is incorporated in a camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3188—Scale or resolution adjustment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures

Definitions

  • Embodiments of the present invention relate to a method and apparatus for controlling projection of a wearable device, and a wearable device. Background technique
  • wearable electronic devices With the rapid development of electronic technology, various wearable electronic devices are becoming more and more versatile, and are becoming more and more user-friendly, so that users have a better experience in using wearable electronic devices.
  • smart wearable electronic devices also known as wearable devices
  • Providing a projection member on these wearable devices allows the wearable device to have a projection display function.
  • the projection display is performed by the wearable device
  • the human body since the human body inevitably performs some posture adjustment, the relative positional movement between the projection member of the wearable device and the object as the projection screen is caused.
  • the object as the projection screen is also the surface of an organ (for example, a palm) of the human body, there is a possibility that the surface of the organ may be deformed or the like, so that the projection image projected by the projection member of the wearable device is an object as a projection screen. The screen is not displayed properly on the surface.
  • At least one embodiment of the present invention provides a method and apparatus for controlling projection of a wearable device, and a wearable device such that a projected image projected by a projection member provided on the wearable device can perform normal projection display on the palm.
  • At least one embodiment of the present invention provides a method for controlling projection of a wearable device, wherein the wearable device is provided with a projection component, comprising: obtaining, by using a 3D collection device disposed on the wearable device, as a projection screen a 3D shape distribution of the object; determining a vertex coordinate of the projection area on the object as the projection screen according to the 3D shape distribution of the object as the projection screen obtained by the collection; determining according to the determined vertex coordinates a projection plane; an angle between the projection plane and a center line of a projection field of view of the projection member, a distance between a geometric center of the projection plane and the projection member, and the object as a projection screen 3D shape Distribution, projection control.
  • At least one embodiment of the present invention further provides an apparatus for controlling projection of a wearable device, wherein the wearable device is provided with a projection component, including: a collection module, configured to pass a 3D collection set on the wearable device The device is configured to obtain a 3D shape distribution of the object as the projection screen; the determining module is configured to determine, according to the 3D shape distribution of the object as the projection screen obtained by the collection module, on the object as the projection screen a vertex coordinate of the projection area, and determining a projection plane according to the determined vertex coordinate; a control module, configured to: according to an angle between a projection center angle of the projection component and a projection plane determined by the determining module, a distance between the geometric center of the projection plane and the projection member, and a 3D shape distribution of the object as a projection screen, and performing projection control such that the projection image projected by the projection member is on the object as a projection screen A clear and stable projection display is achieved in the upper projection area.
  • a projection component including: a collection module,
  • At least one embodiment of the present invention provides a wearable device comprising a projection component and any of the above-described devices for controlling projection of the wearable device.
  • FIG. 1 is a flowchart of a method for controlling projection of a wearable device according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of an angle and a distance between a smart ring and a palm according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a size of a projected projection screen of a smart ring according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of a device for controlling projection of a wearable device according to another embodiment of the present invention. detailed description
  • FIG. 1 is a flowchart of an implementation of a method for controlling projection of a wearable device according to an embodiment of the present invention, including:
  • a 3D shape distribution of an object as a projection screen is obtained by collecting a 3D (three-dimensional) collection device set on the wearable device.
  • the 3D collection device disposed on the wearable device may be a structured light 3D scanner, a binocular camera, and a time offlight (TOF).
  • the 3D collection device can collect the coordinates of all the points on the surface of the object as the projection screen in the three-dimensional coordinate system with the 3D collection device as the coordinate origin, and further determine that the object as the projection screen is in the 3D collection device.
  • the position coordinate of the three-dimensional coordinate system established by using the 3D collection device as the coordinate origin, thereby determining the degree of deformation of the object as the projection screen, and the relative displacement of the projection component on the wearable device The angle change and position change of the object of the projection screen.
  • S102 Determine a vertex coordinate of a projection area located on the object as the projection screen according to the 3D shape distribution obtained as the projection screen obtained by the collection.
  • the shape of the projection area on the object as the projection screen can be set according to actual conditions, for example, a circle, a rectangle, or the like. Depending on the shape of the projection area, a different number of vertex coordinates can be determined. For example, in at least one embodiment of the invention, in order to accommodate most projection devices, the shape of the projection area is, for example, a rectangular shape, in which case four of the rectangular areas can be selected. The vertices, which make the determined four vertices sequentially connected to form a graph that approximates a rectangle. The following will be described by taking as an example a case where four vertex coordinates are determined to form a rectangular projection area, but the present invention is not limited thereto.
  • the object as the projection screen may be various projection media capable of projection display, for example, a palm may be used as the projection medium.
  • the palm is relatively small compared to a typical projection screen.
  • the projection area determined on the palm is the maximum projection area that can be on the palm, so the corresponding four vertices at this time may be two edge points of the palm close to the wrist, and the palm is close to the little finger position.
  • the edge points and the palm are close to the edge points at the position of the index finger, and the four edge points are connected to be approximately rectangular.
  • the deformed projection screen may cause the determined vertices not to be in the same plane, and a projection is determined according to the determined vertex coordinates.
  • Plane the projection plane is used as the plane on which the object of the projection screen is located, and projection control is performed.
  • a plane closest to the determined vertex is selected as the projection plane, and the closest projection plane can be determined as follows: The plane whose distance sum between the coordinates is the smallest is determined as the projection plane.
  • S104 an angle between a projection plane and a center line of a projection angle of view of a projection component of the wearable device, a distance between a geometric center of the projection plane and a projection component of the wearable device, and a 3D shape distribution of the object as the projection screen Projection control is performed to enable a projection screen projected by the projection unit of the wearable device to achieve a clear and stable projection display in a projection area on an object as a projection screen.
  • the shape of the projected image projected by the projection member can be adjusted according to the angle between the projection plane and the center line of the projection field of view of the projection member, so that the projection image projected onto the object as the projection screen can be projected.
  • the shape of the projection area on the object as the projection screen can be adjusted.
  • Adjusting the size of the projected image projected by the projection member according to the distance between the geometric center of the projection plane and the projection member, so that the projection image projected onto the object as the projection screen is adapted to the size of the projection area on the object as the projection screen .
  • the display brightness of the projected picture projected in the projection area on the object as the projection screen is corrected in accordance with the 3D shape distribution of the object as the projection screen.
  • the center of the projection field of view is the center line of the apex angle formed by the projection member connected to the four end points of the rectangle; if the projection field of view is circular, then the field of view angle is projected
  • the centerline is the centerline of the taper angle formed by the projection member being joined to the circle.
  • the shape and size of the graphic are adjusted by the angle change and the distance change, and the display brightness of the projected picture is adjusted by the 3D shape distribution of the object as the projection screen, so that the wearable device can be more accurately
  • the relative positional change between the projection member and the object as the projection screen and the screen display caused by the deformation of the object as the projection screen are not properly adjusted.
  • the shape of the projected image projected by the projection member is adjusted according to an angle between the projection plane and the center line of the projection field of view of the projection member, and the following manner can be adopted: according to the projection plane and the projection member An angle between the center line of the film and television field, determining a correction angle for trapezoidal correction of the projection picture projected by the projection member; and the projection unit according to the determined correction angle
  • the projected projection screen is trapezoidally corrected, making it easier to adjust the shape of the screen.
  • adjusting the size of the projected image projected by the projection member according to the distance between the geometric center of the projection plane and the projection member can be determined as follows: According to the formula - G* 1 ⁇ 2 ), The compression ratio at which the projected image projected by the projection member is compressed.
  • the compression ratio for compressing the projected image projected by the projection component -1 is the size of the object as the projection screen, and -0 is the size of the preset projection screen, which is the geometric center and center of the projection plane.
  • the distance between the projected parts, ⁇ The distance between the geometric center of the projection plane corresponding to the projection component when the projection area size is equal to the projection screen size.
  • the size of the projected picture can be adaptively adjusted so that the projected picture can be completely projected into the projected area on the object as the projection screen.
  • the display brightness of the projected picture projected in the projection area on the object as the projection screen is corrected according to the 3D shape distribution of the object as the projection screen, and the following manner can be used: ⁇ ) determining the display brightness of the projected picture in the projection area on the object as the projection screen; correcting the display brightness of the projected picture projected in the projection area on the object as the projection screen according to the determined display brightness; , -.
  • ⁇ ⁇ is the corresponding coordinate point in the projection area on the object as the projection screen ( ⁇ , the display brightness of the projected image at the position, J" ( x , is the projection brightness to the coordinate point ( ⁇ , the display screen at the position, i ⁇ ' 2 ) represents the integral of the three-dimensional coordinate point of the corresponding coordinate point ( x , ) in the projection area on the object as the projection screen in the 3D shape distribution of the object as the projection screen.
  • the non-planar deformation of the object as the projection screen is converted to a plane by an integral operation, and the degree of deformation of the projection screen is determined by the integral operation, and the deformation of the object as the projection screen can be accurately determined.
  • the brightness is adjusted to the extent.
  • a method for controlling projection of a wearable device is a 3D shape distribution of the object as a projection screen collected by the 3D collection device on the wear device, determining a vertex coordinate of the projection area located on the object as the projection screen, and determining a projection plane according to the determined vertex coordinates of the projection area, Projection control is performed by projecting the angle between the projection plane and the center line of the projection field of view of the projection member, the distance between the geometric center of the projection plane and the projection member, and the 3D shape distribution of the object as the projection screen The projected image is projected and displayed in the projection area of the palm.
  • the relative position between the projection member of the wearable device and the object as the projection screen changes or the object as the projection screen is deformed, the corresponding change can be reflected in the angle and the distance.
  • the change of the 3D shape of the object as the projection screen, and the adjustment control of the projection screen so that the projection image projected by the projection component on the wearable device can perform clear and stable normal projection on the surface of the object as the projection screen display.
  • the wearable device is a smart ring
  • the object as a projection screen is an example of a palm, which is not limited thereto.
  • the wearable device may also be a wearable device having a projection display function such as a smart bracelet, a smart watch, or smart glasses
  • the object as a projection screen may be various objects such as a wall, a table, and an arm.
  • the movement of the finger causes the projection angle of the projected image projected by the smart ring worn on the finger to change, and the distance between the smart ring and the palm changes.
  • the change of the angle and the change of the distance will cause the projection picture to change.
  • the projection plane is determined in S103.
  • the projection plane can be regarded as the palm plane. Therefore, the angle between the center of the projection field of view projected by the smart ring and the projection plane is defined as the angle between the smart ring and the palm plane, which will be intelligent.
  • the distance between the ring and the geometric center of the projection plane is defined as the distance between the smart ring and the palm plane, as shown in Figure 2.
  • the adjustment control of the projection picture can be performed to adapt to the smart ring projection caused by the finger movement.
  • the projection angle of the projected image changes to make the projection display normally.
  • the deformation of the palm causes the palm to be a non-planar body.
  • the projection image projected onto the palm will be deformed.
  • each point of the deformed palm is relatively determined.
  • the tilt angle of the projection plane According to the tilt angle, the deformation variable at the corresponding position of the palm can be determined, and then the pixel data at the corresponding position is corrected to avoid Avoid distortion of the picture due to non-planarity of the palm.
  • the shape of the projected image projected by the smart ring can be adjusted according to the angle between the projection plane and the center line of the projection field of view, so that the projection image projected onto the palm is adapted to the shape of the projection area of the palm.
  • adjust the size of the projected image projected by the smart ring so that the projection image projected onto the palm is adapted to the size of the projection area on the palm; according to the 3D shape distribution of the palm, Correction of the display brightness of the projected picture projected into the projection area on the palm.
  • the shape of the projected image projected by the smart ring can be adjusted by using a trapezoidal correction method; according to the projection plane and the projection angle of view The angle between the center lines determines a correction angle for trapezoidal correction of the projection picture projected by the smart ring; and the trapezoidal correction is performed on the projection picture projected by the smart ring according to the determined correction angle.
  • the most common scene of conventional trapezoidal correction is oblique projection onto the projection screen.
  • the projection screen is still a plane, but when the palm projection is performed, the four vertices of the projection area on the palm are probably not in a plane, so it is determined according to the four vertices. a projection plane, and then determining the correction angle of the trapezoidal correction by the angle between the projection plane and the center line of the projection field of view angle, so that when the relative angle of the smart ring and the palm changes, the projection image projected onto the projection area of the palm display is normal. .
  • the process of trapezoidal correction may use, for example, a trapezoidal correction method in a projector.
  • a trapezoidal correction method in a projector.
  • the shape of the projected image projected by the smart ring may be deformed, the projection image of the projection area finally projected onto the palm is normal.
  • the specific trapezoidal correction process can be used in the existing trapezoidal correction process, which will not be described in detail in the embodiments of the present invention.
  • the angle between the projection plane and the center line of the projection field of view changes, it is not limited to the processing by trapezoidal correction, and the smart ring can also be adjusted by, for example, physical/mechanical adjustment.
  • the projection angle keeps the projected image stable.
  • d0, dl, and d2 are the distances between the geometric center of the projection plane and the smart ring, respectively. It can be seen from Fig. 3 that the size of the palm does not change, but when the distance between the geometric center of the projection plane and the smart ring changes, some of the projected images cannot be projected on the palm, so it is necessary to according to the geometric center and intelligence of the projection plane.
  • the distance between the rings adjusts the size of the projected image projected by the smart ring.
  • the size of the original projected picture projected by the smart ring is generally a fixed size, and since the projection area of the palm is generally small, in most cases, the distance between the smart ring and the palm changes.
  • the projected projection image will exceed the size of the palm, so that the projected image projected by the smart ring can be compressed at an appropriate ratio to project the projected image onto the projection area of the palm.
  • the compression ratio of the projection picture projected by the smart ring is determined; then the size of the projection picture projected by the smart ring is adjusted to be projected on the smart ring according to the determined compression ratio.
  • the size of the projected image after compression; the compression ratio for compressing the projected image projected by the smart ring, L -h md is the size of the hand zero, L _ 0 is the preset palm size, and is the geometric center and intelligence of the projection plane
  • the distance between the rings, ⁇ is the distance between the geometric center of the projection plane and the smart ring when the projection area is equal to the size of the palm.
  • the integration operation is performed by the coordinate points at the corresponding positions in the shape distribution of the palm 3D, and the degree of inclination of the relatively determined projection plane at the corresponding position can be obtained, thereby reflecting the degree of deformation of the palm, depending on the The degree of deformation at the position is adjusted to adjust the brightness of the screen caused by the deformation of the palm, so that the picture is displayed normally.
  • the method for controlling the projection of the wearable device determines the vertex coordinates of the projection area located on the palm according to the 3D shape distribution of the palm set by the 3D collection device disposed on the smart ring, and according to the determined projection area
  • the vertex coordinates determine a projection plane, the angle between the projection plane and the centerline of the projection field of view of the smart ring, the geometric center of the projection plane and the smart ring
  • the distance between the fingers, as well as the 3D shape distribution of the palm is controlled by the palm of the hand, so that the projected image projected by the smart ring is projected and displayed in the projection area of the palm.
  • At least one embodiment of the present invention further provides a device for controlling projection of the wearable device.
  • the device includes: a collection module 1 and a determination module 2 And control module 3.
  • the collection module 1 is for collecting a 3D shape distribution of an object as a projection screen by a 3D collection device set on a wearable device.
  • the determining module 2 is configured to determine a vertex coordinate of the projection area located on the object as the projection screen according to the 3D shape distribution of the object as the projection screen obtained by the collection module 1, and determine a projection plane according to the determined vertex coordinates. .
  • the control module 3 is configured to: according to an angle between a projection field angle center line of the projection component on the wearable device and a projection plane determined by the determination module 2, a distance between a projection plane geometric center and a projection component on the wearable device, And a 3D shape distribution of the projection member, and projection control is performed to realize a clear and stable projection display in a projection area projected by the projection member on the wearable device in a projection area on the object as the projection screen.
  • the determining module 2 can be configured to: determine a plane that minimizes the sum of the distance variances between the determined vertex coordinates as the projection plane.
  • control module 3 can be configured to: adjust the projection of the projection component according to an angle between a projection field angle center line of the projection component on the wearable device and a projection plane determined by the determination module 2 Projecting the shape of the screen such that the projected image projected onto the object as the projection screen is adapted to the shape of the projection area on the object as the projection screen; the geometric center of the projection plane determined by the projection component on the wearable device and the determination module 2
  • the distance between the projections projected by the projection member is adjusted such that the projection image projected onto the object as the projection screen is adapted to the size of the projection area on the object as the projection screen; according to the object as the projection screen
  • the 3D shape distribution corrects the display brightness of the projected picture projected in the projection area on the object as the projection screen.
  • control module 3 can be used to: The angle between the center line of the projection field of view of the shadow member determines a correction angle for performing trapezoidal correction on the projection screen projected by the projection member; and trapezoidally corrects the projection image projected by the projection member according to the determined correction angle.
  • control module 3 can be configured to: determine, according to the formula _o*W), a compression ratio for compressing a projection image projected by the projection component; and adjust a size of the projection image projected by the projection component to be compressed according to the above The scale of the projected image projected by the projection component; wherein, the compression ratio for compressing the projected image projected by the projection component, -1 is the size of the object as the projection screen, and is the preset projection screen Dimensions, the distance between the geometric center of the projection plane and the projected part, d . The distance between the geometric center of the projection plane corresponding to the projection component when the projection area size is equal to the projection screen size.
  • the display brightness of the projected picture in the projection area on the object of the projection screen is corrected;
  • - MX is the corresponding coordinate point in the projection area on the object as the projection screen ( x , the display brightness of the projected picture at the position, J "( x , for projection to the coordinate point ( x , display brightness of the display at the position, i ⁇ ' 2 ) indicates that the 3D shape distribution of the object as the projection screen corresponds to the projection area on the object as the projection screen
  • the integral of the three-dimensional coordinate point of the coordinate point is the corresponding coordinate point in the projection area on the object as the projection screen.
  • the wearable device is a smart ring
  • the object as a projection screen is a palm.
  • the apparatus for controlling the projection of the wearable device determines the 3D shape distribution of the object as the projection screen collected by the 3D collection device disposed on the wearable device, and determines the object located on the object as the projection screen. a vertex coordinate of the projection area, and determining a projection plane according to the determined vertex coordinates of the projection area, an angle between the projection plane and a center line of the projection field of view of the projection component, a distance between the geometric center of the projection plane and the projection component And a 3D shape distribution of the object as the projection screen, and projection control is performed so that the projection screen projected by the projection member is projected and displayed in the projection area of the palm.
  • the projection part of the wearable device when used as a projection screen, the corresponding change can be reflected in the angle, the distance, and the change of the 3D shape of the object as the projection screen, and the projection screen is adjusted and controlled.
  • the projection picture projected by the projection member on the wearable device can perform clear and stable normal projection display on the surface of the object as the projection screen.
  • At least one embodiment of the present invention further provides a wearable device including a projection component and a device for controlling projection of the wearable device, the control wearable
  • the device for projecting the device is the device for projecting the wearable device according to the above embodiment.
  • the wearable device has the same structure as the prior art except for the device for controlling the projection of the wearable device, and details are not described herein again.
  • the wearable device may also be a wearable device having a projection display function such as a smart bracelet, a smart watch, or smart glasses, and the object as a projection screen may be various objects such as a wall, a table, and an arm.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Geometry (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Projection Apparatus (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Optics & Photonics (AREA)

Abstract

一种控制可穿戴设备投影的方法及装置、可穿戴设备，所述投影方法通过设置在所述可穿戴设备上的3D采集设备采集得到作为投影屏幕的物体的3D形状分布；根据采集得到的所述作为投影屏幕的物体的3D形状分布，确定位于所述作为投影屏幕的物体上的投影区域的顶点坐标；根据确定的所述顶点坐标，确定一投影平面；根据所述投影平面与所述投影部件的投影视场角中心线之间的角度、所述投影平面几何中心与所述投影部件之间的距离，以及所述作为投影屏幕的物体的3D形状分布，进行投影控制，使所述投影部件投射出的投影画面在所述作为投影屏幕的物体上的投影区域内实现清晰稳定的投影显示。

Description

控制可穿戴设备投影的方法及装置、 可穿戴设备 技术领域
本发明的实施例涉及一种控制可穿戴设备投影的方法及装置、 可穿戴设 备。 背景技术
随着电子技术的快速发展， 各种穿戴式电子设备的功能越来越丰富， 越 来越人性化， 令用户在使用穿戴式电子设备的过程中拥有了更好的体验。 目 前， 智能穿戴式电子设备（也可称为可穿戴设备）逐渐成为潮流。 在这些可 穿戴设备上设置投影部件， 可使得可穿戴设备具备投影显示功能。
然而， 利用可穿戴设备进行投影显示时， 由于人体不可避免地会进行一 些姿态调整， 从而会导致可穿戴设备的投影部件与作为投影屏幕的物体之间 的相对位置移动。 或者， 如果作为投影屏幕的物体也是人体的某一器官（例 如手掌）表面时， 该器官表面有可能出现变形等问题， 使得可穿戴设备的投 影部件投射出的投影画面在作为投影屏幕的物体的表面上不能正常显示画 面。 发明内容
本发明至少一实施例提供一种控制可穿戴设备投影的方法及装置、 可穿 戴设备， 以使可穿戴设备上设置的投影部件投射出的投影画面能够在手掌上 进行正常投影显示。
本发明至少一实施例提供一种控制可穿戴设备投影的方法， 所述可穿戴 设备上设置有投影部件， 包括： 通过设置在所述可穿戴设备上的 3D釆集设 备釆集得到作为投影屏幕的物体的 3D形状分布； 根据釆集得到的所述作为 投影屏幕的物体的 3D形状分布， 确定位于所述作为投影屏幕的物体上的投 影区域的顶点坐标； 根据确定的所述顶点坐标， 确定一投影平面； 根据所述 投影平面与所述投影部件的投影视场角中心线之间的角度、 所述投影平面几 何中心与所述投影部件之间的距离， 以及所述作为投影屏幕的物体的 3D形 状分布， 进行投影控制。
本发明至少一实施例还提供一种控制可穿戴设备投影的装置， 所述可穿 戴设备上设置有投影部件， 包括： 釆集模块， 用于通过设置在所述可穿戴设 备上的 3D釆集设备釆集得到作为投影屏幕的物体的 3D形状分布；确定模块， 用于根据釆集模块釆集得到的所述作为投影屏幕的物体的 3D形状分布， 确 定位于所述作为投影屏幕的物体上的投影区域的顶点坐标， 并根据确定的所 述顶点坐标， 确定一投影平面； 控制模块， 用于根据所述投影部件的投影视 场角中心线与确定模块确定的投影平面之间的角度、 所述投影平面几何中心 与所述投影部件之间的距离，以及所述作为投影屏幕的物体的 3D形状分布， 进行投影控制， 使所述投影部件投射出的投影画面在所述作为投影屏幕的物 体上的投影区域内实现清晰稳定的投影显示。
本发明至少一实施例提供一种可穿戴设备， 该可穿戴设备包括投影部件 以及上述涉及的任一种控制可穿戴设备投影的装置。 附图说明
为了更清楚地说明本发明实施例的技术方案， 下面将对实施例的附图作 简单地介绍，显而易见地，下面描述中的附图仅仅涉及本发明的一些实施例， 而非对本发明的限制。
图 1为本发明一实施例提供的控制可穿戴设备投影的方法流程图； 图 2 为本发明一实施例提供的智能戒指与手掌之间的角度和距离示意 图；
图 3为本发明一实施例提供的智能戒指投射投影画面大小示意图； 图 4 为本发明另一实施例提供的控制可穿戴设备投影的装置构成示意 图。 具体实施方式
为使本发明实施例的目的、 技术方案和优点更加清楚， 下面将结合本发 明实施例的附图， 对本发明实施例的技术方案进行清楚、 完整地描述。显然， 所描述的实施例是本发明的一部分实施例， 而不是全部的实施例。 基于所描 述的本发明的实施例， 本领域普通技术人员在无需创造性劳动的前提下所获 得的所有其他实施例， 都属于本发明保护的范围。
图 1所示为本发明实施例提供的一种控制可穿戴设备投影的方法的实现 流程图， 包括：
S101 : 通过设置在可穿戴设备上的 3D (三维）釆集设备釆集得到作为 投影屏幕的物体的 3D形状分布。
在本发明至少一实施例中， 设置在可穿戴设备上的 3D釆集设备可以是 结构光三维扫描仪、 双目摄像机以及飞行时间探测器（time offlight, TOF ) 等。该 3D釆集设备可以釆集到作为投影屏幕的物体的表面所有点在以 3D釆 集设备为坐标原点的三维坐标系内的坐标， 进而可以确定作为投影屏幕的物 体在以 3D釆集设备为坐标原点的三维坐标系内的 3D形状分布。
根据获取到的作为投影屏幕的物体， 以 3D釆集设备为坐标原点建立的 三维坐标系的位置坐标， 从而可以确定出作为投影屏幕的物体的变形程度， 以及可穿戴设备上的投影部件相对作为投影屏幕的物体的角度变化和位置变 化等。
S102: 根据釆集得到的作为投影屏幕的 3D形状分布， 确定位于作为投 影屏幕的物体上的投影区域的顶点坐标。
作为投影屏幕的物体上的投影区域的形状可以根据实际情况来设定， 例 如可以是圓形、 矩形等。 根据投影区域的形状， 可以确定不同数量的顶点坐 标， 例如， 在本发明至少一实施例中， 为适应大部分投影设备， 投影区域形 状例如为矩形形状， 此时则可选择矩形区域的四个顶点， 使确定的四个顶点 顺序连线后形成的图形近似矩形。 以下将以确定四个顶点坐标形成矩形投影 区域为例进行说明， 但是本发明不限于此。
作为投影屏幕的物体可以是各种能够进行投影显示的投影介质， 例如可 将手掌作为投影介质。 手掌相对一般的投影屏幕而言比较小。 在本发明至少 一实施例中， 在手掌上确定的投影区域为手掌上能够的最大投影区域， 故此 时对应的四个顶点可以是手掌靠近腕部的两个边缘点、 手掌靠近小指位置处 的边缘点和手掌靠近食指位置处的边缘点，这四个边缘点连接后近似为矩形。
S103: 根据确定的顶点坐标， 确定一投影平面。
由于作为投影屏幕的物体可能会发生变形 （例如手掌） ， 变形后的投影 屏幕可能使确定的顶点并不位于同一平面， 根据确定的顶点坐标确定一投影 平面， 将该投影平面作为投影屏幕的物体所在的平面， 进行投影控制。 在本发明至少一实施例中， 为了使投影画面显示的较为精确， 选择一与 确定的顶点最接近的平面作为投影平面， 确定最接近的投影平面时可釆用如 下方式： 将与确定的顶点坐标之间的距离方差之和最小的平面， 确定为投影 平面。
S104: 根据投影平面与可穿戴设备的投影部件的投影视场角中心线之间 的角度、 投影平面几何中心与可穿戴设备的投影部件之间的距离， 以及作为 投影屏幕的物体的 3D形状分布， 进行投影控制， 使可穿戴设备的投影部件 投射出的投影画面在作为投影屏幕的物体上的投影区域内实现清晰稳定的投 影显示。
在本发明至少一实施例中， 可根据投影平面与投影部件的投影视场角中 心线之间的角度， 调整投影部件投射出的投影画面形状， 使投影到作为投影 屏幕的物体上的投影画面与作为投影屏幕的物体上的投影区域的形状相适 应。 根据投影平面几何中心与投影部件之间的距离， 调整投影部件投射出的 投影画面的大小， 使投影到作为投影屏幕的物体上的投影画面与作为投影屏 幕的物体上的投影区域的大小相适应。 根据作为投影屏幕的物体的 3D形状 分布， 对投射到作为投影屏幕的物体上的投影区域内的投影画面的显示亮度 进行校正。
例如， 如果投影视场为矩形时， 则投影视场角中心线为投影部件与该矩 形四个端点相连所形成的顶角的中心线； 如果投影视场为圓形时， 则投影视 场角中心线为投影部件与该圓形相连所形成的锥形角的中心线。
本发明至少一实施例中， 通过角度变化和距离变化适应调整图形的形状 以及大小， 并通过作为投影屏幕的物体的 3D形状分布适应调整投影画面的 显示亮度， 能够更为精确的对可穿戴设备的投影部件与作为投影屏幕的物体 之间的相对位置变化以及作为投影屏幕的物体的变形带来的画面显示不正常 进行适应性调整。
在本发明至少一实施例中， 根据投影平面与投影部件的投影视场角中心 线之间的角度， 调整投影部件投射出的投影画面形状， 可釆用如下方式： 根 据投影平面与投影部件的投影视场角中心线之间的角度， 确定对投影部件投 射出的投影画面进行梯形校正的校正角度； 根据确定的校正角度对投影部件 投射出的投影画面进行梯形校正， 可更为简单的对画面形状进行调整。 在本发明至少一实施例中， 根据投影平面几何中心与所述投影部件之间 的距离， 调整投影部件投射出的投影画面的大小， 可釆用如下方式： 按照公式 - G* ½ )， 确定对投影部件投射出的投影画面进行压缩 的压缩比例。 上述公式中， 为对所述投影部件投射出的投影画面进行压缩 的压缩比例， -1为作为投影屏幕的物体的尺寸， - 0为预设的投影屏幕的 尺寸， 为投影平面几何中心与所述投影部件之间的距离， ^。为投影区域尺 寸与投影屏幕尺寸相等时对应的投影平面几何中心与所述投影部件之间的距 离。 当确定了压缩比例后， 将投影部件投射出的投影画面的大小， 调整为按 照确定的压缩比例对投影部件投射出的投影画面进行压缩后的大小。
本发明至少一实施例中通过确定适当的压缩比例对投影画面进行压缩， 能够适应性的对投影画面的大小进行调整， 使得投影画面能够完全投射到作 为投影屏幕的物体上的投影区域内。
在本发明至少一实施例中， 根据作为投影屏幕的物体的 3D形状分布， 对投射到作为投影屏幕的物体上的投影区域内的投影画面的显示亮度进行校 正， 可釆用如下方式： 按照公式
Figure imgf000007_0001
ζ)， 确定作为投影屏幕的物体上的 投影区域内的投影画面的显示亮度； 根据确定的显示亮度， 对投射到作为投 影屏幕的物体上的投影区域内的投影画面的显示亮度进行校正； 这里， -。Μ Χ， 为作为投影屏幕的物体上的投影区域内对应坐标点 (χ， 位置处投 影画面的显示亮度， J"(x, 为投射到坐标点 (χ, 位置处的显示画面的显示 亮度， i ^' 2)表示对作为投影屏幕的物体的 3D形状分布中与作为投影屏幕 的物体上的投影区域内对应坐标点（x， 的三维坐标点的积分。
本发明至少一实施例中通过积分运算将作为投影屏幕的物体的非平面变 形转换到平面上， 并通过该积分运算确定作为投影屏幕的变形程度， 能够较 为准确的依据作为投影屏幕的物体的变形程度进行亮度调整。
本发明至少一实施例提供的控制可穿戴设备投影的方法， 根据设置在可 穿戴设备上的 3D釆集设备釆集的作为投影屏幕的物体的 3D形状分布，确定 位于作为投影屏幕的物体上的投影区域的顶点坐标， 并根据确定的投影区域 的顶点坐标确定一投影平面， 通过该投影平面与投影部件的投影视场角中心 线之间的角度、 投影平面几何中心与投影部件之间的距离， 以及作为投影屏 幕的物体的 3D形状分布， 进行投影控制， 使投影部件投射出的投影画面在 手掌上的投影区域内投影显示。 即， 本发明至少一实施例中， 当可穿戴设备 的投影部件与作为投影屏幕的物体之间的相对位置发生变化或者作为投影屏 幕的物体发生变形时， 能够将对应的变化体现在角度、 距离以及作为投影屏 幕的物体的 3D形状的变化上， 并对投影画面进行调整控制， 使可穿戴设备 上的投影部件投射出的投影画面能够在作为投影屏幕的物体的表面上进行清 晰稳定的正常投影显示。
以下将结合实际应用对上述实施例涉及的控制可穿戴设备投影的方法进 行详细说明。
本发明至少一实施例中以可穿戴设备为智能戒指， 作为投影屏幕的物体 为手掌为例进行说明， 当然并不以此为限。 例如， 可穿戴设备也可以是智能 手镯、 智能手表、 智能眼镜等具备投影显示功能的可穿戴设备， 而作为投影 屏幕的物体也可以是墙壁、 桌子、 手臂等各种物体。
手指的移动会导致戴在手指上的智能戒指投射出的投影画面的投影角度 发生变化， 以及智能戒指与手掌之间的距离发生变化， 角度的变化和距离的 变化都会导致投影画面发生变化， 在 S103 中确定了投影平面， 该投影平面 可认为是手掌平面， 故将智能戒指投射的投影视场角中心线与投影平面之间 的夹角定义为智能戒指与手掌平面之间的角度， 将智能戒指与投影平面几何 中心之间的距离定义为智能戒指与手掌平面之间的距离， 如图 2所示。 通过 投影平面 M与投影视场角中心线 1之间的角度 Θ、投影平面几何中心 K与智 能戒指之间的距离 d， 可进行投影画面的调整控制， 以适应手指移动造成的 智能戒指投射出的投影画面的投影角度发生变化， 使投影正常显示。
手掌的变形导致手掌为非平面体， 此时投影到手掌上的投影画面将会发 生变形，可以根据设置在 3D釆集设备釆集到的手掌 3D形状，确定变形后的 手掌上的每一点相对确定的投影平面的倾斜角度。 根据该倾斜角度即可确定 手掌对应位置处的变形变量， 进而对相应位置处的像素数据进行校正， 以避 免由于手掌的非平面造成的画面变形。
本发明至少一实施例中可根据投影平面与投影视场角中心线之间的角 度， 调整智能戒指投射出的投影画面形状， 使投影到手掌上的投影画面与手 掌上的投影区域的形状相适应； 根据投影平面几何中心与智能戒指之间的距 离， 调整智能戒指投射出的投影画面的大小， 使投影到手掌上的投影画面与 手掌上的投影区域的大小相适应； 根据手掌的 3D形状分布， 对投射到手掌 上的投影区域内的投影画面的显示亮度进行校正。
本发明至少一实施例中在投影平面与投影视场角中心线之间的角度发生 变化时， 可釆用梯形校正的方式调整智能戒指投射出的投影画面形状； 根据 投影平面与投影视场角中心线之间的角度， 确定对智能戒指投射出的投影画 面进行梯形校正的校正角度； 根据确定的校正角度对智能戒指投射出的投影 画面进行梯形校正。
常规的梯形校正最常用的场景是倾斜投影到投影屏幕上， 投影屏幕依然 是个平面， 但进行掌上投影时， 手掌上的投影区域的四个顶点很可能不在一 个平面上， 故根据四个顶点确定一投影平面， 然后通过投影平面与投影视场 角中心线之间的角度， 确定进行梯形校正的校正角度， 从而使得智能戒指与 手掌相对角度变化时， 投影到手掌上的投影区域的投影画面显示正常。
本发明至少一实施例中梯形校正的过程可釆用例如投影仪中的梯形校正 方式， 虽然智能戒指投射出的投影画面的形状可能是畸形的， 但最后投影到 手掌上的投影区域的投影画面是正常的。 具体的梯形校正过程可釆用现有的 梯形校正过程， 本发明实施例不再赘述。
需要说明的是，在投影平面与投影视场角中心线之间的角度发生变化时， 可不局限于釆用梯形校正的方式进行处理，还可釆用例如物理 /机械调整的方 式， 调整智能戒指的投射角度， 使投影画面保持稳定。
进一步的， 投影平面几何中心与智能戒指之间的距离发生变化时， 投射 到投影区域的投影画面的大小也会发生变化。 如图 3所示， d0， dl和 d2分 别为投影平面几何中心与智能戒指之间的距离。 从图 3可看出， 手掌的大小 不变， 但是投影平面几何中心与智能戒指之间的距离变化时， 将会导致有部 分投影画面不能投射在手掌上， 因此需要根据投影平面几何中心与智能戒指 之间的距离， 调整智能戒指投射出的投影画面的大小。 本发明至少一实施例中， 智能戒指投射出的原始投影画面的大小一般为 固定大小， 并且由于手掌上的投影区域一般比较小， 大多数情况下， 智能戒 指与手掌之间的距离发生变化时， 投射出的投影画面将超出手掌的大小， 故 可对智能戒指投射出的投影画面进行适当比例的压缩， 将投影画面投射到手 掌上的投影区域内。
L _ hand
例如可按照公式 -G*½ )， 确定对智能戒指投射出的投影画面进 行压缩的压缩比例； 然后将智能戒指投射出的投影画面的大小， 调整为按照 确定的压缩比例对智能戒指投射出的投影画面进行压缩后的大小； 为对智 能戒指投射出的投影画面进行压缩的压缩比例， L -h md为手零的大小, L _ 0 为预设的手掌大小， 为投影平面几何中心与智能戒指之间的距离， ^为投 影区域与手掌大小相等时对应的投影平面几何中心与智能戒指之间的距离。
本发明至少一实施例中根根据手掌的 3D形状分布， 对手掌上的投影区 域内的投影画面的显示亮度进行校正， 可釆用如下方式： 按 ^公式 —0 Μ χ' ） = _ζ'"(χ' ） ^^" —^^ ^ ， 确定手掌上的投影 区域内的投影画面的显示亮度； 根据确定的显示亮度， 对手掌上的投影区域 内的投影画面的显示亮度进行校正； 这里， - M X， 为手掌上的投影区域 内对应坐标点（x， 位置处投影画面的显示亮度， 为投射到坐标点 位置处的显示画面的显示亮度，
Figure imgf000010_0001
ζ)表示对手掌 3D形状 分布中与手掌上的投影区域内对应坐标点 的三维坐标点的积分。
本发明至少一实施例中通过对手掌 3D形状分布中的相应位置处的坐标 点进行积分运算， 可得到对应位置处相对确定的投影平面的倾斜程度， 进而 能够反映处手掌的变形程度， 根据不同位置处的变形程度进行亮度调整， 可 适应手掌变形造成的画面变形， 使画面正常显示。
本发明实施例提供的控制可穿戴设备投影的方法， 根据设置在智能戒指 上的 3D釆集设备釆集的手掌 3D形状分布，确定位于手掌上的投影区域的顶 点坐标， 并根据确定的投影区域的顶点坐标确定一投影平面， 通过该投影平 面与智能戒指的投影视场角中心线之间的角度、 投影平面几何中心与智能戒 指之间的距离， 以及手掌的 3D形状分布， 进行掌上投影控制， 使智能戒指 投射出的投影画面在手掌上的投影区域内投影显示。 即， 当手指和手掌发生 变化时， 能够将对应的变化体现在角度、 距离以及手掌变形程度的变化上， 并对投影画面进行调整控制， 使智能戒指投射出的投影画面能够在手掌上进 行正常投影显示。
基于上述实施例提供的控制可穿戴设备投影的方法， 本发明至少一实施 例还提供一种控制可穿戴设备投影的装置， 如图 4所示， 该装置包括： 釆集 模块 1、 确定模块 2和控制模块 3。
釆集模块 1用于通过设置在可穿戴设备上的 3D釆集设备釆集得到作为 投影屏幕的物体的 3D形状分布。
确定模块 2用于根据釆集模块 1釆集得到的作为投影屏幕的物体的 3D 形状分布， 确定位于作为投影屏幕的物体上的投影区域的顶点坐标， 并根据 确定的顶点坐标， 确定一投影平面。
控制模块 3用于根据可穿戴设备上的投影部件的投影视场角中心线与确 定模块 2确定的投影平面之间的角度、 投影平面几何中心与可穿戴设备上的 投影部件之间的距离， 以及投影部件的 3D形状分布， 进行投影控制， 使可 穿戴设备上的投影部件投射出的投影画面在作为投影屏幕的物体上的投影区 域内实现清晰稳定的投影显示。
本发明至少一实施例中， 例如， 确定模块 2可用于： 将与确定的顶点坐 标之间的距离方差之和最小的平面， 确定为投影平面。
本发明至少一实施例中， 例如， 控制模块 3可用于： 根据可穿戴设备上 的投影部件的投影视场角中心线与确定模块 2确定的投影平面之间的角度， 调整投影部件投射出的投影画面形状， 使投影到作为投影屏幕的物体上的投 影画面与作为投影屏幕的物体上的投影区域的形状相适应； 根据可穿戴设备 上的投影部件与确定模块 2确定的投影平面的几何中心之间的距离， 调整投 影部件投射出的投影画面的大小， 使投影到作为投影屏幕的物体上的投影画 面与作为投影屏幕的物体上的投影区域的大小相适应； 根据作为投影屏幕的 物体的 3D形状分布， 对投射到作为投影屏幕的物体上的投影区域内的投影 画面的显示亮度进行校正。
本发明至少一实施例中， 例如， 控制模块 3可用于： 根据投影平面与投 影部件的投影视场角中心线之间的角度， 确定对投影部件投射出的投影画面 进行梯形校正的校正角度； 根据确定的校正角度对所述投影部件投射出的投 影画面进行梯形校正。
φ_ L _\
进一步的， 例如， 控制模块 3 可用于： 按照公式 _o*W )， 确定 对投影部件投射出的投影画面进行压缩的压缩比例； 将投影部件投射出的投 影画面的大小， 调整为按照上述压缩比例对投影部件投射出的投影画面进行 压缩后的大小； 其中， 为对投影部件投射出的投影画面进行压缩的压缩比 例， -1为作为投影屏幕的物体的尺寸， 为预设的投影屏幕的尺寸， 为 投影平面几何中心与投影部件之间的距离， d。为投影区域尺寸与投影屏幕尺 寸相等时对应的投影平面几何中心与所述投影部件之间的距离。 例如， 控制模块 3可用于： 按照公式 -^ =^" ^)* '^)， 确 定作为投影屏幕的物体上的投影区域内的投影画面的显示亮度； 根据确定的 显示亮度， 对投射到作为投影屏幕的物体上的投影区域内的投影画面的显示 亮度进行校正； 这里， -。M X， 为作为投影屏幕的物体上的投影区域内对 应坐标点 (x, 位置处投影画面的显示亮度， J"(x, 为投射到坐标点 (x, 位 置处的显示画面的显示亮度， i ^' 2)表示对作为投影屏幕的物体的 3D形状 分布中与作为投影屏幕的物体上的投影区域内对应坐标点 的三维坐标 点的积分。
本发明实施例中上述可穿戴设备为智能戒指， 作为投影屏幕的物体为手 掌。
本发明至少一实施例提供的控制可穿戴设备投影的装置， 根据设置在可 穿戴设备上的 3D釆集设备釆集的作为投影屏幕的物体的 3D形状分布，确定 位于作为投影屏幕的物体上的投影区域的顶点坐标， 并根据确定的投影区域 的顶点坐标确定一投影平面， 通过该投影平面与投影部件的投影视场角中心 线之间的角度、 投影平面几何中心与投影部件之间的距离， 以及作为投影屏 幕的物体的 3D形状分布， 进行投影控制， 使投影部件投射出的投影画面在 手掌上的投影区域内投影显示。 即， 当可穿戴设备的投影部件与作为投影屏 幕的物体之间的相对位置发生变化或者作为投影屏幕的物体发生变形时， 能 够将对应的变化体现在角度、 距离以及作为投影屏幕的物体的 3D形状的变 化上， 并对投影画面进行调整控制， 使可穿戴设备上的投影部件投射出的投 影画面能够在作为投影屏幕的物体的表面上进行清晰稳定的正常投影显示。
基于上述实施例涉及的控制可穿戴设备投影的方法和装置， 本发明至少 一实施例还提供一种可穿戴设备， 该可穿戴设备包括投影部件和控制可穿戴 设备投影的装置， 该控制可穿戴设备投影的装置为上述实施例涉及的可穿戴 设备投影的装置。
本发明至少一实施例中可穿戴设备除控制可穿戴设备的投影的装置以 外， 其它部分与现有的结构相同， 在此不再赘述。
需要说明的是， 尽管上文以智能戒指和手掌为例进行了说明， 然而本领 域的技术人员应当明白， 本发明不限于此。 例如， 可穿戴设备也可以是智能 手镯、 智能手表、 智能眼镜等具备投影显示功能的可穿戴设备， 而作为投影 屏幕的物体也可以是墙壁、 桌子、 手臂等各种物体。
以上所述仅是本发明的示范性实施方式， 而非用于限制本发明的保护范 围， 本发明的保护范围由所附的权利要求确定。
本申请要求于 2014年 4月 28日递交的中国专利申请第 201410175550.7 号的优先权， 在此全文引用该中国专利申请公开的内容以作为本申请的一部 分。

Claims

权利要求书
1、一种控制可穿戴设备投影的方法，所述可穿戴设备上设置有投影部件， 包括：
通过设置在所述可穿戴设备上的 3D釆集设备釆集得到作为投影屏幕的 物体的 3D形状分布；
根据釆集得到的所述作为投影屏幕的物体的 3D形状分布， 确定位于所 述作为投影屏幕的物体上的投影区域的顶点坐标；
根据确定的所述顶点坐标， 确定一投影平面；
根据所述投影平面与所述投影部件的投影视场角中心线之间的角度、 所 述投影平面几何中心与所述投影部件之间的距离， 以及所述作为投影屏幕的 物体的 3D形状分布， 进行投影控制。
2、如权利要求 1所述的方法， 其中， 将与确定的所述顶点坐标之间的距 离方差之和最小的平面， 确定为投影平面。
3、 如权利要求 1或 2所述的方法， 其中，
根据所述投影平面与所述投影部件的投影视场角中心线之间的角度， 调 整所述投影部件投射出的投影画面形状， 使投影到所述作为投影屏幕的物体 上的投影画面与所述作为投影屏幕的物体上的投影区域的形状相适应；
根据所述投影平面几何中心与所述投影部件之间的距离， 调整所述投影 部件投射出的投影画面的大小， 使投影到所述作为投影屏幕的物体上的投影 画面与作为投影屏幕的物体上的投影区域的大小相适应；
根据所述作为投影屏幕的物体的 3D形状分布， 对投射到作为投影屏幕 的物体上的投影区域内的投影画面的显示亮度进行校正。
4、 如权利要求 3所述的方法， 其中，
根据所述投影平面与所述投影部件的投影视场角中心线之间的角度， 确 定对所述投影部件投射出的投影画面进行梯形校正的校正角度；
根据所述校正角度对所述投影部件投射出的投影画面进行梯形校正。
5、 如权利要求 3所述的方法， 其中，
- 0* ( )， 确定对所述投影部件投射出的投影画面进行 压缩的压缩比例；
将所述投影部件投射出的投影画面的大小， 调整为按照所述压缩比例对 所述投影部件投射出的投影画面进行压缩后的大小；
其中， 为对所述投影部件投射出的投影画面进行压缩的压缩比例， -1 为作为投影屏幕的物体的尺寸， -0为预设的投影屏幕的尺寸， 为投影平 面几何中心与所述投影部件之间的距离， 为投影区域尺寸与投影屏幕尺寸 相等时对应的投影平面几何中心与所述投影部件之间的距离。
6、 如权利要求 3所述的方法， 其中， 按照公式 υ" ^) = υ ^) * ί(^' ζ)， 确定所述作为投影屏幕的物体 上的投影区域内的投影画面的显示亮度；
根据确定的显示亮度， 对投射到所述作为投影屏幕的物体上的投影区域 内的投影画面的显示亮度进行校正；
其中， L - X,y 为所述作为投影屏幕的物体上的投影区域内对应坐标 点 (x, 位置处投影画面的显示亮度， J"(x, 为投射到坐标点 (x, 位置处的 显示画面的显示亮度， J^'^' z)表示对所述作为投影屏幕的物体的 3D形状分 布中与所述作为投影屏幕的物体上的投影区域内对应坐标点（x， 的三维坐 标点的积分。
7、 如权利要求 1-6任一项所述的方法， 其中， 所述可穿戴设备为智能戒 指， 所述作为投影屏幕的物体为手掌。
8、一种控制可穿戴设备投影的装置，所述可穿戴设备上设置有投影部件， 包括：
釆集模块， 用于通过设置在所述可穿戴设备上的 3D釆集设备釆集得到 作为投影屏幕的物体的 3D形状分布；
确定模块，用于根据釆集模块釆集得到的所述作为投影屏幕的物体的 3D 形状分布， 确定位于所述作为投影屏幕的物体上的投影区域的顶点坐标， 并 根据确定的所述顶点坐标， 确定一投影平面；
控制模块， 用于根据所述投影部件的投影视场角中心线与确定模块确定 的投影平面之间的角度、所述投影平面几何中心与所述投影部件之间的距离， 以及所述作为投影屏幕的物体的 3D形状分布， 进行投影控制。
9、如权利要求 8所述的装置， 其中， 所述确定模块将与确定的所述顶点 坐标之间的距离方差之和最小的平面， 确定为投影平面。
10、 如权利要求 8或 9所述的装置， 其中， 所述控制模块：
根据所述投影平面与所述投影部件的投影视场角中心线之间的角度， 调 整所述投影部件投射出的投影画面形状， 使投影到所述作为投影屏幕的物体 上的投影画面与所述作为投影屏幕的物体上的投影区域的形状相适应；
根据所述投影平面几何中心与所述投影部件之间的距离， 调整所述投影 部件投射出的投影画面的大小， 使投影到所述作为投影屏幕的物体上的投影 画面与作为投影屏幕的物体上的投影区域的大小相适应；
根据所述作为投影屏幕的物体的 3D形状分布， 对投射到作为投影屏幕 的物体上的投影区域内的投影画面的显示亮度进行校正。
11、 如权利要求 10所述的装置， 其中， 所述控制模块：
根据所述投影平面与所述投影部件的投影视场角中心线之间的角度， 确 定对所述投影部件投射出的投影画面进行梯形校正的校正角度；
根据所述校正角度对所述投影部件投射出的投影画面进行梯形校正。
12、 如权利要求 10所述的装置， 其中， 所述控制模块：
φ_ L _\
按照公式 _o*W )， 确定对所述投影部件投射出的投影画面进行 压缩的压缩比例；
将所述投影部件投射出的投影画面的大小， 调整为按照所述压缩比例对 所述投影部件投射出的投影画面进行压缩后的大小；
其中， 为对所述投影部件投射出的投影画面进行压缩的压缩比例， - 1 为作为投影屏幕的物体的尺寸， 为预设的投影屏幕的尺寸， 为投影平 面几何中心与所述投影部件之间的距离， 为投影区域尺寸与投影屏幕尺寸 相等时对应的投影平面几何中心与所述投影部件之间的距离。
13、 如权利要求 10所述的装置， 其中， 所述控制模块： 按照公式 υ" ^) = υ ^) * ί(^' ζ)， 确定所述作为投影屏幕的物体 上的投影区域内的投影画面的显示亮度; 根据确定的显示亮度， 对投射到所述作为投影屏幕的物体上的投影区域 内的投影画面的显示亮度进行校正；
其中， L - X,y 为所述作为投影屏幕的物体上的投影区域内对应坐标 点 (x, 位置处投影画面的显示亮度， J"(x, 为投射到坐标点 (x, 位置处的 显示画面的显示亮度， ί ·^ 2)表示对所述作为投影屏幕的物体的 3D形状分 布中与所述作为投影屏幕的物体上的投影区域内对应坐标点（χ， 的三维坐 标点的积分。
14、 如权利要求 8-13任一项所述的装置， 其中， 所述可穿戴设备为智能 戒指， 所述作为投影屏幕的物体为手掌。
15、一种可穿戴设备， 包括投影部件以及如权利要求 8-14任一项所述的 控制可穿戴设备投影的装置。
PCT/CN2014/085210 2014-04-28 2014-08-26 控制可穿戴设备投影的方法及装置、可穿戴设备 WO2015165181A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US14/437,112 US9872002B2 (en) 2014-04-28 2014-08-26 Method and device for controlling projection of wearable apparatus, and wearable apparatus
KR1020157013331A KR101669780B1 (ko) 2014-04-28 2014-08-26 웨어러블 장치의 프로젝션을 제어하기 위한 방법 및 디바이스, 및 웨어러블 장치
JP2017508721A JP2017520026A (ja) 2014-04-28 2014-08-26 ウェアラブルデバイスの投影を制御する方法及び装置、ウェアラブルデバイス
EP14853154.4A EP3139599B1 (en) 2014-04-28 2014-08-26 Method and apparatus for controlling projection of wearable device, and wearable device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410175550.7 2014-04-28
CN201410175550.7A CN103974048B (zh) 2014-04-28 2014-04-28 控制可穿戴设备投影的方法及装置、可穿戴设备

Publications (1)

Publication Number Publication Date
WO2015165181A1 true WO2015165181A1 (zh) 2015-11-05

Family

ID=51243026

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/085210 WO2015165181A1 (zh) 2014-04-28 2014-08-26 控制可穿戴设备投影的方法及装置、可穿戴设备

Country Status (6)

Country Link
US (1) US9872002B2 (zh)
EP (1) EP3139599B1 (zh)
JP (1) JP2017520026A (zh)
KR (1) KR101669780B1 (zh)
CN (1) CN103974048B (zh)
WO (1) WO2015165181A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110554502A (zh) * 2018-05-30 2019-12-10 乐金显示有限公司 显示面板、显示装置和虚拟现实/增强现实装置

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103974048B (zh) * 2014-04-28 2016-05-04 京东方科技集团股份有限公司 控制可穿戴设备投影的方法及装置、可穿戴设备
KR20160055577A (ko) * 2014-11-10 2016-05-18 엘지전자 주식회사 웨어러블 디바이스
CN104461003B (zh) * 2014-12-11 2019-02-05 联想(北京)有限公司 一种信息处理方法及电子设备
CN104486573B (zh) * 2014-12-22 2017-11-28 联想(北京)有限公司 一种信息处理方法和电子设备
CN106034212B (zh) * 2015-03-10 2019-02-26 深圳富泰宏精密工业有限公司 投影装置、控制装置及穿戴式投影***
CN104698728A (zh) * 2015-03-27 2015-06-10 百度在线网络技术（北京）有限公司 微型投影装置及其操作方法和操作装置
EP3280136B1 (en) * 2015-03-30 2021-04-28 MegaChips Corporation Projection systems and projection methods
CN106331666B (zh) 2015-07-03 2020-02-07 中兴通讯股份有限公司 一种投影终端梯形校正方法、装置及投影终端
CN105430189A (zh) * 2015-12-10 2016-03-23 合肥虔视光电科技有限公司 一种智能投影手环
CN105578163B (zh) * 2015-12-31 2020-02-21 联想(北京)有限公司 一种信息处理方法及电子设备
CN106028010A (zh) * 2016-06-17 2016-10-12 联想(北京)有限公司 一种显示控制方法及装置
CN106060310A (zh) * 2016-06-17 2016-10-26 联想(北京)有限公司 一种显示控制方法及装置
DE102017219790A1 (de) * 2017-11-07 2019-05-09 Volkswagen Aktiengesellschaft System und Verfahren zum Bestimmen einer Pose einer Augmented-Reality-Brille, System und Verfahren zum Einmessen einer Augmented-Reality-Brille, Verfahren zum Unterstützen einer Posenbestimmung einer Augmented-Reality-Brille und für das Verfahren geeignetes Kraftfahrzeug
CN111123625B (zh) * 2019-12-13 2021-05-18 成都极米科技股份有限公司 投影仪及投影方法
CN112716117B (zh) * 2020-12-28 2023-07-14 维沃移动通信有限公司 智能手环及其控制方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1888814A (zh) * 2006-07-25 2007-01-03 深圳大学 三维主动视觉传感器的多视点姿态估计和自标定方法
CN1932635A (zh) * 2005-09-12 2007-03-21 卡西欧计算机株式会社 投影装置、投影方法和记录投影方法的记录介质
CN102193631A (zh) * 2011-05-05 2011-09-21 上海大学 可穿戴式三维手势交互***及其使用方法
CN103974048A (zh) * 2014-04-28 2014-08-06 京东方科技集团股份有限公司 控制可穿戴设备投影的方法及装置、可穿戴设备

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7352913B2 (en) 2001-06-12 2008-04-01 Silicon Optix Inc. System and method for correcting multiple axis displacement distortion
JP4155890B2 (ja) * 2003-07-15 2008-09-24 カシオ計算機株式会社 プロジェクタ、プロジェクタの傾斜角度取得方法及び投影像補正方法
JP2006140556A (ja) * 2004-11-10 2006-06-01 Seiko Epson Corp プロジェクタ
FR2907246B1 (fr) * 2006-10-12 2008-12-12 Airbus France Sas Procede et dispositifs de projection de motifs bidimensionels sur des surfaces complexes d'objets tridimensionnels
AU2008290211A1 (en) * 2007-08-19 2009-02-26 Ringbow Ltd. Finger-worn devices and related methods of use
DE102007055204B4 (de) 2007-11-19 2010-04-08 Deutsches Zentrum für Luft- und Raumfahrt e.V. Roboter, medizinischer Arbeitsplatz und Verfahren zum Projizieren eines Bildes auf die Oberfläche eines Objekts
US20090295712A1 (en) * 2008-05-29 2009-12-03 Sony Ericsson Mobile Communications Ab Portable projector and method of operating a portable projector
US20110123694A1 (en) * 2009-11-24 2011-05-26 Hussmann Corporation Table with ethylene scrubber
WO2011105502A1 (ja) * 2010-02-24 2011-09-01 京セラ株式会社 携帯電子機器および投影システム
JP2012151670A (ja) * 2011-01-19 2012-08-09 Renesas Electronics Corp 画像投影システム及び半導体集積回路
US10061387B2 (en) * 2011-03-31 2018-08-28 Nokia Technologies Oy Method and apparatus for providing user interfaces
US8228315B1 (en) 2011-07-12 2012-07-24 Google Inc. Methods and systems for a virtual input device
KR101627634B1 (ko) 2011-12-26 2016-06-08 한국전자통신연구원 프로젝터 영상 보정 장치 및 방법
JP6127366B2 (ja) * 2012-03-07 2017-05-17 セイコーエプソン株式会社 プロジェクター、及び、プロジェクターの制御方法
KR20130121526A (ko) * 2012-04-27 2013-11-06 한국전자통신연구원 착용형 프로젝션 장치
JP5958072B2 (ja) * 2012-05-18 2016-07-27 株式会社Ｊｖｃケンウッド 投射装置および画像補正方法
US9626748B2 (en) * 2012-07-02 2017-04-18 Seiko Epson Corporation Projector and method for controlling the same
JP5711702B2 (ja) * 2012-08-23 2015-05-07 日本電信電話株式会社 投影型３次元形状復元装置、投影型３次元形状復元方法及び投影型３次元形状復元プログラム
CN103338342A (zh) * 2013-03-19 2013-10-02 卿婷 自适应投影仪

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1932635A (zh) * 2005-09-12 2007-03-21 卡西欧计算机株式会社 投影装置、投影方法和记录投影方法的记录介质
CN1888814A (zh) * 2006-07-25 2007-01-03 深圳大学 三维主动视觉传感器的多视点姿态估计和自标定方法
CN102193631A (zh) * 2011-05-05 2011-09-21 上海大学 可穿戴式三维手势交互***及其使用方法
CN103974048A (zh) * 2014-04-28 2014-08-06 京东方科技集团股份有限公司 控制可穿戴设备投影的方法及装置、可穿戴设备

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110554502A (zh) * 2018-05-30 2019-12-10 乐金显示有限公司 显示面板、显示装置和虚拟现实/增强现实装置

Also Published As

Publication number Publication date
KR20150135765A (ko) 2015-12-03
EP3139599A4 (en) 2018-01-24
EP3139599A1 (en) 2017-03-08
JP2017520026A (ja) 2017-07-20
KR101669780B1 (ko) 2016-10-27
CN103974048A (zh) 2014-08-06
CN103974048B (zh) 2016-05-04
EP3139599B1 (en) 2022-04-06
US9872002B2 (en) 2018-01-16
US20160301906A1 (en) 2016-10-13

Similar Documents

Publication Publication Date Title
WO2015165181A1 (zh) 控制可穿戴设备投影的方法及装置、可穿戴设备
WO2015085956A1 (zh) 一种基于投影图像的处理方法及装置
US20160014385A1 (en) Image processor, image processing method, and image projector
WO2017054589A1 (zh) 一种多深度图融合方法及装置
JP6330036B2 (ja) 画像処理装置及び画像表示装置
CN110214340B (zh) 使用rgb色彩数据的结构光深度图的细化
US20190149787A1 (en) Projection system and image projection method
WO2014083721A1 (ja) 情報処理装置および情報処理方法
CN105989577B (zh) 一种图像校正的方法和装置
WO2015165209A1 (zh) 穿戴式投影装置及其调焦方法、投影方法
CN105787884A (zh) 一种图像处理方法及电子设备
US20130265219A1 (en) Information processing apparatus, program, and information processing method
WO2017067262A1 (zh) 一种图像处理方法和装置
TW201124789A (en) System and method for projection correction
WO2017179432A1 (ja) ３次元的な投影対象のための画像投影方法及び画像投影装置
JP2017050616A5 (zh)
CN109690568A (zh) 一种处理方法及移动设备
KR20200103374A (ko) 2차원 이미지를 이용한 3차원 모델링 방법
WO2019051785A1 (zh) 一种用于智能终端的图标显示方法及图标显示装置
JP2016218729A (ja) 画像処理装置、画像処理方法およびプログラム
TWI703869B (zh) 投影裝置、投影系統及影像校正方法
CN108133469A (zh) 基于epi的光场拼接装置及方法
WO2021096503A1 (en) Foreshortening-distortion correction on faces
CN115997379A (zh) 用于立体渲染的图像fov的复原
TWI543046B (zh) 光學觸控系統

Legal Events

Date Code Title Description
REEP Request for entry into the european phase

Ref document number: 2014853154

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 14437112

Country of ref document: US

Ref document number: 2014853154

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 20157013331

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2017508721

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14853154

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE