WO2016165362A1 - Projection display method, device, electronic apparatus and computer storage medium - Google Patents

Projection display method, device, electronic apparatus and computer storage medium Download PDF

Info

Publication number
WO2016165362A1
WO2016165362A1 PCT/CN2015/096943 CN2015096943W WO2016165362A1 WO 2016165362 A1 WO2016165362 A1 WO 2016165362A1 CN 2015096943 W CN2015096943 W CN 2015096943W WO 2016165362 A1 WO2016165362 A1 WO 2016165362A1
Authority
WO
WIPO (PCT)
Prior art keywords
target point
target object
target
virtual
point
Prior art date
Application number
PCT/CN2015/096943
Other languages
French (fr)
Chinese (zh)
Inventor
蒋楠
王煜辰
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2016165362A1 publication Critical patent/WO2016165362A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the invention relates to intelligent projection processing technology, in particular to a projection display method, device, electronic device and computer storage medium.
  • the embodiment of the invention provides a projection display method, device, electronic device and computer storage medium, which can display the operation process of the operation interface on the projection interface, so that the operation result is synchronously displayed while the projection interface displays the operation result.
  • Embodiments of the present invention provide a projection display method, where the method includes:
  • a projection display of a virtual image of the target object is controlled.
  • the parameter corresponding to the at least one target point in the target object includes a scanning angle and a scanning distance
  • the scanning distance is a linear distance between the target point and the scanning point; the scanning angle is an angle formed by a straight line between the target point and the scanning point and the operation interface.
  • the virtual imaging process is performed by using the parameter corresponding to the at least one target point to obtain a virtual image of the target object, including:
  • the target point height is a distance between the target and the operation interface; a plane coordinate corresponding to the target point is a plane coordinate of a projection point of the target point on the operation interface.
  • the method further includes:
  • controlling the projection display of the virtual image of the target object comprises:
  • the embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the projection display method according to the embodiment of the invention.
  • An embodiment of the present invention further provides an electronic device, where the electronic device includes a scanning sensor, an imager, an image outputter, and a processor;
  • the processor is configured to control the scan sensor scan detection corresponding to an operation interface a target object in the preset area, obtaining a parameter corresponding to at least one target point in the target object; controlling the imager to perform virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object Controlling a projection display of the virtual image of the target object by the image outputter.
  • the embodiment of the invention further provides a projection display device, the device comprising an acquisition module, a virtual imaging processing module and a control module; wherein
  • the acquiring module is configured to scan and detect a target object in a preset area corresponding to the operation interface, and obtain a parameter corresponding to at least one target point in the target object;
  • the virtual imaging processing module is configured to perform virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object;
  • the control module is configured to control a projection display of a virtual image of the target object.
  • the parameter corresponding to the at least one target point in the target object includes a scanning angle and a scanning distance
  • the scanning distance is a linear distance between the target point and the scanning point; the scanning angle is an angle formed by a straight line between the target point and the scanning point and the operation interface.
  • the virtual imaging processing module includes a coordinate positioning sub-module and a virtual imaging processing sub-module;
  • the coordinate positioning sub-module is configured to determine a target point height and a plane coordinate corresponding to the target point based on the scan angle and the scan distance;
  • the virtual imaging processing sub-module is configured to perform virtual imaging processing according to the target point height and the plane coordinate corresponding to the target point, to obtain virtual imaging corresponding to the at least one target point, and to use the virtual imaging corresponding to the at least one target point as Virtual imaging of the target object.
  • the target point height is a distance between the target point and the operation interface; a plane coordinate corresponding to the target point is a plane coordinate of a projection point of the target point on the operation interface.
  • the device further includes a virtual transparent processing module
  • the virtual transparent processing module is configured to perform a virtualized and transparent process on the obtained virtual image of the target object to obtain a virtualized and transparent processed virtual image;
  • control module is further configured to control a projection display of the virtualized and transparent processed virtual image.
  • the projection display method, the device, the electronic device, and the computer storage medium provided by the embodiment of the present invention detect a target object corresponding to the preset area of the operation interface by scanning, and obtain a parameter corresponding to at least one target point in the target object; Performing virtual imaging processing on the parameter corresponding to the at least one target point to obtain a virtual image of the target object; and controlling projection display of the virtual image of the target object.
  • the operation process of the operation interface can be displayed on the projection interface, so that the operation process is synchronously displayed on the basis of displaying the operation result on the projection interface.
  • the user can see both the operation result and the operation process on the projection interface, and eliminate the inconsistency that is caused by the complete separation of the projection interface and the operation interface to the user in the prior art, thereby improving the user experience.
  • FIG. 1 is a schematic flowchart 1 of an implementation flow of a projection display method according to an embodiment of the present invention
  • FIG. 2 is a second schematic diagram of an implementation flow of a projection display method according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram showing an implementation principle of determining a target point height and a plane coordinate corresponding to a target point based on the scanning angle and the scanning distance according to an embodiment of the present invention
  • FIG. 4 is a schematic flowchart 3 of an implementation flow of a projection display method according to an embodiment of the present invention.
  • FIG. 5 is a diagram showing a display effect of a projection display method on a projection interface according to an embodiment of the present invention
  • FIG. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
  • FIG. 7 is a first schematic structural diagram of a projection display device according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of a virtual imaging processing module according to an embodiment of the present invention.
  • FIG. 9 is a second schematic structural diagram of a projection display device according to an embodiment of the present invention.
  • the scan detects a target object in the preset area corresponding to the operation interface, obtains a parameter corresponding to at least one target point in the target object, and performs virtual imaging processing by using parameters corresponding to the at least one target point.
  • a projection display method according to an embodiment of the present invention includes:
  • Step S101 Scan to detect a target object in a preset area corresponding to the operation interface, and obtain a parameter corresponding to at least one target point in the target object;
  • the electronic device may scan and detect a target object in a preset area corresponding to the operation interface by using a device having a scan detection function, such as a scan sensor provided in itself, to obtain a parameter corresponding to at least one target point in the target object. .
  • the electronic device may be a projector including an operation interface and a projection interface or other device having a projection function.
  • the operation interface may be a touch screen interface; the operation interface may also be an operation interface similar to a keyboard including physical buttons with different functions.
  • the target object in the preset area corresponding to the operation interface may be a touch point acting on the touch screen interface or a user finger, a stylus pen, etc. performing a touch operation on the touch screen interface;
  • the target object in the preset area of the operation interface may also be a user's finger or the like that performs a key operation on the operation interface including the physical buttons having different functions.
  • the parameter corresponding to the at least one target point in the target object includes a scanning angle and a scanning distance
  • the scanning distance is a linear distance between the target point and the scanning point;
  • the angle of the drawing is an angle between the straight line between the target point and the scanning point and the operation interface.
  • the scanning point is a device for performing a scan detecting operation, such as a position where a scanning sensor or the like is located on the electronic device.
  • a function switch for controlling the projection display according to the embodiment of the present invention is disposed in the electronic device. After the user turns on the projection display function through the function switch, the electronic device starts to control a device having a scan detection function, such as a scan sensor provided by itself, to scan and detect a target object in a preset area corresponding to the operation interface, to obtain a A parameter corresponding to at least one target point in the target object.
  • a scan detection function such as a scan sensor provided by itself
  • Step S102 Perform virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object.
  • the electronic device performs a virtual imaging process by using a scan angle and a scan distance corresponding to the at least one target point, and obtains a virtual image of at least one target point in the target object as a virtual image of the target object.
  • the virtual imaging processing process may adopt a related technology that is relatively mature in the prior art, and details are not described herein again.
  • Step S103 Control a projection display of the virtual image of the target object.
  • the electronic device controls the projection display of the virtual image of the target object on the projection interface in real time.
  • a target object corresponding to at least one target point in the target object is obtained by detecting a target object in a preset area corresponding to the operation interface; and the at least one target point is corresponding to
  • the parameter performs a virtual imaging process to obtain a virtual image of the target object; and controls a projection display of the virtual image of the target object on the projection interface.
  • the operation process of the operation interface can be displayed on the projection interface, so that the operation process is synchronously displayed on the basis of displaying the operation result on the projection interface.
  • the user can see both the operation result and the operation process on the projection interface, eliminating the prior art due to the projection interface and the operation boundary.
  • the complete separation of the face gives the user a sense of incoherence, which enhances the user experience.
  • the embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the projection display method according to the embodiment of the invention.
  • FIG. 2 is a second schematic diagram of an implementation flow of a projection display method according to an embodiment of the present invention.
  • a projection display method according to an embodiment of the present invention includes:
  • Step S201 The scan detects a target object in the preset area corresponding to the operation interface, and obtains a scan angle and a scan distance corresponding to at least one target point in the target object;
  • the scanning distance is a linear distance between the target point and the scanning point; the scanning angle is an angle formed by a straight line between the target point and the scanning point and the operation interface.
  • Step S202 Determine a plane coordinate corresponding to the target point height and the target point based on the scan angle and the scan distance;
  • the target point height is a distance between the target point and the operation interface; the plane coordinate corresponding to the target point is a plane coordinate of a projection point of the target point on the operation interface.
  • FIG. 3 is a schematic diagram of an implementation principle of determining a target point height and a plane coordinate corresponding to a target point based on the scan angle and the scan distance according to the embodiment of the present invention.
  • the rectangle matrix is used to represent the projector.
  • the touch screen interface has four scanning sensors distributed around the touch screen, corresponding to scanning points C, D, E, and F, respectively. Taking one of the scanning points C as an example, when scanning into a preset area corresponding to the operation interface, that is, at least one target point M in the target object above the touch screen, the scanning sensor obtains and feeds back the scanning angle A and the scanning distance.
  • CM scanning angle
  • Step S203 Perform virtual imaging processing according to the target point height and the plane coordinate corresponding to the target point, obtain virtual imaging corresponding to the at least one target point, and perform virtual imaging corresponding to the at least one target point as virtual imaging of the target object. ;
  • the electronic device further transmits the three-dimensional information positioning to the imager for virtual imaging, Finally, a virtual imaging of the target object is obtained.
  • the virtual imaging processing process may adopt a related technology that is relatively mature in the prior art, and details are not described herein again.
  • Step S204 Control a projection display of the virtual image of the target object.
  • the projection display method can display the operation process of the operation interface on the projection interface, so that the operation process is synchronously displayed on the basis of displaying the operation result on the projection interface.
  • the user can see both the operation result and the operation process on the projection interface, and eliminate the inconsistency that is caused by the complete separation of the projection interface and the operation interface to the user in the prior art, thereby improving the user experience.
  • the embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the projection display method according to the embodiment of the invention.
  • FIG. 4 is a schematic flowchart 3 of an implementation flow of a projection display method according to an embodiment of the present invention. As shown in FIG. 4, a projection display method according to an embodiment of the present invention includes:
  • Step S401 The scan detects a target object in a preset area corresponding to the operation interface, and obtains a parameter corresponding to at least one target point in the target object;
  • the parameter corresponding to the at least one target point in the target object includes a scanning angle and a scanning distance
  • the scanning distance is a linear distance between the target point and the scanning point; the scanning angle is an angle formed by a straight line between the target point and the scanning point and the operation interface.
  • Step S402 Perform virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object.
  • Step S403 Performing a virtualized transparent process on the obtained virtual image of the target object to obtain a virtual image after the blur transparent process;
  • the obtained virtual image of the target object is subjected to blur transparent processing by an image processor in the electronic device, so that when the virtual image of the target object is displayed on the projection interface, the projection interface is not completely covered. The result of the operation that would have been displayed.
  • the virtual transparent processing process may adopt a related technology that is relatively mature in the prior art, and details are not described herein again.
  • Step S404 Control the projection display of the virtual image after the blur transparent processing.
  • the obtained virtual image of the target object is further subjected to blurring and transparent processing to obtain virtualized and transparent processed images.
  • Image after that, the projection display of the virtualized transparent image is controlled, as shown in FIG. 5.
  • the operation process of the operation interface can be displayed on the projection interface, so that the display operation process is synchronized, that is, the virtual image after the blur transparent process is displayed on the basis of displaying the operation result on the projection interface.
  • the image processor in the electronic device performs the blur transparent processing on the obtained virtual image of the target object, when the virtual image of the target object is displayed on the projection interface, the projection interface is not completely covered. The result of the operation that needs to be displayed, thereby improving the user experience.
  • the embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the embodiment of the present invention.
  • the projection display method is not limited to:
  • FIG. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. As shown in FIG. 6, the electronic device includes a scanning sensor 601, an imager 602, an image outputter 603, and a processor 604.
  • the processor 604 is configured to control the scan sensor 601 to scan and detect a target object in a preset area corresponding to the operation interface, obtain a parameter corresponding to at least one target point in the target object, and control the imager 602. Performing virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object; and controlling projection display of the virtual image of the target object by the image outputter 603.
  • the parameter corresponding to the at least one target point of the target object includes a scan angle and a scan distance; the scan distance is a linear distance between the target point and the scan point; and the scan angle is the target point The line between the scanning point and the operation interface is at an angle.
  • FIG. 7 is a first schematic structural diagram of a projection display device according to an embodiment of the present invention. As shown in FIG. 7, the device includes an acquisition module 701, a virtual imaging processing module 702, and a control module 703.
  • the acquiring module 701 is configured to scan and detect a target object in a preset area corresponding to the operation interface, and obtain a parameter corresponding to at least one target point in the target object;
  • the parameter corresponding to the at least one target point of the target object includes a scanning angle and a scanning distance; wherein the scanning distance is a linear distance between the target point and the scanning point; the scanning angle is the The line between the target point and the scanning point is at an angle to the operation interface.
  • the virtual imaging processing module 702 is configured to perform virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object;
  • the control module 703 is configured to control a projection display of a virtual image of the target object.
  • the virtual imaging processing module 702 includes a coordinate positioning sub-module 7021 and a virtual imaging processing sub-module 7022;
  • the coordinate positioning sub-module 7021 is configured to determine a target point height and a plane coordinate corresponding to the target point based on the scan angle and the scan distance;
  • the target point height is a distance between the target point and the operation interface;
  • a plane coordinate corresponding to the target point is a plane coordinate of a projection point of the target point on the operation interface.
  • the virtual imaging processing sub-module 7022 is configured to perform virtual imaging processing according to the target point height and the plane coordinate corresponding to the target point, to obtain virtual imaging corresponding to the at least one target point, and to perform virtual imaging corresponding to the at least one target point. As a virtual imaging of the target object.
  • the device further includes a virtual transparent processing module 704;
  • the virtual transparent processing module 704 is configured to perform a virtualized and transparent process on the obtained virtual image of the target object to obtain a virtualized and transparent processed virtual image.
  • control module 703 is further configured to control a projection display of the virtualized transparent processed virtual image.
  • each module in the projection display device and the submodules included in each module of the embodiment of the present invention may be implemented by a processor in the electronic device to which the projection display device belongs, or may be implemented by specific logic.
  • the circuit is implemented; for example, in a practical application, a central processing unit (CPU), a microprocessor (Micro Processor Unit (MPU), a digital signal processor (Digital Signal Processor), which is located in an electronic device to which the projection display device belongs. DSP), or Field Programmable Gate Array (FPGA) implementation.
  • CPU central processing unit
  • MPU Micro Processor Unit
  • DSP Digital Signal Processor
  • FPGA Field Programmable Gate Array
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • the target object corresponding to the preset area of the operation interface is detected by scanning, and the parameter corresponding to the at least one target point in the target object is obtained; and the parameter corresponding to the at least one target point is used.
  • a virtual imaging process to obtain a virtual image of the target object; controlling a projection display of the virtual image of the target object.
  • the operation process of the operation interface can be displayed on the projection interface, so that the operation process is synchronously displayed on the basis of displaying the operation result on the projection interface.
  • the user can see both the operation result and the operation process on the projection interface, and eliminate the inconsistency that is caused by the complete separation of the projection interface and the operation interface to the user in the prior art, thereby improving the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

Provided in embodiments of the present invention are a projection display method, device, electronic apparatus and computer storage medium, the method comprising: scanning to detect a target object in a preset region corresponding to an operation interface, and acquiring a parameter corresponding to at least one target point in the target object; performing virtual imaging by utilizing the parameter corresponding to the at least one target point, and obtaining a virtual image of the target object; and controlling the displaying of a projection of the virtual image of the target object.

Description

一种投影显示方法、装置、电子设备及计算机存储介质Projection display method, device, electronic device and computer storage medium 技术领域Technical field
本发明涉及智能投影处理技术，尤其涉及一种投影显示方法、装置、电子设备及计算机存储介质。The invention relates to intelligent projection processing technology, in particular to a projection display method, device, electronic device and computer storage medium.
背景技术Background technique
目前，随着电子技术的飞速发展，智能投影技术已广泛应用于日常生活中。然而，对于现有的智能投影设备而言，以包括触摸屏类操作界面的投影仪为例，当操作者在触摸屏界面上对投影仪进行操作时，投影仪的投影界面只投射出操作者操作的结果。也就是说操作界面和投影界面是分离的，这就使观众只看到操作结果而看不到操作过程，容易产生投影界面显示不连贯、不流畅的感觉，严重影响用户体验。At present, with the rapid development of electronic technology, intelligent projection technology has been widely used in daily life. However, for the existing smart projection device, taking a projector including a touch screen type operation interface as an example, when the operator operates the projector on the touch screen interface, the projection interface of the projector only projects the operator's operation. result. That is to say, the operation interface and the projection interface are separated, which makes the viewer only see the operation result and can not see the operation process, and it is easy to produce a feeling that the projection interface is inconsistent and not smooth, which seriously affects the user experience.
发明内容Summary of the invention
本发明实施例提供一种投影显示方法、装置、电子设备及计算机存储介质，能够将操作界面的操作过程显示在投影界面，使得在投影界面显示操作结果的同时同步显示操作过程。The embodiment of the invention provides a projection display method, device, electronic device and computer storage medium, which can display the operation process of the operation interface on the projection interface, so that the operation result is synchronously displayed while the projection interface displays the operation result.
本发明实施例的技术方案是这样实现的：The technical solution of the embodiment of the present invention is implemented as follows:
本发明实施例提供一种投影显示方法，所述方法包括：Embodiments of the present invention provide a projection display method, where the method includes:
扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数；Scanning to detect a target object in a preset area corresponding to the operation interface, and obtaining a parameter corresponding to at least one target point in the target object;
利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；Performing a virtual imaging process using parameters corresponding to the at least one target point to obtain a virtual image of the target object;
控制所述目标对象的虚拟图像的投影显示。 A projection display of a virtual image of the target object is controlled.
上述方案中，所述目标对象中至少一个目标点对应的参数包括扫描夹角和扫描距离；In the above solution, the parameter corresponding to the at least one target point in the target object includes a scanning angle and a scanning distance;
其中，所述扫描距离为所述目标点与扫描点之间的直线距离；所述扫描夹角为所述目标点与扫描点之间的直线和所述操作界面所成夹角。The scanning distance is a linear distance between the target point and the scanning point; the scanning angle is an angle formed by a straight line between the target point and the scanning point and the operation interface.
上述方案中，所述利用至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像，包括：In the above solution, the virtual imaging process is performed by using the parameter corresponding to the at least one target point to obtain a virtual image of the target object, including:
基于所述扫描夹角和扫描距离确定目标点高度和目标点对应的平面坐标；Determining a plane coordinate corresponding to the target point height and the target point based on the scan angle and the scan distance;
根据所述目标点高度和目标点对应的平面坐标进行虚拟成像处理，得到至少一个目标点对应的虚拟成像，将所述至少一个目标点对应的虚拟成像作为所述目标对象的虚拟成像。And performing virtual imaging processing according to the target point height and the plane coordinate corresponding to the target point, obtaining virtual imaging corresponding to the at least one target point, and performing virtual imaging corresponding to the at least one target point as virtual imaging of the target object.
上述方案中，所述目标点高度为所述目标与所述操作界面的距离；所述目标点对应的平面坐标为所述目标点在所述操作界面上的投影点的平面坐标。In the above solution, the target point height is a distance between the target and the operation interface; a plane coordinate corresponding to the target point is a plane coordinate of a projection point of the target point on the operation interface.
上述方案中，所述方法还包括：In the above solution, the method further includes:
将所得到的所述目标对象的虚拟图像进行虚化透明处理，得到虚化透明处理后的虚拟图像；Performing a virtualized transparent process on the obtained virtual image of the target object to obtain a virtual image after the blur transparent process;
相应的，控制所述目标对象的虚拟图像的投影显示，包括：Correspondingly, controlling the projection display of the virtual image of the target object comprises:
控制所述虚化透明处理后的虚拟图像的投影显示。Controlling the projection display of the virtualized transparent processed image.
本发明实施例还提供一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，所述计算机可执行指令用于执行本发明实施例所述投影显示方法。The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the projection display method according to the embodiment of the invention.
本发明实施例还提供一种电子设备，所述电子设备包括扫描感应器、成像器、图像输出器和处理器；其中，An embodiment of the present invention further provides an electronic device, where the electronic device includes a scanning sensor, an imager, an image outputter, and a processor;
所述处理器，配置为控制所述扫描感应器扫描检测对应于操作界面的 预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数；控制所述成像器利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；控制所述图像输出器对所述目标对象的虚拟图像的投影显示。The processor is configured to control the scan sensor scan detection corresponding to an operation interface a target object in the preset area, obtaining a parameter corresponding to at least one target point in the target object; controlling the imager to perform virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object Controlling a projection display of the virtual image of the target object by the image outputter.
本发明实施例又提供一种投影显示装置，所述装置包括获取模块、虚拟成像处理模块和控制模块；其中，The embodiment of the invention further provides a projection display device, the device comprising an acquisition module, a virtual imaging processing module and a control module; wherein
所述获取模块，配置为扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数；The acquiring module is configured to scan and detect a target object in a preset area corresponding to the operation interface, and obtain a parameter corresponding to at least one target point in the target object;
所述虚拟成像处理模块，配置为利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；The virtual imaging processing module is configured to perform virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object;
所述控制模块，配置为控制对所述目标对象的虚拟图像的投影显示。The control module is configured to control a projection display of a virtual image of the target object.
上述方案中，所述目标对象中至少一个目标点对应的参数包括扫描夹角和扫描距离；In the above solution, the parameter corresponding to the at least one target point in the target object includes a scanning angle and a scanning distance;
其中，所述扫描距离为所述目标点与扫描点之间的直线距离；所述扫描夹角为所述目标点与扫描点之间的直线和所述操作界面所成夹角。The scanning distance is a linear distance between the target point and the scanning point; the scanning angle is an angle formed by a straight line between the target point and the scanning point and the operation interface.
上述方案中，所述虚拟成像处理模块包括坐标定位子模块和虚拟成像处理子模块；In the above solution, the virtual imaging processing module includes a coordinate positioning sub-module and a virtual imaging processing sub-module;
所述坐标定位子模块，配置为基于所述扫描夹角和扫描距离确定目标点高度和目标点对应的平面坐标；The coordinate positioning sub-module is configured to determine a target point height and a plane coordinate corresponding to the target point based on the scan angle and the scan distance;
所述虚拟成像处理子模块，配置为根据所述目标点高度和目标点对应的平面坐标进行虚拟成像处理，得到至少一个目标点对应的虚拟成像，将所述至少一个目标点对应的虚拟成像作为所述目标对象的虚拟成像。The virtual imaging processing sub-module is configured to perform virtual imaging processing according to the target point height and the plane coordinate corresponding to the target point, to obtain virtual imaging corresponding to the at least one target point, and to use the virtual imaging corresponding to the at least one target point as Virtual imaging of the target object.
上述方案中，所述目标点高度为所述目标点与所述操作界面的距离；所述目标点对应的平面坐标为所述目标点在所述操作界面上的投影点的平面坐标。 In the above solution, the target point height is a distance between the target point and the operation interface; a plane coordinate corresponding to the target point is a plane coordinate of a projection point of the target point on the operation interface.
上述方案中，所述装置还包括虚拟透明处理模块；其中，In the above solution, the device further includes a virtual transparent processing module;
所述虚拟透明处理模块，配置为将所得到的所述目标对象的虚拟图像进行虚化透明处理，得到虚化透明处理后的虚拟图像；The virtual transparent processing module is configured to perform a virtualized and transparent process on the obtained virtual image of the target object to obtain a virtualized and transparent processed virtual image;
相应的，所述控制模块，还配置为控制所述虚化透明处理后的虚拟图像的投影显示。Correspondingly, the control module is further configured to control a projection display of the virtualized and transparent processed virtual image.
本发明实施例所提供的投影显示方法、装置、电子设备及计算机存储介质，通过扫描检测对应于操作界面的预设区域的目标对象，获得所述目标对象中至少一个目标点对应的参数；利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；控制所述目标对象的虚拟图像的投影显示。如此，能够将操作界面的操作过程显示在投影界面，使得在投影界面显示操作结果的基础上，同步显示操作过程。这样，用户可以在投影界面既看到操作结果也看到操作过程，消除现有技术中由于投影界面与操作界面完全分离给用户带来的不连贯的感觉，从而提升用户体验。The projection display method, the device, the electronic device, and the computer storage medium provided by the embodiment of the present invention detect a target object corresponding to the preset area of the operation interface by scanning, and obtain a parameter corresponding to at least one target point in the target object; Performing virtual imaging processing on the parameter corresponding to the at least one target point to obtain a virtual image of the target object; and controlling projection display of the virtual image of the target object. In this way, the operation process of the operation interface can be displayed on the projection interface, so that the operation process is synchronously displayed on the basis of displaying the operation result on the projection interface. In this way, the user can see both the operation result and the operation process on the projection interface, and eliminate the inconsistency that is caused by the complete separation of the projection interface and the operation interface to the user in the prior art, thereby improving the user experience.
附图说明DRAWINGS
图1为本发明实施例投影显示方法的实现流程示意图一；1 is a schematic flowchart 1 of an implementation flow of a projection display method according to an embodiment of the present invention;
图2为本发明实施例投影显示方法的实现流程示意图二；2 is a second schematic diagram of an implementation flow of a projection display method according to an embodiment of the present invention;
图3为本发明实施例基于所述扫描夹角和扫描距离确定目标点高度和目标点对应的平面坐标的实现原理图；3 is a schematic diagram showing an implementation principle of determining a target point height and a plane coordinate corresponding to a target point based on the scanning angle and the scanning distance according to an embodiment of the present invention;
图4为本发明实施例投影显示方法的实现流程示意图三；4 is a schematic flowchart 3 of an implementation flow of a projection display method according to an embodiment of the present invention;
图5为本发明实施例投影显示方法在投影界面上的显示效果图；FIG. 5 is a diagram showing a display effect of a projection display method on a projection interface according to an embodiment of the present invention; FIG.
图6为本发明实施例电子设备的组成结构示意图；6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
图7为本发明实施例投影显示装置的组成结构示意图一；FIG. 7 is a first schematic structural diagram of a projection display device according to an embodiment of the present invention; FIG.
图8为本发明实施例虚拟成像处理模块的组成结构示意图；8 is a schematic structural diagram of a virtual imaging processing module according to an embodiment of the present invention;
图9为本发明实施例投影显示装置的组成结构示意图二。 FIG. 9 is a second schematic structural diagram of a projection display device according to an embodiment of the present invention.
具体实施方式detailed description
在本发明实施例中，扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数；利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；控制所述目标对象的虚拟图像的投影显示。In the embodiment of the present invention, the scan detects a target object in the preset area corresponding to the operation interface, obtains a parameter corresponding to at least one target point in the target object, and performs virtual imaging processing by using parameters corresponding to the at least one target point. Obtaining a virtual image of the target object; controlling projection display of the virtual image of the target object.
下面结合附图及具体实施例对本发明再作进一步详细的说明。The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.
实施例一Embodiment 1
图1为本发明实施例投影显示方法的实现流程示意图一，如图1所示，本发明实施例投影显示方法包括：1 is a schematic flowchart 1 of an implementation process of a projection display method according to an embodiment of the present invention. As shown in FIG. 1 , a projection display method according to an embodiment of the present invention includes:
步骤S101：扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数；Step S101: Scan to detect a target object in a preset area corresponding to the operation interface, and obtain a parameter corresponding to at least one target point in the target object;
具体地，电子设备可以通过设置于自身的扫描感应器等具有扫描检测功能的器件扫描检测对应于操作界面的预设区域中的目标对象，以获得所述目标对象中至少一个目标点对应的参数。Specifically, the electronic device may scan and detect a target object in a preset area corresponding to the operation interface by using a device having a scan detection function, such as a scan sensor provided in itself, to obtain a parameter corresponding to at least one target point in the target object. .
这里，所述电子设备可以为包括操作界面和投影界面的投影仪或其他具有投影功能的设备。其中，所述操作界面可以为触摸屏界面；所述操作界面还可以为类似于键盘的包含有不同功能的物理按键的操作界面。相应的，所述对应于操作界面的预设区域中的目标对象可以为作用于所述触摸屏界面上的触摸点或在所述触摸屏界面执行触摸操作的用户手指、触控笔等；所述对应于操作界面的预设区域中的目标对象还可以为在所述包括有不同功能的物理按键的操作界面执行按键操作的用户手指等。Here, the electronic device may be a projector including an operation interface and a projection interface or other device having a projection function. The operation interface may be a touch screen interface; the operation interface may also be an operation interface similar to a keyboard including physical buttons with different functions. Correspondingly, the target object in the preset area corresponding to the operation interface may be a touch point acting on the touch screen interface or a user finger, a stylus pen, etc. performing a touch operation on the touch screen interface; The target object in the preset area of the operation interface may also be a user's finger or the like that performs a key operation on the operation interface including the physical buttons having different functions.
这里，所述目标对象中至少一个目标点对应的参数包括扫描夹角和扫描距离；Here, the parameter corresponding to the at least one target point in the target object includes a scanning angle and a scanning distance;
其中，所述扫描距离为所述目标点与扫描点之间的直线距离；所述扫 描夹角为所述目标点与扫描点之间的直线和所述操作界面所成夹角。需要补充说明的是，所述扫描点为用于执行扫描检测操作的器件，如扫描感应器等在所述电子设备上所处的位置。Wherein the scanning distance is a linear distance between the target point and the scanning point; The angle of the drawing is an angle between the straight line between the target point and the scanning point and the operation interface. It should be additionally noted that the scanning point is a device for performing a scan detecting operation, such as a position where a scanning sensor or the like is located on the electronic device.
在实际应用中，电子设备中设置有控制本发明实施例所述投影显示的功能开关。当用户通过功能开关开启所述投影显示功能后，电子设备开始控制设置于自身的扫描感应器等具有扫描检测功能的器件来扫描检测对应于操作界面的预设区域中的目标对象，以获得所述目标对象中至少一个目标点对应的参数。In a practical application, a function switch for controlling the projection display according to the embodiment of the present invention is disposed in the electronic device. After the user turns on the projection display function through the function switch, the electronic device starts to control a device having a scan detection function, such as a scan sensor provided by itself, to scan and detect a target object in a preset area corresponding to the operation interface, to obtain a A parameter corresponding to at least one target point in the target object.
步骤S102：利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；Step S102: Perform virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object.
具体地，所述电子设备利用所述至少一个目标点对应的扫描夹角和扫描距离进行虚拟成像处理，得到所述目标对象中至少一个目标点的虚拟图像，作为所述目标对象的虚拟图像。Specifically, the electronic device performs a virtual imaging process by using a scan angle and a scan distance corresponding to the at least one target point, and obtains a virtual image of at least one target point in the target object as a virtual image of the target object.
这里，所述虚拟成像处理过程，可以采用现有技术中比较成熟的相关技术，这里不再赘述。Here, the virtual imaging processing process may adopt a related technology that is relatively mature in the prior art, and details are not described herein again.
步骤S103：控制所述目标对象的虚拟图像的投影显示。Step S103: Control a projection display of the virtual image of the target object.
具体地，所述电子设备在得到所述目标对象的虚拟图像后，实时地控制所述目标对象的虚拟图像在投影界面上的投影显示。Specifically, after obtaining the virtual image of the target object, the electronic device controls the projection display of the virtual image of the target object on the projection interface in real time.
通过本发明实施例所述投影显示方法，通过扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数；利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；控制所述目标对象的虚拟图像在投影界面上的投影显示。如此，能够将操作界面的操作过程显示在投影界面，使得在投影界面显示操作结果的基础上，同步显示操作过程。这样，用户可以在投影界面既看到操作结果也看到操作过程，消除现有技术中由于投影界面与操作界 面完全分离给用户带来的不连贯的感觉，从而提升用户体验。According to the projection display method of the embodiment of the present invention, a target object corresponding to at least one target point in the target object is obtained by detecting a target object in a preset area corresponding to the operation interface; and the at least one target point is corresponding to The parameter performs a virtual imaging process to obtain a virtual image of the target object; and controls a projection display of the virtual image of the target object on the projection interface. In this way, the operation process of the operation interface can be displayed on the projection interface, so that the operation process is synchronously displayed on the basis of displaying the operation result on the projection interface. In this way, the user can see both the operation result and the operation process on the projection interface, eliminating the prior art due to the projection interface and the operation boundary. The complete separation of the face gives the user a sense of incoherence, which enhances the user experience.
本发明实施例还提供一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，所述计算机可执行指令用于执行本发明实施例所述投影显示方法。The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the projection display method according to the embodiment of the invention.
实施例二Embodiment 2
图2为本发明实施例投影显示方法的实现流程示意图二，如图2所示，本发明实施例投影显示方法包括：FIG. 2 is a second schematic diagram of an implementation flow of a projection display method according to an embodiment of the present invention. As shown in FIG. 2, a projection display method according to an embodiment of the present invention includes:
步骤S201：扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的扫描夹角和扫描距离；Step S201: The scan detects a target object in the preset area corresponding to the operation interface, and obtains a scan angle and a scan distance corresponding to at least one target point in the target object;
其中，所述扫描距离为所述目标点与扫描点之间的直线距离；所述扫描夹角为所述目标点与扫描点之间的直线和所述操作界面所成夹角。The scanning distance is a linear distance between the target point and the scanning point; the scanning angle is an angle formed by a straight line between the target point and the scanning point and the operation interface.
步骤S202：基于所述扫描夹角和扫描距离确定目标点高度和目标点对应的平面坐标；Step S202: Determine a plane coordinate corresponding to the target point height and the target point based on the scan angle and the scan distance;
其中，所述目标点高度为所述目标点与所述操作界面的距离；所述目标点对应的平面坐标为所述目标点在所述操作界面上的投影点的平面坐标。The target point height is a distance between the target point and the operation interface; the plane coordinate corresponding to the target point is a plane coordinate of a projection point of the target point on the operation interface.
在一示例中，图3为本发明实施例基于所述扫描夹角和扫描距离确定目标点高度和目标点对应的平面坐标的实现原理图，如图3所示，利用长方形矩阵来表示投影仪的触摸屏界面，在触摸屏四周分布着4个扫描感应器，分别对应扫描点C、D、E、F。以其中一个扫描点C为例，当扫描到对应于操作界面的预设区域中，即触摸屏上方的目标对象中至少一个目标点M时，扫描感应器会获得并反馈扫描夹角A和扫描距离CM。坐标***根据扫描夹角A和扫描距离CM来计算确定目标点高度和目标点对应的平面坐标。具体地，根据扫描夹角A和扫描距离CM及扫描面与垂直面CE的夹角B计算出目标点M在触摸屏界面上的投影点N的平面坐标 (X＝CN*COS(B)，Y＝CO+CN*SIN(B))，并根据所述目标点M与所述触摸屏界面的距离计算出目标点M与所述触摸屏界面的距离，即目标点M的高度MN＝CM*SIN(A)。In an example, FIG. 3 is a schematic diagram of an implementation principle of determining a target point height and a plane coordinate corresponding to a target point based on the scan angle and the scan distance according to the embodiment of the present invention. As shown in FIG. 3, the rectangle matrix is used to represent the projector. The touch screen interface has four scanning sensors distributed around the touch screen, corresponding to scanning points C, D, E, and F, respectively. Taking one of the scanning points C as an example, when scanning into a preset area corresponding to the operation interface, that is, at least one target point M in the target object above the touch screen, the scanning sensor obtains and feeds back the scanning angle A and the scanning distance. CM. The coordinate locator calculates the plane coordinates corresponding to the target point height and the target point based on the scan angle A and the scan distance CM. Specifically, the plane coordinate of the projection point N of the target point M on the touch screen interface is calculated according to the scanning angle A and the scanning distance CM and the angle B between the scanning surface and the vertical plane CE. (X=CN*COS(B), Y=CO+CN*SIN(B)), and calculating the distance between the target point M and the touch screen interface according to the distance between the target point M and the touch screen interface, ie The height of the target point M is MN = CM * SIN (A).
步骤S203：根据所述目标点高度和目标点对应的平面坐标进行虚拟成像处理，得到至少一个目标点对应的虚拟成像，将所述至少一个目标点对应的虚拟成像作为所述目标对象的虚拟成像；Step S203: Perform virtual imaging processing according to the target point height and the plane coordinate corresponding to the target point, obtain virtual imaging corresponding to the at least one target point, and perform virtual imaging corresponding to the at least one target point as virtual imaging of the target object. ;
具体地，当通过计算确定出目标点高度和目标点对应的平面坐标后，即确定出目标点的三维信息定位，则所述电子设备进一步将所述三维信息定位传递给成像器进行虚拟成像，最终得到所述目标对象的虚拟成像。Specifically, after determining the target point height and the plane coordinate corresponding to the target point by calculation, that is, determining the three-dimensional information positioning of the target point, the electronic device further transmits the three-dimensional information positioning to the imager for virtual imaging, Finally, a virtual imaging of the target object is obtained.
这里，所述虚拟成像处理过程，可以采用现有技术中比较成熟的相关技术，这里不再赘述。Here, the virtual imaging processing process may adopt a related technology that is relatively mature in the prior art, and details are not described herein again.
步骤S204：控制所述目标对象的虚拟图像的投影显示。Step S204: Control a projection display of the virtual image of the target object.
如此，通过本发明实施例所述投影显示方法，能够将操作界面的操作过程显示在投影界面，使得在投影界面显示操作结果的基础上，同步显示操作过程。这样，用户可以在投影界面既看到操作结果也看到操作过程，消除现有技术中由于投影界面与操作界面完全分离给用户带来的不连贯的感觉，从而提升用户体验。As such, the projection display method according to the embodiment of the present invention can display the operation process of the operation interface on the projection interface, so that the operation process is synchronously displayed on the basis of displaying the operation result on the projection interface. In this way, the user can see both the operation result and the operation process on the projection interface, and eliminate the inconsistency that is caused by the complete separation of the projection interface and the operation interface to the user in the prior art, thereby improving the user experience.
本发明实施例还提供一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，所述计算机可执行指令用于执行本发明实施例所述投影显示方法。The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the projection display method according to the embodiment of the invention.
实施例三Embodiment 3
图4为本发明实施例投影显示方法的实现流程示意图三，如图4所示，本发明实施例投影显示方法包括：FIG. 4 is a schematic flowchart 3 of an implementation flow of a projection display method according to an embodiment of the present invention. As shown in FIG. 4, a projection display method according to an embodiment of the present invention includes:
步骤S401：扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数； Step S401: The scan detects a target object in a preset area corresponding to the operation interface, and obtains a parameter corresponding to at least one target point in the target object;
这里，所述目标对象中至少一个目标点对应的参数包括扫描夹角和扫描距离；Here, the parameter corresponding to the at least one target point in the target object includes a scanning angle and a scanning distance;
其中，所述扫描距离为所述目标点与扫描点之间的直线距离；所述扫描夹角为所述目标点与扫描点之间的直线和所述操作界面所成夹角。The scanning distance is a linear distance between the target point and the scanning point; the scanning angle is an angle formed by a straight line between the target point and the scanning point and the operation interface.
步骤S402：利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；Step S402: Perform virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object.
步骤S403：将所得到的所述目标对象的虚拟图像进行虚化透明处理，得到虚化透明处理后的虚拟图像；Step S403: Performing a virtualized transparent process on the obtained virtual image of the target object to obtain a virtual image after the blur transparent process;
这里，通过电子设备中的图像处理器对所得到的所述目标对象的虚拟图像进行虚化透明处理，使得在投影界面上显示所述目标对象的虚拟成像时，并不会完全遮盖投影界面上本来需要显示的操作结果。Here, the obtained virtual image of the target object is subjected to blur transparent processing by an image processor in the electronic device, so that when the virtual image of the target object is displayed on the projection interface, the projection interface is not completely covered. The result of the operation that would have been displayed.
这里，所述虚拟透明处理过程，可以采用现有技术中比较成熟的相关技术，这里不再赘述。Here, the virtual transparent processing process may adopt a related technology that is relatively mature in the prior art, and details are not described herein again.
步骤S404：控制所述虚化透明处理后的虚拟图像的投影显示。Step S404: Control the projection display of the virtual image after the blur transparent processing.
通过本发明实施例所述投影显示方法，在得到所述目标对象的虚拟图像的基础上，进一步将所得到的所述目标对象的虚拟图像进行虚化透明处理，得到虚化透明处理后的虚拟图像；之后，控制所述虚化透明处理后的虚拟图像的投影显示，如图5所示。如此，能够将操作界面的操作过程显示在投影界面，使得在投影界面显示操作结果的基础上，同步显示操作过程，即显示所述虚化透明处理后的虚拟图像。这样，由于电子设备中的图像处理器对所得到的所述目标对象的虚拟图像进行虚化透明处理，使得在投影界面上显示所述目标对象的虚拟成像时，并不会完全遮盖投影界面上本来需要显示的操作结果，从而提升用户体验。According to the projection display method of the embodiment of the present invention, on the basis of obtaining the virtual image of the target object, the obtained virtual image of the target object is further subjected to blurring and transparent processing to obtain virtualized and transparent processed images. Image; after that, the projection display of the virtualized transparent image is controlled, as shown in FIG. 5. In this way, the operation process of the operation interface can be displayed on the projection interface, so that the display operation process is synchronized, that is, the virtual image after the blur transparent process is displayed on the basis of displaying the operation result on the projection interface. In this way, since the image processor in the electronic device performs the blur transparent processing on the obtained virtual image of the target object, when the virtual image of the target object is displayed on the projection interface, the projection interface is not completely covered. The result of the operation that needs to be displayed, thereby improving the user experience.
本发明实施例还提供一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，所述计算机可执行指令用于执行本发明实施例所 述投影显示方法。The embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the embodiment of the present invention. The projection display method.
实施例四Embodiment 4
图6为本发明实施例电子设备的组成结构示意图，如图6所示，所述电子设备包括扫描感应器601、成像器602、图像输出器603和处理器604；其中，FIG. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. As shown in FIG. 6, the electronic device includes a scanning sensor 601, an imager 602, an image outputter 603, and a processor 604.
所述处理器604，配置为控制所述扫描感应器601扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数；控制所述成像器602利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；控制所述图像输出器603对所述目标对象的虚拟图像的投影显示。The processor 604 is configured to control the scan sensor 601 to scan and detect a target object in a preset area corresponding to the operation interface, obtain a parameter corresponding to at least one target point in the target object, and control the imager 602. Performing virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object; and controlling projection display of the virtual image of the target object by the image outputter 603.
其中，所述目标对象中至少一个目标点对应的参数包括扫描夹角和扫描距离；所述扫描距离为所述目标点与扫描点之间的直线距离；所述扫描夹角为所述目标点与扫描点之间的直线和所述操作界面所成夹角。The parameter corresponding to the at least one target point of the target object includes a scan angle and a scan distance; the scan distance is a linear distance between the target point and the scan point; and the scan angle is the target point The line between the scanning point and the operation interface is at an angle.
实施例五Embodiment 5
图7为本发明实施例投影显示装置的组成结构示意图一，如图7所示，所述装置包括获取模块701、虚拟成像处理模块702和控制模块703；其中，FIG. 7 is a first schematic structural diagram of a projection display device according to an embodiment of the present invention. As shown in FIG. 7, the device includes an acquisition module 701, a virtual imaging processing module 702, and a control module 703.
所述获取模块701，配置为扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数；The acquiring module 701 is configured to scan and detect a target object in a preset area corresponding to the operation interface, and obtain a parameter corresponding to at least one target point in the target object;
这里，所述目标对象中至少一个目标点对应的参数包括扫描夹角和扫描距离；其中，所述扫描距离为所述目标点与扫描点之间的直线距离；所述扫描夹角为所述目标点与扫描点之间的直线和所述操作界面所成夹角。Here, the parameter corresponding to the at least one target point of the target object includes a scanning angle and a scanning distance; wherein the scanning distance is a linear distance between the target point and the scanning point; the scanning angle is the The line between the target point and the scanning point is at an angle to the operation interface.
所述虚拟成像处理模块702，配置为利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；The virtual imaging processing module 702 is configured to perform virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object;
所述控制模块703，配置为控制所述目标对象的虚拟图像的投影显示。 The control module 703 is configured to control a projection display of a virtual image of the target object.
在一实施例中，如图8所示，所述虚拟成像处理模块702包括坐标定位子模块7021和虚拟成像处理子模块7022；In an embodiment, as shown in FIG. 8, the virtual imaging processing module 702 includes a coordinate positioning sub-module 7021 and a virtual imaging processing sub-module 7022;
所述坐标定位子模块7021，配置为基于所述扫描夹角和扫描距离确定目标点高度和目标点对应的平面坐标；The coordinate positioning sub-module 7021 is configured to determine a target point height and a plane coordinate corresponding to the target point based on the scan angle and the scan distance;
这里，所述目标点高度为所述目标点与所述操作界面的距离；所述目标点对应的平面坐标为所述目标点在所述操作界面上的投影点的平面坐标。Here, the target point height is a distance between the target point and the operation interface; a plane coordinate corresponding to the target point is a plane coordinate of a projection point of the target point on the operation interface.
所述虚拟成像处理子模块7022，配置为根据所述目标点高度和目标点对应的平面坐标进行虚拟成像处理，得到至少一个目标点对应的虚拟成像，将所述至少一个目标点对应的虚拟成像作为所述目标对象的虚拟成像。The virtual imaging processing sub-module 7022 is configured to perform virtual imaging processing according to the target point height and the plane coordinate corresponding to the target point, to obtain virtual imaging corresponding to the at least one target point, and to perform virtual imaging corresponding to the at least one target point. As a virtual imaging of the target object.
在一实施例中，如图9所示，所述装置还包括虚拟透明处理模块704；其中，In an embodiment, as shown in FIG. 9, the device further includes a virtual transparent processing module 704;
所述虚拟透明处理模块704，配置为将所得到的所述目标对象的虚拟图像进行虚化透明处理，得到虚化透明处理后的虚拟图像；The virtual transparent processing module 704 is configured to perform a virtualized and transparent process on the obtained virtual image of the target object to obtain a virtualized and transparent processed virtual image.
相应的，所述控制模块703，还配置为控制所述虚化透明处理后的虚拟图像的投影显示。Correspondingly, the control module 703 is further configured to control a projection display of the virtualized transparent processed virtual image.
在实际应用中，本发明实施例所述投影显示装置中的各模块及其各模块所包括的子模块均可以通过所述投影显示装置所属电子设备中的处理器实现，也可以通过具体的逻辑电路实现；比如，在实际应用中，可由位于投影显示装置所属电子设备的中央处理器(Central Processing Unit，CPU)、微处理器(Micro Processor Unit，MPU)、数字信号处理器(Digital Signal Processor，DSP)、或现场可编程门阵列(Field Programmable Gate Array，FPGA)实现。In practical applications, each module in the projection display device and the submodules included in each module of the embodiment of the present invention may be implemented by a processor in the electronic device to which the projection display device belongs, or may be implemented by specific logic. The circuit is implemented; for example, in a practical application, a central processing unit (CPU), a microprocessor (Micro Processor Unit (MPU), a digital signal processor (Digital Signal Processor), which is located in an electronic device to which the projection display device belongs. DSP), or Field Programmable Gate Array (FPGA) implementation.
本发明实施例所记载的技术方案之间，在不冲突的情况下，可以任意组合。 The technical solutions described in the embodiments of the present invention can be arbitrarily combined without conflict.
本领域内的技术人员应明白，本发明的实施例可提供为方法、***、或计算机程序产品。因此，本发明可采用硬件实施例、软件实施例、或结合软件和硬件方面的实施例的形式。而且，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
本发明是参照根据本发明实施例的方法、设备(***)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
以上所述，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本发明的保护范围之内。 The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention.
工业实用性Industrial applicability
本发明实施例所述投影显示方法，通过扫描检测对应于操作界面的预设区域的目标对象，获得所述目标对象中至少一个目标点对应的参数；利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；控制所述目标对象的虚拟图像的投影显示。如此，能够将操作界面的操作过程显示在投影界面，使得在投影界面显示操作结果的基础上，同步显示操作过程。这样，用户可以在投影界面既看到操作结果也看到操作过程，消除现有技术中由于投影界面与操作界面完全分离给用户带来的不连贯的感觉，从而提升用户体验。 In the projection display method of the embodiment of the present invention, the target object corresponding to the preset area of the operation interface is detected by scanning, and the parameter corresponding to the at least one target point in the target object is obtained; and the parameter corresponding to the at least one target point is used. a virtual imaging process to obtain a virtual image of the target object; controlling a projection display of the virtual image of the target object. In this way, the operation process of the operation interface can be displayed on the projection interface, so that the operation process is synchronously displayed on the basis of displaying the operation result on the projection interface. In this way, the user can see both the operation result and the operation process on the projection interface, and eliminate the inconsistency that is caused by the complete separation of the projection interface and the operation interface to the user in the prior art, thereby improving the user experience.

Claims (12)

  1. 一种投影显示方法，所述方法包括：A projection display method, the method comprising:
    扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数；Scanning to detect a target object in a preset area corresponding to the operation interface, and obtaining a parameter corresponding to at least one target point in the target object;
    利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；Performing a virtual imaging process using parameters corresponding to the at least one target point to obtain a virtual image of the target object;
    控制所述目标对象的虚拟图像的投影显示。A projection display of a virtual image of the target object is controlled.
  2. 根据权利要求1所述的方法，其中，所述目标对象中至少一个目标点对应的参数包括扫描夹角和扫描距离；The method according to claim 1, wherein the parameter corresponding to at least one target point in the target object comprises a scanning angle and a scanning distance;
    其中，所述扫描距离为所述目标点与扫描点之间的直线距离；所述扫描夹角为所述目标点与扫描点之间的直线和所述操作界面所成夹角。The scanning distance is a linear distance between the target point and the scanning point; the scanning angle is an angle formed by a straight line between the target point and the scanning point and the operation interface.
  3. 根据权利要求2所述的方法，其中，所述利用至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像，包括：The method according to claim 2, wherein the virtual imaging process is performed by using parameters corresponding to the at least one target point to obtain a virtual image of the target object, including:
    基于所述扫描夹角和扫描距离确定目标点高度和目标点对应的平面坐标；Determining a plane coordinate corresponding to the target point height and the target point based on the scan angle and the scan distance;
    根据所述目标点高度和目标点对应的平面坐标进行虚拟成像处理，得到至少一个目标点对应的虚拟成像，将所述至少一个目标点对应的虚拟成像作为所述目标对象的虚拟成像。And performing virtual imaging processing according to the target point height and the plane coordinate corresponding to the target point, obtaining virtual imaging corresponding to the at least one target point, and performing virtual imaging corresponding to the at least one target point as virtual imaging of the target object.
  4. 根据权利要求3所述的方法，其中，所述目标点高度为所述目标与所述操作界面的距离；所述目标点对应的平面坐标为所述目标点在所述操作界面上的投影点的平面坐标。The method according to claim 3, wherein the target point height is a distance between the target and the operation interface; a plane coordinate corresponding to the target point is a projection point of the target point on the operation interface Plane coordinates.
  5. 根据权利要求1至4任一项所述的方法，其中，所述方法还包括：The method of any of claims 1 to 4, wherein the method further comprises:
    将所得到的所述目标对象的虚拟图像进行虚化透明处理，得到虚化透明处理后的虚拟图像；Performing a virtualized transparent process on the obtained virtual image of the target object to obtain a virtual image after the blur transparent process;
    相应的，控制所述目标对象的虚拟图像的投影显示，包括： Correspondingly, controlling the projection display of the virtual image of the target object comprises:
    控制所述虚化透明处理后的虚拟图像的投影显示。Controlling the projection display of the virtualized transparent processed image.
  6. 一种电子设备，所述电子设备包括扫描感应器、成像器、图像输出器和处理器；An electronic device including a scanning sensor, an imager, an image outputter, and a processor;
    所述处理器，配置为控制所述扫描感应器扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数；控制所述成像器利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；控制所述图像输出器对所述目标对象的虚拟图像的投影显示。The processor is configured to control the scan sensor to detect a target object in a preset area corresponding to the operation interface, obtain a parameter corresponding to at least one target point in the target object, and control the imager to utilize the And performing virtual imaging processing on the parameter corresponding to the at least one target point to obtain a virtual image of the target object; and controlling the image display of the virtual image of the target object by the image output device.
  7. 一种投影显示装置，所述装置包括获取模块、虚拟成像处理模块和控制模块；A projection display device, the device comprising an acquisition module, a virtual imaging processing module and a control module;
    所述获取模块，配置为扫描检测对应于操作界面的预设区域中的目标对象，获得所述目标对象中至少一个目标点对应的参数；The acquiring module is configured to scan and detect a target object in a preset area corresponding to the operation interface, and obtain a parameter corresponding to at least one target point in the target object;
    所述虚拟成像处理模块，配置为利用所述至少一个目标点对应的参数进行虚拟成像处理，得到所述目标对象的虚拟图像；The virtual imaging processing module is configured to perform virtual imaging processing by using parameters corresponding to the at least one target point to obtain a virtual image of the target object;
    所述控制模块，配置为控制对所述目标对象的虚拟图像的投影显示。The control module is configured to control a projection display of a virtual image of the target object.
  8. 根据权利要求7所述的装置，其中，所述目标对象中至少一个目标点对应的参数包括扫描夹角和扫描距离；The apparatus according to claim 7, wherein the parameter corresponding to the at least one target point in the target object comprises a scanning angle and a scanning distance;
    其中，所述扫描距离为所述目标点与扫描点之间的直线距离；所述扫描夹角为所述目标点与扫描点之间的直线和所述操作界面所成夹角。The scanning distance is a linear distance between the target point and the scanning point; the scanning angle is an angle formed by a straight line between the target point and the scanning point and the operation interface.
  9. 根据权利要求8所述的装置，其中，所述虚拟成像处理模块包括坐标定位子模块和虚拟成像处理子模块；The apparatus of claim 8, wherein the virtual imaging processing module comprises a coordinate positioning sub-module and a virtual imaging processing sub-module;
    所述坐标定位子模块，配置为基于所述扫描夹角和扫描距离确定目标点高度和目标点对应的平面坐标；The coordinate positioning sub-module is configured to determine a target point height and a plane coordinate corresponding to the target point based on the scan angle and the scan distance;
    所述虚拟成像处理子模块，配置为根据所述目标点高度和目标点对应的平面坐标进行虚拟成像处理，得到至少一个目标点对应的虚拟成像，将 所述至少一个目标点对应的虚拟成像作为所述目标对象的虚拟成像。The virtual imaging processing sub-module is configured to perform virtual imaging processing according to the target point height and the plane coordinate corresponding to the target point, to obtain virtual imaging corresponding to the at least one target point, and The virtual imaging corresponding to the at least one target point serves as virtual imaging of the target object.
  10. 根据权利要求9所述的装置，其中，所述目标点高度为所述目标点与所述操作界面的距离；所述目标点对应的平面坐标为所述目标点在所述操作界面上的投影点的平面坐标。The device according to claim 9, wherein the target point height is a distance between the target point and the operation interface; a plane coordinate corresponding to the target point is a projection of the target point on the operation interface The plane coordinate of the point.
  11. 根据权利要求7至10任一项所述的装置，其中，所述装置还包括虚拟透明处理模块；The apparatus according to any one of claims 7 to 10, wherein the apparatus further comprises a virtual transparent processing module;
    所述虚拟透明处理模块，配置为将所得到的所述目标对象的虚拟图像进行虚化透明处理，得到虚化透明处理后的虚拟图像；The virtual transparent processing module is configured to perform a virtualized and transparent process on the obtained virtual image of the target object to obtain a virtualized and transparent processed virtual image;
    相应的，所述控制模块，还配置为控制所述虚化透明处理后的虚拟图像的投影显示。Correspondingly, the control module is further configured to control a projection display of the virtualized and transparent processed virtual image.
  12. 一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，所述计算机可执行指令用于执行权利要求1至5任一项所述投影显示方法。 A computer storage medium having stored therein computer executable instructions for performing the projection display method of any one of claims 1 to 5.
PCT/CN2015/096943 2015-08-24 2015-12-10 Projection display method, device, electronic apparatus and computer storage medium WO2016165362A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510523224.5A CN106488160A (en) 2015-08-24 2015-08-24 A kind of method for displaying projection, device and electronic equipment
CN201510523224.5 2015-08-24

Publications (1)

Publication Number Publication Date
WO2016165362A1 true WO2016165362A1 (en) 2016-10-20

Family

ID=57125614

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/096943 WO2016165362A1 (en) 2015-08-24 2015-12-10 Projection display method, device, electronic apparatus and computer storage medium

Country Status (2)

Country Link
CN (1) CN106488160A (en)
WO (1) WO2016165362A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112954206A (en) * 2021-02-05 2021-06-11 上海富彭展览展示服务有限公司 Virtual makeup display method, system, device and storage medium thereof
CN113593015A (en) * 2021-07-27 2021-11-02 杭州思锐迪科技有限公司 Scanning system, method, device, electronic device and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107222676B (en) 2017-05-26 2020-06-02 Tcl移动通信科技（宁波）有限公司 Blurred picture generation method, storage device and mobile terminal

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100177035A1 (en) * 2008-10-10 2010-07-15 Schowengerdt Brian T Mobile Computing Device With A Virtual Keyboard
CN101963840A (en) * 2009-07-22 2011-02-02 罗技欧洲公司 Be used for system and method long-range, the virtual screen input
CN102063183A (en) * 2011-02-12 2011-05-18 深圳市亿思达显示科技有限公司 Virtual input device of grove type
CN102662585A (en) * 2012-04-06 2012-09-12 潘晓雷 Method for adaptively regulating touch input range of screen, and mobile terminal
US8959013B2 (en) * 2010-09-27 2015-02-17 Apple Inc. Virtual keyboard for a non-tactile three dimensional user interface

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007093984A2 (en) * 2006-02-16 2007-08-23 Ftk Technologies Ltd. A system and method of inputting data into a computing system
US8228345B2 (en) * 2008-09-24 2012-07-24 International Business Machines Corporation Hand image feedback method and system
CN102736726A (en) * 2011-04-11 2012-10-17 曾亚东 Stealth technology for keyboard and mouse
DE102011112663A1 (en) * 2011-09-05 2013-03-07 Doron Lahav Data inputting method involves determining position of finger of user based on position of keys on keyboard and displaying keys and fingers on display during data input of user

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100177035A1 (en) * 2008-10-10 2010-07-15 Schowengerdt Brian T Mobile Computing Device With A Virtual Keyboard
CN101963840A (en) * 2009-07-22 2011-02-02 罗技欧洲公司 Be used for system and method long-range, the virtual screen input
US8959013B2 (en) * 2010-09-27 2015-02-17 Apple Inc. Virtual keyboard for a non-tactile three dimensional user interface
CN102063183A (en) * 2011-02-12 2011-05-18 深圳市亿思达显示科技有限公司 Virtual input device of grove type
CN102662585A (en) * 2012-04-06 2012-09-12 潘晓雷 Method for adaptively regulating touch input range of screen, and mobile terminal

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112954206A (en) * 2021-02-05 2021-06-11 上海富彭展览展示服务有限公司 Virtual makeup display method, system, device and storage medium thereof
CN113593015A (en) * 2021-07-27 2021-11-02 杭州思锐迪科技有限公司 Scanning system, method, device, electronic device and storage medium

Also Published As

Publication number Publication date
CN106488160A (en) 2017-03-08

Similar Documents

Publication Publication Date Title
US9519968B2 (en) Calibrating visual sensors using homography operators
TWI544447B (en) System and method for augmented reality
US10600169B2 (en) Image processing system and image processing method
US20160054791A1 (en) Navigating augmented reality content with a watch
JP6146094B2 (en) Information operation display system, display program, and display method
US20150256815A1 (en) 3d camera calibration
JP2013235373A5 (en)
JP5802247B2 (en) Information processing device
JP5496032B2 (en) Tactile sensation presentation apparatus and control method for tactile sensation presentation apparatus
JP2013178636A5 (en)
CN103677240A (en) Virtual touch interaction method and equipment
CN102508578A (en) Projection positioning device and method as well as interaction system and method
JP2017199289A (en) Information processor, control method thereof, program, and storage medium
JP2014170483A5 (en)
WO2016165362A1 (en) Projection display method, device, electronic apparatus and computer storage medium
JP2015019133A5 (en)
CN106919247B (en) Virtual image display method and device
US20140168165A1 (en) Electronic device with virtual touch function and instant adjusting method for virtual touch
US20150029351A1 (en) Display method, image capturing method and electronic device
US20140043443A1 (en) Method and system for displaying content to have a fixed pose
JP2015177428A5 (en)
JP2018055685A (en) Information processing device, control method thereof, program, and storage medium
TWI719591B (en) Method and computer system for object tracking
EP3059664A1 (en) A method for controlling a device by gestures and a system for controlling a device by gestures
KR20140148288A (en) Three-dimensional interactive system and interactive sensing method thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15889058

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15889058

Country of ref document: EP

Kind code of ref document: A1