CN112000241B - Operation recognition method and device, storage medium and electronic device - Google Patents
Operation recognition method and device, storage medium and electronic device Download PDFInfo
- Publication number
- CN112000241B CN112000241B CN202010761832.0A CN202010761832A CN112000241B CN 112000241 B CN112000241 B CN 112000241B CN 202010761832 A CN202010761832 A CN 202010761832A CN 112000241 B CN112000241 B CN 112000241B
- Authority
- CN
- China
- Prior art keywords
- projection area
- light spot
- infrared light
- infrared
- size
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000004590 computer program Methods 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 10
- 230000002452 interceptive effect Effects 0.000 abstract description 18
- 238000005516 engineering process Methods 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 14
- 230000005540 biological transmission Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 210000001015 abdomen Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0412—Digitisers structurally integrated in a display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Position Input By Displaying (AREA)
Abstract
The application provides an operation identification method and device, a storage medium and an electronic device, wherein the method comprises the following steps: collecting infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device; and determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is an effective contact operation according to the size of the infrared light spot. The application solves the problem that the invalid contact operation of the interfering object cannot be identified in the related technology.
Description
Technical Field
The present application relates to the field of communications, and in particular, to an operation identification method and apparatus, a storage medium, and an electronic apparatus.
Background
An ultra-short focus desktop projection and infrared touch equipment, such as a projection loudspeaker box, is a device which is placed on a desktop for use, can display a projection rectangular picture on the desktop, and can realize finger click touch operation on the projection picture. Although both projection technology and infrared detection technology are relatively mature, the product combining the two has many challenges or many instabilities, and mainly shows that infrared touch control is easy to be disturbed. For example, when the projection display area is provided with a pen, a rubber, a mouse, an electric wire, a desktop bulge, even the whole palm, arms, bellies, clothes and other interfering objects, the touch effect of the finger can be seriously affected, and the phenomena of insanitation, false triggering and the like of the finger are caused.
Aiming at the problem that the ineffective contact operation of the interfering object cannot be identified in the related art, no effective technical scheme has been proposed yet.
Disclosure of Invention
The embodiment of the application provides an operation identification method and device, a storage medium and an electronic device, which are used for at least solving the problem that invalid contact operation of an interfering object cannot be identified in the related technology.
According to an embodiment of the present application, there is provided an operation recognition method including:
collecting infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
and determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is an effective contact operation according to the size of the infrared light spot.
Optionally, the identifying whether the contact of the target object to the projection area is a valid contact operation according to the size of the infrared light spot includes: determining that the contact of the first object to the projection area is an ineffective contact operation under the condition that a first light spot exists in at least one infrared light spot; the size of the first light spot is smaller than or equal to a first threshold value or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays through the first object contacting the projection area, and the target object comprises the first object.
Optionally, the identifying whether the contact of the target object to the projection area is a valid contact operation according to the size of the infrared light spot includes: judging whether a second light spot exists in at least one infrared light spot, wherein the size of the second light spot is larger than a first threshold value and smaller than a second threshold value; determining the number of at least one of the second spots in the presence of the second spot; determining that the contact of the second object to the projection area is effective contact operation under the condition that the quantity meets a third preset condition; wherein the second light spot is formed by the reflection of the infrared ray by the second object contacting the projection area, and the target object comprises the second object.
Optionally, after the determining the size of the infrared light spot, identifying whether the contact of the target object to the projection area is a valid contact operation according to the size of the infrared light spot, the method further includes: and under the condition that the contact of the target object to the projection area is identified as effective contact operation, responding to the effective contact operation, and generating a touch signal corresponding to the effective contact operation.
Optionally, in the case that the contact of the target object to the projection area is identified as an effective contact operation, generating a touch signal corresponding to the effective contact operation in response to the effective contact operation, including: determining coordinates of the effective contact operation from the emitted light forming the infrared light spot; and generating a touch signal corresponding to the effective touch operation according to the coordinates.
Optionally, before the collecting the infrared light spot, the method further comprises: and projecting the target area through the projection device to obtain the projection area, and transmitting an infrared light beam to the projection area through an infrared laser transmitter.
According to another embodiment of the present application, there is provided an operation recognition apparatus including:
the acquisition module is used for acquiring infrared light spots through the infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
and the identification module is used for determining the size of the infrared light spot and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot.
Optionally, the identification module is further configured to: determining that the contact of the first object to the projection area is an ineffective contact operation under the condition that a first light spot exists in at least one infrared light spot; the size of the first light spot is smaller than or equal to a first threshold value or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays through the first object contacting the projection area, and the target object comprises the first object.
Alternatively, according to another embodiment of the present application, there is provided a storage medium having stored therein a computer program, wherein the computer program is arranged to perform the above method when run.
Alternatively, according to another embodiment of the application, there is provided an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the above method.
According to the application, the infrared camera is used for collecting the infrared light spots, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through the projection device; and determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is an effective contact operation according to the size of the infrared light spot. Therefore, the problem that invalid contact operation of an interfering object cannot be identified in the related technology can be solved, the identification accuracy of the contact operation is improved, and the user experience is optimized.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:
FIG. 1 is a flow chart of a method of operation identification according to an embodiment of the present application;
FIG. 2 is a schematic diagram of an ultra-short focal desktop projection and infrared touch device according to an embodiment of the present application;
FIG. 3 is a flow chart of a method of operation identification according to another embodiment of the present application;
FIG. 4 is a schematic diagram of a touch operation according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a touch operation according to another embodiment of the present application;
FIG. 6 is a schematic diagram of a touch operation according to another embodiment of the present application;
fig. 7 is a block diagram of the operation recognition apparatus according to an embodiment of the present application;
fig. 8 is a block diagram of an operation recognition apparatus according to another embodiment of the present application;
fig. 9 is a block diagram of an operation recognition apparatus according to still another embodiment of the present application;
fig. 10 is a schematic structural view of an alternative electronic device according to an embodiment of the present application.
Detailed Description
The application will be described in detail hereinafter with reference to the drawings in conjunction with embodiments. It should be noted that, without conflict, the embodiments of the present application and features of the embodiments may be combined with each other.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order.
An embodiment of the present application provides an operation identification method, and fig. 1 is a flowchart of the operation identification method according to an embodiment of the present application, as shown in fig. 1, including:
step S102, collecting infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
step S104, determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is an effective contact operation according to the size of the infrared light spot.
According to the application, the infrared camera is used for collecting the infrared light spots, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through the projection device; and determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is an effective contact operation according to the size of the infrared light spot. Therefore, the problem that invalid contact operation of an interfering object cannot be identified in the related technology can be solved, the identification accuracy of the contact operation is improved, and the user experience is optimized.
In the above embodiment, before the collecting the infrared light spot, the method further includes: and projecting the target area through the projection device to obtain the projection area, and transmitting an infrared light beam to the projection area through an infrared laser transmitter. As an alternative embodiment, the projection device may be an ultra-short Jiao Guangji, for example, by projecting the ultra-short Jiao Guangji onto the target area to form a projection area, and by emitting an infrared beam of light onto the projection area by an infrared laser emitter, the infrared light being reflected by the target object when the target object contacts the projection area, the emitted light forming an infrared spot, which is then captured by an infrared camera.
The size of the infrared light spot may be the diameter or the area of the infrared light spot, or the size of the infrared light spot may be the width of the infrared light spot when the infrared light spot is in a band shape.
Based on the above embodiment, the identifying whether the contact of the target object to the projection area is a valid contact operation according to the size of the infrared light spot includes: determining that the contact of the first object to the projection area is an ineffective contact operation under the condition that a first light spot exists in at least one infrared light spot; the size of the first light spot is smaller than or equal to a first threshold value or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays through the first object contacting the projection area, and the target object comprises the first object.
Under the condition that a first light spot with the size smaller than or equal to a first threshold value or larger than or equal to a second threshold value exists in infrared light spots collected by an infrared camera, determining that a first object corresponding to the first light spot is an interfering object, the first light spot is an invalid light spot, and the contact of the first object to a projection area is an invalid contact operation, so that the identification of the invalid contact operation of the interfering object is realized, the influence of the interfering object on the touch operation is avoided, the accuracy of the touch operation is improved, and the user experience is optimized.
In the above embodiment, the identifying whether the contact of the target object to the projection area is a valid contact operation according to the size of the infrared light spot further includes: judging whether a second light spot exists in at least one infrared light spot, wherein the size of the second light spot is larger than a first threshold value and smaller than a second threshold value; determining the number of at least one of the second spots in the presence of the second spot; determining that the contact of the second object to the projection area is effective contact operation under the condition that the quantity meets a third preset condition; wherein the second light spot is formed by the reflection of the infrared ray by the second object contacting the projection area, and the target object comprises the second object.
Based on the above embodiment, in the case where there is a second light spot whose size is greater than the first threshold value and smaller than the second threshold value in the infrared light spot collected by the infrared camera, it is determined that the second object corresponding to the second light spot is not an interfering object. Because the number of touch points supported by the touch device is limited, it is further determined whether the number of second light spots meets a third preset condition, for example, the third preset condition is that the number of second light spots is smaller than a number threshold. Under the condition that the number of the second light spots accords with a third preset condition, the contact of the second object to the projection area is determined to be effective contact operation, and the second light spots are effective light spots, so that the effective contact operation which can be supported by the touch equipment can be identified, and the accuracy of the touch operation is improved.
After the determining the size of the infrared light spot and identifying whether the contact of the target object with the projection area is an effective contact operation according to the size of the infrared light spot, the above embodiment may further execute the following technical solutions: and under the condition that the contact of the target object to the projection area is identified as effective contact operation, responding to the effective contact operation, and generating a touch signal corresponding to the effective contact operation.
It should be noted that, since the effective contact operation is identified, the touch signal may be generated in response to the effective contact operation, so as to perform touch control on the touch device according to the touch information number.
Wherein, when the contact of the target object to the projection area is identified as an effective contact operation, the generating a touch signal corresponding to the effective contact operation in response to the effective contact operation includes: determining coordinates of the effective contact operation from the emitted light forming the infrared light spot; and generating a touch signal corresponding to the effective touch operation according to the coordinates.
In the above embodiment, by determining the coordinates of the effective contact operation and generating the touch signal corresponding to the effective contact operation according to the coordinates, an accurate touch signal can be generated according to the effective contact operation, and the accuracy of the touch operation is improved.
The above operation recognition method is explained below with reference to an example, but is not limited to the technical solution of the embodiment of the present application.
The operation recognition method of the embodiment of the application can be applied to desktop projection and infrared touch equipment, for example, the ultra-short-focus desktop projection and infrared touch equipment shown in fig. 2. Fig. 2 is a schematic diagram of an ultra-short focal desktop projection and infrared touch device according to an embodiment of the present application, and as shown in fig. 2, the ultra-short focal desktop projection and infrared touch device 21 projects toward a target area to obtain a projection area 22. The ultra-short-focus desktop projection and infrared touch equipment comprises a projection device, an infrared laser emitter, an infrared camera and a processor.
The ultra-short Jiao Guangji is used for projecting a rectangular picture with a specified size (for example, 23 inches) on a desktop to obtain a projection area; the infrared laser emitter is used for emitting a beam of infrared light, and the infrared light passes through the conical optical device to cover a layer of infrared light on the whole projection area; the infrared camera is used for detecting reflected infrared light formed after infrared light is blocked by the target object, wherein the reflected infrared light forms an infrared light spot; the processor is used for controlling the projection of the ultra-short Jiao Guangji and determining the coordinates of the reflected light received by the infrared camera and the size of the reflected light spot.
FIG. 3 is a flowchart of a method of identifying operations according to another embodiment of the present application, as shown in FIG. 3, comprising the steps of:
step 1: starting up the touch control equipment;
step 2: after the touch equipment is started, the processor controls the ultra-short Jiao Guangji to project;
step 3: controlling the infrared laser to normally emit infrared rays;
step 4: controlling the infrared camera to collect light spots;
step 5: judging whether the infrared camera collects infrared light spots or not;
if no infrared light spot is acquired, step 9 is performed. If the infrared light spots are not collected, the fact that no finger touch is performed in the projection area and no interference object exists is indicated;
if the infrared camera collects the infrared light spots, executing the step 6;
step 6: the processor processes and analyzes the infrared light spot to determine whether the touch operation is effective (i.e., effective touch, such as finger touch).
In the embodiment of the application, when the size of the infrared light spot (for example, the diameter of the light spot) is between 10mm and 20mm, the size can be determined to be caused by finger touch; an infrared spot of 10mm or less is determined as being caused by the presence of a small interfering object (e.g., an interfering object such as a desktop bump, an electric wire, etc.) in the projection area; an infrared spot of 20mm or more is determined to be caused by the presence of a relatively large interfering object in the projection area. For the infrared spots of 10mm or less and the infrared spots of 20mm or more, the interference spots caused by the interfering object and the ineffective contact operation at this time were determined. Since finger touches are typically set with acceptable points (e.g., 10-point touches and 5-point touches) according to the device hardware configuration, valid finger touches within a set point number will respond. Thus, when the infrared spot is an infrared spot between 10mm and 20mm, it is necessary to further determine whether the number of infrared spots between 10mm and 20mm is within the set point number, and if so, the processor determines that the contact within the projected area is a valid contact operation.
If the contact operation is invalid, executing the step 8; otherwise, executing the step 7;
step 7: and performing normal picture response according to the effective touch operation.
Step 8: the processor filters and shields the light spots and does not respond according to an invalid touch operation;
step 9: no touch operation is received and no response is made.
Fig. 4 is a schematic diagram of a touch operation according to an embodiment of the present application. As shown in fig. 4, normal finger touch operation exists in the projection area. The touch control equipment can capture infrared reflection light spots through the infrared camera and accurately identify finger touch control coordinates through calculation, so that the processor can make correct picture feedback response.
The touch device in the related art has very high requirements on the flatness of the desktop. Firstly, the desktop is to be flat and can not be rugged, otherwise, touch control is not available or false triggering is easily caused; secondly, the desktop cannot have foreign matters, such as pens, erasers, wires and the like, otherwise, the desktop can be identified as having objects to trigger touch control to perform touch control response, and when the finger clicks the projection picture (namely the projection area) again. FIG. 5 is a schematic diagram of a touch operation according to another embodiment of the present application, as shown in FIG. 5, in addition to a finger touch, there is an interfering object in the projection area, and at this time, the touch operation is not responded to the finger touch or a disorder of response occurs; thirdly, when one hand presses or arms are positioned in the projection area, the other hand clicks the projection area again, and the response is disordered. FIG. 6 is a schematic diagram of a touch operation according to another embodiment of the present application, as shown in FIG. 6, in which one hand presses on the projection area, and when the other hand clicks on the projection area again, the touch operation responds to confusion. Therefore, in order to achieve accurate touch control, the projection surface must be strictly controlled, otherwise the operation experience effect is seriously affected.
Through the embodiment, the problem that touch experience is affected due to the fact that touch is not flexible and false triggered by the interfering object in the projection area can be solved, invalid touch operation caused by the interfering object is filtered, operation stability of touch equipment is improved, natural smoothness of touch operation is ensured, and user experience is improved.
From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present application.
According to another embodiment of the present application, an operation recognition device is provided, and the operation recognition device is used for implementing the foregoing embodiments and preferred embodiments, and is not described in detail. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
Fig. 7 is a block diagram of an operation recognition apparatus according to an embodiment of the present application, the apparatus including:
the collecting module 72 is configured to collect an infrared light spot by using an infrared camera, where the infrared light spot is formed by reflecting infrared light by a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spot to the target area by using a projection device;
and an identification module 74, configured to determine a size of the infrared light spot, and identify whether the contact of the target object to the projection area is a valid contact operation according to the size of the infrared light spot.
According to the application, the infrared camera is used for collecting the infrared light spots, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through the projection device; and determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is an effective contact operation according to the size of the infrared light spot. Therefore, the problem that invalid contact operation of an interfering object cannot be identified in the related technology can be solved, the identification accuracy of the contact operation is improved, and the user experience is optimized.
Wherein, the identification module 74 is further configured to: determining that the contact of the first object to the projection area is an ineffective contact operation under the condition that a first light spot exists in at least one infrared light spot; the size of the first light spot is smaller than or equal to a first threshold value or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays through the first object contacting the projection area, and the target object comprises the first object.
In the above embodiment, the identification module 74 is further configured to: judging whether a second light spot exists in at least one infrared light spot, wherein the size of the second light spot is larger than a first threshold value and smaller than a second threshold value; determining the number of at least one of the second spots in the presence of the second spot; determining that the contact of the second object to the projection area is effective contact operation under the condition that the quantity meets a third preset condition; wherein the second light spot is formed by the reflection of the infrared ray by the second object contacting the projection area, and the target object comprises the second object.
Fig. 8 is a block diagram of an operation recognition apparatus according to another embodiment of the present application. As shown in fig. 8, the apparatus further includes: and the generating module 76 is used for responding to the effective contact operation and generating a touch signal corresponding to the effective contact operation when the contact of the target object to the projection area is identified as the effective contact operation.
Wherein the generating module 76 is further configured to: determining coordinates of the effective contact operation from the emitted light forming the infrared light spot; and generating a touch signal corresponding to the effective touch operation according to the coordinates.
Fig. 9 is a block diagram of an operation recognition apparatus according to still another embodiment of the present application. As shown in fig. 9, the apparatus further includes: a projection module 78, configured to obtain the projection area by projecting the projection device onto the target area; an emission module 80 for emitting an infrared beam towards the projection area by means of an infrared laser emitter.
An embodiment of the present application also provides a storage medium including a stored program, wherein the program executes the method of any one of the above.
Alternatively, in the present embodiment, the above-described storage medium may be configured to store program code for performing the steps of:
s1, acquiring infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
s2, determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot.
Alternatively, in the present embodiment, the storage medium may include, but is not limited to: a U-disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Alternatively, specific examples in this embodiment may refer to examples described in the foregoing embodiments and optional implementations, and this embodiment is not described herein.
An embodiment of the application also provides an electronic device comprising a memory having stored therein a computer program and a processor arranged to run the computer program to perform the steps of any of the method embodiments described above.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, where the transmission device is connected to the processor, and the input/output device is connected to the processor.
Alternatively, in the present embodiment, the above-described processor may be configured to execute the following steps by a computer program:
s1, acquiring infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
s2, determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot.
Fig. 10 is a schematic structural view of an alternative electronic device according to an embodiment of the present application. Alternatively, it will be understood by those skilled in the art that the structure shown in fig. 10 is only schematic, and the electronic device may also be a terminal device such as a smart phone (e.g. an Android phone, an iOS phone, etc.), a tablet computer, a palm computer, and a mobile internet device (Mobile Internet Devices, MID), a PAD, etc. Fig. 10 is not limited to the structure of the electronic device. For example, the electronic device may also include more or fewer components (e.g., network interfaces, etc.) than shown in FIG. 10, or have a different configuration than shown in FIG. 10.
The memory 1002 may be configured to store software programs and modules, such as program instructions/modules corresponding to the operation recognition method and the operation recognition device in the embodiment of the present application, and the processor 1004 executes the software programs and modules stored in the memory 1002, thereby performing various functional applications and data processing, that is, implementing the operation recognition method described above. The memory 1002 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, the memory 1002 may further include memory located remotely from the processor 1004, which may be connected to the terminal via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. As an example, the memory 1002 may include, but is not limited to, the acquisition module 72, the identification module 74, the generation module 76, the projection module 78, and the emission module 80, which include the operation identification device. In addition, other module units in the operation recognition device may be included, but are not limited to, and are not described in detail in this example.
Optionally, the transmission device 1006 is configured to receive or transmit data via a network. Specific examples of the network described above may include wired networks and wireless networks. In one example, the transmission device 1006 includes a network adapter (Network Interface Controller, NIC) that can connect to other network devices and routers via a network cable to communicate with the internet or a local area network. In one example, the transmission device 1006 is a Radio Frequency (RF) module for communicating wirelessly with the internet.
In addition, the electronic device further includes: a display 1008 for displaying a screen manipulated by a current operation device; and a connection bus 1010 for connecting the respective module parts in the above-described electronic device.
In other embodiments, the terminal or the server may be a node in a distributed system, where the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting the plurality of nodes through a network communication. Among them, the nodes may form a Peer-To-Peer (P2P) network, and any type of computing device, such as a server, a terminal, etc., may become a node in the blockchain system by joining the Peer-To-Peer network.
Alternatively, specific examples in this embodiment may refer to examples described in the foregoing embodiments and optional implementations, and this embodiment is not described herein.
It will be appreciated by those skilled in the art that the modules or steps of the application described above may be implemented in a general purpose computing device, they may be concentrated on a single computing device, or distributed across a network of computing devices, they may alternatively be implemented in program code executable by computing devices, so that they may be stored in a memory device for execution by computing devices, and in some cases, the steps shown or described may be performed in a different order than that shown or described, or they may be separately fabricated into individual integrated circuit modules, or multiple modules or steps within them may be fabricated into a single integrated circuit module for implementation. Thus, the present application is not limited to any specific combination of hardware and software.
The above description is only of the preferred embodiments of the present application and is not intended to limit the present application, but various modifications and variations can be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the principle of the present application should be included in the protection scope of the present application.
Claims (9)
1. An operation recognition method, comprising:
collecting infrared light spots through an infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
determining the size of the infrared light spot, and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot;
wherein the identifying whether the contact of the target object to the projection area is an effective contact operation according to the size of the infrared light spot includes: judging whether a second light spot exists in at least one infrared light spot, wherein the size of the second light spot is larger than a first threshold value and smaller than a second threshold value; determining the number of at least one of the second spots in the presence of the second spot; determining that the contact of the second object to the projection area is effective contact operation under the condition that the quantity meets a third preset condition; the second light spots are formed by reflecting the infrared rays through the second object contacting the projection area, the target object comprises the second object, and the third preset condition is that the number of the second light spots is smaller than a number threshold.
2. The method of claim 1, wherein the identifying whether the contact of the target object to the projection area is a valid contact operation based on the size of the infrared spot comprises:
determining that the contact of the first object to the projection area is an ineffective contact operation under the condition that a first light spot exists in at least one infrared light spot; the size of the first light spot is smaller than or equal to a first threshold value or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays through the first object contacting the projection area, and the target object comprises the first object.
3. The method according to claim 1, wherein after said determining the size of the infrared light spot, identifying whether the contact of the target object to the projection area is a valid contact operation based on the size of the infrared light spot, the method further comprises:
and under the condition that the contact of the target object to the projection area is identified as effective contact operation, responding to the effective contact operation, and generating a touch signal corresponding to the effective contact operation.
4. A method according to claim 3, wherein, in the case where the contact of the target object to the projection area is identified as a valid contact operation, generating a touch signal corresponding to the valid contact operation in response to the valid contact operation comprises:
determining coordinates of the effective contact operation from the emitted light forming the infrared light spot;
and generating a touch signal corresponding to the effective touch operation according to the coordinates.
5. The method of claim 1, wherein prior to the collecting infrared spots, the method further comprises:
and projecting the target area through the projection device to obtain the projection area, and transmitting an infrared light beam to the projection area through an infrared laser transmitter.
6. An operation recognition apparatus, comprising:
the acquisition module is used for acquiring infrared light spots through the infrared camera, wherein the infrared light spots are formed by reflecting infrared rays through a target object contacting a projection area, and the projection area is obtained by projecting the infrared light spots to the target area through a projection device;
the identification module is used for determining the size of the infrared light spot and identifying whether the contact of the target object to the projection area is effective contact operation or not according to the size of the infrared light spot;
the identification module is further used for judging whether a second light spot exists in at least one infrared light spot, wherein the size of the second light spot is larger than a first threshold value and smaller than a second threshold value; determining the number of at least one of the second spots in the presence of the second spot; determining that the contact of the second object to the projection area is effective contact operation under the condition that the quantity meets a third preset condition; the second light spots are formed by reflecting the infrared rays through the second object contacting the projection area, the target object comprises the second object, and the third preset condition is that the number of the second light spots is smaller than a number threshold.
7. The apparatus of claim 6, wherein the identification module is further configured to:
determining that the contact of the first object to the projection area is an ineffective contact operation under the condition that a first light spot exists in at least one infrared light spot; the size of the first light spot is smaller than or equal to a first threshold value or larger than or equal to a second threshold value, the first light spot is formed by reflecting the infrared rays through the first object contacting the projection area, and the target object comprises the first object.
8. A storage medium having a computer program stored therein, wherein the computer program is arranged to perform the method of any of claims 1 to 5 when run.
9. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method according to any of the claims 1 to 5 by means of the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010761832.0A CN112000241B (en) | 2020-07-31 | 2020-07-31 | Operation recognition method and device, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010761832.0A CN112000241B (en) | 2020-07-31 | 2020-07-31 | Operation recognition method and device, storage medium and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112000241A CN112000241A (en) | 2020-11-27 |
| CN112000241B true CN112000241B (en) | 2023-11-28 |
Family
ID=73462635
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010761832.0A Active CN112000241B (en) | 2020-07-31 | 2020-07-31 | Operation recognition method and device, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112000241B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113721769A (en) * | 2021-08-31 | 2021-11-30 | 歌尔科技有限公司 | Projection interference detection method, device, equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007328754A (en) * | 2006-05-12 | 2007-12-20 | Assist:Kk | Touch panel system and its operation method |
| CN102364419A (en) * | 2011-10-08 | 2012-02-29 | 广东威创视讯科技股份有限公司 | Camera type touch control method and system thereof |
| CN102622137A (en) * | 2012-02-29 | 2012-08-01 | 广东威创视讯科技股份有限公司 | Touch screen multi-point touch control method and device for front positioning of cameras |
| CN108701365A (en) * | 2017-08-29 | 2018-10-23 | 广东虚拟现实科技有限公司 | Luminous point recognition methods, device and system |
| CN110162225A (en) * | 2019-05-05 | 2019-08-23 | 青岛小鸟看看科技有限公司 | A kind of projection lamp and the touch control method for projection lamp |
| CN110213407A (en) * | 2019-05-28 | 2019-09-06 | Oppo（重庆）智能科技有限公司 | A kind of operating method of electronic device, electronic device and computer storage medium |
| CN110221732A (en) * | 2019-05-15 | 2019-09-10 | 青岛小鸟看看科技有限公司 | A kind of touch control projection system and touch action recognition methods |
| CN110308817A (en) * | 2019-06-10 | 2019-10-08 | 青岛小鸟看看科技有限公司 | A kind of touch action recognition methods and touch control projection system |
-
2020
- 2020-07-31 CN CN202010761832.0A patent/CN112000241B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007328754A (en) * | 2006-05-12 | 2007-12-20 | Assist:Kk | Touch panel system and its operation method |
| CN102364419A (en) * | 2011-10-08 | 2012-02-29 | 广东威创视讯科技股份有限公司 | Camera type touch control method and system thereof |
| CN102622137A (en) * | 2012-02-29 | 2012-08-01 | 广东威创视讯科技股份有限公司 | Touch screen multi-point touch control method and device for front positioning of cameras |
| CN108701365A (en) * | 2017-08-29 | 2018-10-23 | 广东虚拟现实科技有限公司 | Luminous point recognition methods, device and system |
| CN110162225A (en) * | 2019-05-05 | 2019-08-23 | 青岛小鸟看看科技有限公司 | A kind of projection lamp and the touch control method for projection lamp |
| CN110221732A (en) * | 2019-05-15 | 2019-09-10 | 青岛小鸟看看科技有限公司 | A kind of touch control projection system and touch action recognition methods |
| CN110213407A (en) * | 2019-05-28 | 2019-09-06 | Oppo（重庆）智能科技有限公司 | A kind of operating method of electronic device, electronic device and computer storage medium |
| CN110308817A (en) * | 2019-06-10 | 2019-10-08 | 青岛小鸟看看科技有限公司 | A kind of touch action recognition methods and touch control projection system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112000241A (en) | 2020-11-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107422915B (en) | Response control mehtod, device, storage medium and the terminal of touch screen | |
| CN109656827B (en) | Control tree generation method and terminal equipment | |
| WO2020168858A1 (en) | Data self-calibration method and related apparatus | |
| CN107808109B (en) | Two-dimensional code image identification method and mobile terminal | |
| CN112000241B (en) | Operation recognition method and device, storage medium and electronic device | |
| CN111507268B (en) | Alarm method and device, storage medium and electronic device | |
| CN109726543A (en) | A kind of login method of application program, device, terminal device and storage medium | |
| CN112908321A (en) | Device control method, device, storage medium, and electronic apparatus | |
| US20210232286A1 (en) | Control execution method and device, storage medium and electronic apparatus | |
| CN106249968B (en) | Scanning method and device | |
| CN110825303A (en) | Interaction method, device, terminal and computer readable medium | |
| CN113703572A (en) | Electronic device, control method, control apparatus, and storage medium | |
| CN110213407B (en) | Electronic device, operation method thereof and computer storage medium | |
| CN112697151A (en) | Method, apparatus and storage medium for determining initial point of mobile robot | |
| CN114756162B (en) | Touch system and method, electronic device and computer readable storage medium | |
| CN109298805A (en) | Proximity state recognition methods, device, terminal device and storage medium | |
| US20140267033A1 (en) | Information Technology Device Input Systems And Associated Methods | |
| CN113412684B (en) | Improving automation rules by determining relationships between events and control commands | |
| CN111062360B (en) | Hand tracking system and tracking method thereof | |
| CN110706474B (en) | Detection system, method, device, equipment and storage medium for infrared emission function | |
| CN110703615A (en) | Data-driven scene method and device based on Internet of things | |
| KR102669446B1 (en) | Server for providing access information and method for operating thereof | |
| CN110806885B (en) | MCU (microprogrammed control Unit) firmware updating method, intelligent projector and related product | |
| CN110221717B (en) | Virtual mouse driving device, gesture recognition method and device for virtual mouse | |
| CN108989661B (en) | Camera equipment control method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |