CN113126795A - Touch identification method of touch display device and related equipment - Google Patents

Touch identification method of touch display device and related equipment Download PDF

Info

Publication number
CN113126795A
CN113126795A CN201911422917.XA CN201911422917A CN113126795A CN 113126795 A CN113126795 A CN 113126795A CN 201911422917 A CN201911422917 A CN 201911422917A CN 113126795 A CN113126795 A CN 113126795A
Authority
CN
China
Prior art keywords
touch
target area
area
infrared
scanning direction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911422917.XA
Other languages
Chinese (zh)
Other versions
CN113126795B (en
Inventor
王武军
李新
孙健菲
张连峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Hisense Commercial Display Co Ltd
Original Assignee
Qingdao Hisense Commercial Display Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Commercial Display Co Ltd filed Critical Qingdao Hisense Commercial Display Co Ltd
Priority to CN201911422917.XA priority Critical patent/CN113126795B/en
Publication of CN113126795A publication Critical patent/CN113126795A/en
Application granted granted Critical
Publication of CN113126795B publication Critical patent/CN113126795B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

The invention discloses a touch identification method of a touch display device and related equipment, wherein the touch display device comprises: the display panel, set up the infrared emission component on first side and second side adjacent to display panel, set up the infrared receiving element on the side opposite to infrared emission component of display panel, and the processor; when the touch object is not detected in at least one scanning direction, the intersection of touch areas formed in other scanning directions is used as a target area, a virtual touch area formed in the undetected scanning direction is reversely deduced according to the boundary position of the target area, and the virtual touch area is finer than the touch area divided by infrared rays, so that the positions of touch points can be refined according to the virtual touch area, a tiny touch object with the distance less than the minimum distance of the infrared rays can be detected, multiple points which cannot be identified due to the fact that the distance is too close can be distinguished, and the detection accuracy of infrared touch is improved.

Description

Touch identification method of touch display device and related equipment
Technical Field
The present invention relates to the field of display technologies, and in particular, to a touch identification method for a touch display device and a related device.
Background
The touch screen, also known as a touch screen or a touch display device, is used as a display device with a touch function, gives multimedia a brand-new appearance, and is widely applied to the fields of inquiry of public information, industrial control, military command, electronic games, multimedia teaching and the like.
Touch screens can be classified into infrared type, resistive type, surface acoustic wave type, and capacitive type touch screens according to different types of sensors. The infrared touch technology has the advantages of strong environmental adaptability, long service life, more identifiable touch points and the like. The infrared touch screen is basically structured in such a way that a plurality of infrared emitting elements and infrared receiving elements are arranged around a touch detection area, and infrared light emitted by the infrared emitting elements is received by the infrared receiving elements positioned opposite to each other.
The current trend of infrared touch technology is to adopt less infrared components to reach higher detection accuracy, but the current detection technology needs the touch object to block light to be detected, so that some touch objects smaller than the distance between the infrared components can not detect the touch object in some detection directions when contacting the display screen, and the detection accuracy is not high.
Disclosure of Invention
The invention provides a touch identification method of a touch display device and related equipment, which are used for improving touch detection precision.
In a first aspect, the present invention provides a touch identification method for a touch display device, where the touch display device includes:
a display panel for image display;
the infrared emitting elements are arranged on the adjacent first side and second side of the display panel and used for emitting infrared rays in different scanning directions;
the infrared receiving element is arranged on the side edge of the display panel opposite to the infrared emitting element and is used for receiving infrared rays from different directions;
the processor is electrically connected with the infrared transmitting element and the infrared receiving element;
the touch identification method comprises the following steps:
when touch operation occurs, determining a touch area according to the infrared signal received by the infrared receiving element; the touch area is an area where the blocked light path is located in the same scanning direction;
when no touch object is detected in at least one of the first side edge and the second side edge in the scanning direction, taking the intersection of the touch areas as a target area;
determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction;
and determining the position of the touch point according to the position of the virtual touch area.
In a possible implementation manner, in the method provided by the present invention, the determining, according to a boundary position of the target area in the undetected scanning direction, a virtual touch area of the target area in the undetected scanning direction includes:
making a tangent line on the edge of the target area along the undetected scanning direction;
and defining a virtual touch area of the target area in the undetected scanning direction according to tangent lines at two sides of the target area and the undetected infrared light in the scanning direction.
In a possible implementation manner, in the foregoing method provided by the present invention, before determining, according to a boundary position of the target area in the undetected scanning direction, a virtual touch area of the target area in the undetected scanning direction, the method further includes:
judging whether the target area meets a preset threshold condition or not;
the determining, according to the boundary position of the target area in the undetected scanning direction, a virtual touch area of the target area in the undetected scanning direction includes:
and when the target area meets a preset threshold condition, determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction.
In a possible implementation manner, in the method provided by the present invention, the determining whether the target area satisfies a preset threshold condition includes:
judging whether the number of touch areas on the first side edge, including the target area, is greater than or equal to a first threshold value;
judging whether the number of touch areas including the target area on the second side is larger than or equal to a second threshold value or not;
when the number of touch areas including the target area on the first side is greater than or equal to a first threshold value and the number of touch areas including the target area on the second side is greater than or equal to a second threshold value, determining that the target area meets a preset threshold value condition;
the first threshold is less than or equal to the number of scanning directions on the first side, and the second threshold is less than or equal to the number of scanning directions on the second side.
In a possible implementation manner, in the foregoing method provided by the present invention, the method further includes:
determining that the target area does not meet a preset threshold condition when the number of touch areas including the target area on the first side is smaller than a first threshold and/or the number of touch areas including the target area on the second side is smaller than a second threshold;
and deleting the target area which does not meet the preset threshold condition.
In a possible implementation manner, in the method provided by the present invention, the determining the position of the touch point according to the position of the virtual touch area includes:
intersecting the virtual touch area with other touch areas to form an initial candidate area;
screening out effective candidate areas in the initial candidate areas;
and taking the position of the effective candidate area as the position of the touch point.
In a possible implementation manner, in the foregoing method provided by the present invention, the method further includes:
performing track tracking and smoothing processing on the determined touch points;
performing coordinate conversion on the touch points subjected to track tracking and smoothing;
and outputting the coordinates of the touch points.
In one possible implementation, the present invention provides the above method, wherein the number of the scanning directions of the infrared emission elements is 30-60.
In a second aspect, the present invention provides a touch display device, including:
a display panel for image display;
the infrared emitting elements are arranged on the adjacent first side and second side of the display panel and used for emitting infrared rays in different scanning directions;
the infrared receiving element is arranged on the side edge of the display panel opposite to the infrared emitting element and is used for receiving infrared rays from different directions;
the processor is electrically connected with the infrared transmitting element and the infrared receiving element and used for determining a touch area according to an infrared signal received by the infrared receiving element when touch operation occurs; when no touch object is detected in at least one of the first side edge and the second side edge in the scanning direction, taking the intersection of the touch areas as a target area; determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction; determining the position of a touch point according to the position of the virtual touch area;
the touch area is an area where a blocked light path is located in the same scanning direction.
In a third aspect, the present invention provides a readable storage medium storing executable instructions for performing any of the above methods.
The invention has the following beneficial effects:
the invention provides a touch identification method of a touch display device and related equipment, wherein the touch display device comprises: a display panel for image display; the infrared emitting element is arranged on the adjacent first side and second side of the display panel and used for emitting infrared rays in different scanning directions; the infrared receiving element is arranged on the side edge of the display panel opposite to the infrared emitting element and is used for receiving infrared rays from different directions; the processor is electrically connected with the infrared transmitting element and the infrared receiving element; the touch identification method comprises the following steps: when touch operation occurs, determining a touch area according to an infrared signal received by the infrared receiving element; the touch area is an area where the blocked light path is located in the same scanning direction; when no touch object is detected in at least one of the first side edge and the second side edge in the scanning direction, taking the intersection of the touch areas as a target area; determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction; and determining the position of the touch point according to the position of the virtual touch area. According to the touch identification method provided by the invention, when the infrared signal generated by the touch object is not detected in at least one scanning direction, the intersection of the touch areas formed in other scanning directions is used as the target area, the virtual touch area formed in the undetected scanning direction is reversely deduced according to the boundary position of the target area, the boundary of the virtual touch area is not overlapped with the infrared ray, and the subareas are finer than the touch areas divided by the infrared ray, so that the positions of the touch points can be further refined according to the virtual touch area, the tiny touch object with the distance less than the minimum distance of the infrared ray can be detected, the multiple points which cannot be identified due to the too close distance can be distinguished, and the detection precision of the infrared touch is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments of the present invention will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a touch display device according to an embodiment of the present invention;
fig. 2 is a second schematic structural diagram of a touch display device according to an embodiment of the invention;
fig. 3 is a schematic diagram of a touch scene according to an embodiment of the present invention;
fig. 4 is a flowchart illustrating a touch recognition method of a touch display device according to an embodiment of the present invention;
FIG. 5 is a schematic diagram illustrating the blocking of the infrared light in the scanning direction a1 of the first side s1 in FIG. 3;
FIG. 6 is a schematic diagram illustrating the blocking of the infrared light in the scanning direction a2 of the first side s1 in FIG. 3;
FIG. 7 is a schematic diagram illustrating the blockage of the infrared light in the scanning direction b1 of the second side s2 in FIG. 3;
FIG. 8 is a schematic diagram illustrating the blockage of the infrared light in the scanning direction b2 of the second side s2 in FIG. 3;
FIG. 9 is a schematic illustration of a target area generated in the touch scene of FIG. 3;
FIG. 10 is a schematic view of the virtual touch area demarcated in the undetected scan direction by the target area in FIG. 9;
FIG. 11 shows a virtual touch area X1A schematic diagram of the position of the inner touch point;
FIG. 12 shows a virtual touch area X2Schematic diagram of the position of the inner touch point.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The touch display device provided by the embodiment of the invention is an infrared touch display device, an infrared transmitting and receiving sensing element is usually arranged on an outer frame of a display panel of the infrared touch display device, an infrared detection net is formed on the surface of a screen, and when any touch object blocks infrared rays between the infrared transmitting element and the infrared receiving sensing element, a receiving signal drops sharply, so that the touch object can be detected. The infrared touch technology has the advantages of high stability, strong adaptability, long service life and the like, and is widely applied to the field of display.
Fig. 1 and fig. 2 are schematic structural diagrams of a touch display device according to an embodiment of the present invention, and as shown in fig. 1 and fig. 2, the touch display device according to the embodiment of the present invention includes:
a display panel 100 for displaying an image.
The display panel 100 may be a liquid crystal display panel, an organic light emitting diode display panel, or an electronic book, and is not limited herein. The display panel 100 is used for image display and is independent of the infrared touch system.
The infrared emitting element 21 is arranged on the first side s1 and the second side s2 adjacent to the display panel and is used for emitting infrared rays in different scanning directions; the infrared receiving element 22 is disposed on the side of the display panel opposite to the infrared emitting element, and is used for receiving infrared light from different directions.
In practical applications, the display panel 100 is generally a rectangular panel, so that the infrared emitting elements 21 can be disposed on one long side and one short side of the display panel, and the infrared receiving elements can be disposed on the other two sides, thereby forming a two-dimensional infrared optical network on the display panel. As shown in fig. 1, the positions of the infrared emitting elements 21 and the infrared receiving elements 22 correspond to each other, and the infrared rays emitted from one infrared emitting element 21 in the same scanning direction are received by the uniquely corresponding infrared receiving element 22.
With the continuous development of touch technology, a smaller number of infrared elements are adopted, and a trend of achieving higher detection accuracy is a development trend, in order to fully utilize a limited number of infrared emitting elements 21 and infrared receiving elements 22, as shown in fig. 2, the infrared emitting elements 21 in the embodiment of the present invention can emit infrared rays in different scanning directions, as can be seen from fig. 2, when the emitting direction of the infrared rays emitted by the infrared emitting elements 21 is changed, the corresponding infrared receiving elements 22 are also changed, but each infrared emitting element 21 has a unique infrared receiving element 22 corresponding thereto in the same scanning direction.
The processor 300 is electrically connected to the infrared emitting device 21 and the infrared receiving device 22.
The processor 300 may be electrically connected to each of the infrared emitting element 21 and the infrared receiving element 22, and is configured to control a scanning direction of the infrared emitting element 21, and simultaneously receive an infrared signal detected by the infrared receiving element 22, and the processor 300 further has a data processing capability, and may perform an operation on the infrared signal received by the infrared receiving element 22 in different scanning directions, so as to finally determine a position of a touch point.
In view of the development trend of the infrared touch technology of using fewer infrared elements, achieving higher detection accuracy, when a tiny touch object touches the display panel, the tiny touch object is likely to fall between two adjacent infrared light rays without blocking the infrared light rays, at this time, an infrared signal in the scanning direction cannot be detected, and touch recognition cannot be performed on the touch object in the scanning direction.
Fig. 3 is a schematic view of a touch scene provided by an embodiment of the invention, and as shown in fig. 3, the first side s1 and the second side s2 of the display panel are provided with infrared emitting elements, and the other two sides are provided with infrared receiving elements. The scanning directions of the infrared emitting elements on the first side s1 are both the a1 and a2 directions, and the scanning directions of the infrared emitting elements on the second side s2 are both the b1 and b2 directions. Wherein the scanning light is indicated by the lines with arrows. When a touch operation occurs, light rays blocked by a touch object are represented by dotted lines, and light rays not blocked by the touch object are represented by solid lines.
As can be seen from fig. 3, since the size of the touch object is small, when two touch objects with a close distance are simultaneously touched, no infrared light is blocked in the scanning direction a2 of the first side s1, and therefore, during touch recognition, the touch object cannot be detected in the scanning direction a2 of the first side s1, and two touch points with a close distance are often recognized as one point, and cannot be distinguished from multiple points, so that the touch detection accuracy is not high.
In view of this, embodiments of the present invention provide a touch recognition method based on the touch display device, which can recognize a tiny touch object and can also finely distinguish between multi-point touches.
Fig. 4 is a flowchart of a touch recognition method according to an embodiment of the present invention, and as shown in fig. 4, the touch recognition method according to the embodiment of the present invention includes:
s10, when a touch operation occurs, determining a touch area according to the infrared signal received by the infrared receiving element;
s20, when no touch object is detected in at least one of the first side and the second side in the scanning direction, taking an intersection of the touch areas as a target area;
s30, determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction;
and S40, determining the position of the touch point according to the position of the virtual touch area.
The touch area is an area where the blocked light path is located in the same scanning direction.
Based on the application scenario, when an infrared signal generated by a touch object is not detected in at least one scanning direction, an intersection of touch regions formed in other scanning directions is used as a target region, and a virtual touch region formed in the undetected scanning direction is reversely deduced according to a boundary position of the target region, wherein the boundary of the virtual touch region is not overlapped with infrared rays, and a partition is finer than the touch region divided by the infrared rays, so that positions of touch points can be further refined according to the virtual touch region, a tiny touch object smaller than the minimum distance of the infrared rays can be detected, multiple points which cannot be identified due to too close distance originally can be distinguished, and the detection accuracy of infrared touch is improved.
The following describes an implementation of the touch recognition method according to an embodiment of the present invention. In the embodiment of the present invention, the first side s1 and the second side s2 respectively have two scanning directions as an example, and the touch recognition method provided in the embodiment of the present invention is illustrated.
Fig. 5 and fig. 6 are schematic diagrams illustrating the blocking of infrared light in two scanning directions a1 and a2 of the first side s1 in fig. 3, respectively, and as shown in fig. 5, a touch object in a touch operation blocks part of the infrared light in the scanning direction a 1. In the embodiment of the invention, the area where continuous light rays shielded in the same scanning direction are located is divided into one touch area. Then, a touch area is formed in the scanning direction a 1. As shown in fig. 6, the touch object does not block any light in the scanning direction a2, i.e., no touch area is generated in the scanning direction a 2.
Fig. 7 and 8 are schematic diagrams illustrating the blocking of infrared light rays in two scanning directions b1 and b2 of the second side edge s2 in fig. 3, respectively, and a touch object generates a touch area in the scanning direction b1 as shown in fig. 7. As shown in fig. 8, a touching object produces a touch area in the scan direction b 2.
After the touch areas formed in each scanning direction are detected, the touch areas are intersected, and touch points are included in the areas where the intersections are located.
Fig. 9 is a schematic diagram of a target area generated in the touch scene in fig. 3, and as shown in fig. 9, no touch object is detected in the scanning direction a2 of the first side edge s1, and the target area in fig. 9 can be obtained by intersecting the touch areas generated in the other three scanning directions.
Further, in the above step S30, determining the virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction includes:
making a tangent line on the edge of the target area along the undetected scanning direction;
and defining a virtual touch area of the target area in the undetected scanning direction according to tangent lines at two sides of the target area and the undetected infrared light in the scanning direction.
The scanning direction of the touch display device is preset, so that the slope of the scanning direction in which the touch object is not detected is known, the profile of the target area can be tangent to the slope of the scanning direction in which the touch object is not detected, so as to obtain the boundary position of the target area in the scanning direction in which the touch object is not detected, and then the virtual touch area in the scanning direction in which the touch object is not detected is defined according to the boundary position. The virtual touch area may further refine the target area, so that a plurality of touch points that cannot be identified originally may be identified.
Still taking the target region in fig. 9 as an example, fig. 10 is a schematic view of a virtual touch region divided by the target region in fig. 9 in the undetected scanning direction, as shown in fig. 10, the scanning direction in which the touch object is undetected is the scanning direction a2 of the first side s1, and the slope of the scanning direction a2 is consistent with the slope of the infrared ray in the scanning direction a2, so that the target region can be tangent along the emitting direction of the infrared ray in the scanning direction a2, and the obtained tangent is represented by a dashed line in the scanning direction a2 in fig. 10. As can be seen from fig. 10, there is an infrared ray between the two tangent lines, and the area between the two tangent lines is divided into two virtual touch areas X by taking the infrared ray between the two tangent lines as a boundary1And X2. In this way, virtual touch areas can be further subdivided in the scanning direction in which no touch object is originally detected, and touch points may be located in two virtual touch areas.
It should be noted that, in the currently used infrared touch display device, the infrared element is generally disposed above the display screen, and therefore, when a touch object wants to touch the display screen, the touch object needs to go through the depth of the infrared element before touching the display screen. Thus, there is a problem that: when the touch object does not touch the display screen, the infrared light in the infrared optical network is blocked, the touch display device performs touch identification according to the infrared signal, and then the touch identification is triggered, so that the touch display device belongs to a misoperation behavior.
In order to avoid the occurrence of the misoperation, the embodiment of the invention firstly judges the threshold of the generated target area, and then executes the subsequent steps when the threshold condition is met.
Then, in the touch recognition method provided in the embodiment of the present invention, before the step S30, the method may further include:
judging whether the target area meets a preset threshold condition or not;
accordingly, in the above step S30, determining the virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction includes:
and when the target area meets a preset threshold value condition, determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction.
Specifically, the determining whether the target area satisfies a predetermined threshold condition in the step includes:
judging whether the number of touch areas including the target area on the first side is larger than or equal to a first threshold value or not;
judging whether the number of touch areas including the target area on the second side is larger than or equal to a second threshold value or not;
when the number of touch areas including the target area on the first side is greater than or equal to a first threshold value and the number of touch areas including the target area on the second side is greater than or equal to a second threshold value, determining that the target area meets a preset threshold value condition;
the first threshold is less than or equal to the number of scanning directions on the first side, and the second threshold is less than or equal to the number of scanning directions on the second side.
In practical applications, the light rays in the infrared optical network do not exit in the same plane, and therefore, the more scanning directions in which the touch object can be detected, the closer the distance between the touch object and the display screen can be indicated, and the more the touch operation is prone to occur. In the actual detection process, the maximum number of touch areas that can be detected on the first side does not exceed the number of scanning directions on the first side, and the maximum number of touch areas that can be detected on the second side does not exceed the number of scanning directions on the second side.
In general, the closer the value of the first threshold is to the number of scanning directions on the first side, the closer the value of the second threshold is to the number of scanning directions on the second side, the more satisfactory the touch recognition is. In specific implementation, the first threshold and the second threshold may be reasonably set according to actual requirements, and the specific values of the first threshold and the second threshold are not limited in the embodiment of the present invention.
When the threshold value judgment is executed, if one of the following three conditions occurs, all the three conditions are regarded that the target area does not meet the preset threshold value condition:
1. the number of touch areas on the first side edge, including the target area, is less than a first threshold;
2. the number of touch areas on the second side edge containing the target area is smaller than a second threshold value;
3. the number of touch areas on the first side containing the target area is less than a first threshold, while the number of touch areas on the second side containing the target area is less than a second threshold.
In this case, the target area that does not satisfy the preset threshold condition may be deleted, and the subsequent operation may be performed on the other target areas that satisfy the threshold condition. If all target areas do not meet the threshold condition, the touch operation may be re-detected or the threshold condition may be considered for modification.
Further, in the step S40, the determining the position of the touch point according to the position of the virtual touch area includes:
intersecting the virtual touch area with other touch areas to form an initial candidate area;
screening out an effective candidate region in the initial candidate region;
and taking the position of the effective candidate area as the position of the touch point.
After the virtual touch areas in the undetected scanning direction are divided according to the boundary of the target area, each virtual touch area may be intersected with other touch areas to form an intersection as an initial candidate area, and then an effective candidate area is screened out from the initial candidate area, so that the position of the effective candidate area is used as the position of the touch point. The step of screening the effective candidate region in the initial candidate region is an operation of removing the interference touch point, and reference may be made to a method for removing the interference touch point in the prior art, which is not described herein again.
As shown in FIG. 10, a virtual touch area X is determined1And X2Then, the virtual touch area X is displayed1Intersecting with other touch areas to obtain initial candidate areas as shown in FIG. 11; virtual touch area X2And intersect other touch areas to obtain initial candidate areas as shown in fig. 12. If the areas shown in fig. 11 and 12 are valid candidate areas after the screening is performed, it is shown that smaller touch objects can be identified by using the touch identification method provided by the embodiment of the present invention, and multiple points that cannot be identified originally are distinguished, so that the detection accuracy of infrared touch is improved.
In specific implementation, the touch recognition method provided in the embodiment of the present invention may further include:
performing track tracking and smoothing processing on the determined touch points;
performing coordinate conversion on the touch points subjected to track tracking and smoothing;
and outputting the coordinates of the touch points.
Specifically, after the position of the touch point is determined, the method provided by the embodiment of the present invention may further perform operations of trajectory tracking and smoothing on the touch point, so as to optimize the position of the touch point.
The trajectory tracking operation may be calculated by a distance optimal matching algorithm or a kalman predictive tracking algorithm. Taking the distance optimal matching algorithm as an example:
the scanning period of the touch screen is fixed, that is, the interval between every two periods is fixed, if the scanning period is set as unit time t, according to the relationship among the uniform variable speed movement distance s, the speed v and the acceleration a, there are:
vt=v0+at;
Figure BDA0002352788850000131
the velocity v can be calculated according to the coordinates of the touch points in two consecutive periods, the acceleration a can be calculated according to the coordinates of the touch points in three consecutive periods, and in several consecutive scanning periods, if the touch point movement is assumed to be a uniform variable speed linear movement, the coordinate position of the touch point in the next scanning period can be predicted according to the distance formula. After the coordinates of the touch points are determined according to the method of the embodiment of the invention in the next scanning period, track tracking is sequentially performed by searching for the predicted touch point closest to the real touch point for matching.
In addition, the track smoothing process may adopt five-point cubic smoothing, polynomial fitting smoothing algorithm, and the like, which is not limited herein.
And performing coordinate conversion on the touch points subjected to the track tracking and smoothing, wherein the coordinate system can be a coordinate system in a display surface of the display panel, and outputting the coordinates after the coordinates of the touch points are obtained to obtain the coordinate positions of the touch points.
In practical applications, the emission angle of the infrared emission element 21 provided by the embodiment of the present invention can reach 120 to 140 °, and 30 to 60 scanning directions can be provided. In the embodiment of the present invention, only two scanning directions exist on the first side s1 and the second side s2, which are taken as an example to explain a specific process of the touch recognition method provided in the embodiment of the present invention, when the scanning directions on the first side s1 or the second side s2 are increased to 30-60, the positions of the touch points can still be detected by the above method. The touch identification method provided by the embodiment of the invention can be applied to a single-point touch or multi-point touch scheme, can track the moving track according to the detected position of the touch point, and is particularly suitable for application scenes such as fine-stroke writing, small-word identification, multi-point distinguishing and multiple writing.
Based on the same inventive concept, an embodiment of the present invention further provides a touch display device, where the touch display device can implement any one of the above touch identification methods, as shown in fig. 1, the touch display device provided in the embodiment of the present invention includes:
a display panel 100 for image display;
the infrared emitting element 21 is disposed on the first side s1 and the second side s2 adjacent to the display panel 100, and is configured to emit infrared rays in different scanning directions;
an infrared receiving element 22 disposed on the side of the display panel 100 opposite to the infrared emitting element 21 for receiving infrared light from different directions;
the processor 300 is electrically connected with the infrared transmitting element 21 and the infrared receiving element 22, and the processor 300 is used for determining a touch area according to an infrared signal received by the infrared receiving element 22 when touch operation occurs; when no touch object is detected in at least one of the first side s1 and the second side s2 in the scanning direction, the intersection of the touch areas is set as a target area; determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction; determining the position of a touch point according to the position of the virtual touch area;
the touch area is an area where the blocked light path is located in the same scanning direction.
According to the touch display device provided by the embodiment of the invention, when the infrared signal generated by the touch object is not detected in at least one scanning direction, the intersection of the touch areas formed in other scanning directions is used as the target area, and the virtual touch area formed in the undetected scanning direction is reversely deduced according to the boundary position of the target area, the boundary of the virtual touch area is not overlapped with the infrared ray, and the subareas are finer than the touch areas divided by the infrared ray, so that the positions of the touch points can be further refined according to the virtual touch area, the tiny touch object with the distance less than the minimum distance of the infrared ray can be detected, the multiple points which cannot be identified due to the too close distance can be distinguished, and the detection precision of the infrared touch is improved.
Optionally, the processor 300 is specifically configured to tangent an edge of the target area along the undetected scanning direction; and defining a virtual touch area of the target area in the undetected scanning direction according to tangent lines at two sides of the target area and the undetected infrared light in the scanning direction.
The virtual touch area may further refine the target area, so that a plurality of touch points that cannot be identified originally may be identified.
Optionally, the processor 300 is further configured to determine whether the target area meets a preset threshold condition before determining the virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction; and when the target area meets a preset threshold value condition, determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction.
Optionally, the processor 300 is specifically configured to determine whether the number of touch areas on the first side edge, which include the target area, is greater than or equal to a first threshold; judging whether the number of touch areas including the target area on the second side is larger than or equal to a second threshold value or not; when the number of touch areas including the target area on the first side is greater than or equal to a first threshold value and the number of touch areas including the target area on the second side is greater than or equal to a second threshold value, determining that the target area meets a preset threshold value condition;
the first threshold is less than or equal to the number of scanning directions on the first side, and the second threshold is less than or equal to the number of scanning directions on the second side.
Optionally, the processor 300 is further configured to determine that the target area does not meet a preset threshold condition when the number of the touch areas including the target area on the first side is smaller than a first threshold and/or the number of the touch areas including the target area on the second side is smaller than a second threshold; and deleting the target area which does not meet the preset threshold condition.
In the embodiment of the present invention, whether the target area satisfies the condition of touch recognition may be determined by setting the first threshold and the second threshold and determining the threshold.
Optionally, the processor 300 is specifically configured to intersect the virtual touch area with other touch areas to form an initial candidate area; screening out an effective candidate region in the initial candidate region; and taking the position of the effective candidate area as the position of the touch point.
Optionally, the processor 300 is further configured to perform trajectory tracking and smoothing on the determined touch point; performing coordinate conversion on the touch points subjected to track tracking and smoothing; and outputting the coordinates of the touch points.
In practical applications, the emission angle of the infrared emission element 21 provided by the embodiment of the present invention can reach 120 to 140 °, and 30 to 60 scanning directions can be provided. The above-described processing may be performed for the touch areas generated on the first side s1 and the second side s2, so as to determine the position of the touch point.
The embodiment of the invention also provides a readable storage medium, wherein the readable storage medium stores executable instructions, and the executable instructions are used for executing any touch identification method.
The embodiment of the invention provides a touch identification method and related equipment of a touch display device, wherein the touch display device comprises: a display panel for image display; the infrared emitting element is arranged on the adjacent first side and second side of the display panel and used for emitting infrared rays in different scanning directions; the infrared receiving element is arranged on the side edge of the display panel opposite to the infrared emitting element and is used for receiving infrared rays from different directions; the processor is electrically connected with the infrared transmitting element and the infrared receiving element; the touch identification method comprises the following steps: when touch operation occurs, determining a touch area according to an infrared signal received by the infrared receiving element; the touch area is an area where the blocked light path is located in the same scanning direction; when no touch object is detected in at least one of the first side edge and the second side edge in the scanning direction, taking the intersection of the touch areas as a target area; determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction; and determining the position of the touch point according to the position of the virtual touch area. According to the touch identification method provided by the embodiment of the invention, when the infrared signal generated by the touch object is not detected in at least one scanning direction, the intersection of the touch areas formed in other scanning directions is used as the target area, and the virtual touch area formed in the undetected scanning direction is reversely deduced according to the boundary position of the target area, the boundary of the virtual touch area is not overlapped with the infrared ray, and the subareas are finer than the touch areas divided by the infrared ray, so that the positions of the touch points can be further refined according to the virtual touch area, the tiny touch object with the distance less than the minimum distance of the infrared ray can be detected, the multiple points which cannot be identified due to the too close distance can be distinguished, and the detection precision of the infrared touch is improved.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (10)

1. A touch identification method of a touch display device is characterized in that the touch display device comprises:
a display panel for image display;
the infrared emitting elements are arranged on the adjacent first side and second side of the display panel and used for emitting infrared rays in different scanning directions;
the infrared receiving element is arranged on the side edge of the display panel opposite to the infrared emitting element and is used for receiving infrared rays from different directions;
the processor is electrically connected with the infrared transmitting element and the infrared receiving element;
the touch identification method comprises the following steps:
when touch operation occurs, determining a touch area according to the infrared signal received by the infrared receiving element; the touch area is an area where the blocked light path is located in the same scanning direction;
when no touch object is detected in at least one of the first side edge and the second side edge in the scanning direction, taking the intersection of the touch areas as a target area;
determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction;
and determining the position of the touch point according to the position of the virtual touch area.
2. The method as claimed in claim 1, wherein said determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction comprises:
making a tangent line on the edge of the target area along the undetected scanning direction;
and defining a virtual touch area of the target area in the undetected scanning direction according to tangent lines at two sides of the target area and the undetected infrared light in the scanning direction.
3. The method of claim 1, wherein before the determining the virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction, the method further comprises:
judging whether the target area meets a preset threshold condition or not;
the determining, according to the boundary position of the target area in the undetected scanning direction, a virtual touch area of the target area in the undetected scanning direction includes:
and when the target area meets a preset threshold condition, determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction.
4. The method of claim 3, wherein the determining whether the target area satisfies a predetermined threshold condition comprises:
judging whether the number of touch areas on the first side edge, including the target area, is greater than or equal to a first threshold value;
judging whether the number of touch areas including the target area on the second side is larger than or equal to a second threshold value or not;
when the number of touch areas including the target area on the first side is greater than or equal to a first threshold value and the number of touch areas including the target area on the second side is greater than or equal to a second threshold value, determining that the target area meets a preset threshold value condition;
the first threshold is less than or equal to the number of scanning directions on the first side, and the second threshold is less than or equal to the number of scanning directions on the second side.
5. The method of claim 4, wherein the method further comprises:
determining that the target area does not meet a preset threshold condition when the number of touch areas including the target area on the first side is smaller than a first threshold and/or the number of touch areas including the target area on the second side is smaller than a second threshold;
and deleting the target area which does not meet the preset threshold condition.
6. The method of claim 1, wherein determining the location of the touch point based on the location of the virtual touch area comprises:
intersecting the virtual touch area with other touch areas to form an initial candidate area;
screening out effective candidate areas in the initial candidate areas;
and taking the position of the effective candidate area as the position of the touch point.
7. The method of claim 1, wherein the method further comprises:
performing track tracking and smoothing processing on the determined touch points;
performing coordinate conversion on the touch points subjected to track tracking and smoothing;
and outputting the coordinates of the touch points.
8. The method of any of claims 1-7, wherein the infrared-emitting elements have a scan direction of 30-60.
9. A touch display device, comprising:
a display panel for image display;
the infrared emitting elements are arranged on the adjacent first side and second side of the display panel and used for emitting infrared rays in different scanning directions;
the infrared receiving element is arranged on the side edge of the display panel opposite to the infrared emitting element and is used for receiving infrared rays from different directions;
the processor is electrically connected with the infrared transmitting element and the infrared receiving element and used for determining a touch area according to an infrared signal received by the infrared receiving element when touch operation occurs; when no touch object is detected in at least one of the first side edge and the second side edge in the scanning direction, taking the intersection of the touch areas as a target area; determining a virtual touch area of the target area in the undetected scanning direction according to the boundary position of the target area in the undetected scanning direction; determining the position of a touch point according to the position of the virtual touch area;
the touch area is an area where a blocked light path is located in the same scanning direction.
10. A readable storage medium having stored thereon executable instructions for performing the method of any one of claims 1-8.
CN201911422917.XA 2019-12-31 2019-12-31 Touch identification method of touch display device and related equipment Active CN113126795B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911422917.XA CN113126795B (en) 2019-12-31 2019-12-31 Touch identification method of touch display device and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911422917.XA CN113126795B (en) 2019-12-31 2019-12-31 Touch identification method of touch display device and related equipment

Publications (2)

Publication Number Publication Date
CN113126795A true CN113126795A (en) 2021-07-16
CN113126795B CN113126795B (en) 2022-08-19

Family

ID=76769757

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911422917.XA Active CN113126795B (en) 2019-12-31 2019-12-31 Touch identification method of touch display device and related equipment

Country Status (1)

Country Link
CN (1) CN113126795B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115033170A (en) * 2022-05-20 2022-09-09 阿里巴巴(中国)有限公司 Input control system and method based on virtual keyboard and related device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102419664A (en) * 2011-08-03 2012-04-18 北京汇冠新技术股份有限公司 Multi-point identification method and system of infrared touch screen
CN102495695A (en) * 2011-11-25 2012-06-13 广州视睿电子科技有限公司 Multi-point touch identification method, touch device and system for infrared geminate transistor touch screen
CN103853388A (en) * 2012-12-05 2014-06-11 北京汇冠新技术股份有限公司 Method for improving touch precision of infrared touch screen
CN107728860A (en) * 2017-10-19 2018-02-23 青岛海信电器股份有限公司 A kind of touch points of infrared touch screen recognition methods, device and touch-screen equipment
CN107831953A (en) * 2017-12-14 2018-03-23 青岛海信电器股份有限公司 A kind of infrared touch panel scan method, device and infrared touch control device
CN109542276A (en) * 2018-11-22 2019-03-29 青岛海信商用显示股份有限公司 A kind of touch point identification method and device and display equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102419664A (en) * 2011-08-03 2012-04-18 北京汇冠新技术股份有限公司 Multi-point identification method and system of infrared touch screen
CN102495695A (en) * 2011-11-25 2012-06-13 广州视睿电子科技有限公司 Multi-point touch identification method, touch device and system for infrared geminate transistor touch screen
CN103853388A (en) * 2012-12-05 2014-06-11 北京汇冠新技术股份有限公司 Method for improving touch precision of infrared touch screen
CN107728860A (en) * 2017-10-19 2018-02-23 青岛海信电器股份有限公司 A kind of touch points of infrared touch screen recognition methods, device and touch-screen equipment
CN107831953A (en) * 2017-12-14 2018-03-23 青岛海信电器股份有限公司 A kind of infrared touch panel scan method, device and infrared touch control device
CN109542276A (en) * 2018-11-22 2019-03-29 青岛海信商用显示股份有限公司 A kind of touch point identification method and device and display equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115033170A (en) * 2022-05-20 2022-09-09 阿里巴巴(中国)有限公司 Input control system and method based on virtual keyboard and related device

Also Published As

Publication number Publication date
CN113126795B (en) 2022-08-19

Similar Documents

Publication Publication Date Title
US9746975B2 (en) Capacitive measurement processing for mode changes
US10126892B2 (en) Moisture management
CN110597414B (en) Touch detection method of touch screen and related equipment
WO2014209519A1 (en) Input object classification
JP2011522332A (en) Multiple pointer ambiguity and occlusion resolution
CN102232209A (en) Stereo optical sensors for resolving multi-touch in a touch detection system
CN104615310A (en) Method and device for determining candidate touch points
CN105573538A (en) Sliding broken line compensation method and electronic device
EP2691841A1 (en) Method of identifying multi-touch scaling gesture and device using the same
US20130285957A1 (en) Display device and method using a plurality of display panels
WO2017131891A2 (en) Mitigating common mode display noise using hybrid estimation approach
GB2527918A (en) Glove touch detection
CN104598082A (en) Method and device for determining candidate touch point
EP2691839A1 (en) Method of identifying translation gesture and device using the same
CN111177869A (en) Method, device and equipment for determining sensor layout scheme
CN105373267A (en) Multi-point identification method and device of infrared touch screen and infrared touch screen
CN105260064A (en) Touch point identification method and apparatus, and display device
CN105468214B (en) Location-based object classification
US9971429B2 (en) Gesture recognition method, apparatus and device, computer program product therefor
CN113126795B (en) Touch identification method of touch display device and related equipment
CN105579945A (en) Digital device and control method thereof
US8952934B2 (en) Optical touch systems and methods for determining positions of objects using the same
WO2015060932A1 (en) Ghost suppression using hybrid capacitive sensing
US20160283017A1 (en) Hybrid detection for a capacitance input device
US10521052B2 (en) 3D interactive system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant