CN102945103B - A kind of touch object identification method of optical sensor - Google Patents
A kind of touch object identification method of optical sensor Download PDFInfo
- Publication number
- CN102945103B CN102945103B CN201210433967.XA CN201210433967A CN102945103B CN 102945103 B CN102945103 B CN 102945103B CN 201210433967 A CN201210433967 A CN 201210433967A CN 102945103 B CN102945103 B CN 102945103B
- Authority
- CN
- China
- Prior art keywords
- touch objects
- touch
- optical sensor
- image
- objects
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Image Analysis (AREA)
- Position Input By Displaying (AREA)
Abstract
A kind of touch object identification method of optical sensor, comprises optical sensor signals processing unit, image pre-processing unit, touch objects recognition unit, touch objects secondary recognition unit, touch objects one-dimensional position information process unit and touch objects physical location unit.Touch objects recognition methods comprises: by the collection of optical sensor signals processing unit and process touch-screen picture signal import image pre-processing unit into; Filtering process is carried out to obtained perceptual image; Perceptual image information after process being sent into touch objects recognition unit, through identifying, obtaining initial touch thing one-dimensional position information; Analyze, judge this positional information, if initial touch thing one-dimensional position information is wrong, then the identification of touch objects secondary is carried out to perceptual image again; According to historical juncture touch objects one dimension identifying information, obtain final touch objects one-dimensional position information, find the physical location of touch objects.The robustness of the method is high, when unfavorable factor causes perceptual image quality not good, still can identify the position of touch objects fast and accurately.
Description
Technical field
The present invention relates to optical touch technology, particularly relate to a kind of recognition methods being applicable to the optical sensor touch objects position of various complicated.
Background technology
The main flow touching technique of domestic market is worked as based on vector pressure sensing technology, resistive technologies, infrared technology, capacitance technology, touch-surface technology of acoustic wave, although these touching techniques have his own strong points, but, all more or less there is many technical problems and be difficult to solve.And the appearance of optical touch screen solves a difficult problem for numerous touch-screen substantially, and there is the following supremacy clause touching market of leader.Optical touch technology is a kind of new technology being different from the touching techniques such as existing infrared, surface acoustic wave, resistance, electric capacity, and optical sensor is quick to careful movement response, makes the operation of operator more brisk, smooth, accurately.Optics module can detect multiple finger of operator or the position of other touch operation body accurately, operator not only can be clicked, double-click, dilatory, can also implement to rotate freely and the operation such as amplification.Existing optical touch screen structure mainly comprises luminescence component, optical sensor signals processing unit, graphics processing unit and display unit.
In optical touch technology, image procossing is the gordian technique of optical touch, and one of key factor affecting image procossing is exactly the identification of touch objects.Current is mostly adopt difference frame method, optical flow method and Background difference to the identification of touch objects.Fig. 1 is the optical sensor touch objects recognition principle block diagram of main employing at present, and its functional module comprises: optical sensor signals processing unit, image pre-processing unit, touch objects recognition unit, touch objects one-dimensional position information process unit and touch objects physical location unit.Wherein, optical sensor signals processing unit, general adopts CCD camera or CMOS camera, for gathering and processing the image information of touch-screen display; Wherein, image pre-processing unit carries out filtering process to the perceptual image obtained from optical sensor signals processing unit; Wherein, touch objects recognition unit be to image pre-processing unit process after perceptual image, carry out touch objects identification; Wherein, touch objects one-dimensional position information process unit is the result to touch objects identification, carries out one-dimensional position information record; Touch objects physical location unit is for calculating the physical location of touch objects in touch screen.The method of this identification touch objects position, when perceptual image quality is undesirable, the leakage discrimination of touch objects is higher, thus greatly have impact on the performance that optical sensor touches body sense.
As can be seen here, a kind of touch object identification method of optical sensor of improvement is needed.
Summary of the invention
For the deficiency that prior art exists, the object of the present invention is to provide a kind of touch object identification method of optical sensor being applicable to various complicated.
For achieving the above object, technical scheme of the present invention is: a kind of touch object identification method of optical sensor, comprise optical sensor signals processing unit, image pre-processing unit, touch objects recognition unit, touch objects secondary recognition unit, touch objects one-dimensional position information process unit and touch objects physical location unit, touch objects recognition methods comprises:
By the collection of described optical sensor signals processing unit and process touch-screen picture signal import described image pre-processing unit into;
In described image pre-processing unit, carry out pre-service to obtained perceptual image, described pre-service is filtering process;
Perceptual image information after filtering process is sent into touch objects recognition unit, carries out touch objects identifying processing, obtain initial touch thing one-dimensional position information;
Initial touch thing one-dimensional position information is analyzed, judged, if initial touch thing one-dimensional position information is wrong, then the identification of touch objects secondary is carried out to described perceptual image again;
In the identification of described touch objects secondary, according to historical juncture touch objects one dimension identifying information, obtain final touch objects one-dimensional position information, find the physical location of touch objects in touch screen, complete touch objects identification.
Preferably, analyze a recognition result, according to the touch objects identification situation to historical juncture optical sensor perceptual image, carry out following the tracks of, analyzing, obtain historical juncture touch objects number, the touch objects number that itself and current time optical sensor perceptual image identify is compared;
Preferably, comparative result, if judge that initial touch thing one-dimensional position information is wrong, then enters touch objects secondary recognition unit, carries out the identification of touch objects secondary;
Preferably, the identification of touch objects secondary, comprising:
First, by analyzing the movement tendency of touch objects in the historical juncture on sensor senses image, estimate the general location doping current time touch objects;
Then, choose this position to left and right suitably expanding the region formed, and to mark this region be doubtful touch objects region;
Find touch objects condition, secondary identification is carried out to this doubtful touch objects region, each image pixel foreground location in doubtful touch objects region and corresponding image pixel background positions are compared, by traversing graph picture, find touch objects condition, and then find doubtful touch objects position;
Travel through doubtful touch objects region, find all doubtful touch objects meeting touch objects condition;
Choose wherein touch objects and touch the maximum doubtful touch objects position of energy, and be labeled as actual touch object location, i.e. touch objects physical location;
Upgrade touch objects identification number and touch objects recognizing site, so far, complete the touch objects identification on touch-screen.
Compared with prior art, the technique effect of technical solution of the present invention is: touch objects recognition methods of the present invention be undesirable for the perceptual image quality under multiple environment and propose, by carrying out comprehensive assessment to perceptual image, draw the touch objects recognition methods being applicable to various complicated.The robustness of the method is high, particularly and/or optical sensor unreasonable in optical sensor installation site exposes improper, such as illumination is crossed strong or excessively weak, when causing optical sensor perceptual image quality not good etc. factor, can both identify the position of touch objects fast and accurately.When installing touch-screen, then without the need to carrying out the evaluation of the factors such as illumination to the installation environment of touch-screen, save operational sequence.
Accompanying drawing explanation
Fig. 1 is existing optical sensor touch objects recognition principle block diagram;
Fig. 2 is optical sensor perceptual image touch objects recognition principle block diagram of the present invention;
Fig. 3 is optical sensor perceptual image touch objects identification workflow diagram of the present invention.
Embodiment
Below in conjunction with drawings and Examples, the present invention is described in further detail.
Affecting one of key factor of optical touch performance is light image processing module, and what play a crucial role in image processing module is exactly the identification of touch objects.
Existing optical sensor touch objects identification structure shown in Fig. 1 only carries out one-dimensional position information record to the result of touch objects identification, and calculate the physical location of touch objects in touch screen thus, the leakage discrimination of its touch objects is higher.
Fig. 2 illustrates optical sensor touch objects identification structure of the present invention, and its functional module comprises optical sensor signals processing unit, image pre-processing unit, touch objects recognition unit, touch objects secondary recognition unit, touch objects one-dimensional position information process unit and touch objects physical location unit.The course of work of its each functional module: after this touching device is powered on, first, image pre-processing unit can obtain perceptual image from optical sensor signals processing unit, then, pre-service is carried out to this perceptual image, result is sent into touch objects recognition unit, in this unit, touch objects is once identified, recognition result is recorded and is processed in initial touch thing one-dimensional position information process unit, by analysis, judge, if initial touch thing one-dimensional position information is wrong, then the identification of touch objects secondary is carried out again to perceptual image, finally, touch objects physical location is on the touchscreen obtained in touch objects physical location unit.
Fig. 3 illustrates optical sensor perceptual image touch objects identification workflow of the present invention, and its identification process comprises the following steps:
1) carry out filtering process to each optical sensor perceptual image, removing interference noise point, makes its image more level and smooth.
2) carry out touch objects to the perceptual image information after filtering process once to identify, obtain initial touch thing one-dimensional position information.
3) recognition result is analyzed, according to the touch objects identification situation to historical juncture optical sensor perceptual image, carry out following the tracks of, analyzing, obtain historical juncture touch objects number, by the touch objects number that the perceptual image one of in itself and current time first optical sensor or the second optical sensor identifies, compare.
4) comparative result, if the touch objects number that the perceptual image one of in current time first optical sensor or the second optical sensor identifies equals historical juncture touch objects number, and when wherein another identification touch objects number is less than historical juncture touch objects number, by carrying out estimation prediction to historical juncture touch objects motion in one dimension trend, judge whether current time touch objects exists the possibility that optical sensor perceptual image overlaps, if do not had, then once identify the possibility having and leak and identify touch objects, or the possibility of wrong identification touch objects, then less to identification touch objects number optical sensor perceptual image carries out secondary identification.
5) touch objects secondary identification, comprising:
First, the general location of the current time touch objects of the optical sensor perceptual image that should carry out secondary identification is estimated;
Then, choose this position to left and right suitably expanding the region formed, and to mark this region be doubtful touch objects region;
Find touch objects condition, secondary identification is carried out to this doubtful touch objects region, each image pixel foreground location in doubtful touch objects region and corresponding image pixel background positions are compared, when the difference of image pixel background positions subtracted image pixel foreground location is greater than default fixed threshold, from this POS INT, to doubtful touch objects area coverage image, if when finding the reference position in doubtful touch objects region, then to the perceptual image traversing graph picture from right to left of optical sensor, if when finding doubtful touch objects region rest position, then to the perceptual image traversing graph picture from left to right of optical sensor, in traversing graph picture, if the difference having the pixel of continuous more than 3 all to meet image pixel background positions subtracted image pixel foreground location is greater than default fixed threshold, be then touch objects condition to this condition flag, wherein, fixed threshold is by concrete optical sensor perceptual image quality analysis, and experience draws,
Travel through doubtful touch objects region, will the intermediate value of the start-stop position of touch objects condition be met, be labeled as doubtful touch objects position;
Choose wherein touch objects and touch the maximum doubtful touch objects position of energy, and be labeled as actual touch object location, i.e. touch objects physical location, wherein, touch objects touches energy and can obtain by asking for average gray value;
6) upgrade touch objects identification number and touch objects recognizing site, upgrade historical information;
So far, the touch objects identification on touch-screen is completed.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (7)
1. a touch object identification method of optical sensor, comprise optical sensor signals processing unit, image pre-processing unit, touch objects recognition unit, touch objects secondary recognition unit, touch objects one-dimensional position information process unit and touch objects physical location unit, touch objects recognition methods comprises:
By the collection of described optical sensor signals processing unit and process touch-screen picture signal import described image pre-processing unit into;
In described image pre-processing unit, carry out pre-service to obtained perceptual image, described pre-service is filtering process;
Perceptual image information after filtering process is sent into described touch objects recognition unit, carry out touch objects identifying processing, obtain initial touch thing one-dimensional position information;
Analyze a recognition result, according to the touch objects identification situation to historical juncture optical sensor perceptual image, carry out following the tracks of, analyzing, obtain historical juncture touch objects number, the touch objects number that itself and current time optical sensor perceptual image identify is compared; Comparative result, if judge that described initial touch thing one-dimensional position information is wrong, then enters described touch objects secondary recognition unit, carries out the identification of touch objects secondary again to described perceptual image;
In the identification of described touch objects secondary, first estimate the general location of the current time touch objects of the optical sensor perceptual image that should carry out secondary identification; Then, choose this position to left and right suitably expanding the region formed, and to mark this region be doubtful touch objects region; Secondary identification is carried out to this doubtful touch objects region, each image pixel foreground location in described doubtful touch objects region and corresponding image pixel background positions is compared, by traversing graph picture, finds touch objects condition; Travel through described doubtful touch objects region, find all doubtful touch objects position meeting described touch objects condition; Choose wherein touch objects and touch the maximum doubtful touch objects position of energy, and be labeled as actual touch object location, i.e. touch objects physical location; Upgrade touch objects identification number and touch objects recognizing site, upgrade historical information, complete touch objects identification.
2. recognition methods according to claim 1, it is characterized in that, described touch objects number compares, and is by historical juncture touch objects number, touch objects number with the perceptual image one of in current time first optical sensor or the second optical sensor identifies, compares.
3. recognition methods according to claim 1, it is characterized in that, described judgement initial touch thing one-dimensional position information is wrong, refer to if the touch objects number that the perceptual image one of in current time first optical sensor or the second optical sensor identifies equals historical juncture touch objects number, and when wherein another identification touch objects number is less than historical juncture touch objects number, by estimating prediction, judge there is the possibility of leaking and identifying or identifying touch objects by mistake, then enter described touch objects secondary recognition unit, carry out the identification of touch objects secondary.
4. recognition methods according to claim 3, it is characterized in that, described estimation prediction, by carrying out estimation prediction to historical juncture touch objects motion in one dimension trend, judge whether current time touch objects exists the possibility that optical sensor perceptual image overlaps, if do not had, then once identify the possibility having and leak and identify touch objects, or the possibility of wrong identification touch objects, then less to identification touch objects number optical sensor perceptual image carries out secondary identification.
5. recognition methods according to claim 1, it is characterized in that, find in touch objects condition, each image pixel foreground location in doubtful touch objects region and corresponding image pixel background positions are compared, when the difference of image pixel background positions subtracted image pixel foreground location is greater than default fixed threshold, from this POS INT, to described doubtful touch objects area coverage image;
If the difference having the pixel of continuous more than 3 all to meet image background position subtracted image foreground location is greater than default fixed threshold, be then touch objects condition to this condition flag.
6. recognition methods according to claim 1, is characterized in that, will meet the intermediate value of the start-stop position of touch objects condition, is labeled as doubtful touch objects position.
7. recognition methods according to claim 5, it is characterized in that, to the traversing graph picture in doubtful touch objects region, when finding the reference position in doubtful touch objects region, to the perceptual image traversing graph picture from right to left of optical sensor, when finding doubtful touch objects region rest position, to the perceptual image traversing graph picture from left to right of optical sensor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210433967.XA CN102945103B (en) | 2012-10-19 | 2012-11-01 | A kind of touch object identification method of optical sensor |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210401193.2 | 2012-10-19 | ||
| CN201210401193 | 2012-10-19 | ||
| CN201210433967.XA CN102945103B (en) | 2012-10-19 | 2012-11-01 | A kind of touch object identification method of optical sensor |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102945103A CN102945103A (en) | 2013-02-27 |
| CN102945103B true CN102945103B (en) | 2015-12-09 |
Family
ID=47728053
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210433967.XA Active CN102945103B (en) | 2012-10-19 | 2012-11-01 | A kind of touch object identification method of optical sensor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102945103B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI507947B (en) * | 2013-07-12 | 2015-11-11 | Wistron Corp | Apparatus and system for correcting touch signal and method thereof |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102012769A (en) * | 2010-11-18 | 2011-04-13 | 无锡中星微电子有限公司 | Method and device for performing multi-point control on contents on screen by using camera |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2876470B1 (en) * | 2004-10-12 | 2006-12-22 | Eastman Kodak Co | DISPLAY CONTROL METHOD USING PORTABLE IMAGE SENSOR EQUIPMENT |
-
2012
- 2012-11-01 CN CN201210433967.XA patent/CN102945103B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102012769A (en) * | 2010-11-18 | 2011-04-13 | 无锡中星微电子有限公司 | Method and device for performing multi-point control on contents on screen by using camera |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102945103A (en) | 2013-02-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102118408B1 (en) | Method of performing a touch action in a touch sensitive device | |
| JP6079832B2 (en) | Human computer interaction system, hand-to-hand pointing point positioning method, and finger gesture determination method | |
| KR101877570B1 (en) | Apparatus for setting parking position based on around view image and method thereof | |
| KR101514169B1 (en) | Information processing device, information processing method, and recording medium | |
| US20130050076A1 (en) | Method of recognizing a control command based on finger motion and mobile device using the same | |
| US20130279756A1 (en) | Computer vision based hand identification | |
| TWI431538B (en) | Image based motion gesture recognition method and system thereof | |
| CN103353935A (en) | 3D dynamic gesture identification method for intelligent home system | |
| EP2374089A1 (en) | Method, apparatus and computer program product for providing hand segmentation for gesture analysis | |
| US10198627B2 (en) | Gesture identification with natural images | |
| CN103870071B (en) | One kind touches source discrimination and system | |
| TW201322058A (en) | Gesture recognition system and method | |
| CN104850219A (en) | Equipment and method for estimating posture of human body attached with object | |
| TWI571772B (en) | Virtual mouse driving apparatus and virtual mouse simulation method | |
| JP5895720B2 (en) | Subject tracking device, subject tracking method, and computer program for subject tracking | |
| CN104834412A (en) | Touch terminal based on non-contact hand gesture recognition | |
| CN108762557A (en) | A kind of touch detecting method and computer readable storage medium | |
| CN103713755A (en) | Touch recognizing device and recognizing method | |
| CN104239844A (en) | Image recognition system and image recognition method | |
| CN108255352B (en) | Multi-touch implementation method and system in projection interaction system | |
| CN105511691A (en) | Optical touch sensing device and touch signal judgment method thereof | |
| CN102541417B (en) | Multi-object tracking method and system in virtual touch screen system | |
| CN102945103B (en) | A kind of touch object identification method of optical sensor | |
| US20190258325A1 (en) | Mid-air finger pointing detection for device interaction | |
| US20120139855A1 (en) | Apparatus and method for detecting touch information and proximity information in display apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20210520 Address after: 215500 5th floor, building 4, 68 Lianfeng Road, Changfu street, Changshu City, Suzhou City, Jiangsu Province Patentee after: Changshu intellectual property operation center Co.,Ltd. Address before: 214192 No. 99 Furong Zhongsan Road, Xishan Economic Development Zone, Wuxi City, Jiangsu Province Patentee before: WUXI HINORA TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220818 Address after: No. 129, Luyi Road, Guli Town, Changshu City, Suzhou City, Jiangsu Province 215500 Patentee after: Suzhou xinshida Precision Electronic Technology Co.,Ltd. Address before: 215500 5th floor, building 4, 68 Lianfeng Road, Changfu street, Changshu City, Suzhou City, Jiangsu Province Patentee before: Changshu intellectual property operation center Co.,Ltd. |