Embodiment
See also Fig. 1, Fig. 1 is the process flow diagram of camera type touch detection method first embodiment of the present invention.
Said camera type touch detection method starts from step S102.
Then, in step S104, obtain at least three precalculated positions outside the on-screen display (osd) area to the original image of said screen shot.
Said at least three precalculated positions are arranged on outside the viewing area of said screen, and its coordinate with respect to said screen is known.In this embodiment; The coordinate in three precalculated positions all is arranged on the top margin of said screen; Wherein, The coordinate in the coordinate in first precalculated position and second precalculated position is separately positioned on the top margin of said screen and the intersection point place on two other limit, and the coordinate in the 3rd precalculated position is arranged on the midpoint of said top margin.In this embodiment, through on said three precalculated positions, a camera head being set respectively, and the scope that the shooting visual angle of said three camera heads is set all comprises whole said screen, and said screen is taken, and obtains said original image.
In this step, comprise that further one is carried out the denoising point to said image, increase the treatment step of contrast, the quality of data of the image that obtains with raising makes the detection and location of touch objects more accurate.
The said original image that in step S104, obtains comprises the image within the border of said screen, also comprises the image outside the bounds of said screen, yet, have only the image within the border of said screen could reflect whether have touch objects to occur.When the image outside the bounds of said screen changes; Do not represent to have touch objects to touch said screen; If do not distinguish; Then can receive the influence of the image change outside the bounds of said screen during the coordinate Calculation of touch objects, cause the location mistake easily, and invalid calculating can cause prolong the positioning time to touch objects.
Therefore, in step S106, the image from said original image within the border of selected said screen.Get rid of the interference that the image outside the bounds of said screen changes the touch point detection and location are caused.
In this step, discern the image on the border of said screen, selected said screen border is the image within the border of said screen to the image in said precalculated position.Then, in follow-up step, the image within the border of a said screen of need processing, and need not handle whole original image, shorten the time of in the subsequent step image being handled.
In this embodiment, said screen comprises the boundary marker thing that is arranged on its edge, and the outer rim that said boundary marker thing can be employed in said screen is provided with frame shape thing or the bar that plastics or aluminium alloy make and realizes.Said boundary marker thing is included in an extinction part and the non-extinction part perpendicular to the range upon range of setting of direction of said screen.Said extinction part can be employed in the surface spraying of said frame shape thing or bar or the mode of stickup light absorbent realizes that said light absorbent can adopt black ink, flannelette, coating etc.Said extinction partly is used for absorption and shines its lip-deep light, and in the said original image of therefore taking, the image of said extinction part is shown as and is parallel to said screen and darker narrow rectangular line.The mode that said non-extinction part can be employed in the surface spraying of said frame shape thing or bar or paste non-light absorbent realizes that said non-light absorbent can adopt metal powder, sheet metal, aluminium foil, glass etc.Said non-extinction partly is used for reflected illumination to its lip-deep light, and in the said original image of therefore taking, the image of said extinction part is shown as and is parallel to screen and the higher narrow rectangular line of brightness.
In this step; Image according to said boundary marker thing; Be a bright fringes and a dark fringe of and mutual range upon range of setting parallel with screen in the said original image, the image of selected said boundary marker thing is the image within the border of said screen to the image in said precalculated position.
The extinction part of said boundary marker thing and the mutual alignment of non-extinction part can freely be provided with, and promptly both can said light absorption unit branch be arranged on the position away from screen, and said non-light absorption unit branch is arranged on the position near screen; Also can said non-light absorption unit branch be arranged on the position away from screen, said light absorption unit branch is arranged on the position near screen.
Because said extinction part and said non-extinction part are perpendicular to the range upon range of setting of the direction of said screen, said boundary marker thing is difficult in said original image its optical characteristics separately and general environment for use or touch objects obscured.
In this embodiment,, therefore, said boundary marker thing is not set on the top margin of said screen, on three limits in addition said boundary marker thing is set all, indicate the border of said screen owing on the top margin of said screen said camera head is set.
In step S108, judge in the said selected image that the border of the screen thing that whether is touched blocks.As if judged result is " being ", then execution in step S110.If judged result is " denying ", then return step S104.
When bright fringes or dark fringe are not blocked described in the image within the border of selected said screen, represent not have on the said screen touch objects that it is made the action of touch.Therefore return step S104, obtain the image of shooting again.
When bright fringes or dark fringe are blocked described in the image within the border of selected said screen, represent to have on the said screen touch objects that it is made the action of touch, then execution in step S110.
Because said boundary marker thing comprises said extinction part and said non-extinction part, if touch objects can reflect ambient light, then in this dark fringe speck appears in the image within the border of said selected said screen; If it is less that the character of touch objects is reflect ambient light, then blackening can appear in bright fringes.Therefore, no matter whether touch objects can reflect ambient light, all can in the image within the border of selected said screen, distinguish more significantly, makes the touch objects orienting response sensitiveer.
In step S110, the coordinate of the position that is blocked according to the border of said screen and the coordinate Calculation touch objects in said precalculated position.In this embodiment; Concrete computing method are: the position that is blocked according to the border of said screen and the coordinate in said precalculated position, calculate some straight lines through the coordinate in each said precalculated position and the position that is blocked through the border of said screen respectively; Then, be judged as touch article coordinate through the intersecting point coordinate of the straight line of three said precalculated position coordinates respectively with three.
The flow process of said camera type touch detection method ends at step S112.
Constantly repeat above-mentioned process step, can obtain the motion track of touch objects, can carry out corresponding operation according to the motion track of touch objects then, like mouse moving, the dragging etc. of display page.
As a kind of preferred implementation; Said camera type touch detection method may further include a step S105: the brightness value of judging surround lighting according to the perhaps selected image of said original image; And with the brightness value of said surround lighting and preset value relatively, open or close a sidelight source according to comparative result.Said sidelight source is arranged on outside the said on-screen display (osd) area, and a side in said at least three precalculated positions is used for providing photographic images required light to said screen.
If the brightness value of surround lighting is lower than said predetermined value in the image that said original image is perhaps selected; Then open said sidelight source, said screen is thrown light on, make the shooting original image more clear; If the brightness of image display environment light is higher than said predetermined value; Then close said sidelight source,, reduce energy loss to utilize ambient light illumination fully.Can also control said sidelight source and send the light of different brightness according to the brightness of the surround lighting in said original image or the image of selecting.For example, the predetermined value of a plurality of brightness is set, when the brightness value of the surround lighting in said original image or the selected image is lower than one of them predetermined value, makes this sidelight source send the light with said predetermined value corresponding brightness.
Compared with prior art, in the camera type touch detection method of the present invention, the coordinate according to the coordinate Calculation touch objects in the image of said screen shot and said precalculated position can position a plurality of touch objects simultaneously.Image from said original image within the border of selected said screen is only handled the image within the border of said screen, can get rid of the interference that the image change outside the bounds of said screen is brought, and reduces the data volume of computing, accelerates locating speed.Simultaneously; Because said boundary marker thing comprises extinction part and non-extinction part; Make it in said original image, be shown as range upon range of bright fringes and dark fringe, be different from general environment for use and touch objects apparent in viewly, and touch objects reflect ambient light whether no matter; The capital produces shielded image on said bright fringes and dark fringe, so said camera type touch detection method is sensitiveer to the detection and location of touch objects.In addition, said sidelight source is opened or closed to surround lighting in the image that said original image is perhaps selected and predetermined value relatively according to comparative result; When surround lighting is enough; Utilize surround lighting to take, when surround lighting is not enough, utilize said sidelight source illumination to be provided said screen; Make the said original image of shooting more clear, more accurate to the location of touch objects.
Please consult Fig. 2 and Fig. 3 in the lump, Fig. 2 is the structural representation of camera type touch detection system first embodiment of the present invention, and Fig. 3 is the principle of work synoptic diagram of camera type touch detection system first embodiment of the present invention.
Said camera type touch detection system comprises image data acquisition module 131, image screening module 135, image data processing module 132 and data memory module 133.
Said image data acquisition module 131 is used to obtain the original image that at least three precalculated positions outside the viewing area of screen 110 are taken said screen 110.Said at least three precalculated positions are arranged on outside the viewing area of said screen 110, and its coordinate with respect to said screen 110 is known.
In this embodiment, 131 three of the controls of said image data acquisition module are arranged on the camera head outside the viewing area of said screen 110, and said screen 110 is taken, and obtain said original image.The position of said three camera heads all is arranged on the top margin of said screen 110.Wherein, first camera head 121 and second camera head 122 are separately positioned on the top margin of said screen 110 and the intersection point place on other both sides, and the 3rd camera head 123 is arranged on the midpoint of said top margin.Wherein, the shooting visual angle of said first camera head 121 and said second camera head 122 all is 90 °, and the angle of the top margin of its camera lens optical axis and said screen is 45 °.The shooting visual angle of said the 3rd camera head 123 is 170 ° to 180 °, and the angle of the top margin of its camera lens optical axis and said screen is 90 °.The scope at the shooting visual angle of said three camera heads all comprises whole said screen 110.
Said the 3rd camera head 123 also can use two, and to take visual angles all be that 90 ° camera head replaces; At this moment; Said two shooting visual angles are the midpoint that 90 ° camera head all is arranged on said top margin; And be used for separately half said screen 110 is taken, obtain said original image.So, then need not adopt expensive wide viewing angle camera head, also can reduce because the difficulty that the one-tenth distortion of image of camera head lens brings to Flame Image Process.
In practical operation, said at least three camera heads can select to install different optical filter or color filter according to the needs of environment for use.
As a kind of preferred implementation, the said original image that 131 pairs of said image data acquisition modules obtain carries out the denoising point, increases the processing of contrast, to improve the quality of data of said image, makes the detection and location of touch objects more accurate.
Owing to comprise the image within the bounds of said screen 110 in the said original image that obtains of said image data acquisition module 131; Also comprise the image outside the bounds of said screen 110; Yet, have only the image within the bounds of said screen 110 could reflect whether have touch objects to occur.When the image outside the bounds of said screen 110 changes; Do not represent to have touch objects to touch said screen 110; If do not distinguish; Then can receive the influence of the image change outside the bounds of said screen 110 during the coordinate Calculation of touch objects, cause the location mistake easily, and invalid calculating increase can cause prolong the positioning time to touch objects.
Therefore, the image within the bounds of said image screening module 135 selected said screen 110 in said original image.Get rid of the interference that the image outside the bounds of said screen 110 changes the touch point detection and location are caused.Then, in the follow-up process that image is handled, the image within the border of a said screen 110 of need processing, and need not handle whole original image, shorten the time that image is handled.
In this embodiment, said screen 110 comprises the boundary marker thing 101 that is arranged on its edge, and said boundary marker thing 101 can be provided with frame shape thing or the bar that plastics or aluminium alloy make in the outer rim of said screen 110 and realize.Said boundary marker thing 101 is included in perpendicular to an extinction part 104 of the range upon range of setting of direction of said screen 110 and a non-extinction part 102.Said extinction part 104 can be employed in the surface spraying of said frame shape thing or bar or the mode of stickup light absorbent realizes that said light absorbent can adopt black ink, flannelette, coating etc.Said extinction part 104 is used for absorption and shines its lip-deep light, and when therefore taking, the image of said extinction part 104 is shown as and is parallel to screen and darker narrow rectangular line.The mode that said non-extinction part 102 can be employed in the surface spraying of said frame shape thing or bar or paste non-light absorbent realizes that said non-light absorbent can adopt metal powder, sheet metal, aluminium foil, glass etc.Said non-extinction part 102 is used for reflected illumination to its lip-deep light, and when therefore taking, the image of said non-extinction part 102 is shown as and is parallel to screen and the higher narrow rectangular line of brightness.
In this embodiment; Said image screening module 135 is according to the image of boundary marker thing 101 described in the image of said shooting; Promptly parallel with screen 110 an and range upon range of bright fringes and dark fringes mutually, selected said bright fringes and dark fringe are the image within the border of said screen 110 to the image in said precalculated position.
The extinction part 104 of said boundary marker thing 101 and the mutual alignment of non-extinction part 102 can freely be provided with, and promptly both can said extinction part 104 be arranged on the position away from screen 110, and said non-extinction part 102 is arranged on the position near screen 110; Also can said non-extinction part 102 be arranged on the position away from screen 110, said extinction part 104 is arranged on the position near screen 110.
Because said extinction part 104 is provided with in the direction laminated perpendicular to said screen 110 with said non-extinction part 102, the optical characteristics of said extinction part 104 and said non-extinction part 102 makes said boundary marker thing 101 in said original image, be difficult for obscuring with general environment for use or touch objects.
In this embodiment; Because on the top margin of said screen 110 said camera head is set, therefore, said top margin is not provided with said boundary marker thing 101; On other three limits of said screen 110, said boundary marker thing 101 is set all, indicates the border of said screen 110.
When bright fringes or dark fringe were not blocked described in the image within the bounds of said screen 110, representing did not have touch objects that it is made the action of touch on the said screen 110.Then said image screening module 135 continues the said original image that said image data acquisition module 131 obtains is selected, and judges in the said selected image touch objects whether occurs.
When bright fringes or dark fringe were blocked described in the image within the bounds of selected said screen 110, representing had touch objects that it is made the action of touch on the said screen 110.
Because said boundary marker thing 101 comprises said extinction part 104 and said non-extinction part 102, if touch objects can reflect ambient light, then speck appears in this dark fringe in the selected image of said image screening module 135; If it is less that the character of touch objects is reflect ambient light, then blackening can appear in bright fringes.Therefore, no matter whether touch objects can reflect ambient light, all more easily identifies, and makes said camera type touch detection system sensitiveer to the detection and location of touch objects.
In said selected image, the border of screen is touched thing when blocking, the coordinate of the position that said image data processing module 132 is blocked according to the border of said screen 110 and the coordinate Calculation touch objects in said precalculated position.
Said data memory module 133 is used to store the image data of said image data acquisition module 131 collections and the coordinate data that the said image data processing module 132 of process is handled the touch objects of back acquisition.
In this embodiment, said image data processing module 132 can adopt DSP or FPGA to realize, the said data memory module 133 preferred Flash of employing storeies are realized.
Specify said camera type touch detection system work principle below.
Before the said camera type touch detection system work, said image data acquisition module 131 is at first calibrated the parameter of each camera head, mainly comprises the camera lens mechanical location adjustment of camera head, and surveyed area is demarcated, photographic images and actual angle error correction etc.
When said camera type touch detection system is worked, at first carry out the initialization of system, comprise that the parameter of each camera head and data collection and analysis module 130 is provided with initialization.The said a plurality of camera heads of said then image data acquisition module 131 controls are taken screen; Obtain original image; Said original image is carried out the denoising point; Increase processing such as contrast, and said original image is sent to said data memory module 133 and said image screening module 135, said image screening module 135 is according to the image within the bounds of the selected said screen 110 in said original image of the boundary marker thing 101 in the original image that photographs.Show that in selected image said boundary marker thing 101 is blocked, when promptly said bright fringes or dark fringe were blocked, expression had touch objects on said screen 110, to carry out touch action.
The position that said image data processing module 132 is blocked by said touch objects according to the border of said screen 110 and the coordinate in said precalculated position; Calculate respectively through the coordinate in three said precalculated positions and pass through some straight lines of the image of said touch objects respectively; With two preliminary coordinate that are judged as touch objects respectively through the intersecting point coordinate of the straight line of said two precalculated position coordinates, shown in 4 of the A among Fig. 3, B, C, D.Then; Said image data processing module 132 combines the preliminary coordinate of said touch objects with straight line through the 3rd precalculated position; If the principle of corresponding points on straight line confirms that then the preliminary coordinate of said touch objects is the coordinate of actual touch thing, shown in 2 of the A among Fig. 3, B; Otherwise, with the preliminary coordinate of said touch objects for being judged as incorrect coordinate, shown in 2 of the C among Fig. 3, D.
See also Fig. 4, Fig. 4 is the structural representation of a kind of preferred implementation of camera type touch detection system of the present invention.As a kind of preferred implementation; Said camera type touch detection system can further comprise a Data Post module 140; Said Data Post module 140 links to each other with said image data processing module 132; Said Data Post module 140 is obtained the coordinate of the touch objects of continual renovation from said image data processing module 132, obtain the coordinate motion track of touch objects, carries out predefined instruction according to the coordinate motion track of said touch objects again; Mouse moving for example, the dragging or the like of display page.The calculating of said touch article coordinate also can be carried out by said Data Post module 140.
Please consult Fig. 5, Fig. 6 in the lump, Fig. 5 is the principle of work synoptic diagram of the another kind of preferred implementation of camera type touch detection system of the present invention, and Fig. 6 is the structural representation of the another kind of preferred implementation of camera type touch detection system of the present invention.As the another kind of preferred implementation of camera type touch detection system of the present invention, said camera type touch detection system further comprises two sidelight sources 151,152.Said sidelight source 151,152 is used for providing photographic images required illumination light to said screen; It is arranged on outside the viewing area of screen 110; And be arranged on the same side with said three camera heads; Keep certain distance with said a plurality of camera heads, the light of avoiding sending shines directly into the camera lens of said three camera heads.Said sidelight source 151,152 can be light-emitting components such as fluorescent tube, LED or bulb, and its shape can be a linear light source, also can be point source of light independently.
Said camera type touch detection system further comprises a light source control module 134; The original image that said light source control module 134 is used for obtaining according to said image data acquisition module 131 is judged the brightness value of surround lighting; And with the brightness value of said surround lighting and preset value relatively, open or close said sidelight source 151,152 according to comparative result.If the brightness value of said surround lighting is lower than said predetermined value, then open said sidelight source 151,152, said screen 110 is thrown light on, make said image data acquisition module 131 get access to more distinct image; If the brightness value of image display environment light is higher than said predetermined value, then close said sidelight source 151,152, to utilize surround lighting fully, reduce energy loss.Said light source control module 134 further can also be provided with a plurality of brightness predetermined values, according to the brightness value of said surround lighting, controls said sidelight source 151,152 and sends the light of different brightness.For example, when the brightness of surround lighting is higher than one of them predetermined value, controls said sidelight source 151,152 and send predefined and light this predetermined value corresponding brightness.
Compared with prior art, in the camera type touch detection system of the present invention, said image data processing module can position a plurality of touch objects according to the coordinate to the coordinate Calculation touch objects in the image of said screen shot and said precalculated position simultaneously.Image within the border of said image data processing module selected said screen from said original image; Only handle the image within the border of said screen; Can get rid of the interference that the image change outside the bounds of said screen is brought, reduce the data volume of computing, accelerate locating speed.Simultaneously; Because said boundary marker thing comprises extinction part and non-extinction part; Make it in said original image, be shown as range upon range of bright fringes and dark fringe, be different from general environment for use and touch objects apparent in viewly, and touch objects reflect ambient light whether no matter; The capital is blocked said bright fringes or dark fringe, so said camera type touch detection system is sensitiveer to the detection and location of touch objects.Said light source control module compares the brightness and the predetermined value of surround lighting; Unlatching is perhaps closed said sidelight source according to comparative result, when surround lighting is enough, utilizes surround lighting to take; When surround lighting is not enough; Utilize said sidelight source illumination to be provided, make the original image of shooting more clear said screen, more accurate to the location of touch objects.
Camera type touch detection system of the present invention can be applied in the outside surface of any display device, does not receive the restriction of display device; Do not need environment for use is proposed higher requirement, and it is high to touch precision, extendability is strong, is easier to realize that the multiple point touching of large scale screen detects, and it is convenient that camera type touch detection system of the present invention also has Installation and Debugging, the advantage that cost is low.
Use same principle, camera type touch detection method of the present invention and system thereof can carry out the multipoint positioning more than 3.In addition; Through understanding technical scheme of the present invention; Those skilled in the art will recognize; Through increasing the number of different shooting angle or increase camera head, can make said camera type touch detection method of the present invention and system thereof more accurate to the location of touch objects, also can realize the multipoint positioning more than 3 more easily.
Above-described embodiment of the present invention does not constitute the qualification to protection domain of the present invention.Any modification of within spirit of the present invention and principle, being done, be equal to replacement and improvement etc., all should be included within the claim protection domain of the present invention.