KR101792397B1 - A Touch Sensing Apparatus and Method of Using the Background Intensity Control Technology - Google Patents
A Touch Sensing Apparatus and Method of Using the Background Intensity Control Technology Download PDFInfo
- Publication number
- KR101792397B1 KR101792397B1 KR1020160027255A KR20160027255A KR101792397B1 KR 101792397 B1 KR101792397 B1 KR 101792397B1 KR 1020160027255 A KR1020160027255 A KR 1020160027255A KR 20160027255 A KR20160027255 A KR 20160027255A KR 101792397 B1 KR101792397 B1 KR 101792397B1
- Authority
- KR
- South Korea
- Prior art keywords
- touch sensing
- light amount
- value
- distribution value
- predetermined
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
- G06F3/005—Input arrangements through a video camera
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Position Input By Displaying (AREA)
Abstract
The present invention relates to a touch sensing apparatus and method using a background light amount control technique, and more particularly, to a touch sensing apparatus and method using a background light intensity control technique, which comprises two or more camera modules for photographing a touch sensing area, A touch control module for calculating a deviation value, a touch sensing signal extraction and a touch sensing coordinate, and an interface module for transmitting the touch sensing coordinates of the control module to a display screen, wherein the effective touch sensing A light amount variation value according to a light amount distribution value of a region is calculated and a touch sense signal corresponding to a deviation of a certain threshold value or more from a certain pixel position is determined to extract touch sensing coordinates and a background light amount control Technology and a touch sensing device using the same One will.
Description
The present invention relates to a touch sensing apparatus and method using a background light intensity control technique, which calculates a light intensity deviation value according to a light intensity distribution value of a predetermined effective touch sensing area in an image captured by two or more camera modules, The present invention relates to a touch sensing apparatus and a touch sensing method using a background light amount control technique for extracting touch sensing coordinates and displaying the extracted touch sensing coordinates on a display screen by determining a touch sensing signal according to occurrence of a light amount deviation value equal to or greater than a predetermined threshold value.
In recent years, there has been proposed a touch sensing apparatus or a touch sensing apparatus which, when a human hand or an object touches a character or a specific position displayed on a screen (screen) without using a keyboard, processes the function corresponding to the position determined by the stored software, Touch screens are widely used.
As a method of implementing such a touch sensing device or a touch screen, there are several techniques that are technically different depending on the size and use of the screen. Typical examples include a resistive type, an electrostatic type, a surface ultrasonic type, an infrared type, ) Method.
In this case, the IR LED camera system having the IR LED grid method is mainly used for the conventional large-sized display. However, since the IR LED array bar is installed around the display screen, It is possible to prevent the sensor from reaching the camera or the camera. In this case, since the amount of light reflected from the finger and the like is high in the high illuminance as in the case of outdoor, There is a problem that it often occurs. In addition, since the LED array bar must be installed around the display and the optical alignment is distorted over time, it is difficult for the general user to purchase the device easily, and the device can not be used in an environment where the light amount is large as in the outdoor, There is a disadvantage that it is impossible to expand the market to a sensing device.
In addition, the infrared ray method used as a general method of a medium to large-size touch screen has a problem that it is difficult to install a touch sensing device, production and manufacturing costs are high, a range of application is limited, and coordinate errors occur in a multi-point method.
Therefore, it is required to develop a multi-touch multi-touch sensing device that can operate without any additional parts such as an LED lighting bar around the monitor and can be used in an outdoor environment.
As a conventional technique for solving the above problems, Korean Patent Laid-Open No. 10-2009-0116544 discloses an infrared camera type spatial touch sensing device, a method and a screen device.
However, according to the above-described conventional technology, it is possible to detect the user indicating means entering into the touch sensing space by the infrared radiographic image through the infrared camera, and the visible light blocking filter or the like is applied to the infrared camera, However, there is a disadvantage in that it is impossible to control and judge the ambient light quantity value in addition to the disadvantage that the infrared light emitter is installed separately by using the infrared light sensing camera, thereby increasing manufacturing and installation costs.
SUMMARY OF THE INVENTION It is an object of the present invention to provide an integrated touch sensing device including two or more camera modules, a control module and an interface module to extract touch sensing coordinates.
It is another object of the present invention to provide a rod-shaped multi-touch sensing apparatus that can be operated and used in any outdoor environment without the need for any additional components such as an LED illumination bar around the monitor.
In addition, the present invention extracts the touch detection coordinates according to the light amount deviation value using the light amount distribution value of the background corresponding to the predetermined effective touch detection area in the image taken by the camera module, It is another object of the present invention to allow the touch-sensitive coordinate to be transmitted to the display screen only when it is within the range.
According to another aspect of the present invention, there is provided a camera-based touch sensing apparatus, comprising: at least two camera modules for capturing a touch sensing area; a light intensity variation value calculation unit for calculating a light intensity variation value according to a light intensity distribution value of a predetermined effective touch sensing area, A control module for calculating a touch sensing signal extraction and touch sensing coordinates and an interface module for transmitting the touch sensing coordinates of the control module to a display screen, (Ib (x)), which is a sum of corresponding pixel values of the image sensor corresponding to the sensing area, and a value of the corresponding pixel value of the image sensor according to the time in the effective touch sensing area (Is (x, t)) of the sum-of-hours.
According to another aspect of the present invention, there is provided a method of operating a camera-based touch sensing device, comprising the steps of: installing the touch sensing device; detecting at least one valid touch sensing area in a captured image of the camera module of the touch sensing device; A second step of setting a coordinate plane of a display area, a third step of calculating a light amount deviation value according to a light amount distribution value of a predetermined effective touch sensing area in an image photographed by the camera module, A fourth step of determining a touch sensing signal when a deviation of a certain pixel position of the sensing area is greater than a predetermined threshold value and extracting touch sensing coordinates by triangulation calculation; And transmits the touch-detected coordinates to the display screen only when it is within the display area range And a fifth step of performing the second step.
Therefore, the touch sensing apparatus using the background light amount control technique of the present invention has an effect that it can be attached to any place indoors or outdoors where the change of the light amount is frequent without installing a touch panel or the like around the monitor.
In addition, the present invention has the effect that the sensitivity of detection is not deteriorated even if the light reflected from the touch object is strong due to the adjustment of the light amount distribution value for touch detection even in an environment where the light amount is enriched as in outdoor. In particular, since a front surface such as a digital shine is designed to be a glass plane, there is an effect of solving problems such as a limitation in use due to protrusion of a peripheral lighting bar and a malfunction in a high temperature in the conventional optical system.
In addition, the present invention can be applied not only to a touch sensing device having a medium to large screen, but also to an indoor / outdoor shine, an electronic blackboard, and a touch sensing external touch sensing device which can be easily manufactured at low cost, .
1 is a configuration diagram of a touch sensing apparatus using a background light amount control technique according to an embodiment of the present invention,
2 is a graph of an initial photographed image of a camera module and a base light amount distribution value Ib (x) of the image according to an embodiment of the present invention,
FIG. 3 is a graph showing an initial light amount deviation value calculation graph and a light amount deviation value after a certain period of time according to an embodiment of the present invention,
FIG. 4 is a graph illustrating a touch image captured by a camera module and a touch sensed by calculating a light amount deviation value of the touch image according to an exemplary embodiment of the present invention.
5 is a flowchart illustrating an operation method of a touch sensing apparatus using a background light amount control technique according to an embodiment of the present invention.
The terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary terms and the inventor may appropriately define the concept of the term in order to best describe its invention It should be construed as meaning and concept consistent with the technical idea of the present invention.
Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention and are not intended to represent all of the technical ideas of the present invention. Therefore, various equivalents It should be understood that water and variations may be present.
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
1 is a block diagram of a touch sensing apparatus using a background light amount control technique according to an embodiment of the present invention.
1, the present invention is a
This is explained in detail as follows.
The
In addition, the
At this time, the
The
At this time, the light amount distribution value is divided into a base light amount distribution value Ib (x) and an hour light amount distribution value Is (x, t).
The
2 is a graph of an initial photographed image and a base light amount distribution value Ib (x) of the
The initial photographic image is an image in which the upper part of the black monitor and the background area are photographed at the same time with the touch sensing device of the present invention installed on the upper part of the monitor.
At this time, an effective touch sensing area for determining a touch sensing area is set by previously setting a predetermined area of one or more areas in the image captured by the
The base light amount distribution value Ib (x) represents a sum of corresponding pixel values of the image sensor corresponding to the effective touch sensing area in an image at the instant when each of the
Also, the effective touch sensing area may be set to one or more areas.
Hereinafter, the light amount of the effective touch sensing area may be changed according to various factors according to the time, and the corresponding value of the image sensor according to the time in the effective touch sensing area, The sum of the pixel values is defined as a temporal light quantity distribution value (Is (x, t)).
The
Therefore, the calculation of the light amount deviation value means calculating the relative deviation between the base light amount distribution value Ib (x) and the temporal light amount distribution value Is (x, t).
The calculation formula of the light quantity deviation value for obtaining the relative deviation is as follows.
(formula)
At this time, if a relative deviation of a predetermined value or more occurs after a predetermined time according to the light amount deviation value calculation, the base light amount distribution value Ib (x) is initialized to the current time light amount distribution value Is (x, t) And continues to calculate the light amount deviation value.
This is reflected when the light amount value of the effective touch sensing area varies due to various factors according to the time. For example, when the light amount according to the base light amount distribution value Ib (x) (X (t)) is replaced with the temporal light amount distribution value Is (x, t) when the light amount value of the effective touch sensing area becomes larger as the deviation value becomes lower and the periphery becomes brighter. Thereby making it possible to continuously calculate the light amount deviation value.
As a result, even if the light amount value of the effective touch sensing area changes with time, it is corrected to the base light intensity distribution value Ib (x), thereby correcting the relative deviation. As a result, There is an effect that the touch detection sensitivity does not drop.
FIG. 3 is a graph illustrating an initial light amount deviation value calculation graph and a light amount deviation value after a predetermined time, according to an embodiment of the present invention.
The
4 is a graph illustrating a touch image captured by a camera module and a touch sensed by calculating a light amount deviation value of the touch image according to an exemplary embodiment of the present invention.
The
This means that the touch points measured by the two cameras are converted into angular values to find the coordinates on the two-dimensional plane according to the triangulation method.
At this time, when the position of the touch sensing coordinates extracted by the triangulation calculation is recognized as effective touch coordinates within a predetermined range on the screen to be monitored or displayed, the
In addition, the
In addition, the
The
5 is a flowchart illustrating an operation method of a touch sensing apparatus using a background light amount control technique according to an embodiment of the present invention.
The operation method of the camera-type touch sensing device as shown in the figure includes a first step (S100) of installing the touch sensing device, a second step (S200) of setting an effective touch sensing area and a coordinate plane area, A third step S300, a fourth step S400 of extracting the touch sensing coordinates, and a fifth step S500 of transmitting and displaying the touch sensing coordinates on the display screen.
In the first step S100, the touch sensing apparatus of the present invention is installed, and power is supplied to operate the touch sensing apparatus. At this time, the touch sensing device may be attached to a monitor on which touch coordinates are directly displayed, such as the top or bottom of the monitor, or may be attached to a place where the touch sensing space can be obtained, have.
In the second step S200, a touch point recognized by the touch sensing device for displaying one or more effective touch sensing areas and touch coordinates in an image captured by two or more camera modules mounted on the touch sensing device is displayed on a monitor A step of setting a coordinate plane of a predetermined display area so as not to deviate from a setting area or boundary of a screen to be displayed.
The third step S300 is a step of calculating a light amount deviation value according to a light amount distribution value of a predetermined effective touch sensing area in an image photographed by the camera module.
In the third step S300, the base light amount distribution value Ib (x) in the effective touch sensing area is firstly stored and the light amount distribution value Is (x, t) A third step S320 of calculating a relative deviation between the base light amount distribution value Ib (x) and the temporal light amount distribution value Is (x, t) (X (t)) which is the initial light amount distribution value (Is (x, t)) at the current time when a relative deviation greater than a predetermined value occurs after a predetermined time in step S320 Step S330.
The third step S300 is continuously performed unless a touch sense signal having a deviation of more than a predetermined threshold value is generated.
In the fourth step S400, when a deviation of a predetermined pixel value of the effective touch sensing area is greater than a predetermined threshold value, the touch sensing signal is determined to be a touch sensing signal and the touch sensing coordinate is extracted by triangulation calculation .
The fifth step S500 is a step of transmitting and displaying the touch sensing coordinates on the display screen only when the touch sensing coordinates are within the predetermined display area range on the plane in the fourth step.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, Various changes and modifications will be possible.
100: touch sensing device 110: camera module
120: control module 130: interface module
140; Auxiliary LED module
Claims (10)
Two or more camera modules for photographing the touch sensing area,
A control module for calculating a light amount deviation value according to a light amount distribution value of a predetermined effective touch sensing area in the image photographed by the camera module, extracting a touch sensing signal, and calculating touch sensing coordinates,
And an interface module for transmitting the touch sensing coordinates of the control module to a display screen,
Wherein the light amount distribution value is a sum of a base light amount distribution value Ib (x) that is a sum of corresponding pixel values of the image sensor corresponding to the valid touch sensing area at the instant the camera module is first photographed, (X, t), which is a sum of corresponding pixel values of the image sensor with respect to time in the effective touch sensing area,
Wherein the light amount deviation value calculation unit calculates a relative deviation between the base light amount distribution value (Ib (x)) and the time light amount distribution value (Is (x, t)) using the background light amount control technique .
Wherein the constant camera module is a camera module having a 180-degree wide-angle lens.
Further comprising one or more auxiliary LED modules operated by the control module when the light amount distribution value of the valid touch sensing area is a dark environment of less than a predetermined brightness.
Wherein the effective touch sensing area is a touch sensing area in which a predetermined portion of at least one area is previously set and set in an image photographed by each of the camera modules.
(X (t)) at the current time when the relative deviation of the base light amount distribution value Ib (x) is greater than a predetermined value after the predetermined amount of time according to the calculation of the light amount deviation value And a background light amount control technique.
Wherein when the light intensity distribution value is greater than a predetermined threshold value at a certain pixel position in the calculation of the light amount distribution value, the touch sensing signal is determined to be a touch sensing signal and the touch sensing coordinate is extracted by triangulation calculation.
Wherein the touch sensing coordinate is transmitted to the display screen only when the touch sensing coordinate is within a predetermined display area range on a plane.
A first step of installing the touch sensing device,
A second step of setting a coordinate plane of at least one valid touch sensing area and a predetermined display area in the captured image of the camera module of the touch sensing device,
(3) for initially storing the base light amount distribution value Ib (x) in the predetermined effective touch sensing area and continuously extracting the hour light amount distribution value Is (x, t) from the image photographed by the camera module A third step of calculating a relative deviation between the base light amount distribution value Ib (x) and the time light amount distribution value Is (x, t), and a third step of calculating a light amount deviation value ; And
A fourth step of determining the touch sensing signal when a deviation of a certain pixel position of the effective touch sensing area is greater than a predetermined threshold value in the third step and extracting touch sensing coordinates by triangulation calculation;
And a fifth step of transmitting the touch sensing coordinates to the display screen only when the touch sensing coordinate is within the predetermined display area range on the plane in the fourth step. The touch sensing device according to claim 1, Way.
(X (t)) at the current time when a relative deviation of a predetermined value or more occurs after a predetermined time in the step 3-2. 3 is a flowchart illustrating a method of operating a touch sensing apparatus using a background light amount control technique according to an embodiment of the present invention;
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160027255A KR101792397B1 (en) | 2016-03-07 | 2016-03-07 | A Touch Sensing Apparatus and Method of Using the Background Intensity Control Technology |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160027255A KR101792397B1 (en) | 2016-03-07 | 2016-03-07 | A Touch Sensing Apparatus and Method of Using the Background Intensity Control Technology |
Publications (2)
Publication Number | Publication Date |
---|---|
KR20170104714A KR20170104714A (en) | 2017-09-18 |
KR101792397B1 true KR101792397B1 (en) | 2017-11-21 |
Family
ID=60034531
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020160027255A KR101792397B1 (en) | 2016-03-07 | 2016-03-07 | A Touch Sensing Apparatus and Method of Using the Background Intensity Control Technology |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101792397B1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102561043B1 (en) * | 2023-02-28 | 2023-07-28 | (주) 아하 | Display device enabling input in a non-contact state and operating method thereof |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003316515A (en) | 2002-04-19 | 2003-11-07 | Toshiba Corp | Display area specifying device |
JP2004185283A (en) * | 2002-12-03 | 2004-07-02 | Canon Inc | Optical coordinate input device |
JP2006047247A (en) | 2004-08-09 | 2006-02-16 | Denso Corp | Noncontact-type detecting device and control device |
-
2016
- 2016-03-07 KR KR1020160027255A patent/KR101792397B1/en active IP Right Grant
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003316515A (en) | 2002-04-19 | 2003-11-07 | Toshiba Corp | Display area specifying device |
JP2004185283A (en) * | 2002-12-03 | 2004-07-02 | Canon Inc | Optical coordinate input device |
JP2006047247A (en) | 2004-08-09 | 2006-02-16 | Denso Corp | Noncontact-type detecting device and control device |
Also Published As
Publication number | Publication date |
---|---|
KR20170104714A (en) | 2017-09-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105023552B (en) | Display and brightness adjusting method thereof | |
JP4820285B2 (en) | Automatic alignment touch system and method | |
JP4442877B2 (en) | Coordinate input device and control method thereof | |
JP4927021B2 (en) | Cursor control device and control method for image display device, and image system | |
US9886933B2 (en) | Brightness adjustment system and method, and mobile terminal | |
TWI396121B (en) | Touch control apparatus and touch point detection method | |
US10397565B2 (en) | Imaging device with alignment analysis | |
CN102955619B (en) | Optical touch system and positioning method thereof | |
JP2012133808A (en) | Cursor control method and device | |
US20110074738A1 (en) | Touch Detection Sensing Apparatus | |
TW201322088A (en) | Optical touch device and imaging processing method for optical touch device | |
EP3076272B1 (en) | Content display control method and system based on detecting the reflection of a beam of light | |
TWI498792B (en) | Optical touch system and touch and display system | |
KR100968205B1 (en) | Apparatus and Method for Space Touch Sensing and Screen Apparatus sensing Infrared Camera | |
KR101792397B1 (en) | A Touch Sensing Apparatus and Method of Using the Background Intensity Control Technology | |
CN105511691A (en) | Optical touch sensing device and touch signal judgment method thereof | |
US20120019442A1 (en) | Pointing device for use with a computer and methods of operation and calibration thereof | |
KR20180042381A (en) | Illumination acquisition system, illumination control system and program | |
JP2013074613A (en) | Display device | |
CN102043543B (en) | Optical touch control system and method | |
US9239635B2 (en) | Method and apparatus for graphical user interface interaction on a domed display | |
JP2018055257A (en) | Information processing device, control method thereof, and program | |
TWI464651B (en) | Optical touch system and touch object separating method thereof | |
US10310668B2 (en) | Touch screen display system and a method for controlling a touch screen display system | |
CN111124195A (en) | Method for automatically adjusting screen display size |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant |