TW201308126A - Optical pointer control system and method therefor - Google Patents
Optical pointer control system and method therefor Download PDFInfo
- Publication number
- TW201308126A TW201308126A TW100128754A TW100128754A TW201308126A TW 201308126 A TW201308126 A TW 201308126A TW 100128754 A TW100128754 A TW 100128754A TW 100128754 A TW100128754 A TW 100128754A TW 201308126 A TW201308126 A TW 201308126A
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- control system
- coordinate
- coordinate value
- optical index
- Prior art date
Links
Landscapes
- Position Input By Displaying (AREA)
Abstract
Description
本發明係有關一種光學式指標控制系統及方法，特別是指一種將成像於影像感測器中光點影像之位置直接轉換至顯示幕上對應位置以決定指標位置之指標控制系統及方法。The present invention relates to an optical index control system and method, and more particularly to an index control system and method for directly converting a position of a spot image imaged in an image sensor to a corresponding position on a display screen to determine an index position.
近來許多電子互動遊戲系統提供使用者遊戲搖桿或遙控器，以進行更多樣動作感應之電子遊戲的操作，例如：賽車駕駛及打高爾夫球之等遊戲。此類遊戲搖桿可包含陀螺儀(gyro)、加速計(accelerometer)或影像感測器(image sensor)。目前遊戲搖桿中影像感測器可用來控制螢幕上的游標或指標移動、或點選螢幕上的某一個圖像，直接進行選擇或其他操作。Recently, many electronic interactive game systems have provided user game joysticks or remote controls for more action-like electronic game operations such as racing driving and golfing. Such a joystick can include a gyro, an accelerometer, or an image sensor. At present, the image sensor in the joystick can be used to control the cursor or indicator movement on the screen, or click on an image on the screen to directly select or perform other operations.
該影像感測器會接受擺設於螢幕附近之多個參考點發出之光線，並於擷取之每個畫面(frame)上形成多個光點之影像。前述遊戲搖桿會根據前後畫面中多個光點影像之相對位置改變，並藉由複雜之計算過程始能控制游標移至遊戲搖桿欲指向之處。又各該參考點包括多個發光二極體。The image sensor receives light from a plurality of reference points disposed near the screen, and forms an image of a plurality of light spots on each frame captured. The aforementioned joystick will change according to the relative positions of multiple spot images in the front and rear images, and the complex calculation process can control the cursor to move to the point where the joystick is to be pointed. Each of the reference points further includes a plurality of light emitting diodes.
美國專利第7834848號揭示利用兩個參考點之成像以控制游標之技術，然該等技術均係根據前後畫面中多個光點影像之相對位置改變，並藉由複雜之計算過程輸出相對位移量始能控制游標移至控制器欲指向之處，或是控制畫面中物件進行旋轉。然該等技術需要複雜之計算，因此無法即時反應控制器欲迅速移動游標之指令，同時也得耗費較多電力。另外，美國專利第5448261號也是計算並輸出相對位移量以及方向。U.S. Patent No. 7,834,848 discloses the use of imaging of two reference points to control the technique of cursors. However, these techniques are based on the relative positional changes of multiple spot images in the front and rear pictures, and the relative displacement is output by a complicated calculation process. You can control the cursor to move to where the controller is pointing, or to control the rotation of objects in the screen. However, these techniques require complex calculations and therefore do not immediately respond to controller commands to move the cursor quickly, but also consume more power. In addition, U.S. Patent No. 5,448,261 also calculates and outputs the relative displacement amount and direction.
本案係針對以上先前技術的缺點，提供一種簡化之指標控制系統及方法，能將成像於影像感測器中光點影像之位置直接轉換或映射至顯示幕上對應位置以決定指標位置。因此，本案不需要複雜之計算，可以縮短資料處理之時間，以即時反應控制器之指令，並節省耗電也降低成本。In view of the above disadvantages of the prior art, the present invention provides a simplified index control system and method for directly converting or mapping the position of a spot image imaged in an image sensor to a corresponding position on a display screen to determine an index position. Therefore, this case does not require complicated calculations, which can shorten the time of data processing, respond to the instructions of the controller in real time, and save power consumption and reduce costs.
本發明的目的之一在提供一種指標控制系統。One of the objects of the present invention is to provide an indicator control system.
本發明的另一目的之一在提供一種指標控制系統之運作方法。Another object of the present invention is to provide a method of operating an indicator control system.
為達成以上目的，本發明提供了一種光學式指標控制系統，包含：一影像顯示幕，顯示一具有一指標之畫面；一光源，發出一光線；一控制器，控制該指標之位置，其包括一影像感測器，接受該光線以得到具有一個光點影像的一圖像；以及一座標轉換處理器，計算該光點影像位於該圖像中第一座標系統之第一座標值，並根據預先定義之第二座標系統將該第一座標值轉換為第二座標值；其中該影像顯示幕依照該第二座標值顯示該指標於該畫面上對應的座標位置。To achieve the above object, the present invention provides an optical index control system comprising: an image display screen displaying a picture having an indicator; a light source emitting a light; and a controller controlling the position of the indicator, including An image sensor that receives the light to obtain an image having a spot image; and a label conversion processor that calculates a first coordinate value of the spot image in the first coordinate system of the image, and according to The pre-defined second coordinate system converts the first coordinate value into a second coordinate value; wherein the image display screen displays the corresponding coordinate position of the indicator on the screen according to the second coordinate value.
上述光學式指標控制系統中，該光源宜包括至少一個發光單元。該光源可以是特定波長。影像感測器可以增加一特定波長的濾片。In the above optical index control system, the light source preferably includes at least one light emitting unit. The light source can be a specific wavelength. The image sensor can add a filter of a specific wavelength.
上述光學式指標控制系統中，該第一座標宜根據該影像感測器輸出影像之解析度而定義。In the above optical index control system, the first coordinate should be defined according to the resolution of the image sensor output image.
上述光學式指標控制系統中，該第二座標宜根據該影像顯示幕之輸出影像解析度而定義。In the above optical index control system, the second coordinate should be defined according to the output image resolution of the image display screen.
上述光學式指標控制系統中，宜另包含一驅動該影像顯示幕顯示該畫面之主機，其中該座標轉換處理器可設於該主機內、設於該控制器內、或部分設於該主機內而部分設於該控制器內。The optical index control system further includes a host for driving the image display screen to display the screen, wherein the coordinate conversion processor can be disposed in the host, disposed in the controller, or partially disposed in the host And some are set in the controller.
上述光學式指標控制系統中，該主機和該控制器可以無線或有線方式相互通訊。In the above optical index control system, the host and the controller can communicate with each other wirelessly or by wire.
就另一觀點而言，本發明提供了一種光學式指標控制系統之控制器之運作方法，控制一光學式指標控制系統中一指標之位置，包含：接受該系統產生之至少一光線，以得到具有一個光點影像的一圖像；計算該光點影像位於該圖像中第一座標系統之第一座標值，並根據預先定義之第二座標系統將該第一座標值轉換為第二座標值；以及依照該第二座標值顯示該指標於一影像顯示幕之畫面上對應位置。In another aspect, the present invention provides a method of operating a controller of an optical index control system for controlling the position of an indicator in an optical index control system, comprising: accepting at least one light generated by the system to obtain An image having a spot image; calculating the first coordinate value of the spot image in the first coordinate system of the image, and converting the first coordinate value to the second coordinate according to a predefined second coordinate system a value; and displaying the corresponding position of the indicator on a screen of an image display screen according to the second coordinate value.
底下藉由對具體實施例詳加說明，當更容易瞭解本發明之目的、技術內容、特點及其所達成之功效。The purpose, technical content, features, and effects achieved by the present invention will become more apparent from the detailed description of the embodiments.
本發明之指標控制系統例如適用於遊戲主機之互動遊戲程式的進行、影音播放器之控制及其他遙控影音系統(例如：智慧電視；smart TV)之選播、電腦螢幕之控制等，因此不受下列實施例所例示之系統所限制。指標係指顯示幕或螢幕上顯示之游標或可控制被移動之物件，其中游標之型式可以是箭頭、I字型、十字型、手掌或其他任何方式表示之可受控制之位置標示。The indicator control system of the present invention is applicable, for example, to an interactive game program of a game console, control of a video player, and selection of other remote video and audio systems (eg, smart TV; smart TV), control of a computer screen, etc., and thus are not The system exemplified in the following examples is limited. The indicator refers to the cursor displayed on the display screen or on the screen or the object that can be controlled to be moved. The type of the cursor can be indicated by an arrow, an I-shape, a cross, a palm or any other manner that can be controlled.
第1圖示出本發明光學式指標控制系統之示意圖。如圖所示，指標控制系統10大致上包含一控制器11、一主機12、一光源13及一影像顯示幕14，其中主機12執行之電子遊戲程式或撥放程式係由影像顯示幕14放映。影像顯示幕14可能為影像顯示器、投影裝置、頭戴式顯示器、智慧電視或其他顯示裝置。使用者操作控制器11可驅動程式以執行各種動作指令，例如：使影像顯示幕14上指標或游標141移至右側之選單處。除本實施例所示單一發光單元131外，光源13也可以包括多個發光單元131。Fig. 1 is a schematic view showing an optical index control system of the present invention. As shown in the figure, the indicator control system 10 generally includes a controller 11, a host 12, a light source 13 and an image display screen 14. The electronic game program or the play program executed by the host computer 12 is displayed by the image display screen 14. . The image display screen 14 may be an image display, a projection device, a head mounted display, a smart TV, or other display device. The user operation controller 11 can drive the program to execute various motion commands, for example, moving the indicator or cursor 141 on the image display screen 14 to the menu on the right side. The light source 13 may include a plurality of light emitting units 131 in addition to the single light emitting unit 131 shown in this embodiment.
當控制器11被使用者進行如前所述之操作，光源13之發光單元131產生一個紅外線會成像於控制器11之影像感測器111內，亦即影像感測器111擷取圖像中包括該紅外線之一光點影像。處理器113會計算該光點影像位於擷取圖像中第一座標之第一座標值，並根據影像顯示幕14預先定義之第二座標將該第一座標值轉換為第二座標值。影像顯示幕14則依照第二座標值顯示該游標141於畫面142上對應的座標位置，又該第二座標係由影像顯示幕14之輸出影像解析度所定義。本實施例中，處理器113係設於控制器11中，或者其他實施例可以設於主機12內。又主機12具有無線收發器121，故可以和控制器11之無線收發器112以射頻RF1及RF2(或紅外線)進行雙向資料傳輸，或者其他實施例可以採有線方式傳輸。When the controller 11 is operated by the user as described above, the illumination unit 131 of the light source 13 generates an infrared ray which is imaged in the image sensor 111 of the controller 11, that is, the image sensor 111 captures the image. Includes one of the infrared spot images. The processor 113 calculates the first coordinate value of the first coordinate in the captured image, and converts the first coordinate value into the second coordinate value according to the second coordinate defined by the image display screen 14. The image display screen 14 displays the corresponding coordinate position of the cursor 141 on the screen 142 according to the second coordinate value, and the second coordinate is defined by the output image resolution of the image display screen 14. In this embodiment, the processor 113 is disposed in the controller 11, or other embodiments may be disposed in the host 12. The host 12 has a wireless transceiver 121, so that the wireless transceiver 112 of the controller 11 can perform bidirectional data transmission with radio frequency RF1 and RF2 (or infrared), or other embodiments can be transmitted in a wired manner.
第2圖示出本發明控制器接受光源之視野角度(visual field angle)之示意圖。如圖所示，當使用者將控制器11向右移動或順時鐘旋轉，發光單元131由影像感測器111之視野角度之右側移至左側。參見第3A圖及第3B圖，影像感測器111由上述兩個視野角度擷取兩個圖像，故可得到光點影像331由座標值(x1,y1)移至位於座標值(x2,y2)處之光點影像332。該等座標值係根據影像感測器111之解析度而得，例如：影像感測器111之解析度為256×256，則光點影像所在像素之座標值即為其代表位置。影像感測器111之座標系統以下稱為第一座標系統。其中，為便利未來的映射轉換，可定義第3A圖及第3B圖中，xy座標軸較正常座標軸旋轉180度，亦即水平方向之座標值由右往左方增加，垂直方向之座標值由上往下方增加。當然，也可在影像感測器111擷取影像時，旋轉180度。本發明的特點是，由於光點的位置即是座標位置，因此不需要針對影像感測器111所擷取的圖像進行複雜的相對位移量與方向的計算即可直接產生絕對座標。(本實施例中是以光點大小剛好是一個像素的大小為例。於其他實施例，光點可大於一個像素以上，此時座標可以是光點影像中心、也可以是權值重心、或以其他方式在光點影像中取任何一像素作為座標。)Figure 2 is a schematic diagram showing the visual field angle of the controller of the present invention receiving the light source. As shown, when the user moves the controller 11 to the right or clockwise, the light-emitting unit 131 is moved to the left by the right side of the field of view of the image sensor 111. Referring to FIGS. 3A and 3B, the image sensor 111 extracts two images from the two viewing angles, so that the spot image 331 is moved from the coordinate value (x1, y1) to the coordinate value (x2, Spot image 332 at y2). The coordinate values are obtained according to the resolution of the image sensor 111. For example, if the resolution of the image sensor 111 is 256×256, the coordinate value of the pixel where the light spot image is located is its representative position. The coordinate system of the image sensor 111 is hereinafter referred to as a first coordinate system. In order to facilitate future mapping conversion, it can be defined in the 3A and 3B drawings, the xy coordinate axis is rotated 180 degrees from the normal coordinate axis, that is, the coordinate value in the horizontal direction is increased from right to left, and the coordinate value in the vertical direction is from the top. Increase below. Of course, it is also possible to rotate 180 degrees when the image sensor 111 captures an image. The feature of the present invention is that since the position of the light spot is the coordinate position, it is not necessary to perform complex calculation of the relative displacement amount and direction for the image captured by the image sensor 111 to directly generate the absolute coordinate. (In this embodiment, the size of the spot is exactly the size of one pixel. In other embodiments, the spot may be more than one pixel, and the coordinate may be the center of the spot image, or the center of gravity, or Take any pixel in the spot image as a coordinate in other ways.)
第4圖示出影像顯示幕反應第2圖中控制器轉動之游標移動之示意圖。參見本圖，影像顯示幕14之畫面142上的游標141由左上角座標值(x1’,y1’)移至位於座標值(x2’,y2’)處之游標141’。該座標值(x1’,y1’)係由前述座標值(x1,y1)直接映射或轉換而得，同樣座標值(x2’,y2’)也是由前述座標值(x2,y2)直接映射或轉換而得。影像顯示幕14之座標系統以下稱為第二座標系統。由於影像顯示幕14會定義或選用一種解析度，例如：1024×768。因此，前述處理器113可以預先得知影像顯示幕14之解析度，以移動平均或內插等方法，將座標值(x1,y1)及(x2,x2)直接且分別映射或轉換為(x1’,y1’)及(x2’,x2’)。若處理器113無法預先得知影像顯示幕14之解析度，則可以單純輸出第一座標系統之座標值((x1,y1)及(x2,x2))，而由主機12之處理器來建立影像感測器111之第一座標系統和影像顯示幕14之第二座標系統間的轉換公式，因此影像感測器111得到光點影像之座標值很容易就映射到第二座標系統上對應之座標值。在此情況下，廣義而言，控制器11中之處理器113與主機12中之處理器可合併視為一個廣義的座標轉換處理器。亦即，此座標轉換處理器可以全部位於控制器11內(由處理器113達成全部座標轉換功能)、或全部位於主機12內(由主機12內的處理器達成全部座標轉換功能)、或部分位於控制器11內而部分位於主機12內(由處理器113和主機12內的處理器合作達成全部座標轉換功能)。Fig. 4 is a view showing the movement of the cursor in the rotation of the controller in Fig. 2 in response to the image display screen. Referring to the figure, the cursor 141 on the screen 142 of the image display screen 14 is moved from the upper left corner coordinate value (x1', y1') to the cursor 141' at the coordinate value (x2', y2'). The coordinate value (x1', y1') is directly mapped or converted by the aforementioned coordinate value (x1, y1), and the same coordinate value (x2', y2') is also directly mapped by the aforementioned coordinate value (x2, y2) or Converted. The coordinate system of the image display screen 14 is hereinafter referred to as a second coordinate system. Since the image display screen 14 defines or selects a resolution, for example: 1024 x 768. Therefore, the processor 113 can know the resolution of the image display screen 14 in advance, and directly or separately convert the coordinate values (x1, y1) and (x2, x2) to (x1) by moving average or interpolation. ', y1') and (x2', x2'). If the processor 113 cannot know the resolution of the image display screen 14 in advance, the coordinates of the first coordinate system ((x1, y1) and (x2, x2)) can be simply output, and the processor of the host 12 can be established. The conversion formula between the first coordinate system of the image sensor 111 and the second coordinate system of the image display screen 14 is such that the coordinate value of the image sensor 111 is easily mapped to the corresponding coordinate on the second coordinate system. Coordinate value. In this case, in a broad sense, the processor 113 in the controller 11 can be combined with the processor in the host 12 as a generalized coordinate conversion processor. That is, the coordinate conversion processor may all be located in the controller 11 (all coordinate conversion functions are achieved by the processor 113), or all located in the host 12 (all coordinate conversion functions are achieved by the processor in the host 12), or portions It is located in the controller 11 and partially located in the host 12 (the processor 113 cooperates with the processor in the host 12 to achieve the full coordinate conversion function).
以上已針對較佳實施例來說明本發明，唯以上所述者，僅係為使熟悉本技術者易於了解本發明的內容而已，並非用來限定本發明之權利範圍。在本發明之相同精神下，熟悉本技術者可以思及各種等效變化。例如，主機12可以是遊戲主機、影音播放器或智慧電視；再例如，處理器122於前述實施例中係設於控制器11中，但其他實施例可以設於主機12或系統中其他裝置內。再者，光源13也可以包括多個發光單元131，可以於影像感測器111中形成多個分離光點影像，各光點影像之座標值均可利用前述方法直接轉換至影像顯示幕上對應之座標值以控制多個指標或游標。故在本發明之相同精神下的各種等效變化，均應包含在本發明的範圍之內。The present invention has been described with reference to the preferred embodiments thereof, and the present invention is not intended to limit the scope of the present invention. In the same spirit of the invention, various equivalent changes can be conceived by those skilled in the art. For example, the host 12 may be a game console, a video player, or a smart TV. For example, the processor 122 is disposed in the controller 11 in the foregoing embodiment, but other embodiments may be disposed in the host 12 or other devices in the system. . In addition, the light source 13 may also include a plurality of light emitting units 131, and a plurality of separated light spot images may be formed in the image sensor 111. The coordinate values of the light spot images may be directly converted to corresponding to the image display screen by using the foregoing method. The coordinate value to control multiple indicators or cursors. Therefore, various equivalent changes in the spirit of the invention are intended to be included within the scope of the invention.
10．．．指標控制系統10. . . Indicator control system
11．．．控制器11. . . Controller
111．．．影像感測器111. . . Image sensor
112．．．無線收發器112. . . Wireless transceiver
113．．．處理器113. . . processor
12．．．主機12. . . Host
121．．．無線收發器121. . . Wireless transceiver
13．．．光源13. . . light source
131．．．發光單元131. . . Light unit
14．．．影像顯示幕14. . . Image display
141、141’．．．游標141, 141’. . . cursor
142．．．畫面142. . . Picture
331．．．光點影像331. . . Spot image
332．．．光點影像332. . . Spot image
IR．．．紅外線IR. . . infrared
RF1、RF2．．．射頻RF1, RF2. . . Radio frequency
第1圖示出本發明光學式指標控制系統之示意圖。Fig. 1 is a schematic view showing an optical index control system of the present invention.
第2圖示出本發明控制器接受光源之視野角度(visual field angle)之示意圖。Figure 2 is a schematic diagram showing the visual field angle of the controller of the present invention receiving the light source.
第3A、3B圖示出影像感測器由第2圖中兩個視野角度擷取兩個圖像。3A, 3B illustrate that the image sensor captures two images from the two field of view angles in FIG.
第4圖示出影像顯示幕反應第2圖中控制器轉動之游標移動之示意圖。Fig. 4 is a view showing the movement of the cursor in the rotation of the controller in Fig. 2 in response to the image display screen.
10．．．指標控制系統10. . . Indicator control system
11．．．控制器11. . . Controller
111．．．影像感測器111. . . Image sensor
112．．．無線收發器112. . . Wireless transceiver
113．．．處理器113. . . processor
12．．．主機12. . . Host
121．．．無線收發器121. . . Wireless transceiver
13．．．光源13. . . light source
131．．．發光單元131. . . Light unit
14．．．影像顯示幕14. . . Image display
141．．．游標141. . . cursor
142．．．畫面142. . . Picture
Claims (17)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW100128754A TW201308126A (en) | 2011-08-11 | 2011-08-11 | Optical pointer control system and method therefor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW100128754A TW201308126A (en) | 2011-08-11 | 2011-08-11 | Optical pointer control system and method therefor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| TW201308126A true TW201308126A (en) | 2013-02-16 |
Family
ID=48169827
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW100128754A TW201308126A (en) | 2011-08-11 | 2011-08-11 | Optical pointer control system and method therefor |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TW201308126A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI468843B (en) * | 2013-05-30 | 2015-01-11 | Delta Electronics Inc | Interactive projection system and interactive image-detecting method |
-
2011
- 2011-08-11 TW TW100128754A patent/TW201308126A/en unknown
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI468843B (en) * | 2013-05-30 | 2015-01-11 | Delta Electronics Inc | Interactive projection system and interactive image-detecting method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9724609B2 (en) | Apparatus and method for augmented reality | |
| JP5839220B2 (en) | Information processing apparatus, information processing method, and program | |
| JP5049228B2 (en) | Dialogue image system, dialogue apparatus and operation control method thereof | |
| US20120208639A1 (en) | Remote control with motion sensitive devices | |
| US20100201808A1 (en) | Camera based motion sensing system | |
| EP2394717A2 (en) | Image generation system, image generation method, and information storage medium for video games | |
| TW201104494A (en) | Stereoscopic image interactive system | |
| EP2538309A2 (en) | Remote control with motion sensitive devices | |
| US20130082923A1 (en) | Optical pointer control system and method therefor | |
| US20100188587A1 (en) | Projection method | |
| KR20060132219A (en) | Apparatus and method for implementing pointing user interface using signal of light emitter | |
| US20210208699A1 (en) | Direct three-dimensional pointing using light tracking and relative position detection | |
| US10978019B2 (en) | Head mounted display system switchable between a first-person perspective mode and a third-person perspective mode, related method and related non-transitory computer readable storage medium | |
| TWI442269B (en) | Control device and method using control device for controlling screen | |
| US20140359536A1 (en) | Three-dimensional (3d) human-computer interaction system using computer mouse as a 3d pointing device and an operation method thereof | |
| US11055049B1 (en) | Systems and methods for facilitating shared rendering | |
| US9678583B2 (en) | 2D and 3D pointing device based on a passive lights detection operation method using one camera | |
| US20130176218A1 (en) | Pointing Device, Operating Method Thereof and Relative Multimedia Interactive System | |
| US9013404B2 (en) | Method and locating device for locating a pointing device | |
| TW201337639A (en) | Finger-pointing direction image control device and method thereof | |
| US20130002549A1 (en) | Remote-control device and control system and method for controlling operation of screen | |
| CN202306460U (en) | Optical pointer control device | |
| CN114567803B (en) | Non-contact control system | |
| US20130271371A1 (en) | Accurate extended pointing apparatus and method thereof | |
| TW201308126A (en) | Optical pointer control system and method therefor |