TWI549497B - Method, air mouse and smart television to control a cursor - Google Patents
Method, air mouse and smart television to control a cursor Download PDFInfo
- Publication number
- TWI549497B TWI549497B TW104123263A TW104123263A TWI549497B TW I549497 B TWI549497 B TW I549497B TW 104123263 A TW104123263 A TW 104123263A TW 104123263 A TW104123263 A TW 104123263A TW I549497 B TWI549497 B TW I549497B
- Authority
- TW
- Taiwan
- Prior art keywords
- ultrasonic
- remote controller
- signal
- cursor
- receivers
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42222—Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42201—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42221—Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Biomedical Technology (AREA)
- Chemical & Material Sciences (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Health & Medical Sciences (AREA)
- Analytical Chemistry (AREA)
- Life Sciences & Earth Sciences (AREA)
- Position Input By Displaying (AREA)
- Selective Calling Equipment (AREA)
- Details Of Television Systems (AREA)
Description
各個實施例大體上涉及智慧電視系統、方法、裝置和電腦程式，更加具體地，涉及一種人機交互介面和遠端運動控制技術。Various embodiments relate generally to smart television systems, methods, apparatus, and computer programs, and more particularly to a human-machine interface and remote motion control techniques.
隨著電視聯網功能的持續發展和逐漸轉向智慧電視時代，新型人機界面和遙控器的發展已經持續進行。With the continuous development of TV networking functions and the gradual shift to the era of smart TV, the development of new human-machine interfaces and remote controls has continued.
隨著聯網功能而持續增長的業務使得列表選擇更加複雜，以上下左右和OK鍵功能為特徵的傳統功能表已經變得不能滿足正常使用的需要，但是提供過於複雜的功能表則可能會導致遙控器的操作麻煩和慢速。迄今為止，在許多電視製造商和品牌的共同努力下，已經出現了三種通用的人機界面解決方案：語音辨識、手勢識別和運動感應。The business that continues to grow with the networking function makes the list selection more complicated. The traditional function table characterized by the above left and right and the OK key function has become unable to meet the needs of normal use, but providing an overly complicated function table may result in remote control. The operation of the device is troublesome and slow. So far, with the joint efforts of many TV manufacturers and brands, three common human-machine interface solutions have emerged: speech recognition, gesture recognition and motion sensing.
對於語音辨識，加入語音辨識功能對於電視產品的多樣性具有深遠的影響，其原因在於各個不同地區存在更大量的複雜方言和地方口音。For speech recognition, the addition of speech recognition has a profound impact on the diversity of TV products because of the large number of complex dialects and local accents in different regions.
對於手勢識別，通過遊戲機已經證實手勢識別在商業上是可用的，然而，對於許多網頁，尤其是要求謹慎且精確遙控器移動的網頁，手勢控制不穩定。同樣，手勢識別不被認為是一種優越的人體工程設計，疲勞容易影響手臂的伸展能力和姿勢。此外，在手勢識別中的運動通常由設置在電視前面的鏡頭捕捉，以及許多人不願意將鏡頭安裝在他們日日觀看的電視上，尤其是可以聯網的電視。For gesture recognition, gesture recognition has been proven commercially available through gaming machines, however, for many web pages, particularly web pages that require careful and precise remote control movement, gesture control is not stable. Similarly, gesture recognition is not considered a superior ergonomic design, and fatigue tends to affect the arm's ability and posture. In addition, the motion in gesture recognition is usually captured by a lens placed in front of the TV, and many people are reluctant to install the lens on the TV they watch on a daily basis, especially for a networked TV.
運動捕捉，也稱為空中指向，被認為是一種在目前發展迅速的技術。可以發現，妨礙其應用的最小障礙是電視，原因在於，當提及電腦使用時，消費者已經廣泛地接受並且瞭解了電腦遙控器、觸控板或Wii式控制器。然而，這些運動捕捉（空中指向）裝置也比普通的遙控器貴得多，它們的高成本也成為妨礙其廣泛應用的主要障礙。Motion capture, also known as aerial pointing, is considered a technology that is rapidly evolving at the moment. It can be found that the smallest obstacle to its application is television, because when it comes to computer use, consumers have widely accepted and understood computer remote controls, touchpads or Wii-style controllers. However, these motion capture (airborne) devices are also much more expensive than conventional remote controls, and their high cost has also become a major obstacle to their widespread use.
需要提出一種克服了現有方法所面臨的問題諸如成本、隱私問題等的人機界面和遙控器。There is a need to propose a human-machine interface and a remote controller that overcome the problems faced by existing methods such as cost, privacy issues, and the like.
以下發明內容僅僅是代表性的並且是非限制性的。The following summary is merely representative and non-limiting.
通過使用各個實施例，克服了上述問題，以及實現了其他優點。The above problems are overcome and other advantages are achieved by the use of various embodiments.
本發明提供用於控制游標的方法、遙控器以及智慧電視，其可以有效的定位遙控器的位置，並基於遙控器的位置來控制游標。The present invention provides a method for controlling a cursor, a remote controller, and a smart TV that can effectively position the remote controller and control the cursor based on the position of the remote controller.
根據本發明的一個方面，本發明提供一種用於控制游標的方法，其包括：響應於觸發信號同時發送多個超聲波信號；接收所述超聲波信號；基於每個超聲波信號的發送時間與到達時間之間的渡越時間來確定每個超聲波信號所經過的距離，基於各個超聲波信號所經過的距離來確定所述遙控器的位置；以及基於所述遙控器的位置將游標顯示在螢幕上。According to an aspect of the present invention, there is provided a method for controlling a cursor, comprising: simultaneously transmitting a plurality of ultrasonic signals in response to a trigger signal; receiving the ultrasonic signals; based on a transmission time and an arrival time of each ultrasonic signal The transit time is used to determine the distance over which each ultrasonic signal passes, the position of the remote controller is determined based on the distance traveled by the respective ultrasonic signals; and the cursor is displayed on the screen based on the position of the remote controller.
進一步的，多個超聲波發射器用於分別發送所述多個超聲波信號，多個超聲波接收器用於分別接收所述超聲波信號，其中多個超聲波發射器位於遙控器內，而多個超聲波接收器分別位於同一平面內的不同位置，該多個超聲波接收器定義了一個坐標系以定位所述遙控器相對於該多個超聲波接收器的位置，通過該坐標系的轉換將所述遙控器相對於該多個超聲波接收器的位置轉換成所述螢幕上的一個相應位置，並在所述螢幕上的相應位置顯示所述游標；或者，多個超聲波接收器位於遙控器內，而多個超聲波發射器分別位於同一平面內的不同位置，該多個超聲波發射器定義了一個坐標系以定位所述遙控器相對於該多個超聲波發射器的位置，通過該坐標系的轉換將所述遙控器相對於該多個超聲波發射器的位置轉換成所述螢幕上的一個相應位置，並在所述螢幕上的相應位置顯示所述游標。Further, a plurality of ultrasonic transmitters are respectively configured to respectively transmit the plurality of ultrasonic signals, and a plurality of ultrasonic receivers are respectively configured to receive the ultrasonic signals, wherein the plurality of ultrasonic transmitters are located in the remote controller, and the plurality of ultrasonic receivers are respectively located Different positions in the same plane, the plurality of ultrasonic receivers define a coordinate system to position the remote controller relative to the plurality of ultrasonic receivers, and the remote controller is compared with the plurality of ultrasonic receivers by the conversion of the coordinate system The positions of the ultrasonic receivers are converted into a corresponding position on the screen, and the cursor is displayed at a corresponding position on the screen; or, the plurality of ultrasonic receivers are located in the remote controller, and the plurality of ultrasonic transmitters are respectively At different locations within the same plane, the plurality of ultrasonic transmitters define a coordinate system to position the remote control relative to the plurality of ultrasonic transmitters, the remote control being relative to the remote control by the coordinate system Converting the position of the plurality of ultrasonic transmitters to a corresponding position on the screen, and at the screen Said respective position display cursor.
進一步的，所述觸發信號源自所述遙控器，所述觸發信號為射頻觸發信號，基於觸發信號的發送時間來確定所述超聲波信號的發送時間。Further, the trigger signal is derived from the remote controller, and the trigger signal is a radio frequency trigger signal, and the sending time of the ultrasonic signal is determined based on a sending time of the trigger signal.
進一步的，多個超聲波接收器位於遙控器內，而多個超聲波發射器分別位於同一平面內的不同位置，所述多個超聲波發射器中的每一個都配置為接收所述觸發信號並且響應於接收到所述觸發信號而發送所述超聲波信號。Further, a plurality of ultrasonic receivers are located in the remote controller, and the plurality of ultrasonic transmitters are respectively located at different positions in the same plane, each of the plurality of ultrasonic transmitters being configured to receive the trigger signal and responsive to The ultrasonic signal is transmitted by receiving the trigger signal.
根據本發明的另一個方面，本發明提供一種用於控制游標的遙控器，其包括：射頻發射器，其配置為發送射頻觸發信號；多個超聲波接收器，其配置為分別接收多個超聲波信號；處理器，被配置為基於所述射頻觸發信號的發射時間確定每個超聲波信號的發送時間，基於每個超聲波信號的發送時間和到達時間之間的時間差來確定每個超聲波信號所經過的距離，基於各個超聲波信號所經過的距離來確定所述遙控器的位置；通訊介面，用於發送有關所述遙控器的所述位置的位置資訊。According to another aspect of the present invention, there is provided a remote controller for controlling a cursor, comprising: a radio frequency transmitter configured to transmit a radio frequency trigger signal; and a plurality of ultrasonic receivers configured to respectively receive a plurality of ultrasonic signals a processor configured to determine a transmission time of each ultrasonic signal based on a transmission time of the radio frequency trigger signal, and determine a distance traveled by each ultrasonic signal based on a time difference between a transmission time and an arrival time of each ultrasonic signal Determining a position of the remote controller based on a distance traveled by each of the ultrasonic signals; and a communication interface for transmitting position information about the position of the remote controller.
進一步的，所述遙控器還包括有另外多個超聲波接收器，該另外多個超聲波接收器亦配置為分別接收所述多個超聲波信號，所述處理器基於所述多個超聲波接收器和所述另外多個超聲波接收器獲取的每個超聲波信號的到達時間計算得到所述多個超聲波接收器的位置以及所述另外多個超聲波接收器的位置，基於這兩組多個超聲波接收器的位置確定所述遙控器的旋轉。Further, the remote controller further includes another plurality of ultrasonic receivers configured to respectively receive the plurality of ultrasonic signals, and the processor is based on the plurality of ultrasonic receivers and Calculating the arrival times of each of the ultrasonic signals acquired by the plurality of other ultrasonic receivers to obtain the positions of the plurality of ultrasonic receivers and the positions of the other plurality of ultrasonic receivers based on the positions of the two sets of the plurality of ultrasonic receivers Determining the rotation of the remote control.
進一步的，所述遙控器包含在智慧型電話中。Further, the remote controller is included in a smart phone.
進一步的，射頻發射器週期性地發送射頻觸發信號；所述多個超聲波接收器週期性的分別接收多個超聲波信號；所述處理器基於所述遙控器的多個位置來確定運動軌跡。Further, the radio frequency transmitter periodically transmits a radio frequency trigger signal; the plurality of ultrasonic receivers periodically receive a plurality of ultrasonic signals respectively; and the processor determines a motion trajectory based on the plurality of positions of the remote controller.
根據本發明的再一個方面，本發明提供一種用於控制游標的電視，其包括：螢幕，其配置有顯示游標；射頻接收器，其配置為接收來自遙控器的觸發信號；位於不同位置的多個超聲波發射器，其配置為響應於接收到所述觸發信號同時發送多個超聲波信號；至少一個處理器，其被配置為接收有關所述遙控器的所述位置的位置資訊；將有關所述遙控器的所述位置的所述位置資訊轉換為用於所述游標的顯示位置，將所述游標顯示在所述顯示位置處。According to still another aspect of the present invention, there is provided a television for controlling a cursor, comprising: a screen configured to display a cursor; a radio frequency receiver configured to receive a trigger signal from the remote controller; An ultrasonic transmitter configured to simultaneously transmit a plurality of ultrasonic signals in response to receiving the trigger signal; at least one processor configured to receive position information regarding the position of the remote controller; The position information of the position of the remote controller is converted into a display position for the cursor, and the cursor is displayed at the display position.
進一步的，位置資訊包括以下至少一個：所述遙控器在給定時間處的確定位置、在給定時間處用於所述多個超聲波信號中的每一個超聲波信號的渡越時間、以及表示所述遙控器在多個時間處的多個位置的運動軌跡。Further, the location information includes at least one of: a determined position of the remote controller at a given time, a transit time for each of the plurality of ultrasonic signals at a given time, and a representation A motion trajectory of a plurality of positions of the remote controller at a plurality of times.
進一步的，所述顯示器是三維顯示器，以及其中，將有關所述遙控器的所述位置的所述位置資訊轉換為用於所述游標的顯示位置包括：將有關所述遙控器的所述位置的所述位置資訊轉換為用於遙控器的三維顯示位置。Further, the display is a three-dimensional display, and wherein converting the position information about the position of the remote controller to a display position for the cursor comprises: relating the position of the remote controller The position information is converted into a three-dimensional display position for the remote controller.
與現有技術相比，本發明在位於同一平面的多個位置和遙控器之間傳輸多個超聲波信號，基於每個超聲波信號的發送時間與到達時間之間的渡越時間來確定每個超聲波信號所經過的距離，基於各個超聲波信號所經過的距離來確定所述遙控器的位置，至少部分地基於所述遙控器的位置將游標顯示在螢幕上。這樣借由所述遙控器的運動來控制在所述螢幕上的所述游標。Compared with the prior art, the present invention transmits a plurality of ultrasonic signals between a plurality of positions located on the same plane and a remote controller, and determines each ultrasonic signal based on a transit time between a transmission time and an arrival time of each ultrasonic signal. The distance elapsed determines the position of the remote control based on the distance traveled by the respective ultrasonic signals, and displays the cursor on the screen based at least in part on the position of the remote control. The cursor on the screen is thus controlled by the movement of the remote control.
各個實施例的特徵、權益和優點中的其中之一旨在提供通過使用空間遙控器控制游標的技術。附加的目的、特徵和優點將在審查以下結合隨附附圖所做的詳細說明時變得顯而易見。One of the features, benefits, and advantages of various embodiments is directed to providing techniques for controlling a cursor by using a space remote control. Additional objects, features, and advantages will be apparent from the review of the appended claims.
根據一個實施例，提供了一種空間遙控器，其包括配置為發送RF信號(有時也可以RF觸發信號)的射頻（RF）觸發器。這些RF信號可以用於週期性地觸發設置在電視上的多個超聲波發射器。多個超聲波發射器在被來自RF觸發器的RF信號觸發時多個發送超聲波信號。設置於遙控器上的多個超聲波接收器接收由設置在電視上的多個超聲波發射器發送的超聲波信號。處理器基於由超聲波發射器發送的超聲波信號到達超聲波接收器的渡越時間來計算空間遙控器相對於多個超聲波發射器的位置。空間遙控器的一系列位置可以用於形成空間遙控器的運動軌跡。空間遙控器將該運動軌跡或位置的位置資訊通過無線地通過通訊介面發送至電視，以及通過電視將該運動軌跡作為游標軌跡顯示到電視螢幕上。其中，多個超聲波發射器分別位於同一平面內的不同位置，該多個超聲波發射器定義了一個坐標系以定位所述空間遙控器相對於該多個超聲波發射器的位置，通過該坐標系的轉換將所述遙控器相對於該多個超聲波發射器的位置轉換成所述電視螢幕上的一個相應位置，並在所述電視螢幕上的相應位置顯示所述游標。需要知道的是，由於多個超聲波接收器設置於所述空間遙控器的同一位置處，該多個超聲波接收器可以被統稱為一個超聲波接收機，也就是說，該超聲波接收機可以接收多個超聲波信號。According to one embodiment, a spatial remote control is provided that includes a radio frequency (RF) trigger configured to transmit an RF signal (and sometimes an RF trigger signal). These RF signals can be used to periodically trigger multiple ultrasonic transmitters placed on the television. A plurality of ultrasonic transmitters transmit a plurality of ultrasonic signals when triggered by an RF signal from an RF flip-flop. A plurality of ultrasonic receivers disposed on the remote controller receive ultrasonic signals transmitted by a plurality of ultrasonic transmitters disposed on the television. The processor calculates the position of the spatial remote control relative to the plurality of ultrasonic transmitters based on the transit time of the ultrasonic signal transmitted by the ultrasonic transmitter to the ultrasonic receiver. A series of positions of the space remote can be used to form the motion track of the space remote. The space remote controller transmits the position information of the motion track or position to the television through the communication interface wirelessly, and displays the motion track as a cursor track on the television screen through the television. Wherein the plurality of ultrasonic transmitters are respectively located at different positions in the same plane, the plurality of ultrasonic transmitters defining a coordinate system for positioning the position of the space remote controller relative to the plurality of ultrasonic transmitters, through the coordinate system The conversion converts the position of the remote control relative to the plurality of ultrasonic transmitters to a corresponding position on the television screen and displays the cursor at a corresponding location on the television screen. It should be noted that since a plurality of ultrasonic receivers are disposed at the same position of the space remote controller, the plurality of ultrasonic receivers may be collectively referred to as an ultrasonic receiver, that is, the ultrasonic receiver may receive multiple Ultrasonic signal.
在另一實施例中，空間遙控器可以包括按照相同或不同頻率運行的至少兩個超聲波接收機。這至少兩個超聲波接收機相隔一定距離。這樣，可以通過計算超聲波接收機的不同軌跡來推導遙控器的旋轉，例如，通過分別使用設置在電視上的至少三個超聲波發射器來計算每個超聲波接收機的3D位置。通過使用該資訊，可以確定遙控器的方位或旋轉。In another embodiment, the spatial remote control can include at least two ultrasonic receivers that operate at the same or different frequencies. The at least two ultrasonic receivers are separated by a certain distance. Thus, the rotation of the remote controller can be derived by calculating different trajectories of the ultrasonic receiver, for example, by calculating the 3D position of each ultrasonic receiver by using at least three ultrasonic transmitters disposed on the television, respectively. By using this information, you can determine the orientation or rotation of the remote control.
在另一替代實施例中，可以存在設置在電視上的至少三個超聲波發射器。RF觸發器按照相同或不同的頻率發送RF信號，以及獨立的超聲波發射器可以由這些RF信號觸發。RF信號的傳播速度比超聲波信號的傳播速度快得多。由此，發送RF信號至不同位置的時間差相對於發送超聲波信號至不同位置的時間差而言可以忽略不計，因此空間遙控器發送的RF信號可以假設為同時到達不同的超聲波發射器，這樣超聲波發射器被同時觸發。可以參考RF信號的發送時間來確定被觸發的超聲波發射器發出超聲波信號的時間，兩者有一定的延時關係，但是各個超聲波發射器發出超聲波信號的時間可以被認為是同時的。In another alternative embodiment, there may be at least three ultrasonic transmitters disposed on the television. RF flip flops transmit RF signals at the same or different frequencies, and independent ultrasonic transmitters can be triggered by these RF signals. The propagation speed of the RF signal is much faster than the propagation speed of the ultrasonic signal. Thus, the time difference between transmitting the RF signal to different positions is negligible with respect to the time difference between transmitting the ultrasonic signal to different positions, so the RF signal transmitted by the space remote controller can be assumed to arrive at different ultrasonic transmitters at the same time, so that the ultrasonic transmitter Triggered simultaneously. The time at which the triggered ultrasonic transmitter emits the ultrasonic signal can be determined by referring to the transmission time of the RF signal, which has a certain delay relationship, but the time at which each ultrasonic transmitter emits the ultrasonic signal can be considered as simultaneous.
空間遙控器可以是智慧型電話的一部分，例如，用智慧型電話代替空間遙控器。將空間遙控器的運動狀況和運動軌跡資訊同時轉換為螢幕游標的運動和軌跡，以便遠端地控制游標。The space remote can be part of a smart phone, for example, a smart phone instead of a space remote. Simultaneously convert the motion status and motion trajectory information of the space remote to the motion and trajectory of the screen cursor to control the cursor remotely.
空間遙控器也可以由具有超聲發送和接收功能的裝置組成。超聲波由空間遙控器發送然後受到設置在智慧螢幕周圍的有源或無源超聲反射器反射。通過計算被不同反射器反射的超聲波的時間差來得出空間遙控器的空間位置，由此，按照相同的方式，經由空間遙控器實現控制游標的目的。The space remote control can also be composed of devices having ultrasonic transmitting and receiving functions. Ultrasound is transmitted by the space remote and then reflected by an active or passive ultrasonic reflector placed around the smart screen. The spatial position of the space remote controller is obtained by calculating the time difference of the ultrasonic waves reflected by the different reflectors, whereby the purpose of controlling the cursor is realized via the space remote controller in the same manner.
根據另一實施例，具有空間遙控器的電視系統包括固定安裝在電視螢幕周圍的多個超聲波接收器。該系統也電連接至電視，向電視輸出電信號。空間遙控器同步地且週期性地發送RF信號和超聲波信號，也可以說，空間遙控器回應RF信號而發出超聲波信號。智慧電視受到RF信號的觸發而開始接收來自安裝在電視螢幕周圍的超聲波接收器的電信號，當超聲波接收器接收到空間遙控器發送的超聲波時，輸出電信號。在電視上的處理器基於不同超聲波接收器檢測到超聲波信號的渡越時間(收到RF信號的時間和檢測到超聲波信號的時間之間的時間差)來計算空間遙控器的位置。空間遙控器的一系列位置形成空間遙控器的運動軌跡，然後可以將該運動軌跡顯示在電視螢幕上。其中，多個超聲波接收器分別位於同一平面內的不同位置，該多個超聲波接收器定義了一個坐標系以定位所述空間遙控器相對於該多個超聲波接收器的位置，通過該坐標系的轉換將所述遙控器相對於該多個超聲波接收器的位置轉換成所述電視螢幕上的一個相應位置，並在所述電視螢幕上的相應位置顯示所述游標。需要知道的是，由於多個超聲波發射器設置於所述空間遙控器的同一位置處，該多個超聲波發射器可以被統稱為一個超聲波發射機，也就是說，該超聲波發射機可以發射多個超聲波信號。In accordance with another embodiment, a television system having a space remote control includes a plurality of ultrasonic receivers fixedly mounted around a television screen. The system is also electrically connected to the television and outputs an electrical signal to the television. The space remote controller transmits the RF signal and the ultrasonic signal synchronously and periodically. It can also be said that the space remote controller sends an ultrasonic signal in response to the RF signal. The smart TV is triggered by the RF signal to start receiving an electrical signal from an ultrasonic receiver installed around the television screen, and outputs an electrical signal when the ultrasonic receiver receives the ultrasonic wave transmitted by the space remote controller. The processor on the television calculates the position of the space remote controller based on the transit time of the ultrasonic signal detected by the different ultrasonic receivers (the time difference between the time when the RF signal is received and the time when the ultrasonic signal is detected). A series of positions of the space remote control form a motion track of the space remote controller, which can then be displayed on the television screen. Wherein the plurality of ultrasonic receivers are respectively located at different positions in the same plane, the plurality of ultrasonic receivers defining a coordinate system for positioning the position of the space remote controller relative to the plurality of ultrasonic receivers, through the coordinate system The conversion converts the position of the remote control relative to the plurality of ultrasonic receivers into a corresponding position on the television screen and displays the cursor at a corresponding position on the television screen. It should be noted that since a plurality of ultrasonic transmitters are disposed at the same position of the space remote controller, the plurality of ultrasonic transmitters may be collectively referred to as an ultrasonic transmitter, that is, the ultrasonic transmitter may emit multiple Ultrasonic signal.
每個超聲波信號的渡越時間是指從該超聲波信號的發送時間到該超聲波信號的接收時間的時間差，其中該超聲波信號的發送時間可以基於所述RF信號的發送時間確定。The transit time of each ultrasonic signal refers to a time difference from the transmission time of the ultrasonic signal to the reception time of the ultrasonic signal, wherein the transmission time of the ultrasonic signal can be determined based on the transmission time of the RF signal.
第一實施例First embodiment
第1圖是示出了根據第一實施例的3D空間遙控器的示意圖。系統100包括遙控器110，該遙控器110能夠週期性地發送RF觸發信號並且同步地接收超聲波信號。超聲波發射器120、122、124、126位於電視螢幕115周圍的不同位置，它們位於同一個平面內。游標140顯示在電視螢幕115上。根據本實施例，遙控器110的位置用於確定顯示游標140的位置。將空間遙控器的運動狀況和運動軌跡資訊轉換為螢幕游標的運動和軌跡，以便遠端地控制游標。Fig. 1 is a schematic view showing a 3D space remote controller according to the first embodiment. System 100 includes a remote control 110 that is capable of periodically transmitting RF trigger signals and synchronously receiving ultrasonic signals. The ultrasonic transmitters 120, 122, 124, 126 are located at different locations around the television screen 115 and are located in the same plane. The cursor 140 is displayed on the television screen 115. According to the present embodiment, the position of the remote controller 110 is used to determine the position at which the cursor 140 is displayed. The motion state and motion trajectory information of the space remote controller is converted into the motion and trajectory of the screen cursor to remotely control the cursor.
在一個非限制性修改例中，為設置在智慧螢幕115周圍的超聲波發射器120、122、124、126增加了接收功能，以及為空間遙控器110增加了超聲反射功能。這樣，通過控制不同超聲波發射器在不同的時間發送超聲波信號，可以創建具有不同相位的超聲波信號來進行空間掃描。系統100根據反射強度的變化來定位空間遙控器110，然後經由回饋系統實現對空間遙控器110的追蹤。In one non-limiting modification, the receiving function is added for the ultrasonic transmitters 120, 122, 124, 126 disposed around the smart screen 115, and the ultrasonic reflection function is added to the space remote control 110. Thus, by controlling different ultrasonic transmitters to transmit ultrasonic signals at different times, ultrasonic signals having different phases can be created for spatial scanning. The system 100 positions the space remote 110 based on changes in the intensity of the reflection, and then tracks the space remote 110 via a feedback system.
RF信號的傳播速度比超聲波的傳播速度高得多。因此，超聲波發射器120、122、124、126響應接收到來自空間遙控器110的RF信號而同時發出多個超聲波信號，也就是說超聲波信號的發送時間可以基於RF觸發信號的發送時間確定。The propagation speed of the RF signal is much higher than the propagation speed of the ultrasonic wave. Therefore, the ultrasonic transmitters 120, 122, 124, 126 simultaneously emit a plurality of ultrasonic signals in response to receiving the RF signal from the space remote controller 110, that is, the transmission time of the ultrasonic signals can be determined based on the transmission time of the RF trigger signals.
在一個非限制性實施例中，遙控器110是3D空間遙控器。3D空間遙控器110通過以下步驟工作：In one non-limiting embodiment, remote control 110 is a 3D space remote control. The 3D space remote control 110 works by the following steps:
1）三個或三個以上的超聲波發射器120、122、124、126固定安裝在電視螢幕115周圍。每個超聲波發射器120、122、124、126受到RF信號的觸發而發送超聲波信號。1) Three or more ultrasonic transmitters 120, 122, 124, 126 are fixedly mounted around the television screen 115. Each of the ultrasonic transmitters 120, 122, 124, 126 is triggered by an RF signal to transmit an ultrasonic signal.
2）空間遙控器110具有週期性地發送RF信號的RF觸發器和接收來自超聲波發射器120、122、124、126的超聲波信號的超聲波接收器。RF信號的傳播速度比超聲波信號的傳播速度高得多。由此，發送RF信號至不同位置的時間差相對於發送超聲波信號至不同位置的時間差而言可以忽略不計。換言之，由空間遙控器110發送到的RF信號可以假設為同時到達不同的超聲波發射器120、122、124、126，超聲波發射器被同時觸發。2) The space remote controller 110 has an RF flip-flop that periodically transmits an RF signal and an ultrasonic receiver that receives an ultrasonic signal from the ultrasonic transmitters 120, 122, 124, 126. The propagation speed of the RF signal is much higher than the propagation speed of the ultrasonic signal. Thus, the time difference between transmitting the RF signal to different locations is negligible with respect to the time difference between transmitting the ultrasonic signal to different locations. In other words, the RF signal transmitted by the space remote control 110 can be assumed to arrive at different ultrasonic transmitters 120, 122, 124, 126 at the same time, and the ultrasonic transmitters are simultaneously triggered.
3）RF信號由空間遙控器110在運動中週期性地發送以觸發超聲波發射器120、122、124、126。由此，空間遙控器110在每個RF信號發送之後接收一組超聲波信號。可以根據超聲波信號到達空間遙控器110的時間來計算此時空間遙控器110相對於這些超聲波發射器120、122、124、126的位置。基於空間遙控器110的一系列連續的位置來生成空間遙控器110的運動軌跡。3) The RF signal is periodically transmitted by the space remote control 110 during motion to trigger the ultrasonic transmitters 120, 122, 124, 126. Thus, the space remote control 110 receives a set of ultrasonic signals after each RF signal is transmitted. The position of the spatial remote controller 110 relative to the ultrasonic transmitters 120, 122, 124, 126 at this time may be calculated based on the time at which the ultrasonic signal reaches the space remote controller 110. A motion trajectory of the space remote controller 110 is generated based on a series of consecutive positions of the space remote controller 110.
4）將空間遙控器110的位置資訊通過資訊通訊介面無線地發送至智慧電視。4) The location information of the space remote controller 110 is wirelessly transmitted to the smart TV through the information communication interface.
5）通過智慧電視將運動軌跡作為游標軌跡投影到電視螢幕115上。這使用戶能夠借由空間遙控器110的運動來控制在電視上的游標140。具體的，該多個超聲波發射器120、122、124、126定義了一個坐標系以定位所述空間遙控器110相對於該多個超聲波發射器120、122、124、126的位置，通過該坐標系的轉換將所述遙控器110相對於該多個超聲波發射器120、122、124、126的位置轉換成所述電視螢幕115上的一個相應位置。5) Projecting the motion trajectory as a cursor trajectory onto the television screen 115 through the smart TV. This enables the user to control the cursor 140 on the television by the motion of the space remote control 110. Specifically, the plurality of ultrasonic transmitters 120, 122, 124, 126 define a coordinate system to position the spatial remote controller 110 relative to the plurality of ultrasonic transmitters 120, 122, 124, 126 through the coordinates The conversion of the remote control 110 relative to the position of the plurality of ultrasonic transmitters 120, 122, 124, 126 is converted to a corresponding position on the television screen 115.
在本實施例的一個修改例中，兩個超聲波接收機固定在空間遙控器上。這些接收器相隔一定距離。這使系統能夠基於這兩個超聲波接收機的不同軌跡來推導空間遙控器110的旋轉。其中每個超聲波接收機包括分別接受多個超聲波信號的多個超聲波接收機。In a modification of this embodiment, two ultrasonic receivers are fixed to the space remote controller. These receivers are separated by a certain distance. This enables the system to derive the rotation of the space remote control 110 based on the different trajectories of the two ultrasonic receivers. Each of the ultrasonic receivers includes a plurality of ultrasonic receivers that respectively receive a plurality of ultrasonic signals.
在本實施例的另一修改例中，空間遙控器110可以具有超聲發送和接收功能。不同頻率的超聲波由空間遙控器110發送然後受到設置在智慧螢幕周圍的有源或無源超聲反射器（替代或補充了發射器120、122、124、126）反射。通過計算被不同反射器反射的超聲波的時間來得出空間遙控器110的空間位置，由此，經由改變空間遙控器110的位置來控制游標140。In another modification of the embodiment, the space remote controller 110 may have an ultrasonic transmitting and receiving function. Ultrasonic waves of different frequencies are transmitted by the space remote control 110 and then reflected by an active or passive ultrasonic reflector (instead of or supplemented by the transmitters 120, 122, 124, 126) disposed around the smart screen. The spatial position of the space remote controller 110 is derived by calculating the time of the ultrasonic waves reflected by the different reflectors, whereby the cursor 140 is controlled via changing the position of the space remote controller 110.
本發明提供了一種基於在固定位置處的超聲波發射陣列120、122、124、126發送的超聲波信號到達遙控器110的時間來計算遙控器110的空間位置的方法。由於超聲波信號以相同的速度行進，所以可以基於超聲波信號到達遙控器110所需的時間來計算遙控器110與每個發射器120、122、124、126的距離。通過使用該資訊，例如，通過使用三邊測量法可以從幾何上確定遙控器110的位置。然後，可以將遙控器110的位置轉換為用於游標140的位置。然後，遙控器位置的相對變換可以轉譯為游標140位置的響聲變化，諸如，用腳將遙控器110移到左邊可以轉譯為將游標140移到螢幕的左邊（移動相同距離或移動一些調整距離）。The present invention provides a method of calculating the spatial position of the remote controller 110 based on the time at which the ultrasonic signals transmitted by the ultrasonic wave transmitting arrays 120, 122, 124, 126 at the fixed position reach the remote controller 110. Since the ultrasonic signals travel at the same speed, the distance of the remote controller 110 from each of the transmitters 120, 122, 124, 126 can be calculated based on the time required for the ultrasonic signals to reach the remote controller 110. By using this information, the position of the remote controller 110 can be geometrically determined, for example, by using a trilateration method. The position of the remote controller 110 can then be converted to a position for the cursor 140. The relative change in position of the remote can then be translated into a change in the position of the cursor 140, such as moving the remote 110 to the left with the foot can be translated to move the cursor 140 to the left of the screen (moving the same distance or moving some adjustment distance) .
第二實施例Second embodiment
第2圖是示出了根據第二實施例的系統200的示意圖。系統200包括遙控器210，該遙控器210能夠週期性地發送RF信號和多個超聲波信號，也可以說，該遙控器210相應週期性的RF信號來發送多個超聲波信號。超聲波接收器220、222、224、226配置為接收來自遙控器210的超聲波信號並且定位在電視螢幕215周圍的不同位置。超聲波接收器220、222、224、226還配置為將從超聲波信號轉換來的電信號發送至控制器，諸如，用於電視和/或機上盒。游標240顯示在電視螢幕215上。根據本實施例，遙控器210的位置用於確定顯示游標240的位置。Figure 2 is a schematic diagram showing a system 200 in accordance with a second embodiment. The system 200 includes a remote controller 210 that is capable of periodically transmitting an RF signal and a plurality of ultrasonic signals. It can also be said that the remote controller 210 transmits a plurality of ultrasonic signals corresponding to periodic RF signals. The ultrasonic receivers 220, 222, 224, 226 are configured to receive ultrasonic signals from the remote control 210 and are positioned at different locations around the television screen 215. The ultrasonic receivers 220, 222, 224, 226 are also configured to transmit electrical signals converted from the ultrasonic signals to a controller, such as for a television and/or a set-top box. The cursor 240 is displayed on the television screen 215. According to the present embodiment, the position of the remote controller 210 is used to determine the position at which the cursor 240 is displayed.
在本實施例中提供的3D空間遙控器210通過以下步驟工作：The 3D space remote controller 210 provided in this embodiment works by the following steps:
1）三個或三個以上的超聲波接收器220、222、224、226固定安裝在電視螢幕215周圍的不同位置，他們位於同一個平面上，並且與電視電連接。超聲波接收器220、222、224、226在接收到超聲波信號時輸出電信號至電視。1) Three or more ultrasonic receivers 220, 222, 224, 226 are fixedly mounted at different locations around the television screen 215, they are on the same plane and are electrically connected to the television. The ultrasonic receivers 220, 222, 224, 226 output electrical signals to the television upon receiving the ultrasonic signals.
2）空間遙控器210同步地發送RF信號和超聲波信號。智慧電視收到RF信號的觸發而開始接收來自安裝在電視螢幕215周圍的超聲波接收器220、222、224、226的電信號。當超聲波接收器220、222、224、226接收到空間遙控器210發送的超聲波時生成電信號。2) The space remote controller 210 synchronously transmits an RF signal and an ultrasonic signal. The smart television receives the triggering of the RF signal and begins receiving electrical signals from the ultrasonic receivers 220, 222, 224, 226 mounted around the television screen 215. An electrical signal is generated when the ultrasonic receivers 220, 222, 224, 226 receive the ultrasonic waves transmitted by the space remote controller 210.
3）RF信號的傳播速度比超聲波的傳播速度高得多，以及空間遙控器210同時發送RF信號和超聲波信號。因此，隨著電視接收到來自空間遙控器210的RF信號，可以在電視上設置空間遙控器210發送超聲波信號的開始時間(發送時間)。3) The propagation speed of the RF signal is much higher than that of the ultrasonic wave, and the space remote controller 210 simultaneously transmits the RF signal and the ultrasonic signal. Therefore, as the television receives the RF signal from the space remote controller 210, the start time (transmission time) at which the space remote controller 210 transmits the ultrasonic signal can be set on the television.
4）在不同位置處的超聲波接收器220、222、224、226接收來自空間遙控器210的超聲波信號的時間是不同的。同時，將超聲波信號轉換為電信號並且將電信號發送至電視的時間相對於超聲波的發送時間可以忽略不計。電視接收來自不同超聲波接收器220、222、224、226的電信號的時間差幾乎等於超聲波接收器220、222、224、226接收空間遙控器210發送的超聲波信號的時間差。4) The time at which the ultrasonic receivers 220, 222, 224, 226 at different locations receive the ultrasonic signals from the space remote control 210 is different. At the same time, the time at which the ultrasonic signal is converted into an electrical signal and the electrical signal is transmitted to the television is negligible with respect to the transmission time of the ultrasonic wave. The time difference between the television receiving the electrical signals from the different ultrasonic receivers 220, 222, 224, 226 is almost equal to the time difference between the ultrasonic receivers 220, 222, 224, 226 receiving the ultrasonic signals transmitted by the spatial remote control 210.
5）來自不同超聲波接收器220、222、224、226的電信號的時間差相當於是接收空間遙控器210發送的超聲波信號的時間差(渡越時間)。由此，根據超聲波信號的渡越時間和超聲波信號的速度來確定超聲波接收器220、222、224、226到空間遙控器210的距離，進而可以推導出遙控器210相對於超聲波接收器220、222、224、226的位置。5) The time difference of the electrical signals from the different ultrasonic receivers 220, 222, 224, 226 corresponds to the time difference (transit time) of the ultrasonic signals transmitted by the receiving space remote controller 210. Thereby, the distance between the ultrasonic receivers 220, 222, 224, and 226 to the space remote controller 210 is determined according to the transit time of the ultrasonic signal and the speed of the ultrasonic signal, and thus the remote controller 210 can be derived with respect to the ultrasonic receivers 220, 222. , 224, 226 location.
6）可以通過接收在運動中的空間遙控器210週期性地發送的RF信號和超聲波信號來計算空間遙控器210的運動軌跡。6) The motion trajectory of the space remote controller 210 can be calculated by receiving the RF signal and the ultrasonic signal periodically transmitted by the spatial remote controller 210 in motion.
7）通過電視將空間遙控器210的運動狀況和運動軌跡資訊轉換為螢幕游標240的運動和軌跡，以便實現借由空間遙控器210的運動控制在電視螢幕215上的游標240。具體的，該多個超聲波接收器220、222、224、226定義了一個坐標系以定位所述遙控器210相對於該多個超聲波接收器的位置，通過該坐標系的轉換將所述遙控器210相對於該多個超聲波接收器的位置轉換成電視螢幕上的一個相應位置，並在所述電視螢幕上的相應位置顯示所述游標。7) Converting the motion condition and motion trajectory information of the space remote controller 210 into the motion and trajectory of the screen cursor 240 by the television to implement the cursor 240 on the television screen 215 by the motion of the space remote controller 210. Specifically, the plurality of ultrasonic receivers 220, 222, 224, 226 define a coordinate system to position the remote controller 210 relative to the plurality of ultrasonic receivers, and the remote controller is converted by the coordinate system The position of the 210 relative to the plurality of ultrasonic receivers is converted to a corresponding position on the television screen, and the cursor is displayed at a corresponding position on the television screen.
在一個實施例中，為設置在智慧螢幕215周圍的超聲波接收器220、222、224、226增加了發送功能，以及為空間遙控器210增加了超聲反射功能。這樣，通過控制不同超聲波發射器在不同的時間發送超聲波信號，可以創建具有不同相位的超聲波信號來進行空間掃描。空間遙控器210的位置取決於反射強度的變化，然後經由回饋系統實現對空間遙控器210的追蹤。In one embodiment, the transmit function is added for the ultrasound receivers 220, 222, 224, 226 disposed around the smart screen 215, and the ultrasound reflection function is added to the space remote controller 210. Thus, by controlling different ultrasonic transmitters to transmit ultrasonic signals at different times, ultrasonic signals having different phases can be created for spatial scanning. The position of the space remote control 210 depends on the change in the intensity of the reflection, and then the tracking of the space remote controller 210 is effected via the feedback system.
3D空間遙控器210包括RF觸發的超聲波發射機。設置在智慧螢幕215（電視螢幕、平板顯示器螢幕等）附近的陣列超聲波接收器220、222、224、226同時被來自遙控器210的RF信號觸發。通過計算接收由陣列超聲波接收器220、222、224、226接收到的超聲波的時間差來推導遙控器210的位置。超聲波不停地被運動中的遙控器210觸發，從而可以獲得遙控器210的運動狀況和3D運動軌跡，以及經由螢幕的游標214將遙控器210的運動狀況和運動軌跡資訊反射到智慧螢幕上。這使得能夠借由遙控器210的3D運動來控制智慧螢幕215的游標240。該3D空間遙控器210不僅適用於3D游標控制，例如，遙控器210也可以用於2D顯示器（例如，通過忽略y軸）。The 3D space remote control 210 includes an RF triggered ultrasonic transmitter. The array ultrasonic receivers 220, 222, 224, 226 disposed near the smart screen 215 (television screen, flat panel display screen, etc.) are simultaneously triggered by the RF signal from the remote controller 210. The position of the remote controller 210 is derived by calculating the time difference of receiving the ultrasonic waves received by the array ultrasonic receivers 220, 222, 224, 226. The ultrasonic waves are continuously triggered by the remote controller 210 in motion, so that the motion state of the remote controller 210 and the 3D motion trajectory can be obtained, and the motion state and motion trajectory information of the remote controller 210 are reflected onto the smart screen via the cursor 214 of the screen. This enables the cursor 240 of the smart screen 215 to be controlled by the 3D motion of the remote controller 210. The 3D space remote control 210 is not only suitable for 3D cursor control, for example, the remote controller 210 can also be used for 2D displays (eg, by ignoring the y-axis).
兩個不同頻率的相隔一定距離的超聲波發射機可以固定在遙控器210上，然後可以通過計算兩個超聲波發射機的不同軌跡來推導遙控器210的旋轉。Two ultrasonic transmitters of different frequencies separated by a distance can be fixed to the remote controller 210, and then the rotation of the remote controller 210 can be derived by calculating different trajectories of the two ultrasonic transmitters.
遙控器210也可以由擁有超聲波發射接收功能的裝置組成。不同頻率的超聲波由遙控器210發送然後受到設置在智慧螢幕215附近的有源或無源超聲反射器（替代或補充了接收器220、222、224、226）反射。通過計算在遙控器210發送之後接收到的不同反射器超聲波的時間差來得出遙控器210的空間位置，由此，實現經由遙控器210控制游標240的目的。The remote controller 210 can also be composed of a device having an ultrasonic wave transmitting and receiving function. Ultrasonic waves of different frequencies are transmitted by the remote control 210 and then reflected by an active or passive ultrasonic reflector disposed adjacent to the smart screen 215 (instead of or supplementing the receivers 220, 222, 224, 226). The spatial position of the remote controller 210 is derived by calculating the time difference of the different reflector ultrasonic waves received after the remote controller 210 transmits, thereby achieving the purpose of controlling the cursor 240 via the remote controller 210.
將空間遙控器210的運動狀況和運動軌跡資訊轉換為螢幕游標240的運動和軌跡，以便遠端地控制游標240。The motion condition and motion trajectory information of the space remote controller 210 is converted into the motion and trajectory of the screen cursor 240 to remotely control the cursor 240.
在一個非限制性實施例中，為設置在智慧螢幕215周圍的超聲波接收器220、222、224、226增加了發送功能，以及為空間遙控器210增加了超聲反射功能。這樣，通過控制不同超聲波發射器在不同的時間發送超聲波信號，可以創建具有不同相位的超聲波信號來進行空間掃描。空間遙控器210由系統取決於反射強度的變化而定位，然後經由回饋系統實現對空間遙控器210的追蹤。In one non-limiting embodiment, a transmit function is added for the ultrasound receivers 220, 222, 224, 226 disposed around the smart screen 215, and an ultrasound reflection function is added to the space remote 210. Thus, by controlling different ultrasonic transmitters to transmit ultrasonic signals at different times, ultrasonic signals having different phases can be created for spatial scanning. The space remote control 210 is positioned by the system depending on changes in the intensity of the reflection, and then tracking of the space remote controller 210 is accomplished via a feedback system.
第3圖示出了適合用於實踐各個實施例的裝置的框圖。遙控器310包括控制器，諸如，資料處理器（DP）312、電腦可讀介質（存儲電腦指令，諸如程式（PROG）315的記憶體（MEM）314）、和合適的無線通訊介面（諸如，超聲波接收器316和RF發射器/接收器318）。遙控器310也可以包括鍵區319和/或專用處理器，例如，位置確定晶片313。Figure 3 shows a block diagram of an apparatus suitable for practicing various embodiments. The remote controller 310 includes a controller such as a data processor (DP) 312, a computer readable medium (storing computer instructions such as a memory (MEM) 314 of a program (PROG) 315), and a suitable wireless communication interface (such as Ultrasonic receiver 316 and RF transmitter/receiver 318). The remote control 310 can also include a keypad 319 and/or a dedicated processor, such as a position determining wafer 313.
第4圖示出了適合用於實踐各個實施例的系統400的框圖。系統400包含頂置單元410和各個發射器/接收器420、422。頂置單元410包括控制器，諸如，資料處理器（DP）412、電腦可讀介質（存儲電腦指令，諸如程式（PROG）415的記憶體（MEM）414）、和合適的無線通訊介面（諸如，RF接收器416）。頂置單元410還與發射器/接收器420、422一起運行以便接收/發送無線信號（諸如，超聲波信號）。頂置單元410也可以包括專用處理器，例如，遙控器位置確定晶片413。FIG. 4 shows a block diagram of a system 400 suitable for practicing various embodiments. System 400 includes a head unit 410 and respective transmitters/receivers 420, 422. The overhead unit 410 includes a controller, such as a data processor (DP) 412, a computer readable medium (storing computer instructions, such as a memory (MEM) 414 of the program (PROG) 415), and a suitable wireless communication interface (such as , RF Receiver 416). The overhead unit 410 also operates with the transmitter/receivers 420, 422 to receive/transmit wireless signals (such as ultrasonic signals). The overhead unit 410 may also include a dedicated processor, such as a remote control position determining wafer 413.
發射器/接收器420、422可以設置於顯示單元（諸如，電視），可以設置於頂置單元410，以及/或者設置於顯示單元外部。雖然示出了兩個發射器/接收器420、422，但是系統400可以包含更多個發射器/接收器。The transmitter/receivers 420, 422 may be disposed on a display unit (such as a television), may be disposed in the overhead unit 410, and/or disposed external to the display unit. Although two transmitters/receivers 420, 422 are shown, system 400 can include more transmitters/receivers.
程式315、415可以包括當由相關資料處理器 312、412執行時使遙控器310和頂置單元410能夠根據實施例運行的程式指令。即，各個實施例可以至少部分地由可執行的電腦軟體實現，由遙控器310的DP 312、頂置單元的DP 412實現，由遙控器310/頂置單元410的硬體實現，或者由軟體和硬體的組合實現。The programs 315, 415 can include program instructions that, when executed by the associated data processor 312, 412, enable the remote control 310 and the overhead unit 410 to operate in accordance with an embodiment. That is, various embodiments may be implemented at least in part by an executable computer software, implemented by the DP 312 of the remote controller 310, the DP 412 of the overhead unit, by the hardware of the remote controller 310/the overhead unit 410, or by software. Realized with a combination of hardware.
一般而言，遙控器310的各個實施例可以包括電視遙控器、電纜盒遙控器、蜂窩電話、平板電腦、遊戲裝置、音樂播放機、以及包含這些功能的組合的其他裝置。In general, various embodiments of remote control 310 can include a television remote control, a cable box remote control, a cellular telephone, a tablet, a gaming device, a music player, and other devices that include a combination of these functions.
一般而言，頂置單元410的各個實施例可以包括包含在電視中的處理單元、電纜盒、遊戲系統以及包含這些功能的組合的其他裝置。In general, various embodiments of overhead unit 410 may include a processing unit, a cable box, a gaming system, and other devices including combinations of these functions included in the television.
MEM 314、414可以是適合本地技術環境的任何類型並且通過使用任何適合的資料存儲技術來實施，諸如，磁記憶體裝置、基於半導體的記憶體裝置、閃速記憶體、光記憶體裝置、固定記憶體和可移除記憶體。DP 312、412可以是適合本地技術環境的任何類型，並且可以包括通用電腦、專用電腦、微處理器和多核處理器，作為非限制性示例。無線通訊介面（例如，發射器/接收器318、RF接收器416等）可以是適合本地技術環境的任何類型並且可以通過使用任何適合的通信技術來實施，諸如RF系統，包括使用光通信系統，諸如紅外系統和/或光掃描系統、RF通信系統、或這些部件的組合。另外，通信介面可以是使用發射器、接收器和/或收發器的雙向介面，或者作為適合本實施例的單向介面。The MEMs 314, 414 can be of any type suitable for the local technical environment and implemented using any suitable data storage technology, such as magnetic memory devices, semiconductor-based memory devices, flash memory, optical memory devices, fixed Memory and removable memory. The DPs 312, 412 may be of any type suitable for a local technical environment and may include general purpose computers, special purpose computers, microprocessors, and multi-core processors, as non-limiting examples. The wireless communication interface (eg, transmitter/receiver 318, RF receiver 416, etc.) can be of any type suitable for the local technical environment and can be implemented using any suitable communication technology, such as an RF system, including the use of an optical communication system, Such as infrared systems and/or optical scanning systems, RF communication systems, or a combination of these components. Additionally, the communication interface can be a bidirectional interface using a transmitter, a receiver, and/or a transceiver, or as a unidirectional interface suitable for the present embodiment.
第5圖圖示了根據另一實施例的在第一位置處顯示游標。如圖所示，遙控器和顯示器處於第一系統狀態500。遙控器相對於螢幕515位於第一遙控器位置510處。發射器520分別產生超聲波信號530、532、534、536。然後在遙控器處接收這些信號530、532、534、536並且確定第一遙控器位置510。基於確定的第一遙控器位置510，將游標顯示在第一游標位置540處。Figure 5 illustrates displaying a cursor at a first location in accordance with another embodiment. As shown, the remote control and display are in a first system state 500. The remote control is located at a first remote control position 510 with respect to the screen 515. Transmitter 520 generates ultrasonic signals 530, 532, 534, 536, respectively. These signals 530, 532, 534, 536 are then received at the remote control and the first remote control position 510 is determined. Based on the determined first remote control position 510, the cursor is displayed at the first cursor position 540.
在一個非限制性實施例中，可以確定每個超聲波信號530、532、534、536從相關發射器520行進至遙控器所需的時間量。該資訊然後可以用於確定在第一遙控器位置510與相關發射器520之間的距離。例如，基於在遙控器處接收第一信號530的時間，可以通過使用已知的超聲波信號的速度來計算在第一遙控器位置510與相關發射器520之間的距離。將用於每個超聲波信號530、532、534、536的距離資訊組合起來能夠在3D環境下確定第一遙控器位置510。In one non-limiting embodiment, the amount of time each ultrasonic signal 530, 532, 534, 536 needs to travel from the associated transmitter 520 to the remote control can be determined. This information can then be used to determine the distance between the first remote control location 510 and the associated transmitter 520. For example, based on the time at which the first signal 530 is received at the remote control, the distance between the first remote control position 510 and the associated transmitter 520 can be calculated by using the speed of the known ultrasonic signal. Combining the distance information for each of the ultrasonic signals 530, 532, 534, 536 can determine the first remote control position 510 in a 3D environment.
第6圖圖示了根據另一實施例的在第二位置處顯示游標。如圖所示，在第二系統狀態600下，遙控器已經從第一遙控器位置510移到了第二遙控器位置610。虛線部分612表示遙控器位置變化。Figure 6 illustrates the display of a cursor at a second location in accordance with another embodiment. As shown, in the second system state 600, the remote control has moved from the first remote control position 510 to the second remote control position 610. The dotted line portion 612 represents the remote controller position change.
在第二遙控器位置610處，遙控器接收來自相關發射器520的每個超聲波信號630、632、634、636。由於遙控器位置變化612，超聲波信號630、632、634、636到達的時延不同。像之前一樣，該資訊用於確定第二遙控器位置610。該資訊然後用於將游標顯示在第二游標位置640處，該第二游標位置640從第一游標位置540偏移了游標位置變化642。At the second remote control position 610, the remote control receives each of the ultrasonic signals 630, 632, 634, 636 from the associated transmitter 520. Due to the remote control position change 612, the arrival time of the ultrasonic signals 630, 632, 634, 636 is different. This information is used to determine the second remote control position 610 as before. This information is then used to display the cursor at a second cursor position 640 that is offset from the first cursor position 540 by a cursor position change 642.
在一個非限制性實施例中，基於一定比例將遙控器位置變化612轉換為游標位置變化642。例如，可以將移動遙控器的1英尺的移動轉換為在螢幕515上移動10英寸或轉換為顯示面積的百分比（例如，沿著x軸的移動等於螢幕大小的50%）。作為替代實施方式，比例可以基於遙控器位置而發生變化，例如，當遙控器沿著y軸遠離螢幕515時的比例可以比當遙控器靠近螢幕515時的比例更大。這使游標的位置能夠在視覺上更靠近使用者在其視野中可以看見遙控器的地方。In one non-limiting embodiment, remote control position change 612 is converted to cursor position change 642 based on a certain ratio. For example, a 1 foot movement of the mobile remote can be converted to a 10 inch movement on screen 515 or a percentage converted to display area (eg, movement along the x-axis equals 50% of the screen size). As an alternative embodiment, the scale may vary based on the remote control position, for example, when the remote control is away from the screen 515 along the y-axis, the ratio may be greater than when the remote control is near the screen 515. This allows the position of the cursor to be visually closer to where the user can see the remote in their field of view.
在另一非限制性實施例中，遙控器可以包括附加的傳感電路。雖然可以基於位置變化來確定移動速度，但是遙控器可以包括附加的速度或移動檢測感測器。例如，遙控器可以包括用於檢測遙控器已經開始移動的加速計。該資訊可以用於點亮在遙控器上的按鈕以及/或者向發射器520發送RF信號以便觸發超聲波信號的發送，從而可以確定遙控器的位置。加速計可以較為簡單，以避免如用於遊戲遙控裝置中的更敏感感測器的高成本。In another non-limiting embodiment, the remote control can include additional sensing circuitry. While the speed of movement can be determined based on positional changes, the remote control can include additional speed or motion detection sensors. For example, the remote control can include an accelerometer for detecting that the remote control has begun to move. This information can be used to illuminate a button on the remote control and/or to send an RF signal to the transmitter 520 to trigger the transmission of the ultrasonic signal so that the position of the remote control can be determined. Accelerometers can be simpler to avoid the high cost of more sensitive sensors as used in gaming remote controls.
從上可知，遙控器可以包括多個超聲波接收器、發射器或反射器，從而也可以確定遙控器的定向和旋轉。該資料可以用於改變游標的圖像，例如，以反映遙控器的定向/旋轉。作為替代實施方式，該資訊可以用於更改遙控器的功能，例如，當垂直握持時移動遙控器可以被詮釋為不改變游標的位置，從而使用戶可以重新定位遙控器。作為另一非限制性示例，扭轉遙控器可以是選擇一個選項和/或返回上級螢幕/功能表的命令。As can be seen from the above, the remote control can include a plurality of ultrasonic receivers, transmitters or reflectors so that the orientation and rotation of the remote control can also be determined. This material can be used to change the image of the cursor, for example, to reflect the orientation/rotation of the remote control. As an alternative embodiment, this information can be used to change the functionality of the remote control, for example, the mobile remote control can be interpreted as not changing the position of the cursor when held vertically, thereby allowing the user to reposition the remote control. As another non-limiting example, the twist remote control can be a command to select an option and/or return to the superior screen/function list.
第7圖是示出了適合用於實踐各個實施例的系統700的示意圖。系統700包括位於顯示器外殼730內的螢幕715。位於顯示器外殼730外部的是在顯示器外殼730上方的第一感測器外殼740和在顯示器外殼730下方的第二感測器外殼742。每個感測器外殼740、742都包括一個或多個發射器/接收器720。在示出的非限制性實施例中，第一感測器外殼740具有兩個反發器/接收器720，而第二感測器外殼742具有一個發射器/接收器720。感測器外殼740、742連接至頂置處理單元710。通過使用至少三個發射器/接收器720，頂置處理單元710能夠在3D中確定遙控器的位置。FIG. 7 is a schematic diagram showing a system 700 suitable for practicing various embodiments. System 700 includes a screen 715 located within display housing 730. Located outside of the display housing 730 is a first sensor housing 740 above the display housing 730 and a second sensor housing 742 below the display housing 730. Each of the sensor housings 740, 742 includes one or more transmitters/receivers 720. In the illustrated non-limiting embodiment, the first sensor housing 740 has two counter/receivers 720 and the second sensor housing 742 has one transmitter/receiver 720. The sensor housings 740, 742 are coupled to the overhead processing unit 710. By using at least three transmitters/receivers 720, the overhead processing unit 710 can determine the position of the remote control in 3D.
在另外的非限制性實施例中，系統700可以包括額外的發射器/接收器720。該額外的發射器/接收器720可以包括在感測器外殼740、742中和/或設置在附加的感測器外殼中。作為替代實施方式，單個感測器外殼可以同時包含感測器外殼740、742。In a further non-limiting embodiment, system 700 can include an additional transmitter/receiver 720. The additional transmitter/receiver 720 can be included in the sensor housings 740, 742 and/or in an additional sensor housing. As an alternative embodiment, a single sensor housing can include both sensor housings 740, 742.
在附加的非限制性實施例中，感測器外殼740、742可以位於不同的佈置中，例如，第二感測器外殼740、742中的一個或兩個都可以沿著顯示器外殼730側定位。作為替代實施方式，感測器外殼740、742可以定位為遠離顯示器外殼730，諸如，嵌在牆體中或併入揚聲器系統中。In additional non-limiting embodiments, the sensor housings 740, 742 can be located in different arrangements, for example, one or both of the second sensor housings 740, 742 can be positioned along the display housing 730 side . As an alternative embodiment, the sensor housings 740, 742 can be positioned away from the display housing 730, such as embedded in a wall or incorporated into a speaker system.
在另外的非限制性實施例中，頂置處理單元710可以包含在顯示器外殼730中，在遠端裝置（諸如，攝像機或電纜盒），或者在感測器外殼740、742中的一個或兩個內。In further non-limiting embodiments, the overhead processing unit 710 can be included in the display housing 730, at a remote device such as a video camera or cable box, or in one or both of the sensor housings 740, 742 Within.
如上所述，遙控器可以發送RF信號以便觸發來自發射器/接收器720的超聲波信號。在一個非限制性實施例中，頂置處理單元710可以接收RF信號是來自發射器/接收器720中的任何一個或來自附加感測器的指示。頂置處理單元710然後可以指令發射器/接收器720開始超聲波信號的發送。As described above, the remote control can transmit an RF signal to trigger an ultrasonic signal from the transmitter/receiver 720. In one non-limiting embodiment, overhead processing unit 710 can receive an indication that the RF signal is from any of transmitters/receivers 720 or from an additional sensor. The overhead processing unit 710 can then instruct the transmitter/receiver 720 to begin transmission of the ultrasonic signals.
作為替代實施方式，每個發射器/接收器720都可以包括用於在接收到RF信號時自動開始發送超聲波信號的電路系統。當發射器/接收器720的回應延遲足夠短時，可以將超聲波信號認為是與RF信號同時發送。在這種情況下，可以將超聲波信號在發射器/接收器720與遙控器之間傳播（或行進）所需的時間確定為在遙控器發送RF信號的時間與遙控器接收超聲波信號的時間之間的時間差。As an alternative embodiment, each transmitter/receiver 720 can include circuitry for automatically starting to transmit an ultrasonic signal upon receipt of an RF signal. When the response delay of the transmitter/receiver 720 is sufficiently short, the ultrasonic signal can be considered to be transmitted simultaneously with the RF signal. In this case, the time required for the ultrasonic signal to propagate (or travel) between the transmitter/receiver 720 and the remote controller can be determined as the time at which the remote controller transmits the RF signal and the time at which the remote controller receives the ultrasonic signal. The time difference between.
在另一替代實施例中，遙控器可以配置為發送另一較高速的信號，以便觸發較低速的超聲波信號。例如，遙控器可以發送紅外（IR）觸發信號。In another alternative embodiment, the remote control can be configured to transmit another higher speed signal to trigger a lower speed ultrasonic signal. For example, the remote control can send an infrared (IR) trigger signal.
第8圖是示出了適合用於實踐各個實施例的系統800的示意圖。在本實施例中，系統800是具有內置多個發射器/接收器820的電視。多個發射器/接收器820位於顯示器外殼830內並且設置在螢幕815周圍。如圖所示，發射器/接收器820與螢幕815相鄰。在另外的實施例中，發射器/接收器820和螢幕815可以部分地或完全地重疊，例如，發射器/接收器820中的一個或多個可以完全位於螢幕815後面。Figure 8 is a schematic diagram showing a system 800 suitable for practicing various embodiments. In the present embodiment, system 800 is a television having a plurality of transmitters/receivers 820 built therein. A plurality of transmitters/receivers 820 are located within display housing 830 and disposed about screen 815. As shown, the transmitter/receiver 820 is adjacent to the screen 815. In further embodiments, the transmitter/receiver 820 and the screen 815 may partially or completely overlap, for example, one or more of the transmitter/receivers 820 may be completely behind the screen 815.
如上所述，各個實施例提供了一種通過使用3D運動來控制游標的方法、設備和（多個）電腦程式。As described above, various embodiments provide a method, apparatus, and computer program(s) for controlling a cursor by using 3D motion.
第9圖是圖示了根據各個實施例的執行電腦程式指令的方法和結果的邏輯流程圖。根據實施例，方法在框910處執行回應於觸發信號而同時發送多個超聲波信號的步驟。在框920處，接收所述多個超聲波信號。在框930處，基於每個超聲波信號的發送時間與到達時間之間的渡越時間來確定每個超聲波信號所經過的距離，基於各個超聲波信號所經過的距離來確定所述遙控器的位置。該方法還在框940處執行至少部分地基於遙控器的位置將游標顯示在螢幕上的步驟。Figure 9 is a logic flow diagram that illustrates the method and results of executing computer program instructions in accordance with various embodiments. According to an embodiment, the method performs the step of transmitting a plurality of ultrasonic signals simultaneously in response to the trigger signal at block 910. At block 920, the plurality of ultrasonic signals are received. At block 930, the distance traveled by each of the ultrasonic signals is determined based on the transit time between the transmission time and the arrival time of each of the ultrasonic signals, and the position of the remote controller is determined based on the distance traveled by the respective ultrasonic signals. The method also performs the step of displaying the cursor on the screen based at least in part on the position of the remote control at block 940.
可以將在第9圖中示出的各個框視為方法步驟，作為使用電腦程式代碼產生的操作，和/或作為構成以實現相關功能的一個或多個邏輯電路元件。The various blocks shown in Figure 9 can be considered as method steps, as operations resulting from the use of computer program code, and/or as one or more logical circuit elements that are configured to perform the relevant functions.
在一個實施例中，本發明提供了一種通過使用3D運動來控制游標的遙控器。該遙控器包括配置為週期性地向設置在電視上的多個超聲波發射器發送RF信號的RF發射器。當被RF信號觸發時，所述超聲波發射器發送多個超聲波信號。該遙控器還包括配置為接收超聲波信號的超聲波接收器。處理器基於所述多個超聲波信號到達超聲波接收器的時間來計算空間遙控器相對於超聲波發射器的位置。空間遙控器的一系列位置形成空間遙控器的運動軌跡。空間遙控器將該運動軌跡無線地發送至電視，以及通過電視將該運動軌跡作為游標軌跡投影到電視螢幕上。In one embodiment, the present invention provides a remote control for controlling a cursor by using 3D motion. The remote control includes an RF transmitter configured to periodically transmit RF signals to a plurality of ultrasonic transmitters disposed on the television. The ultrasonic transmitter transmits a plurality of ultrasonic signals when triggered by an RF signal. The remote control also includes an ultrasonic receiver configured to receive ultrasonic signals. A processor calculates a position of the spatial remote control relative to the ultrasonic transmitter based on a time at which the plurality of ultrasonic signals arrive at the ultrasonic receiver. The series of positions of the space remote control form the motion track of the space remote control. The space remote transmits the motion track wirelessly to the television, and projects the motion track as a cursor track onto the television screen through the television.
在上述遙控器中的任何一個的又一實施例中，RF發射器發送不同頻率的RF信號。超聲波發射器可以被不同頻率的RF信號觸發。例如，處於第一頻率下的一個RF信號觸發單個超聲波發射器（或一組超聲波發射器組），而處於第二頻率下的第二RF信號觸發不同的超聲波發射器（或不同的一組超聲波發射器）。In yet another embodiment of any of the above remote controls, the RF transmitter transmits RF signals of different frequencies. Ultrasonic transmitters can be triggered by RF signals of different frequencies. For example, an RF signal at a first frequency triggers a single ultrasonic transmitter (or a group of ultrasonic transmitters), while a second RF signal at a second frequency triggers a different ultrasonic transmitter (or a different set of ultrasonic waves) launcher).
在上述遙控器中的任何一個的另一實施例中，RF信號的傳播速度比超聲波的傳播速度高得多。由此，RF信號到達不同位置的時間相對於超聲波信號到達不同位置的時間而言可以忽略不計。換言之，由空間遙控器發送到的RF信號可以假設為同時到達不同的超聲波發射器，從而認為超聲波發射器被同時觸發。In another embodiment of any of the above remote controls, the propagation speed of the RF signal is much higher than the propagation speed of the ultrasonic waves. Thus, the time at which the RF signal arrives at a different location is negligible relative to the time at which the ultrasonic signal arrives at a different location. In other words, the RF signal transmitted by the space remote can be assumed to arrive at a different ultrasonic transmitter at the same time, so that the ultrasonic transmitter is considered to be triggered simultaneously.
在上述遙控器中的任何一個的又一實施例中，空間遙控器可以是智慧型電話的一部分，例如，用智慧型電話代替空間遙控器。In still another embodiment of any of the above remote controls, the spatial remote control can be part of a smart phone, for example, a smart phone instead of a space remote.
在上述遙控器中的任何一個的另一實施例中，將空間遙控器的運動和運動軌跡資訊轉換為螢幕游標的運動和軌跡，以便遠端地控制游標。In another embodiment of any of the remote controls described above, the motion and motion trajectory information of the spatial remote control is converted to the motion and trajectory of the screen cursor to remotely control the cursor.
附加實施例提供了一種通過使用3D運動控制游標的遙控器。遙控器配置為提供超聲發送和接收功能。不同頻率的超聲波信號由空間遙控器發送然後受到設置在智慧螢幕周圍的有源或無源超聲反射器反射。通過計算被不同反射器反射的超聲波的時間來得出空間遙控器的空間位置。該資訊然後用於確定遙控器的位置並且因此控制游標。由此，可以借由空間遙控器控制游標。Additional embodiments provide a remote control that controls a cursor by using 3D motion. The remote control is configured to provide ultrasonic transmission and reception. Ultrasonic signals of different frequencies are transmitted by the space remote and then reflected by active or passive ultrasonic reflectors placed around the smart screen. The spatial position of the space remote is derived by calculating the time of the ultrasonic waves reflected by the different reflectors. This information is then used to determine the position of the remote control and thus the cursor. Thus, the cursor can be controlled by the space remote control.
在上述電視系統中的任何一個的又一實施例中，超聲波接收器還包括發送功能。遙控器提供超聲反射功能，例如，而不是超聲波信號發送功能。因此，通過超聲波發射器創建具有不同相位的超聲波信號來進行空間掃描。超聲波信號收到遙控器的反射然後由超聲波接收器接收。基於反射強度變化來確定空間遙控器的位置。In still another embodiment of any of the above television systems, the ultrasonic receiver further includes a transmitting function. The remote control provides an ultrasound reflection function, for example, instead of an ultrasonic signal transmission function. Therefore, spatial scanning is performed by ultrasonic signals having ultrasonic waves of different phases. The ultrasonic signal is received by the remote control and then received by the ultrasonic receiver. The position of the space remote is determined based on the change in the intensity of the reflection.
在上述電視系統中的任何一個的另一實施例中，RF信號的傳播速度比超聲波的傳播速度高得多。RF信號和超聲波信號由空間遙控器同時發送。因此，當電視再接收到超聲波信號之前接收到來自空間遙控器的RF信號時，可以在電視上設置空間遙控器發送超聲波的開始時間，從而使接收RF信號的時間和接收超聲波信號的時間之間的時間差有效地與超聲波信號從遙控器行進至超聲波接收器所需的時間量相同。In another embodiment of any of the above television systems, the propagation speed of the RF signal is much higher than the propagation speed of the ultrasonic waves. The RF signal and the ultrasonic signal are simultaneously transmitted by the space remote controller. Therefore, when the RF signal from the space remote controller is received before the television receives the ultrasonic signal, the start time of the ultrasonic wave transmitted by the space remote controller can be set on the television, so that the time between receiving the RF signal and the time of receiving the ultrasonic signal can be made. The time difference is effectively the same as the amount of time it takes for the ultrasonic signal to travel from the remote to the ultrasonic receiver.
在上述電視系統中的任何一個的又一實施例中，可以基於由遙控器發送的、由處於不同固定位置處的超聲波接收器接收的超聲波信號的到達時間來計算遙控器的空間位置。In still another embodiment of any of the above television systems, the spatial position of the remote control can be calculated based on the arrival time of the ultrasonic signals transmitted by the remote receiver at the ultrasonic receivers at different fixed positions.
所描述的各種操作僅僅是示例性的並且不暗含任何具體順序。進一步地，當恰當時，可以按照任何順序來使用這些操作並且可以部分地使用這些操作。在瞭解了上述實施例之後，應該理解，附加實施例可以採用涉及在電腦系統中傳送或存儲的資料的各種電腦實施操作。這些操作是要求對物理量進行物理操縱的操作。通常，雖然並不一定，這些量採取能夠被存儲、傳送、組合、比較和操縱的電、磁或光信號的形式。The various operations described are merely exemplary and do not imply any specific order. Further, these operations may be used in any order as appropriate and may be used in part. Having understood the above-described embodiments, it should be understood that additional embodiments may employ various computer-implemented operations involving data transmitted or stored in a computer system. These operations are operations that require physical manipulation of physical quantities. Usually, though not necessarily, these quantities take the form of electrical, magnetic or optical signals capable of being stored, transferred, combined, compared and manipulated.
此處描述的過程、進程和/或模組可以在硬體、軟體（體現為具有程式指令的電腦可讀介質）、固件、或其組合中實現。例如，此處描述的功能可以由執行來自記憶體或其他存儲裝置的程式指令的處理器執行。The processes, processes, and/or modules described herein can be implemented in hardware, software ( embodied as a computer readable medium having program instructions), firmware, or a combination thereof. For example, the functions described herein can be performed by a processor executing program instructions from a memory or other storage device.
雖然上述說明已經涉及到具體實施例，但是，可以對所描述的實施例進行其他改變和修改，以獲得這些實施例的一些或所有優點。本領域的技術人員進一步要瞭解的，在不脫離此處所公開的構思的情況下，可以對上述系統和方法進行修改。因此，本發明不應該視為受到所公開實施例的限制。此外，在不相應使用其他特徵的情況下，也可以使用所描述實施例的各種特徵。由此，應該將本說明書視為僅僅是對各種原理的圖示，而不是限制本發明。 以上所述僅為本發明之較佳實施例，凡依本發明申請專利範圍所做之均等變化與修飾，皆應屬本發明之涵蓋範圍。While the above description has been directed to specific embodiments, other changes and modifications may be made to the described embodiments to obtain some or all of the advantages of these embodiments. It will be further appreciated by those skilled in the art that the above-described systems and methods may be modified without departing from the concepts disclosed herein. Therefore, the invention should not be considered as limited by the disclosed embodiments. In addition, various features of the described embodiments can be used without the corresponding use of other features. Accordingly, the description is to be considered as illustrative only of The above are only the preferred embodiments of the present invention, and all changes and modifications made to the scope of the present invention should be within the scope of the present invention.
100、200、400、700、800‧‧‧系統
110、210、310、510、610‧‧‧遙控器
115、215‧‧‧電視螢幕
120、122、124、126、220、222、224、226‧‧‧超聲波發射器
140、240‧‧‧游標
312、412‧‧‧資料處理器
313、413‧‧‧位置確定晶片
314、414‧‧‧記憶體
315、415‧‧‧程式
316‧‧‧超聲波接收器
318‧‧‧RF發射器/接收器
319‧‧‧鍵區
410‧‧‧頂置單元
416‧‧‧RF接收器
420、422、820‧‧‧發射器/接收器
500‧‧‧第一系統狀態
515、715、815‧‧‧螢幕
520‧‧‧發射器
530、532、534、536、630、632、634、636‧‧‧超聲波信號
540‧‧‧第一游標位置
600‧‧‧第二系統狀態
612‧‧‧遙控器位置變化
640‧‧‧第二游標位置
642‧‧‧游標位置變化
710‧‧‧頂置處理單元
720‧‧‧發射器/接收器
730、830‧‧‧顯示器外殼
740、742‧‧‧感測器外殼
910、920、930、940‧‧‧框100, 200, 400, 700, 800‧‧‧ systems
110, 210, 310, 510, 610‧‧ ‧ remote control
115, 215‧‧‧ TV screen
120, 122, 124, 126, 220, 222, 224, 226‧‧‧ ultrasonic transmitter
140, 240‧‧ cursors
312, 412‧‧‧ data processor
313, 413‧‧‧ Position Determination Wafer
314, 414‧‧‧ memory
315, 415‧‧‧ program
316‧‧‧ Ultrasonic Receiver
318‧‧‧RF Transmitter/Receiver
319‧‧‧Keypad
410‧‧‧Top unit
416‧‧‧RF Receiver
420, 422, 820‧‧‧transmitters/receivers
500‧‧‧First system status
515, 715, 815‧‧ ‧ screen
520‧‧‧transmitter
530, 532, 534, 536, 630, 632, 634, 636 ‧ ‧ ultrasonic signals
540‧‧‧First cursor position
600‧‧‧Second system status
612‧‧‧Remote position change
640‧‧‧Second cursor position
642‧‧‧Voice position change
710‧‧‧Top processing unit
720‧‧‧transmitter/receiver
730, 830‧‧‧ display enclosure
740, 742‧‧‧ sensor housing
910, 920, 930, 940‧‧‧ box
第1圖為根據第一實施例的3D空間遙控器的示意圖。 第2圖為根據第二實施例的3D空間遙控器的示意圖。 第3圖為適合用於實踐各個實施例的裝置的框圖。 第4圖為適合用於實踐各個實施例的另一裝置的框圖。 第5圖為根據另一實施例的在第一位置處顯示游標。 第6圖為根據另一實施例的在第二位置處顯示游標。 第7圖為適合用於實踐各個實施例的TV配件裝置的示意圖。 第8圖為具有適合用於實踐各個實施例的內置裝置的TV的示意圖。 第9圖為執行包含在記憶體中的電腦程式指令的方法和結果的邏輯流程圖。Fig. 1 is a schematic view of a 3D space remote controller according to a first embodiment. Fig. 2 is a schematic view of a 3D space remote controller according to a second embodiment. Figure 3 is a block diagram of an apparatus suitable for use in practicing various embodiments. Figure 4 is a block diagram of another apparatus suitable for practicing various embodiments. Figure 5 is a diagram showing a cursor displayed at a first location in accordance with another embodiment. Figure 6 is a diagram showing a cursor displayed at a second location in accordance with another embodiment. Figure 7 is a schematic illustration of a TV accessory device suitable for use in practicing various embodiments. Figure 8 is a schematic illustration of a TV with built-in devices suitable for practicing the various embodiments. Figure 9 is a logic flow diagram of the method and results of executing computer program instructions contained in memory.
910、920、930、940‧‧‧框 910, 920, 930, 940‧‧‧ box
Claims (16)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410346194 | 2014-07-18 | ||
| CN201410345493 | 2014-07-18 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW201607306A TW201607306A (en) | 2016-02-16 |
| TWI549497B true TWI549497B (en) | 2016-09-11 |
Family
ID=54306152
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW104123263A TWI549497B (en) | 2014-07-18 | 2015-07-17 | Method, air mouse and smart television to control a cursor |
Country Status (2)
| Country | Link |
|---|---|
| CN (2) | CN104994414B (en) |
| TW (1) | TWI549497B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10120827B2 (en) | 2015-12-18 | 2018-11-06 | Viewmore Technologies, Inc. | Communication system with serial ports for automatically identifying device types and communication protocols and method thereof |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106990387B (en) * | 2017-05-22 | 2019-08-16 | 湖南云辙科技有限公司 | The positioning data for projection acquisition methods of guide rail band |
| CN107807360A (en) * | 2017-09-30 | 2018-03-16 | 英华达（上海）科技有限公司 | Electronic installation and its distance detection method with distance detection function |
| CN110012325A (en) * | 2019-04-19 | 2019-07-12 | 中新科技集团股份有限公司 | A kind of television set and its control system |
| CN110493625A (en) * | 2019-09-11 | 2019-11-22 | 四川长虹电器股份有限公司 | Flat panel TV remote control system and method based on camera |
| CN112614332B (en) * | 2020-12-10 | 2022-01-28 | 维沃移动通信有限公司 | Terminal control method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070115252A1 (en) * | 2004-01-30 | 2007-05-24 | Koninklijke Philips Electronics N.V. | 3-D cursor control system |
| JP2009194447A (en) * | 2008-02-12 | 2009-08-27 | Oki Electric Ind Co Ltd | Remote controller position detection device, remote controller position detection system, remote controller position detection method, and program |
| CN102779404A (en) * | 2012-06-20 | 2012-11-14 | 南洋 | Multi-control three-dimensional (3D) remote control system |
| CN102937832A (en) * | 2012-10-12 | 2013-02-20 | 广东欧珀移动通信有限公司 | Gesture capturing method and device for mobile terminal |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6717073B2 (en) * | 2000-12-29 | 2004-04-06 | Intel Corporation | Wireless display systems, styli, and associated methods |
| CN2738486Y (en) * | 2004-11-18 | 2005-11-02 | 陈先军 | Multifunction mobile telephone type remote controller |
| CN101030321B (en) * | 2006-03-01 | 2011-05-11 | 松下电器产业株式会社 | Remote controller, video apparatus, remote controlling method and system |
| CN101123675A (en) * | 2006-08-09 | 2008-02-13 | 康佳集团股份有限公司 | A method for TV set remote controller search and TV set with searchable remote controller |
| CN201639685U (en) * | 2010-01-20 | 2010-11-17 | 乐晓珊 | Television capable of finding remote controller |
| CN101866539A (en) * | 2010-05-31 | 2010-10-20 | 深圳创维－Rgb电子有限公司 | Remote control system, remotely-controlled equipment and remote controller |
| CN201750472U (en) * | 2010-06-17 | 2011-02-16 | 韩汶冀 | Remote control device for projection mobile phone |
| KR101126110B1 (en) * | 2010-06-28 | 2012-03-29 | (주)펜앤프리 | 3D image displaying system and 3D displaying method using the same |
| CN101976499A (en) * | 2010-10-11 | 2011-02-16 | 冠捷显示科技（厦门）有限公司 | Method for realizing optimal rotation angle of television screen based on ultrasonic positioning |
| CN102708672A (en) * | 2012-06-20 | 2012-10-03 | 南洋 | Single-control 3D remote control system |
-
2015
- 2015-07-08 CN CN201510399018.8A patent/CN104994414B/en active Active
- 2015-07-08 CN CN201510399212.6A patent/CN105100854B/en active Active
- 2015-07-17 TW TW104123263A patent/TWI549497B/en active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070115252A1 (en) * | 2004-01-30 | 2007-05-24 | Koninklijke Philips Electronics N.V. | 3-D cursor control system |
| JP2009194447A (en) * | 2008-02-12 | 2009-08-27 | Oki Electric Ind Co Ltd | Remote controller position detection device, remote controller position detection system, remote controller position detection method, and program |
| CN102779404A (en) * | 2012-06-20 | 2012-11-14 | 南洋 | Multi-control three-dimensional (3D) remote control system |
| CN102937832A (en) * | 2012-10-12 | 2013-02-20 | 广东欧珀移动通信有限公司 | Gesture capturing method and device for mobile terminal |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10120827B2 (en) | 2015-12-18 | 2018-11-06 | Viewmore Technologies, Inc. | Communication system with serial ports for automatically identifying device types and communication protocols and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104994414B (en) | 2018-03-20 |
| CN104994414A (en) | 2015-10-21 |
| CN105100854A (en) | 2015-11-25 |
| TW201607306A (en) | 2016-02-16 |
| CN105100854B (en) | 2018-06-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI549497B (en) | Method, air mouse and smart television to control a cursor | |
| US20160062488A1 (en) | Three-dimensional air mouse and display used together therewith | |
| US11676349B2 (en) | Wearable augmented reality devices with object detection and tracking | |
| CN101030321B (en) | Remote controller, video apparatus, remote controlling method and system | |
| US20190113966A1 (en) | Input device for ar/vr applications | |
| EP2595402B1 (en) | System for controlling light enabled devices | |
| JP3772137B2 (en) | Pointing device | |
| WO2011013418A1 (en) | Position detection device, position detection method, mobile object, and receiver | |
| US8988662B1 (en) | Time-of-flight calculations using a shared light source | |
| CN106713598B (en) | Instruction transmission method and device based on indication direction and intelligent equipment | |
| JP2014533347A (en) | How to extend the range of laser depth map | |
| US11989355B2 (en) | Interacting with a smart device using a pointing controller | |
| CN113728293A (en) | System and interface for location-based device control | |
| CA2979271A1 (en) | Wayfinding and obstacle avoidance system | |
| JP2018506940A (en) | System and method for controlling a terminal device | |
| JP2009194447A (en) | Remote controller position detection device, remote controller position detection system, remote controller position detection method, and program | |
| WO2016095641A1 (en) | Data interaction method and system, and mobile terminal | |
| US20180143317A1 (en) | Positioning device and positioning method | |
| US8276453B2 (en) | Touchless input device | |
| US20230236318A1 (en) | PERFORMANCE OF A TIME OF FLIGHT (ToF) LASER RANGE FINDING SYSTEM USING ACOUSTIC-BASED DIRECTION OF ARRIVAL (DoA) | |
| JP2008099194A (en) | Position detection apparatus, direction control system for electronic equipment, electronic equipment device, and direction control method and control program | |
| KR102523266B1 (en) | Display apparatus, display system and control method for the display system | |
| KR102089469B1 (en) | Remote Control Apparatus and Method of AVN System | |
| KR20150084756A (en) | Location tracking systme using sensors equipped in smart phone and so on | |
| CN112098929A (en) | Method, device and system for determining relative angle between intelligent devices and intelligent devices |