KR20140032782A - Method for operating a remote controller - Google Patents

Method for operating a remote controller Download PDF

Info

Publication number
KR20140032782A
KR20140032782A KR1020120099495A KR20120099495A KR20140032782A KR 20140032782 A KR20140032782 A KR 20140032782A KR 1020120099495 A KR1020120099495 A KR 1020120099495A KR 20120099495 A KR20120099495 A KR 20120099495A KR 20140032782 A KR20140032782 A KR 20140032782A
Authority
KR
South Korea
Prior art keywords
remote control
control device
movement
mode
unit
Prior art date
Application number
KR1020120099495A
Other languages
Korean (ko)
Inventor
이장희
조덕호
권육
조영주
조상현
김시진
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to KR1020120099495A priority Critical patent/KR20140032782A/en
Publication of KR20140032782A publication Critical patent/KR20140032782A/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42222Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42225User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details characterized by types of remote control, e.g. universal remote control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4227Providing Remote input by a user located remotely from the client device, e.g. at work
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2213/00Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F2213/24Interrupt

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Details Of Television Systems (AREA)

Abstract

In accordance with another aspect of the present invention, there is provided a method of operating a remote control apparatus, the method including: detecting a generation of an interrupt through an acceleration sensor in a sleep mode; And sensing the movement of the remote control apparatus and switching to the wake-up mode when the detection result satisfies a preset wake-up criterion. Accordingly, the user's operation can be minimized, malfunctions can be prevented, and operation can be performed more efficiently, thereby improving user convenience.

Description

Method for operating a remote controller

The present invention relates to a remote control apparatus and a method of operating the same, and more particularly, to a remote control apparatus and an operation method that can improve the user's ease of use.

A video display device is a device having a function of displaying an image that a user can view. The user can view the broadcast through the video display device. A video display device displays a broadcast selected by a user among broadcast signals transmitted from a broadcast station on a display. Currently, broadcasting is changing from analog broadcasting to digital broadcasting around the world.

Digital broadcasting refers to broadcasting in which digital video and audio signals are transmitted. Digital broadcasting is more resistant to external noise than analog broadcasting, so it has less data loss, is advantageous for error correction, has a higher resolution, and provides a clearer picture. Also, unlike analog broadcasting, digital broadcasting is capable of bidirectional service.

On the other hand, a remote control device or the like is used to operate the video display device. Various functions are additionally demanded for the remote control device in accordance with the diversification of the operation performed in the video display device. Therefore, various methods for enhancing user's convenience in a video display device using a remote control device have been studied.

An object of the present invention is to provide a remote control device and its operation method that can improve the user's ease of use.

In addition, another object of the present invention is to provide a remote control apparatus and a method of operating the same, which can be operated more efficiently by minimizing a user's operation and preventing a malfunction.

In accordance with another aspect of the present invention, there is provided a method of operating a remote control apparatus, the method including: detecting a generation of an interrupt through an acceleration sensor in a sleep mode; And sensing the movement of the remote control apparatus and switching to the wake-up mode when the detection result satisfies a preset wake-up criterion.

In order to achieve the above object, a method of operating a remote control apparatus according to an exemplary embodiment of the present invention may include detecting a generation of an interrupt through a sensor unit in a sleep mode, and detecting the occurrence of an interrupt through the sensor unit. Detecting the magnitude and direction of the movement and if the detected magnitude and direction of the movement of the remote controller satisfies a predetermined criterion, the pointer displayed on the image display apparatus may be controlled based on the movement of the remote controller. Switching to a pointing mode.

According to the present invention, it is possible to minimize the user's operation, to prevent malfunction, and to operate more efficiently, thereby improving the user's ease of use.

1 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.
2 is an internal block diagram of the control unit of FIG.
3 is a diagram showing a control method of the remote control apparatus of FIG.
4 is a perspective view of a remote control device according to an embodiment of the present invention.
5 is an internal block diagram of a remote control apparatus according to an embodiment of the present invention.
6 to 8 are views for explaining the operation method of the remote control device and the image display device.
9 is a flowchart illustrating a method of operating a remote control apparatus according to an embodiment of the present invention.
10 and 11 are views for explaining the operation method of the remote control apparatus according to an embodiment of the present invention.
12 is a flowchart illustrating a method of operating a remote control apparatus according to an embodiment of the present invention.
13 and 15 are views for explaining the operation method of the remote control apparatus according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the image display apparatus 100 according to an exemplary embodiment of the present invention may include a broadcast receiver 105, an external device interface 130, a storage 140, a user input interface 150, and a sensor. The controller may include a unit (not shown), a controller 170, a display 180, and an audio output unit 185.

The broadcast receiver 105 may include a tuner 110, a demodulator 120, and a network interface 135. Of course, the tuner unit 110 and the demodulation unit 120 may be provided, but the network interface unit 135 may not be included. Alternatively, the tuner unit 110 and the tuner unit 110 may be provided, And the demodulation unit 120 are not included.

The tuner unit 110 selects an RF broadcast signal corresponding to a channel selected by the user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through the antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner unit 110 can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner unit 110 can be directly input to the controller 170.

The tuner unit 110 may receive an RF broadcast signal of a single carrier according to an Advanced Television System Committee (ATSC) scheme or an RF broadcast signal of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Meanwhile, the tuner unit 110 sequentially selects RF broadcast signals of all broadcast channels stored through a channel memory function among the RF broadcast signals received through the antenna in the present invention, and sequentially selects RF broadcast signals of the intermediate frequency signal, baseband image, . ≪ / RTI >

On the other hand, the tuner unit 110 may be provided with a plurality of tuners in order to receive broadcast signals of a plurality of channels. Alternatively, a single tuner that simultaneously receives broadcast signals of a plurality of channels is also possible.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed.

The stream signal output from the demodulation unit 120 may be input to the controller 170. The control unit 170 performs demultiplexing, video / audio signal processing, and the like, and then outputs an image to the display 180 and outputs audio to the audio output unit 185.

The external device interface unit 130 can transmit or receive data with the connected external device 190. [ To this end, the external device interface unit 130 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 can be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer , And may perform an input / output operation with an external device.

The A / V input / output unit can receive video and audio signals from an external device. Meanwhile, the wireless communication unit can perform short-range wireless communication with other electronic devices.

The network interface unit 135 provides an interface for connecting the video display device 100 to a wired / wireless network including the Internet network. For example, the network interface unit 135 can receive, via the network, content or data provided by the Internet or a content provider or a network operator.

On the other hand, the network interface unit 135 can perform data communication with neighboring electronic devices in the vicinity of the video display device 100. At this time, the network interface unit 135 may receive device information of other electronic devices, channel information that can be remotely controlled by other electronic devices, frequency information, code information, and the like.

The storage unit 140 may store a program for each signal processing and control in the control unit 170 or may store the processed video, audio, or data signals.

In addition, the storage unit 140 may perform a function for temporarily storing video, audio, or data signals input to the external device interface unit 130. [ In addition, the storage unit 140 may store information on a predetermined broadcast channel through a channel memory function such as a channel map.

In addition, the storage unit 140 may store IR format key codes for controlling other electronic devices as an IR signal, and may store an IR format key database of a plurality of electronic devices.

1 shows an embodiment in which the storage unit 140 is provided separately from the control unit 170, the scope of the present invention is not limited thereto. The storage unit 140 may be included in the controller 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

(Not shown), such as a power key, a channel key, a volume key, and a set value, from the remote control apparatus 200, (Not shown) that senses a user's gesture to the control unit 170 or transmits a signal from the control unit 170 to the control unit 170 It is possible to transmit it to the sensor unit (not shown).

According to an embodiment of the present invention, the user input interface unit 150 may receive personal information from the remote control apparatus 200. In addition to the personal information, the web server information being connected by the personal information may be further received.

On the other hand, the user input interface unit 150, from the adjacent electronic device around the image display device 100, transmitted from the remote control device 200, device information of other electronic devices, channel information capable of remote control of other electronic devices Frequency information or code information may be received.

The control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner unit 110 or the demodulation unit 120 or the external device interface unit 130 so as to output the video or audio output Signals can be generated and output.

The video signal processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to the video signal. Also, the image signal processed by the controller 170 may be input to the external output device through the external device interface unit 130.

The audio signal processed by the control unit 170 may be output to the audio output unit 185 as an audio signal. The audio signal processed by the controller 170 may be input to the external output device through the external device interface unit 130. [

Although not shown in FIG. 1, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to Fig.

In addition, the control unit 170 can control the overall operation in the video display device 100. [ For example, the control unit 170 may control the tuner unit 110 to control the tuning of the RF broadcast corresponding to the channel selected by the user or the previously stored channel.

In addition, the controller 170 may control the image display apparatus 100 by a user command or an internal program input through the user input interface unit 150.

Meanwhile, the control unit 170 may control the display 180 to display an image. At this time, the image displayed on the display 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

Meanwhile, the controller 170 may generate a 3D object for a predetermined object among the images displayed on the display 180, and display the 3D object. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), EPG (Electronic Program Guide), various menus, widgets, icons, still images, moving images, and text.

On the other hand, the control unit 170 can recognize the position of the user, remote control device, or other electronic device based on the image photographed from the photographing unit (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 100 can be grasped. In addition, the x-axis coordinate and the y-axis coordinate in the display 180 corresponding to the user position can be grasped.

On the other hand, according to an embodiment of the present invention, the control unit 170 may control to log in based on the personal information received from the remote control device 200. At this time, the login may be a login of the video display apparatus 100 itself, a login to a server connected to the video display apparatus 100, or a login to a predetermined web server subscribed by personal information.

For example, when the user logs in to the video display device 100 by personal ID information and password information received from the remote controller 200, the controller 170 displays a personal screen set for each user account. The control may be displayed at 180. When there is an image being watched, the control unit 170 can control to display a personal setting screen together with the image being watched. Alternatively, it is also possible to switch the scene being watched and display it on the personal setting screen.

The control unit 170 controls the power supply unit (not shown) to turn on the power of the video display device 100 when the power of the video display device 100 is turned off in the state that the personal information is received . That is, in the standby mode, when personal information is received at the user input interface unit 150 or when there is a predetermined input, the controller 170 switches to a wake up mode, It is possible to control the power supply unit to supply power to the power supply unit.

On the other hand, the control unit 170 is received from the network interface unit 135 or the user input interface unit 150, the device information of the adjacent electronic device around the image display device 100, the channel information capable of remote control of other electronic devices On the basis of the personal information from the remote control apparatus 200 based on the frequency information or the code information, it is determined whether or not each electronic device is connected, and an object indicating that the other electronic device is logged in is displayed on the display 180. You can control the display.

Alternatively, the control unit 170 controls the remote control device 200 based on the device information of the adjacent electronic devices in the vicinity of the video display device 100, the channel information that can be remotely controlled by other electronic devices, the frequency information, The device information, the channel information, the frequency information, or the code information.

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided. The channel browsing processing unit receives the stream signal TS output from the demodulation unit 120 or the stream signal output from the external device interface unit 130 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image may be stream-decoded together with a decoded image and input to the controller 170. The control unit 170 may display a thumbnail list having a plurality of thumbnail images on the display 180 using the input thumbnail image.

At this time, the thumbnail list may be displayed in a simple view mode displayed on a partial area in a state where a predetermined image is displayed on the display 180, or in a full viewing mode displayed in most areas of the display 180. The thumbnail images in the thumbnail list can be sequentially updated.

The display 180 converts a video signal, a data signal, an OSD signal, a control signal processed by the control unit 170, a video signal, a data signal, a control signal, and the like received from the external device interface unit 130, .

The display 180 may be a PDP, an LCD, an OLED, a flexible display, or the like, and may also be capable of a 3D display.

Meanwhile, the display 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives the signal processed by the control unit 170 and outputs it as a voice.

A photographing unit (not shown) photographs the user. The photographing unit (not shown) may be implemented by a single camera, but the present invention is not limited thereto, and may be implemented by a plurality of cameras. On the other hand, the photographing unit (not shown) may be embedded in the image display device 100 on the upper side of the display 180 or may be disposed separately. The image information photographed by the photographing unit (not shown) may be input to the control unit 170.

The control unit 170 can detect the gesture of the user based on each of the images photographed from the photographing unit (not shown) or the signals sensed from the sensor unit (not shown) or a combination thereof.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. [ To this end, the remote control device 200 may be connected to a communication network such as Bluetooth, RF (Radio Frequency) communication, IR (infrared) communication, UWB (Ultra Wideband), ZigBee, Can be used.

Also, the remote control apparatus 200 can receive the video, audio, or data signal output from the user input interface unit 150. Further, the remote control device 200 can display or output audio on the remote control device 200 based on the received video, audio, or data signal.

On the other hand, the remote control device 200 according to the embodiment of the present invention can receive information by a near field communication with a predetermined electronic device. The information may be personal ID information or password information that can be used in a portable terminal, a video display device, or an electronic device, as described above.

On the other hand, the remote control device 200 can transmit the received personal information to the video display device 100. [ The communication method at this time can be an IR method or an RF method.

In the embodiment of the present invention, the remote control device 200 mainly describes a space remote control capable of displaying a pointer corresponding to the movement of the user. That is, the remote control device 200 can transmit personal information and the like to the video display device 100 using the RF method.

On the other hand, the remote control apparatus 200 may further receive the web server information or the like being connected by the personal information in addition to the personal information. For example, the mobile terminal may receive web server information about a social network service that is being logged in and accessed. Such web server information is also transmitted to the image display apparatus 100.

On the other hand, it is also possible to receive device information of other electronic devices, channel information that can be remotely controlled by other electronic devices, frequency information, code information, and the like from adjacent electronic devices in the vicinity of the video display device 100. Based on such other electronic device information, a channel, frequency, or code can be assigned to the electronic device to perform remote control.

Meanwhile, the video display device 100 may be a digital broadcast receiver capable of receiving a fixed or mobile digital broadcast.

Meanwhile, the block diagram of the image display apparatus 100 shown in FIG. 1 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display apparatus 100 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

On the other hand, the image display apparatus 100 does not include the tuner 110 and the demodulator 120 shown in FIG. 1, unlike the illustrated in FIG. 1, and the network interface unit 135 or the external device interface unit ( Through 130, the video content may be received and reproduced.

2 is an internal block diagram of the control unit of FIG.

The control unit 170 includes a demultiplexing unit 310, an image processing unit 320, a processor 330, an OSD generating unit 340, a mixer 345, A frame rate conversion unit 350, and a formatter 360. [0031] A voice processing unit (not shown), and a data processing unit (not shown).

The demultiplexer 310 demultiplexes the input stream. For example, when an MPEG-2 TS is input, it can be demultiplexed into video, audio, and data signals, respectively. The stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110 or the demodulator 120 or the external device interface 130.

The image processing unit 320 may perform image processing of the demultiplexed image signal. For this, the image processing unit 320 may include a video decoder 325 and a scaler 335.

The video decoder 325 decodes the demultiplexed video signal and the scaler 335 performs scaling so that the resolution of the decoded video signal can be output from the display 180.

The video decoder 325 can include a decoder of various standards.

The processor 330 may control the overall operation in the image display apparatus 100 or in the control unit 170. [ For example, the processor 330 may control the tuner 110 to select a channel selected by the user or an RF broadcast corresponding to a previously stored channel.

In addition, the processor 330 may control the image display apparatus 100 by a user command or an internal program input through the user input interface unit 150. [

In addition, the processor 330 may perform data transfer control with the network interface unit 135 or the external device interface unit 130.

The processor 330 may control operations of the demultiplexing unit 310, the image processing unit 320, the OSD generating unit 340, and the like in the controller 170.

The OSD generator 340 generates an OSD signal according to a user input or itself. For example, based on a user input signal, a signal for displaying various information in a graphic or text form on the screen of the display 180 can be generated. The generated OSD signal may include various data such as a user interface screen of the video display device 100, various menu screens, a widget, and an icon. In addition, the generated OSD signal may include a 2D object or a 3D object.

The OSD generating unit 340 can generate a pointer that can be displayed on the display based on the pointing signal input from the remote control device 200. [ In particular, such a pointer may be generated by a pointing signal processing unit, and the OSD generating unit 240 may include such a pointing signal processing unit (not shown). Of course, a pointing signal processing unit (not shown) may be provided separately from the OSD generating unit 240.

On the other hand, in the embodiment of the present invention, the OSD generating unit 340 can generate or configure a set personal screen when the image display apparatus 100 itself is logged in. Alternatively, when logging in to the connected server, the OSD generating unit 340 may generate or configure at least a part of the server connection screen so that the server connection screen received from the server is displayed on the display 180. [ Alternatively, the OSD generating unit 340 may generate or configure at least a part of the web server connection screen based on the web server information being accessed by the personal information.

The mixer 345 may mix the OSD signal generated by the OSD generator 340 and the decoded video signal processed by the image processor 320. At this time, the OSD signal and the decoded video signal may include at least one of a 2D signal and a 3D signal. The mixed video signal is supplied to a frame rate converter 350.

A frame rate converter (FRC) 350 can convert the frame rate of an input image. On the other hand, the frame rate converter 350 can output the frame rate without conversion.

The formatter 360 receives the mixed signal from the mixer 345, that is, the OSD signal and the decoded video signal, and changes the format of the signal to be suitable for the display 180 and outputs the signal. For example, the R, G, and B data signals may be output as low voltage differential signaling (LVDS) signals or mini-LVDS signals.

On the other hand, the formatter 360 can separate the 2D video signal and the 3D video signal for 3D video display. It is also possible to change the format of the 3D video signal or convert the 2D video signal to the 3D video signal.

On the other hand, the audio processing unit (not shown) in the control unit 170 can perform the audio processing of the demultiplexed audio signal. To this end, the voice processing unit (not shown) may include various decoders.

In addition, the audio processing unit (not shown) in the control unit 170 can process a base, a treble, a volume control, and the like.

The data processing unit (not shown) in the control unit 170 can perform data processing of the demultiplexed data signal. For example, if the demultiplexed data signal is a coded data signal, it can be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel.

2, a signal from the OSD generating unit 340 and the image processing unit 320 is mixed in a mixer 345 and then 3D processed in a formatter 360. However, the present invention is not limited to this, May be located behind the formatter.

Meanwhile, the block diagram of the controller 170 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram can be integrated, added, or omitted according to the specifications of the control unit 170 actually implemented.

In particular, the frame rate converter 350 and the formatter 360 are not provided in the controller 170, but may be separately provided.

The video display device 100 according to an embodiment of the present invention can receive a voice signal from a remote control device or the like and can receive an audio signal received through an embedded voice recognition engine (not shown) Can be performed.

On the other hand, the image display apparatus 100 may include a voice database for storing data used for voice recognition in the voice recognition engine or in a storage unit outside the voice recognition engine.

The voice database may include an acoustic model database and a language model database that can store an acoustic model and a language model and store an acoustic model and a language model, respectively.

The voice database may further include a pronunciation dictionary database for storing vocabularies and corresponding pronunciation symbols. According to an embodiment, the speech recognition engine may further comprise a pronunciation symbol generation module for generating a pronunciation symbol from the received text data.

The speech recognition engine processes the received voice signal, and outputs the voice recognition result data by comparing the data with data stored in the voice database. On the other hand, the video display device 100 can perform various operations such as menu selection, text input, command input, and channel switching based on the output speech recognition result data.

3 is a diagram showing a control method of the remote control apparatus of FIG.

3 (a), it is exemplified that the pointer 180 corresponding to the remote control device 200 is displayed on the display 180. As shown in FIG.

The user can move or rotate the remote control device 200 up and down, left and right (FIG. 3 (b)), front and rear (FIG. 3 (c)). The pointer 205 displayed on the display 180 of the video display device corresponds to the movement of the remote control device 200. [ The remote control apparatus 200 may be referred to as a spatial remote controller (or pointing device) since the corresponding pointer 205 is moved and displayed according to the movement in the 3D space as shown in the figure.

3B illustrates that when the user moves the remote control apparatus 200 to the left, the pointer 205 displayed on the display 180 of the image display apparatus also shifts to the left corresponding thereto.

Information on the motion of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the image display device. The image display apparatus can calculate the coordinates of the pointer 205 from the information on the motion of the remote control apparatus 200. [ The image display apparatus can display the pointer 205 so as to correspond to the calculated coordinates.

3C illustrates a case where the user moves the remote control device 200 away from the display 180 while the specific button in the remote control device 200 is depressed. Thereby, the selected area in the display 180 corresponding to the pointer 205 can be zoomed in and displayed. Conversely, when the user moves the remote control device 200 close to the display 180, the selection area within the display 180 corresponding to the pointer 205 may be zoomed out and zoomed out. On the other hand, when the remote control device 200 moves away from the display 180, the selection area is zoomed out, and when the remote control device 200 approaches the display 180, the selection area may be zoomed in.

On the other hand, when the specific button in the remote control device 200 is pressed, it is possible to exclude recognizing the up, down, left, and right movement. That is, when the remote control device 200 moves away from or near the display 180, the up, down, left and right movements are not recognized, and only the front and back movements can be recognized. Only the pointer 205 is moved in accordance with the upward, downward, leftward, and rightward movement of the remote control device 200 in a state where the specific button in the remote control device 200 is not pressed.

On the other hand, the moving speed and moving direction of the pointer 205 may correspond to the moving speed and moving direction of the remote control device 200.

FIG. 4 is a perspective view of a remote control apparatus according to an embodiment of the present invention, and FIG. 5 is an internal block diagram of a remote control apparatus.

Referring to FIG. 4, the spatial remote controller 201 according to an embodiment of the present invention may include various input keys, input buttons, and the like.

For example, the spatial remote controller 201 may include an Okay key 291, a menu key 292, a four direction key 293, a channel adjustment key 294, and a volume adjustment key 296 have.

For example, the Okay key 291 may be used to select a menu or item, the menu key 292 may be used to display a predetermined menu, and the four direction keys 293 may be used to select a pointer or an indicator, The channel adjustment key 294 can be used for channel up and down adjustment, and the volume adjustment key 296 can be used for volume up and down adjustment.

In addition, the spatial remote controller 201 may further include a back key 297 and a home key 298. For example, the back key 297 may be used when moving to the previous screen, and the home key 298 may be used when moving to the home screen.

On the other hand, as shown in the figure, the confirmation key 291 may be added with a scroll function. For this, the confirmation key 291 can be implemented as a wheel key. That is, when the OK key 291 is pressed, it is used as a menu or item selection. When the OK key 291 is scrolled up and down, a display screen scrolling or a list page switching can be performed.

In detail, when an image larger than the size of the display is displayed on the display unit 180, when the confirmation key 291 is scrolled to search for the corresponding image, an image area not currently displayed on the display is displayed on the display. As another example, when the list page is displayed on the display unit 180, the previous page or the next page of the current page can be displayed by scrolling the OK key 291. [

This scroll function may be provided with a separate key other than the confirmation key 291. [

On the other hand, the four directional keys 293 can be arranged in four directions in the circular type, as shown in the figure, up, down, left, and right keys. Touch input to the four directional keys 293 may also be possible. For example, if there is a touch operation from the up key to the down key in the direction key 293, the set function may be inputted or performed according to the corresponding touch input.

Referring to FIG. 5, the remote control apparatus 200 includes a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, a power supply unit 260, and a storage unit 270. It may include a control unit 280.

The wireless communication unit 220 transmits / receives signals to / from any one of the video display devices according to the embodiments of the present invention described above. Of the video display devices according to the embodiments of the present invention, one video display device 100 will be described as an example.

In this embodiment, the remote control apparatus 200 may include an RF module 221 capable of transmitting and receiving signals with the image display apparatus 100 according to the RF communication standard. Also, the remote control apparatus 200 may include an IR module 223 capable of transmitting and receiving signals with the image display apparatus 100 according to the IR communication standard.

Further, the remote control device 200 may further include an NFC module (not shown) for short-range magnetic field communication with the electronic device.

The remote control device 200 can transmit a signal containing information on the motion and the like of the remote control device 200 to the image display device 100 through the RF module 221.

Also, the remote control device 200 can receive the signal transmitted by the video display device 100 through the RF module 221. [ Also, the remote control device 200 can transmit commands to the video display device 100 via the IR module 223, such as power on / off, channel change, volume change, and the like, as needed.

On the other hand, according to the present embodiment, the remote control device 200 can receive personal information by a near field communication with a predetermined electronic device.

On the other hand, the remote control device 200 can transmit the received personal information to the video display device 100. [ The communication method at this time can be an IR method or an RF method.

On the other hand, the remote control device 200 can receive device information of other electronic devices, channel information that can be remotely controlled by other electronic devices, frequency information, code information, and the like. Based on such other electronic device information, a channel, frequency, or code can be assigned to the electronic device to perform remote control.

The user input unit 230 may include a keypad, a key (button), a touch pad, or a touch screen. The user can input a command related to the image display apparatus 100 to the remote control apparatus 200 by operating the user input unit 230. [ When the user input unit 230 has a hard key button, the user can input a command related to the image display device 100 to the remote control device 200 through the push operation of the hard key button. When the user input unit 230 has a touch screen, the user can touch a soft key of the touch screen to input a command related to the image display apparatus 100 to the remote control apparatus 200. [ In addition, the user input unit 230 may include various types of input means such as a scroll key, a jog key, and the like that can be operated by the user, and the present invention does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 and / or an acceleration sensor 243.

The gyro sensor 241 can detect the angular velocity and sense information about the motion of the remote control device 200. [ For example, the gyro sensor 241 can sense information about the operation and posture of the remote control device 200 based on the x, y, and z axes.

The acceleration sensor 243 can sense the force and the direction, and can sense information on the moving speed and the like of the remote control device 200.

On the other hand, it may further include a distance measuring sensor, whereby the distance to the display 180 can be sensed. In addition, a separate tilt sensor may be further included. Alternatively, it can detect the amount of change in orientation by including a geomagnetic sensor that can detect the direction of the magnetic field generated by the earth and detect the orientation like a compass.

The output unit 250 may output an image or voice signal corresponding to the operation of the user input unit 230 or corresponding to the signal transmitted from the image display apparatus 100. The user can recognize whether the user input unit 230 is operated or whether the image display apparatus 100 is controlled through the output unit 250.

For example, the output unit 250 includes an LED module 251 that is turned on when the user input unit 230 is operated or a signal is transmitted and received between the image display device 100 and the image display device 100 through the wireless communication unit 225, 253 for outputting sound, an acoustic output module 255 for outputting sound, or a display module 257 for outputting an image.

The power supply unit 260 supplies power to the remote control device 200. The power supply unit 260 can reduce power consumption by stopping the power supply when the remote controller 200 is not moving for a predetermined period of time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for the control or operation of the remote control apparatus 200. [ When the remote control device 200 wirelessly transmits and receives a signal through the image display device 100 and the RF module 221, the remote control device 200 and the image display device 100 transmit signals through a predetermined frequency band Send and receive. The control unit 280 of the remote control device 200 stores information on a frequency band or the like capable of wirelessly transmitting and receiving signals with the image display device 100 paired with the remote control device 200 in the storage unit 270. Reference may be made.

In addition, the storage unit 270 may store IR format key codes for controlling other electronic devices as an IR signal, and may store IR format key databases of a plurality of electronic devices.

The control unit 280 controls various matters related to the control of the remote control device 200. [ The controller 280 transmits a signal corresponding to a predetermined key manipulation of the user input unit 230 or a signal corresponding to the movement of the remote controller 200 sensed by the sensor unit 240 through the wireless communication unit 225. 100 can be sent.

The controller 280 may control the received personal information to be transmitted to the image display apparatus 100 through the wireless communication unit 220 through an electronic device and near field communication. In particular, when there is a predetermined key input by the user input unit 230, the controller 280 may control the received personal information to be transmitted to the image display apparatus 100 through the wireless communication unit 220.

In addition, the controller 280 may control the received personal information to be transmitted to other electronic devices other than the image display apparatus 100. At this time, it is possible to use different channels, frequencies or codes corresponding to each electronic device. Such a channel, frequency, or code may be based on device information from another electronic device, remotely controllable channel information, frequency information, or code information.

The user input interface unit 150 of the image display apparatus 100 includes a wireless communication unit 211 capable of wirelessly transmitting and receiving signals to and from the remote control apparatus 200 and a pointer corresponding to the operation of the remote control apparatus 200. [ And a coordinate value calculation unit 215 that can calculate the coordinate values of the coordinate values.

The user input interface unit 150 can wirelessly transmit and receive signals to and from the remote control device 200 through the RF module 212. [ Also, the remote control device 200 can receive a signal transmitted through the IR module 213 according to the IR communication standard.

The coordinate value calculation unit 215 corrects the camera shake or error from the signal corresponding to the operation of the remote control device 200 received via the wireless communication unit 211 and outputs the coordinate values x, y) can be calculated.

The transmission signal of the remote control device 200 inputted to the image display device 100 through the user input interface unit 150 is transmitted to the control unit 180 of the image display device 100. [ The control unit 180 can determine the information about the operation of the remote control device 200 and the key operation from the signal transmitted from the remote control device 200 and control the video display device 100 accordingly.

As another example, the remote control device 200 may calculate the pointer coordinate value corresponding to the operation and output it to the user input interface unit 150 of the video display device 100. [ In this case, the user input interface unit 150 of the image display apparatus 100 may transmit information on the received pointer coordinate values to the control unit 880 without any additional shaking or error correction process.

Alternatively, as another example, the coordinate value calculating unit 215 may be provided in the control unit 170 instead of the user input interface unit 150, unlike the drawing.

6 to 8 are views for explaining the operation method of the remote control device and the image display device.

6 and 7 are flowcharts illustrating an operation method of a remote control apparatus and an image display apparatus when an interrupt is generated by a key button input of the remote control apparatus and a change from the sleep mode to the wake-up mode occurs.

When the remote controller is in the sleep mode, the user can lift the remote controller and press any key button to perform operations such as volume or channel manipulation of the image display apparatus through the remote controller.

Referring to the drawings, the remote controller 200 is in a sleep state to minimize the driving power of the battery when not in operation (S610),

The sleep mode (or sleep state) may be a state in which each component in the remote controller 200 is in operation only for detecting the occurrence of an interrupt.

Alternatively, the sleep mode may mean a state in which only the mode conversion process that performs the function of switching the wake-up mode to the remote control device 200 without performing operations such as communication with other electronic devices have.

Alternatively, the sleep mode may be a state in which some of the sensors for sensing the motion of the remote control device and the wireless communication unit are deactivated and only some of the components are activated so as to be able to switch to the wake-up mode.

Therefore, in the sleep mode state, driving power for sensing and / or communication operations is not required, so that a minimum amount of power can be consumed.

The wake-up mode may mean a state in which other components in the remote control device are activated for normal operation of the remote control device. On the other hand, the wake-up mode may also be referred to as a normal mode.

In the sleep mode state, if there is an input for a general key button such as a volume control key button provided in the remote control apparatus 200 of the user (S620), the remote control apparatus 200 is input to the image display apparatus 100. A key code corresponding to the key button may be transmitted (S630).

In this case, the remote control device 200 can detect the occurrence of a key button interrupt generated as an input to the key button, and activate a component necessary for transmission of the key code.

On the other hand, the video display device 100 receives a key code (S710), and if normally received, transmits a response signal (Ack) to the remote control device 200 (S720).

The image display apparatus 100 performs an operation corresponding to the received key code, for example, a volume operation (S730).

Meanwhile, when the response signal Ack is received, the remote controller 200 may enter the sleep mode again, and if it is not received, the remote controller 200 may retransmit the key code (S540).

On the other hand, since the operation of the remote control apparatus 200 by the normal key button input is sure that the user intends to use the remote control apparatus 200 when the user presses the key button, it is possible to switch between the sleep mode and the wake-up mode. It is not a big problem, and when a key button is pressed, a corresponding operation may be performed.

Meanwhile, as described above with reference to FIGS. 1 to 5, according to the present invention, another electronic device may be controlled by a movement and a pointing signal of the remote controller.

In this case, the operation of the sensors is required to detect the movement of the remote controller, and the data sensed by the sensors and the data transmitted to the electronic device are more complicated than the key codes. Thus, not only is the operation in the wake-up mode more complicated than the operation at the normal key button input, but also consumes more power because many components in the remote control device operate. Therefore, there is a further need for an efficient sleep mode and wake-up mode switching method.

8 is a pointing point for controlling the image display apparatus 100 according to a pointing signal based on the movement of the remote control apparatus 200, in more detail, the remote controller 200 is switched from the sleep mode to the wake-up mode. One example of switching to a mode (pointing mode) is shown.

When in the wake-up mode, the spatial remote control, which transmits a signal via RF, is also operated by holding the remote control in a sleep state and pressing an arbitrary key button as described with reference to FIGS. 6 and 7. Or, as shown below, by pressing the OK button, a pointer appears on the screen of the image display device and can be used while moving the space remote controller.

Referring to FIG. 8, if there is an OK key button input of the remote control apparatus 200 (S810), the remote control apparatus 200 transmits a key code corresponding to the OK key button input to the image display apparatus 100 ( In operation S820, a response signal (Ack signal) is received from the image display apparatus 100. (S830)

On the other hand, when the image display apparatus 100 receives a key code corresponding to the input of the OK key button, the image display apparatus 100 displays a pointer on the screen of the display 180, or thereafter, displays the pointer when receiving a signal from the remote controller 200. can do.

When the remote control apparatus 200 receives the response signal (Ack signal), the remote control apparatus 200 switches to the pointing state capable of controlling the pointer displayed on the screen of the display 180 (S840).

Thereafter, the remote controller 200 senses the movement of the remote controller through the sensor unit 240 (S845) and outputs a signal based on the movement of the remote controller detected through the sensor unit 240 to display the image display device ( 100) (S860).

The image display apparatus 100 performs an operation corresponding to the input of the user based on the received signal (S880). Here, the operation corresponding to the input of the user corresponds to the motion input of the remote controller. The feedback may be displayed by moving the pointer, for example.

On the other hand, the image display device 100 may transmit a response signal (Ack signal) to the remote control device 200 even when receiving a signal based on the movement of the remote control device (S870).

As described above, in the case of using the remote control device 200 using the pointing, a pointer appears on the image display device screen only when the user lifts the remote control device 200 and presses the OK key button, and the remote control device ( It is used while moving 200).

However, even when the user wakes up to the pointing mode to control the TV by using pointing instead of the wake-up mode by the normal key button, the pointer appears on the TV screen only after pressing the OK key button. It is inconvenient to perform an operation such as controlling the TV menu while moving 200 up, down, left, and right.

Therefore, the present invention can facilitate the usability by causing the pointer to appear in advance on the TV only by the operation of lifting the remote control device 200 and switching to the wake-up mode, more specifically, the pointing mode.

9 is a flowchart illustrating a method of operating a remote control apparatus according to an embodiment of the present invention. 10 and 11 are views for explaining the operation method of the remote control apparatus according to an embodiment of the present invention.

Referring to FIG. 9, first, in a sleep mode, the remote controller 200 detects an interrupt generated through the sensor unit 240, in particular, an interrupt generated through the acceleration sensor 243. (S910)

Meanwhile, the acceleration sensor 243 detects dynamic force such as acceleration and vibration, and uses an application principle of inertial force and electric deformation. The acceleration sensor 243 may detect whether an object moves or a motion state.

On the other hand, if the interrupt occurs by the key button will normally operate as in the example described with reference to FIG.

Since the remote control apparatus 200 normally operates only a mode conversion process for converting to a wake-up mode, the remote control apparatus 200 may operate in a sleep mode using minimal power.

That is, in the sleep mode state, only a part of the user input unit 230 and the sensor unit 240 may be activated to a minimum state in order to detect an interrupt occurrence, thereby minimizing power consumption.

On the other hand, the sensor unit 240 can know whether the interrupt occurs through the sensor. For example, when the acceleration sensor 243 detects the movement of the remote controller 200 in the sleep mode state, a motion detection interrupt is generated.

Meanwhile, the controller 280 may be activated by generating a motion detection interrupt, or the controller 280 may also be activated when only a minimum block is activated in the sleep mode and an interrupt is detected.

The controller 280 may control the remote controller 200 to switch to the wake-up mode when an interrupt through the acceleration sensor 243 occurs.

In this case, the acceleration sensor 243 detects an operation in which the user lifts the remote control device 200 and, accordingly, may switch to the wake-up mode so that the user may point. That is, only the operation of lifting the user's remote control device 200 may be switched to the wake-up mode.

By detecting the movement of the remote control device 200 to eliminate the inconvenience of the user pressing the OK button, it is possible to set the settings of the remote control device 200 to operate in advance only by lifting the remote control device 200.

That is, the remote control apparatus 200 according to an embodiment of the present invention recognizes a movement of grabbing the remote control apparatus 200 when the user wants to use the remote control apparatus 200 to interrupt the acceleration sensor 243. Generates (Interrupt) to perform Auto Wake-up.

Alternatively, the controller 280 detects the movement of the remote controller 200 through the acceleration sensor 243 for a predetermined time T after the interrupt is generated (S920), and the detection result through the acceleration sensor 243. When the preset satisfies a predetermined wake-up criterion (S930), the remote controller 200 may control to switch to the wake-up mode.

Meanwhile, when the wake-up criterion is satisfied, the remote control apparatus may move within the predetermined time.

Therefore, according to one embodiment of the present invention, when the remote control device 200 is moved to generate an interrupt through the acceleration sensor 243, and the remote control device 200 moves within a predetermined time T. You can switch to wake-up mode.

When switching to the wake-up mode immediately when an interrupt occurs through the acceleration sensor 243, that is, when the first movement of the remote controller 200 is detected, the switch to the wake-up mode is remotely controlled in the sleep mode. The fact that the device 200 has moved alone makes it difficult to determine whether the user has moved the remote control device 200 or is willing to operate the remote control device. In addition, there is no distinction of external impact, lifting, lowering, falling, etc., and no directivity.

For example, even if the user touches the remote control device 200 while cleaning, the remote control device 200 may move, thereby causing an interrupt.

In this case, even if the user does not intend to use the remote control device 200, the remote control device 200 may be switched to the wake-up mode, not only causing waste of power, but also needlessly displaying a pointer on the screen.

Therefore, the controller 280 detects the movement of the remote controller 200 through the acceleration sensor 243 for a predetermined time T after the interrupt is generated, so that the movement of the additional or continuous remote controller 200 may be continuously performed. If detected, the user may determine that the user intends to use the remote control apparatus 200 to switch to the wake-up mode.

The predetermined time T is a reference time for determining an interrupt occurrence irrespective of a user's intention, and the predetermined time T determines whether a kind of wake-up mode switching grace case is provided. It may be an additional judgment time.

The predetermined time T may be any value between about 0.5 to 1 second, or any reference time by a user setting, and may be set by a manufacturer or a user.

According to the present invention, by having an additional determination criterion of a predetermined time T, it is possible to determine whether the interrupt generation is due to an event irrelevant to the user's intention or the intended operation.

10 is a view schematically illustrating the movement of the remote control device in the horizontal axis and the time in the vertical axis.

Referring to FIG. 10A, the acceleration sensor 243 detects movements 1010 and 1020 of the remote control apparatus 200 in the sleep mode to generate an interrupt. When the interruption occurs, it has an additional determination interval for a predetermined time T.

The acceleration sensor 243 is a remote control device continuous to additional operations or movements 1010 and 1020 other than the movements 1010 and 1020 of the remote control device 200 which generated the interrupt within the predetermined time T. 200 to detect whether or not the operation.

As shown in FIG. 10A, when the remote controller 200 does not move within the predetermined time T, that is, when the remote controller 200 is in a stop state for a predetermined time T, the remote controller 200 returns to the sleep mode.

As shown in (b) of FIG. 10, when the movement of the remote control apparatus 200 is detected within the predetermined time T, the controller switches to the wake-up mode.

On the other hand, as shown in Figure 10 (c), the movement of the remote control device 200 within the predetermined time (T) may be discontinuous.

The wake-up mode may be a pointing mode that can control the pointer displayed on the image display apparatus 100 based on the movement of the remote controller 200. In this case, upon receiving a signal from the remote controller 200 that the switch is in the wake-up mode, the image display apparatus 200 may display a pointer on the display 180 to prepare the user for controlling the pointer. .

According to the present invention, the convenience of usability can be improved by setting a setting of the remote controller so that the user can operate in advance before using a button such as OK by detecting the motion of the remote controller 200. In addition, for cleaning or other reasons, the remote control device 200 can prevent the unintentional movement, such as bumping or falling, it is possible to further improve the usability.

Meanwhile, the controller 280 may be activated by generating a motion detection interrupt, or the controller 280 may also be activated when a minimum block is detected in the sleep mode and an interrupt is detected.

Meanwhile, when the wake-up criterion is satisfied, the data based on the movement of the remote controller detected by the acceleration sensor may be a predetermined value or more. In other words, it may be switched to the wake-up mode only when the movement of the remote controller is greater than the reference value during the predetermined period.

On the other hand, the step of switching to the wake-up mode (S940), the gyro sensor 241 of the remote control device 200 and the wireless communication unit 220, in particular to activate the RF module 221 for transmitting sensing data. You can do

For example, when the acceleration sensor 243 detects the movement of the remote controller 200 in the sleep mode and the remote controller 200 moves to generate an interrupt through the acceleration sensor 243, the controller All or part of 280 may be activated.

In addition, when the movement of the remote controller 200 is detected within the predetermined time T, the controller 280 may switch the remote controller 200 to the wake-up mode.

Alternatively, the step (S940) of switching to the wake-up mode may be characterized by activating the RF module 221 transmitting the sensing data, in particular, the sensing data of the remote control apparatus 200.

For example, in the sleep mode, the sensor unit 240 detects the movement of the remote control device 200, and then the remote control device 200 moves to the sensor unit 240, in particular, the acceleration sensor 243. When an interrupt occurs, all or part of the controller 280 may be activated.

In addition, when the movement of the remote controller 200 is detected within the predetermined time T, the controller 280 may switch the remote controller 200 to the wake-up mode.

Alternatively, when the acceleration sensor 243 detects the movement of the remote control device 200 in the sleep mode and the remote control device 200 moves to generate an interrupt through the acceleration sensor 243, the control unit 280 ) May activate all or part of the gyro, and activate the gyro sensor 241.

In addition, in the detecting of the movement of the remote control apparatus 200 (S920), the movement of the remote control apparatus 200 may be detected through a gyro sensor 241 and the acceleration sensor 243. Can be. In this case, the movement pattern of the remote control apparatus 200 may be analyzed to determine whether to enter the wake-up mode.

For example, when the wake-up criterion is satisfied, the movement of the remote controller detected by the gyro sensor and the acceleration sensor may correspond to a predetermined pattern.

Alternatively, when the wake-up criterion is satisfied, the wake-up criterion may be a case where at least one of the criteria set on the direction, intensity, and number of times of shaking the remote controller is satisfied.

Meanwhile, the period in which the controller 280 acquires data from the acceleration sensor 243 for the predetermined time T may be different from that in the wake-up mode (normal operation mode).

For example, the cycle can be shortened, i.e., the data can be taken at a faster interval to quickly determine the transition to the wake-up mode.

Alternatively, since the data of the same level as the wake-up mode is not necessary, only enough information may be obtained by extending the period to determine only the additional movement of the remote control apparatus 200.

On the other hand, the operation method of the remote control apparatus according to an embodiment of the present invention may further comprise the step of entering a voice recognition mode that can be input voice through the remote control device.

11 is a diagram referred to for describing a voice recognition mode according to an embodiment of the present invention.

Referring to FIG. 11, when entering the voice recognition mode, a guide message 1120 may be further displayed in addition to the channel image 1110 being viewed.

The guide message 1120 may include a help for inputting a voice command, for example, "Help me say a command. Please check if you do not cover the microphone of the remote control."

On the other hand, the image display apparatus 100 according to an embodiment of the present invention, can receive a voice signal, the voice for the voice signal received through the embedded (rembedded) speech recognition engine (not shown) provided therein Recognition can be performed.

On the other hand, the image display apparatus 100 may include a voice database for storing data used for voice recognition in the voice recognition engine or in a storage unit outside the voice recognition engine.

The voice database may include an acoustic model database and a language model database that can store an acoustic model and a language model and store an acoustic model and a language model, respectively.

The image display apparatus 100 may receive a voice signal input by the user through the remote control apparatus 200 to recognize the voice input and perform a corresponding operation.

For example, when a user inputs “Kbc” through a microphone of a remote controller as shown in FIG. 11, the user may recognize the input voice signal and switch to a channel “Kbc” that matches.

On the other hand, the voice recognition mode may be entered in a variety of ways, such as pressing one of the hard keys provided on the remote control device 200, or selecting a menu displayed on the display 180.

Alternatively, according to an embodiment of the present invention, the remote control apparatus 200 may enter the wake-up mode and display the pointer 205 as well as automatically enter the voice recognition mode.

In addition, in addition to the voice recognition mode, the remote controller 200 may enter a ready state for additional operations.

On the other hand, the operation method of the remote control device according to an embodiment of the present invention is to switch to the sleep mode when the movement of the remote control device is not detected or a motion stop signal is received from the image display device. It may further comprise a step.

That is, when the remote control device 200 stops movement for a predetermined time during use, the remote controller 200 may switch to the sleep mode to reduce power consumption.

Alternatively, the image display apparatus 100 also transmits a motion stop signal to the remote controller 200 when the data regarding the movement of the remote controller 200 is not received for a predetermined time, for example, 5 seconds, and the motion stop signal. Receiving the remote control device 200 may switch to the sleep mode to reduce power consumption.

Since the remote control device 200 is capable of bidirectional communication with the TV using the RF 221, it transmits a motion stop signal from the TV to prevent it when not in use, during cleaning, or against unintentional movement. By controlling the remote control device 200, it is possible to further improve the convenience and efficiency of use of the remote control device 200.

Meanwhile, the operation method of the remote control apparatus according to the present invention may further include transmitting a signal based on the movement of the remote control apparatus to the image display apparatus. In other words, when the user enters the pointing state, the sensing data of the sensor unit 240 is transmitted to the image display apparatus 100 so that the user can point the image display apparatus 100 and the remote control apparatus 200. Can be used intuitively

12 is a flowchart illustrating a method of operating a remote control apparatus according to an embodiment of the present invention, and FIGS. 13 and 15 are views for explaining a method of operating the remote control apparatus according to an embodiment of the present invention. .

Referring to FIG. 12, in a method of operating a remote control apparatus according to an embodiment of the present disclosure, in the sleep mode, detecting an occurrence of an interrupt through the sensor unit 240 (S1210), Detecting a magnitude and a direction of the movement of the remote control apparatus 200 through the sensor unit 240 (S1220), and the preset magnitude and direction of the detected movement of the remote control apparatus 200 based on a preset reference; If satisfied (S1230), switching the pointer displayed on the image display apparatus 100 to a pointing mode that can be controlled based on the movement of the remote control apparatus 200 (S1240). Can be.

Thereafter, in a pointing mode, the method may further include transmitting a signal based on the movement of the remote control apparatus 200 to the image display apparatus, thereby controlling the pointer with the remote control apparatus 200, and controlling the image. The display device 100 can be controlled.

Meanwhile, in the detecting of the magnitude and direction of the movement of the remote control apparatus 200 (S1220), the movement of the remote control apparatus 200 may be detected through a gyro sensor 241 and an acceleration sensor 243. You can do

On the other hand, the step of switching to the pointing mode (S1240), it may be characterized in that to activate the wireless communication unit 220, in particular the RF module 221 for transmitting the sensing data of the remote control device 200.

For example, in the sleep mode, the sensor unit 240 detects the movement of the remote control device 200, and then the remote control device 200 moves to the sensor unit 240, in particular, the acceleration sensor 243. When an interrupt occurs, all or part of the controller 280 may be activated.

In addition, the controller 280 detects the magnitude and direction of the movement of the remote control apparatus 200 for a predetermined time and detects the movement of the remote control apparatus 200 corresponding to a preset reference. 200 may be switched to the pointing mode.

On the other hand, when the predetermined criterion is satisfied, a case in which the magnitude of the movement in the predetermined reference axis direction among the movements of the remote control apparatus 200 may be equal to or greater than a predetermined magnitude.

The remote control apparatus 200 according to the present invention may sense the movement of the X, Y, and Z axes. On the other hand, it can be used as a reference for mode switching by reflecting only at least one reference axis movement in the movement of the X, Y, Z axis.

For example, referring to FIG. 13, when the remote control apparatus 200 moves, the motion components in the X and Y axis directions may be analyzed. Among them, it may be set to switch to the pointing mode when the movement amount in the X-axis direction is larger than the reference value. Alternatively, it may be determined based on two axial movements.

When the predetermined criterion is satisfied, it may correspond to a case in which the movement of the remote controller corresponds to a predetermined pattern. The predetermined pattern may be set by the manufacturer or the user as a pattern for wake-up.

For example, when a pattern for reciprocating the remote controller 200 to the left and right is inputted, a pointing mode may be entered.

In addition, the case of satisfying the predetermined criterion may be a case of satisfying at least one of the criteria set with respect to the direction, intensity, and number of times of shaking the remote controller.

For example, referring to FIG. 14, when the shaking direction is shaken from side to side, when the intensity moves at an intensity greater than or equal to d, and the number is more than N times, the pointing mode entry condition may be set. In addition, it may be possible to set two of the three conditions as reference conditions or set all three.

On the other hand, the above described mainly the pattern for reciprocating the remote control device 200 to the left and right, but the present invention is not limited thereto.

For example, as shown in FIG. 15, it may be set based on an operation pattern such as writing 'Z' using the remote control apparatus 200.

According to this embodiment, by analyzing the motion information of the remote control device 200 input on the three-dimensional space can recognize the user's motion, when the user wants to use the remote control device 200 When the shake is taken, the display mode is switched to the pointing mode, and a pointer may be displayed on the image display apparatus 100.

Since the motion of the remote control apparatus 200 is recognized by dividing the motion, intensity, and repeatability into three items, it is possible to filter out uncertain information such as unintentional movement.

The accelerometer 243 of the remote controller 200 activates the remote controller 200 by sensing the acceleration intensity and simultaneously displays a pointer even when the remote controller 200 is not intentionally moved. There may be inconvenience such as displaying a pointer.

Therefore, this embodiment uses additional pattern recognition other than the detection of the acceleration sensor 241 as a reference condition.

  For example, the external shock to the remote control device 200 by setting a combination of motion discrimination by left / right, up / down motion axis, distinguishing how hard the wave is shaken, and distinguishing how many times it is shaken. If this is added or the remote control device 200 is collapsed, filtering for various other motions is possible.

According to the present invention, it is possible to operate quickly by detecting and executing a motion of a user without inputting a key button of a separate remote control apparatus 200. In addition, since the directionality, intensity, and repeatability of the movement of the remote control apparatus 200 are recognized, malfunctions can be prevented.

On the other hand, in the present embodiment, as described with reference to Figure 11, it may further comprise the step of entering the voice recognition mode that is capable of voice input through the remote control device.

According to the present invention, it is possible to minimize the user's operation, to prevent malfunction, and to operate more efficiently, thereby improving the user's ease of use.

The remote control apparatus and its operation method or the image display apparatus and the operation method according to the present invention is not limited to the configuration and method of the embodiments described as described above, the above embodiments may be variously modified. All or part of each of the embodiments may be configured to be selectively combined so that.

On the other hand, the operation method of the remote control device and the image display device of the present invention can be implemented as code that can be read by the processor on a processor-readable recording medium provided in the remote control device and the image display device. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (20)

In a sleep mode, detecting the occurrence of an interrupt through the acceleration sensor;
Detecting a movement of a remote controller through the acceleration sensor for a predetermined time; And
Switching to a wake-up mode when the detection result satisfies a preset wake-up criterion.
The method of claim 1,
The wake-up mode is a mode for operating a remote control device, characterized in that for controlling the pointer displayed on the image display device based on the movement of the remote control device.
The method of claim 1,
And entering a voice recognition mode through which the voice input is possible through the remote control device.
The method of claim 1,
Switching to the sleep mode when the movement of the remote control device is not detected or when a motion stop signal is received from the image display device.
The method of claim 1,
The switching to the wake-up mode may include activating a gyro sensor and a wireless communication unit of the remote control device.
The method of claim 1,
If the wake-up criterion is satisfied, the remote control device is moved within the predetermined time period.
The method of claim 1,
When the wake-up criterion is satisfied, the data based on the movement of the remote controller detected by the acceleration sensor is a predetermined value or more.
The method of claim 1,
The switching to the wake-up mode may include activating a wireless communication unit of the remote control apparatus.
The method of claim 1,
The detecting of the movement of the remote control apparatus may include detecting a movement of the remote control apparatus through a gyro sensor and the acceleration sensor.
10. The method of claim 9,
When the wake-up criterion is satisfied, the movement of the remote controller detected by the gyro sensor and the acceleration sensor corresponds to a predetermined pattern.
10. The method of claim 9,
When the wake-up criterion is satisfied, at least one of criteria set with respect to a direction, intensity, and number of times of shaking the remote controller is satisfied.
The method of claim 1,
And transmitting a signal based on the movement of the remote control device to an image display device.
Detecting a generation of an interrupt through the sensor unit in a sleep mode;
Sensing the magnitude and direction of movement of a remote control device through the sensor unit; And
When the detected size and direction of the movement of the remote controller satisfies a preset criterion, the pointer displayed on the image display device is switched to a pointing mode that can be controlled based on the movement of the remote controller. Operating method of a remote control device comprising a.
14. The method of claim 13,
And transmitting a signal based on the movement of the remote control device to the image display device.
14. The method of claim 13,
And entering a voice recognition mode through which the voice input is possible through the remote control device.
14. The method of claim 13,
The switching to the pointing mode may include activating a wireless communication unit of the remote control device.
14. The method of claim 13,
If the predetermined criterion is satisfied, the operation method of the remote control apparatus, characterized in that the movement of the movement in the predetermined reference axis direction of the movement of the remote control device is a predetermined size or more.
14. The method of claim 13,
The detecting of the magnitude and direction of the movement of the remote control device may include detecting a movement of the remote control device through a gyro sensor and an acceleration sensor.
14. The method of claim 13,
If the predetermined criterion is satisfied, the operation method of the remote control device, characterized in that the movement of the remote control device corresponds to a predetermined pattern.
14. The method of claim 13,
If the predetermined criterion is satisfied, at least one of the criteria set with respect to the direction, intensity, and number of times to shake the remote control device is satisfied.
KR1020120099495A 2012-09-07 2012-09-07 Method for operating a remote controller KR20140032782A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120099495A KR20140032782A (en) 2012-09-07 2012-09-07 Method for operating a remote controller

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020120099495A KR20140032782A (en) 2012-09-07 2012-09-07 Method for operating a remote controller

Publications (1)

Publication Number Publication Date
KR20140032782A true KR20140032782A (en) 2014-03-17

Family

ID=50644197

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120099495A KR20140032782A (en) 2012-09-07 2012-09-07 Method for operating a remote controller

Country Status (1)

Country Link
KR (1) KR20140032782A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10306313B2 (en) 2015-07-24 2019-05-28 Samsung Electronics Co., Ltd. Display apparatus and method for controlling a screen of display apparatus

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10306313B2 (en) 2015-07-24 2019-05-28 Samsung Electronics Co., Ltd. Display apparatus and method for controlling a screen of display apparatus

Similar Documents

Publication Publication Date Title
US9210459B2 (en) Operation terminal, electronic unit, and electronic unit system
KR102135092B1 (en) Operating Method for Image Display apparatus
KR101788006B1 (en) Remote Controller and Image Display Device Controllable by Remote Controller
US9715287B2 (en) Image display apparatus and method for operating the same
KR20130130453A (en) Image display apparatus and operating method for the same
KR20140046902A (en) Image display apparatus and method for operating the same
JP2013055650A (en) Image display apparatus, remote controller, and method for operating the same
KR101860918B1 (en) Image display apparatus, and method for operating the same
KR102313306B1 (en) Image display apparatus, and mobile termial
US9400568B2 (en) Method for operating image display apparatus
KR20140032782A (en) Method for operating a remote controller
KR102444150B1 (en) Image display apparatus
KR20130042325A (en) Remote controller
KR20170128883A (en) Media system and method of achieving various modes using force input
KR20160056577A (en) Image display apparatus
KR101828399B1 (en) Method for operating an Image Display Device and a Mobile terminal
KR101799315B1 (en) Method for operating an Image display apparatus
KR20140020653A (en) Remote controller and method for operating the same
KR101809045B1 (en) Remote Controller and method for operating the same
KR20140000928A (en) Image display device and displaying method thereof
KR101980546B1 (en) Operating Method for Image Display apparatus
KR20130042326A (en) Remote controller
KR20140115789A (en) Operating Method for Image Display apparatus
KR101896257B1 (en) Remote controller, image display apparatus, and method for operating the same
KR20140081266A (en) Remote controller and Image display apparatus

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination