KR20160061874A - Apparatus for providing home appliance control service based on smart TV and method - Google Patents

Abstract

Disclosed are an apparatus and a method for controlling a home appliance based on a smart TV. According to an embodiment of the present invention, the apparatus for controlling a home appliance comprises: a home appliance control gateway included in a smart TV to generate a home appliance control command according to a user input event for home appliance control to transmit the home appliance control command to a home appliance via a home network and receive home appliance state data from the home appliance; and a web service client included in the smart TV or a portable terminal to provide an interface for controlling the home appliance or checking a state of the home appliance.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a smart TV-based home appliance control device and a home appliance control method.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a home network technology, and relates to a technology for controlling and managing various types of home appliances based on a smart TV.

Smart TV is equipped with central processing unit (CPU) and operating system (OS) for operating software such as personal computer (PC) or smart phone and equipped with internet function, , Games, search, convergence, or intelligent services.

The home appliance control service is evolving into a customized convergence service freely based on the sharing of content information between the real UI / UX and the device and the cloud based on the open platform. Smart TVs are also evolving into high performance open platforms that can drive a wide range of applications. In consideration of such circumstances, there is a need to develop a home appliance control interface module that utilizes the smart TV as a home server for providing a home appliance control service and can easily use and extend the service. Furthermore, it is required to develop a service technology capable of managing and controlling home devices whenever and wherever.

Along with the spread of smart TVs, various applications that are linked with the home network framework are expected to emerge by intelligent and wirelessization of home devices. In addition, mobile terminals that are user-personalized based on such a home network, for example, a smart remote controller, a tablet PC, a smart phone, etc., can be linked to a smart TV. Therefore, it is necessary to develop a smart TV based service considering the environment in which the smart TV and the portable terminal of the user are interlocked.

According to an exemplary embodiment, a method of controlling and managing various types of home devices not only in the home but also outside the home based on the smart TV is proposed.

The home-appliance control apparatus according to an embodiment generates a home-appliance control command in response to a user input event for controlling the home appliance included in the smart TV, transmits the home-appliance control command to the home appliance through the home network, And a web service client included in the smart TV or portable terminal to provide an interface for home device control or home device status confirmation.

The home appliance control gateway according to an embodiment receives a user input event for controlling a home appliance from a web service client of a smart TV or a web service client of a portable terminal and transmits the received user input event to a home appliance And transmits the converted home device control command to the home device through the home network.

The home appliance control gateway according to an embodiment generates a home appliance control command in accordance with the physical interface and the data communication protocol of the home appliance.

The home device control gateway according to an embodiment transmits and receives the home device control command and the home device state data directly to the home device without any protocol conversion if it can be directly connected to the home device, To the home appliance, or receives the converted home appliance state data from the home appliance using the protocol converter.

The protocol converter according to an exemplary embodiment of the present invention may be configured such that when the home network uses the Internet protocol (IP) and the home appliance only supports the serial data communication protocol, if the IP datagram is received from the home appliance control gateway, Extracts only the home appliance control command data configured according to the data communication protocol of the home appliance and transmits the extracted home appliance control command data to the home appliance. When the home appliance state data is received from the home appliance, the received home appliance state data is encapsulated into the IP datagram and transmitted to the home appliance control gateway do.

The home appliance control gateway according to an embodiment converts the home appliance state data received from the home appliance into data of a type recognizable by the web service client.

The home-appliance control gateway according to an exemplary embodiment of the present invention stores and manages the history of home-appliance control command generation and the home-appliance status data to the registration server.

The home device control gateway according to an embodiment detects an event related to the home device state from the home device state data received from the home device, and generates an alert message to notify the user when an event is detected, and transmits the notification message to the web service client .

The home appliance control gateway according to an embodiment allows a notification message to be output directly through the web service client when the web service client is running, and when the web service client is not running, Controls the notify service client to run to control the client to run automatically or to output a notification message.

The web service client according to an exemplary embodiment may be operated based on a web browser provided by a smart TV or a web application program using a webkit library installed on a smart TV.

A web service client according to an embodiment accesses a web server and acquires interface environment components using a web page provided by the web server. Alternatively, the web service client acquires the interface environment component from the registration server only when a new home appliance is connected to the home network.

When the web service client according to an exemplary embodiment is located in the portable terminal, the web service client accesses the registration server and obtains connection information for connection to the home appliance control gateway, and accesses the home appliance control gateway using the obtained connection information. At this time, the connection information for connecting to the home appliance control gateway includes an IP address of the home appliance control gateway and a data communication port.

The home appliance control gateway according to one embodiment registers with the registration server, provides the home appliance information to the registration server to register the home appliance, and the web service client registers with the registration server.

The home appliance control gateway according to one embodiment shares an IP address with a web server when the web server is located on a smart TV.

The method of controlling a home appliance according to another embodiment includes the steps of connecting a web service client of a smart TV to a home appliance control gateway of a smart TV, Receiving the user input event for controlling the home device according to the state of the home device, and transmitting the user input event to the home device control gateway of the smart TV to control the home device do.

At this time, the home-appliance control method includes the steps of: outputting a screen output through the screen of the smart TV to the screen of the user's remote control device; receiving a user input event from the user through the remote control device; To the service client.

According to another embodiment of the present invention, there is provided a method of controlling a home appliance, the method comprising: connecting to a home appliance control gateway of a smart TV through a web service client of the portable terminal; Receiving a user input event for controlling the home device according to the state of the home device and transmitting the user input event to the home device control gateway of the smart TV to receive the home device state data through the home device, .

At this time, the home appliance control service method includes a step of connecting a web service client of the portable terminal to the registration server to access the home appliance control gateway of the smart TV, and a step of connecting to the home appliance control gateway of the smart TV from the connected registration server And accessing the home appliance control gateway of the smart TV using the home appliance control gateway connection information received from the registration server.

In this case, the home device control service method further includes receiving, through the home device control gateway of the smart TV, home device state data whose status has changed through a user input event from the home device control gateway of the smart TV.

According to the embodiment, the home appliance can be indirectly made intelligent by using the home appliance control device without installing various additional devices and software in the home appliance to make the home appliance intelligent. In particular, since the home device is controlled based on the smart TV, a more convenient user interface environment can be provided to the user.

1 is a block diagram of a home-appliance control apparatus and a home appliance according to an embodiment of the present invention;
2 is a configuration diagram of a home appliance control system according to an embodiment of the present invention;
3 is a flowchart illustrating a home-appliance control process according to an embodiment of the present invention.
FIG. 4 is a reference diagram illustrating an embodiment of a home appliance control service of FIG. 3 according to an embodiment of the present invention;
5 is a flowchart illustrating a home-appliance control process according to another embodiment of the present invention.
FIG. 6 is a reference diagram illustrating an embodiment of a home appliance control service of FIG. 5 according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In addition, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the intention of the user, the operator, or the custom. Therefore, the definition should be based on the contents throughout this specification.

1 is a block diagram of a home-appliance control apparatus and a home appliance according to an embodiment of the present invention.

Referring to FIG. 1, a home appliance control apparatus 1 controls a home appliance 2, and includes a home appliance control gateway 100 and a web service client 102. The home appliance control gateway 100 may be located on a smart TV and the web service client 102 may be located on a smart TV or a user's portable terminal.

Smart TV receives and reproduces broadcasting signals such as terrestrial TV, cable TV, internet TV, etc., and plays video, such as video on demand (VoD) And can execute application programs such as a computer game, a mobile game, and the like, and can be connected to the Internet to receive and reproduce or play Internet contents from a web server or a streaming server. For data reproduction, the smart TV includes a display.

The portable terminal may be a portable device, for example, a smart phone, a smart pad, a tablet PC, or the like. The portable terminal can play back moving pictures, execute application programs such as a computer game or a mobile game, connect to the Internet, and receive and play back Internet contents from a web server or a streaming server. The home appliance 2 includes all the devices located in the house, and can be, for example, a refrigerator, a washing machine, a lamp, a front door, a gas valve, a power supply device, a wall pad, The home appliance 2 is connected to a home network.

The home appliance control gateway 100 and the web service client 102 may be located in the smart TV. Or the home appliance control gateway 100 may be located on a smart TV and the web service client 102 may be located on a mobile terminal. Of course, smart TVs can be replaced by other devices that are compatible with smart TVs. For example, in addition to a smart TV, a device capable of playing a moving image, executing an application program, and connecting to the Internet, such as a home server, a tablet PC, a personal computer, a smart phone, and the like, can perform its functions.

2 is a configuration diagram of a home appliance control system according to an embodiment of the present invention.

2, the home appliance control system includes a smart TV 20, a mobile terminal 21, a home appliance 22, a protocol converter 23, and a registration server 24, and includes a notification server 25, And may further include a remote control device 29.

The home appliance control gateway 200 of the smart TV 20 registers and manages the home appliance 22 to be controlled. The home appliance control gateway 200 registers home appliance information, for example, manufacturer, model number, physical data interface, data communication protocol, and the like. In the registration process, an ID for identifying the home device is assigned to each home device.

The home appliance control gateway 200 according to an embodiment transmits the home appliance information to the registration server 24. The registration server 24 performs a function of registering and managing the smart TV 20, the home appliance control gateway 200, a user, and the like, which will be described in detail later.

The home appliance control gateway 200 receives the user input event data for controlling the home appliance from the web service client 202 of the smart TV 20 or the web service client 212 of the portable terminal 21 and processes the user input event data. The user input event is a computer graphic operation and a text input environment provided by the web service client 202 of the smart TV 20 or the web service client 212 of the portable terminal 21, GUI). ≪ / RTI > The home appliance 22 can not directly interpret the user input event. Therefore, the home appliance control gateway 200 interprets the user input event and converts it into home appliance control command data of a form that the home appliance 22 can interpret.

The home appliance control command data according to one embodiment conforms to the physical data interface and data communication protocol of the home appliance 22. For example, when the physical interface standard of the home device 22 is RS-485 and the data communication protocol standard is a serial data communication method, the home device control command data conforms to the RS-485 standard and the serial data communication protocol standard.

The home appliance control gateway 200 according to an embodiment generates a datagram for delivering home appliance control command data to the home appliance 22 in accordance with a data communication protocol available in the home network 28. For example, when the data communication protocol of the home network 28 is based on the Internet protocol (IP), the home appliance control gateway 200 generates an IP datagram in which the home appliance control command data is included in the payload .

The home appliance control gateway 200 and the home appliance 22 are connected to a home network 28 formed by the network gateway 27. The home network 28 may be formed based on Internet Protocol (IP). If the home device 22 is directly connected to the home network 28 and data communication is possible, the home device 22 can establish a communication connection with the home device control gateway 200 through the home network 28, It is possible. However, when the home appliance 22 is not directly connected to the home network 28, it is connected to the home network 28 through the protocol converter 23 and is capable of communicating with the home appliance control gateway 200.

For example, if the home network 22 is based on an Internet protocol, whereas the home appliance 22 only supports a serial data communication protocol based on the RS-485 or RS-232 standard, the protocol converter 23 extracts only the home appliance control command data configured in accordance with the data communication protocol of the home appliance 22 in the IP datagram transmitted from the home appliance control gateway 200 and delivers the extracted home appliance control command data to the home appliance 22. The physical data interface and data communication protocol between the protocol converter 23 and the home device 22 follow those that the home device 22 can support. The protocol converter 23 encapsulates the home appliance state data transmitted from the home appliance 22 into an IP datagram and transmits the encapsulated IP datagram to the home appliance control gateway 200.

The home appliance control gateway 200 according to an embodiment receives home appliance state data indicating various states of the home appliance 22 from the home appliance 22. [ The home appliance state data may be generated according to the physical interface of the home appliance 22 and the data communication protocol standard. The home appliance control gateway 200 interprets the received home appliance status data and transmits the interpreted home appliance status data to the web service client 202 of the smart TV 20 or the web service client 212 of the portable terminal 21 Into data of a form that can be used. That is, the home appliance control gateway 200 determines whether the received home appliance status data is expressed in graphic or text by the web service client 202 of the smart TV 20 or the web service client 212 of the portable terminal 21 Pre-work will be performed.

The home-appliance control gateway 200 according to one embodiment stores and manages a history of home-appliance control command generation, and stores and manages home-appliance state data. In addition, the home appliance control gateway 200 may transmit the home appliance control history and the home appliance state data history to the registration server 24.

The home appliance control gateway 200 according to an exemplary embodiment interprets the home appliance state data and detects various types of events such as a functional error, an abnormal operation, an emergency situation, and an operation completion with respect to the home appliance state. The home device control gateway 200 generates a message to notify the user of the event and transmits the message to the web service client 202 of the smart TV 20, the web service client 212 of the mobile terminal 21, 24). For example, when a gas leakage state is detected, the home appliance control gateway 200 generates a notification message of a gas leak and transmits it to the web service client 202 of the smart TV 20, the web service client of the portable terminal 21, (212) and the registration server (24).

When the web service client 202 of the smart TV 20 or the web service client 212 of the mobile terminal 21 is running, a notification message is transmitted to the web service client 202 of the smart TV 20 or the portable terminal 21 may be displayed directly via the GUI of the web service client 212. On the other hand, when the web service client 202 of the smart TV 20 or the web service client 212 of the mobile terminal 21 is not running, the home appliance control gateway 200, when receiving a notification message And controls the web service client 202 of the smart TV 20 or the web service client 212 of the mobile terminal 21 to be automatically executed. Or the home appliance control gateway 200 may be provided with a notification service client 220 capable of outputting a notification message separately from the web service client 202 of the smart TV 20 or the web service client 212 of the portable terminal 21 Can be controlled to be executed.

In the case of the smart TV 20, since the notification service client is a simple message output, it can operate as a part of the home appliance control gateway 200 or the web service client 202. In the case of the portable terminal 21, the home appliance control gateway (not shown) may be connected to the home appliance control gateway (not shown) by using the notification server 25 operated by the portable telephone network, the portable terminal manufacturer, the operating system provider installed in the portable terminal 21, 200 can transmit a notification message to the portable terminal 21. In this case, the notification message received through the notification server 25 may be output to the screen of the portable terminal 21 by the notification service client 220 in the form of a simple message.

The web service client 202 of the smart TV 20 provides a GUI environment so that the user can control the home device 22 or check the state of the home device 22. [ For example, the web service client 202 expresses the state of the home appliance in graphic or text, and displays the graphic object or the text input window on the TV screen so that the user can control the state of the home appliance. When the user manipulates or adjusts the graphical object or inputs text into the text input window, the web service client 202 determines the degree of manipulation or the degree of coordination and the entered text in the form of data that the home appliance control gateway 200 can receive . Upon receiving the home appliance status data from the home appliance control gateway 200, the web service client 202 interprets the received data and displays the home appliance status in a graphic or text format.

The web service client 202 of the smart TV 20 can be driven based on a web browser provided by the smart TV 20 and can be operated in the form of a web application utilizing a webkit library installed in the smart TV 20 It is possible.

In order for the web service client 202 of the smart TV 20 to provide a GUI environment, a code, a graphic object, or the like, which is composed of elements constituting the GUI environment, that is, a Hyper Text Markup Language (HTML) . The registration server 24 has these GUI environment components in advance. In this situation, the web service client 202 may obtain GUI environment components in two ways.

First, the registration server 24 can simultaneously perform a function as a web server. For example, when a user launches the web service client 202, the web service client 202 contacts the registration server 24 to temporarily download and utilize the GUI environment components. This method uses a web page provided by a web site by accessing a web site to execute the home device control service. However, in this method, the connection between the registration server 24 and the web service client 202 performing the functions of the web server must be maintained stably.

Secondly, only when the home appliance 22 is newly connected to the home network 28, the web service client 202 downloads the GUI environment components from the registration server 24 and transmits some functional elements of the web service client 202 As shown in FIG. This type of web service client 202 is generally referred to as a rich client. The rich client type web service client 202 does not require a separate web server.

The web service client 212 of the portable terminal 21 according to the embodiment connects to the registration server 24. In general, the web service client 212 of the portable terminal 21 can not directly access the home appliance control gateway 200 via the Internet. This is because the IP address assigned to the smart TV 20 including the home appliance control gateway 200 by the network gateway 27 forming the home network 28 is a private IP address that can not be propagated through the Internet to be. To solve the above problem, the network gateway 27 and the router that assists the Internet connection provide an address translation function.

For example, assuming that the home appliance control gateway 200 delivers data to a predetermined destination via the Internet, the private IP address assigned to the smart TV 20 and the data communication used by the home appliance control gateway 200 The port is converted into a form that can be propagated over the Internet by the network gateway 27 and the router. The registration server 24 maps the IP address and the data communication port converted by the network gateway 27 and the router to the smart TV 20 and the home appliance control gateway 200 and registers them. Accordingly, when the user executes the web service client 212 of the portable terminal 21, the web service client 212 first accesses the registration server 24, and then connects the smart TV 20 and the home device Acquires an IP address and a data communication port that can be connected to the control gateway 200, and then connects to the home appliance control gateway 200.

The web service client 212 of the portable terminal 21 according to the embodiment provides a GUI environment so that the user can control the home device 22 or check the state of the home device 22. [ For example, the web service client 212 displays the state of the home appliance in graphic or text, and displays the graphic object or the text input window on the screen of the portable terminal 21 so that the user can control the state of the home appliance. When the user controls or adjusts the graphic object or inputs text into the text input window, the web service client 212 displays the manipulated or adjusted degree and the input text in the form of data that the home appliance control gateway 200 can receive . Upon receipt of the home appliance status data from the home appliance control gateway 200, the web service client 212 analyzes the received data and displays the home appliance status in graphic or text format.

In order for the web service client 212 of the portable terminal 21 to provide a GUI environment, a code, a graphic object, or the like, which is composed of elements constituting a GUI environment, that is, a Hyper Text Markup Language (HTML) . The registration server 24 may be provided with such GUI environment components in advance. Like the web service client 202 of the smart TV 20, the web service client 212 of the mobile terminal 21 can acquire GUI environment components in two ways. First, the registration server 24 can simultaneously perform a function as a web server. For example, when the user executes the web service client 212, the web service client 212 may access the registration server 24 to temporarily download and utilize the GUI environment components. Secondly, only when the home appliance 22 is newly connected to the home network 28, the web service client 212 downloads the GUI environment components from the registration server 24, As shown in FIG.

The registration server 24 registers and manages the smart TV 20 and the home appliance control gateway 200. The registration server 24 may assign an identifier (ID) to the smart TV 20 and the home appliance control gateway 200 to uniquely identify the smart TV 20 and the home appliance control gateway 200 .

The registration server 24 according to one embodiment registers and manages users. The user can basically use only the smart TV 20 and the home appliance control gateway 200 installed in his house. Accordingly, the user is registered in association with the smart TV 20 and the home appliance control gateway 200 that he / she uses. The registration server 24 assigns an account or an identifier to the user. The user can perform the login procedure necessary to use the home device control service using the password together with the assigned account or identifier.

The registration server 24 according to the embodiment registers and manages the portable terminal 21. The user can use the home appliance control service using the web service client 212 of the portable terminal 21. [ The portable terminal 21 used by the user to use the home device control service does not necessarily have to be registered and managed in the registration server 24. [ However, the registration server 24 may prevent the home device 22 from being controlled by a user other than the user, or may register and manage the mobile terminal 21 to provide an additional service such as a notification message service .

The registration server 24 according to one embodiment registers and manages the home device 22. The registration server 24 registers home device information, for example, manufacturer, model number, physical interface, data communication protocol, and the like from the home device control gateway 200. An identifier may be given to the home appliance 22 in order to allow the home appliance control gateway 200 to identify the home appliance 22 in the registration process.

The registration server 24 according to an embodiment analyzes the IP packet received from the home appliance control gateway 200 and transmits the source IP address acquired from the IP packet to the registration server 24 as the information informing the location of the home appliance control gateway 200 . Also, the registration server 24 periodically receives the IP packet from the home appliance control gateway 200 and updates the location information of the home appliance control gateway 200.

The registration server 24 according to the embodiment receives and backs up the home device control history and the home device state data history periodically from the home device control gateway 200 or when an event occurs. Also, the registration server 24 may receive a message informing various types of event detection such as a function error, an abnormal operation, an emergency situation, and an operation completion related to the home appliance state from the home appliance control gateway 200. The registration server 24 transmits the received notification message to the notification server 25 and requests the notification server 25 to forward the notification message to the portable terminal 21 of the user.

When the user executes the web service client 212 of the portable terminal 21 and performs the login procedure, the web service client 212 connects to the registration server 24. When the login procedure is completed, the registration server 24 transmits the location information of the home appliance control gateway 200 related to the user logged into the web service client 212, that is, the IP address of the home appliance control gateway 200.

When the web service client 202 of the smart TV 20 and the web service client 212 of the mobile terminal 21 do not have a rich client type and need a web server, May be installed in parallel with the registration server 24 and may be installed in the smart TV 20. Regardless of where the web server is installed, if the IP address used by the web server does not match the IP address used by the registration server 24, the registration server 24 registers the web service client of the smart TV 20 The IP address indicating the location information of the web server to the web service client 212 of the portable terminal 21 and the web service client 212 of the portable terminal 21.

In the case where the web server according to an embodiment is located in the smart TV 20, the home device control gateway 200 and the web server share IP addresses allocated to the smart TV 20 and use the application for data communication Each port uses a different one. Accordingly, the registration server 24 acquires the IP address and the data communication port information from the IP packet received from the home appliance control gateway 200 installed in the smart TV 20 and the web server, registers and manages the IP address and the data communication port information.

When the web service client 212 of the portable terminal 21 accesses the registration server 24, the registration server 24 registers the web service client 212 of the portable terminal 21 in the smart TV 20 To the web service client 212 of the portable terminal 21, an IP address and a data communication port indicating the respective location information so as to be able to access the home appliance control gateway 200 and the web server. Accordingly, when the user completes the login procedure through the registration server 24, the web service client 212 of the portable terminal 21 uses the acquired IP address and data communication port to access the home And connects to the device control gateway 200 and the web server.

The web service client 202 of the smart TV 20 transmits the IP address and data communication port of the web server and the home appliance control gateway 200 to the smart TV 20 It is unnecessary to connect to the registration server 24 unlike the web service client 212 of the portable terminal 21 because it is in a known state. In this case, the login procedure for user authentication may be omitted or a separate login procedure may be performed by the web server.

The remote control device 29 is a device for the user to remotely control the smart TV 20, and may be, for example, a mirror-type smart remote control. The remote control device 29 provides means for playing back moving pictures and images, a user input interface such as a touch screen, wireless communication means, and the like. Further, the portable terminal 32 may be utilized as the remote control device 29. [

The remote control device 29 according to an embodiment receives the moving image and image data output from the screen of the smart TV 20 from the smart TV 20 and outputs the same to the screen of the smart TV 20 itself. The user can see a moving image and an image displayed on the screen of the remote control device 29 using a user input interface such as a touch screen provided by the remote control device 29, A method of touching a fan, and the like. The user input event is transmitted from the remote control device 29 to the smart TV 20 through the wireless communication means. The smart TV 20 interprets the received user input event and applies it to the application program. As a result, the application program executed on the smart TV 20 responds to the user input event generated from the remote control device 29 by the user.

When the web service client 202 is executed in the smart TV 20, moving image and image data outputted on the TV screen are transmitted to the remote control device 29. The remote control device 29 reproduces moving images and images received from the smart TV 20. [ The moving image and the image reproduced by the remote control device 29 are indicative of the GUI environment provided by the web service client 202 as they are. The user controls or controls the graphic object for home device control or inputs text through the user input interface such as the touch screen of the remote control device 29 while watching the moving images and images output to the remote control device 29 Type user input event. A user input event for controlling the home appliance generated by the user is transmitted from the remote control device 29 to the smart TV 20 through the wireless communication means. The smart TV 20 interprets the received user input event and allows it to be applied by the web service client 202. The web service client 202 interprets the received user input event and generates data or information necessary for generating a home appliance control command based on the received user input event and delivers the data or information to the home appliance control gateway 200.

The network 26 connects the registration server 24, the notification server 25, the mobile terminal 21 and the network gateway 27. The network 26 has a connection structure in which information can be exchanged between the respective components and is connected to a network such as the Internet, a LAN (Local Area Network), a Wireless LAN (Local Area Network), a WAN Personal Area Network), 3G, 4G, LTE, Wi-Fi, Zigbee, and the like.

Meanwhile, the home appliance control service scenario according to the present invention can be divided into two types in consideration of a place where the user is located and a device used by the user to control the home appliance. One is a service scenario in which a user is located in a house and uses a home device control service using a remote control device 29 or the like, and a detailed description thereof will be given later with reference to FIG. 3 and FIG. The other is a service scenario in which a user is located in the house or outside the home and uses the home-device control service using the mobile terminal 21, and a detailed description thereof will be given later with reference to FIG. 5 and FIG.

FIG. 3 is a flowchart for explaining a home-appliance control process according to an embodiment of the present invention. Specifically, when a user is located in a home and uses a remote control device or the like to explain a home- FIG.

It is assumed that the registration procedure for the smart TV, the home appliance control gateway 200, the web server, the user, the home appliance 22 and the like has been completed in advance. It is assumed that the user remotely controls the smart TV 20 using the remote control device. Hereinafter, a service scenario procedure in which a home appliance control service is used by using a remote controller will be described with reference to FIGS. 3 and 4. FIG.

First, the user executes the web service client 202 of the smart TV 20. In the case where the web server is operated, when the user performs the user login procedure through the web service client 202, the web service client 202 connects to the web server. When the web service client 202 is operated in a rich client manner, the above-described steps are omitted.

Then, the web service client 202 connects to the home appliance control gateway 200 (300). The web service client 202 transmits a home appliance status report request command to the home appliance control gateway 200 to display the current state of the home appliance 22 (302). Then, the home appliance control gateway 200 transmits home appliance status report request command data to the home appliance 22 (304). The home appliance status report request command data is generated in a form that can be interpreted by the home appliance 22 by the home appliance control gateway 200.

Then, the home appliance 22 transmits home appliance state data, which is data indicating its current state, to the home appliance control gateway 200 (306). The home appliance control gateway 200 converts the home appliance status data into a form that can be interpreted by the web service client 202 and then transmits the converted home appliance status data to the web service client 202 of the smart TV 20 ).

The web service client 202 displays the home appliance status 310 using the GUI environment, and displays a graphical object, a text input window, and the like necessary for the user to control the home appliance 22.

The web service client 202 then receives 312 a user input event from the user through operations such as manipulating or manipulating the graphic object displayed by the web service client 202 or entering text into the text input window, The web service client 202 interprets the information or data to transmit the information or data necessary for generating the home appliance control command data to the home appliance control gateway 200 in operation 314. The home appliance control gateway 200 transmits the home appliance control command Data is generated (316) and home appliance control command data is transmitted to the home appliance 22 to be controlled (318).

The home appliance 22 analyzes the received control command data to change its current state 320 and then transmits data indicating its current state to the home appliance control gateway 200, The gateway 200 converts the home appliance status data into a form that can be described by the web service client 202, and then transmits the converted data to the web service client 202. The web service client 202 displays the home appliance status using the GUI environment.

When the home appliance 22 is connected to the home network through the protocol converter, the home appliance control requesting the home appliance 22 to transmit the home appliance status report request command data and the home appliance control command data, which are transmitted from the home appliance control gateway 200, And then transmitted to the home appliance 22. Further, the home appliance state data generated by the home appliance 22 is also converted through the protocol converter and then transmitted to the home appliance control gateway 200. [

In the above-described process, the user remotely controls the smart TV 20 using the remote control device, and the GUI environment executed by the web service client 202 of the smart TV 20 is displayed on the screen of the smart TV 20 And the screen of the remote control device. The user can control the home appliance 22 by manipulating or adjusting the graphic object displayed on the screen of the smart TV 20 or inputting text into the text input window using the touch screen function provided by the remote control device. The remote control device may be a mirror-type smart remote control.

4 is a reference diagram illustrating an embodiment of a home appliance control service of FIG. 3 according to an embodiment of the present invention.

Referring to FIG. 4, the registration server 24 registers the home appliance control gateway 200 via the network 26 (400). In addition, the registration server 24 receives the home device control history and home device state data history periodically from the home device control gateway 200, or backs up the home device control history and the home device state data history (440).

When the home appliance is connected to the home network 28 using the protocol converter 23, for example, the home appliances 22-1, 22-2 and 22-3 transmit the home appliance status data to the protocol converter 23 to the home appliance control gateway 200, and converted into the home appliance control gateway 200 through the protocol converter 23 (412). When the home appliance control gateway 200 transmits the home appliance control command data to the protocol converter 23, the protocol converter 23 converts the home appliance control command data to the home appliances 22-1, 22-2, and 22-3 . In contrast, when the home device is directly connected to the home network 28, for example, the home device 22-4 directly transmits the home device status data to the home device control gateway 200 via the home network 28 (430), and receives the home appliance control command data from the home appliance control gateway (200) through the home network (28) (432).

The user remotely controls the smart TV using the remote control device. The screen 450 of the smart TV is displayed on the screen 460 of the remote control device in the same manner. The user controls or controls the graphic objects displayed on the smart TV screen 450 using a user interface such as a touch screen included in the remote control device or inputs texts into the text input window to display the home devices 22-1 and 22-2 , 22-3, 22-4) can be remotely controlled.

FIG. 5 is a flowchart for explaining a home-appliance control process according to another embodiment of the present invention. Specifically, FIG. 5 is a flowchart illustrating a home-appliance control service process using a mobile terminal located in a house or a house.

5, the registration procedure for the smart TV 20, the home appliance control gateway 200, the web server, the user, the portable terminal 21, the home appliance 22, etc. of the registration server 24 is completed .

When the user executes the web service client 212 installed in the portable terminal 21, the web service client 212 connects to the registration server 24 (500). When the user performs the login procedure to the registration server 24 through the web service client 212, the registration server 24 registers the home appliance control gateway 200 as the information for connecting to the home appliance control gateway 200 related to the user, 200 to the web service client 212 (502). When the web server is operated, the registration server 24 transmits the IP address and the data communication port of the web server related to the user to the web service client 212, and the web service client 212 transmits the received IP address and Connect to web server based on data communication port. This step is omitted if the web service client 212 is operated in a rich client fashion.

Then, the web service client 212 accesses the home appliance control gateway 20 based on the IP address and the data communication port of the home appliance control gateway received from the registration server 24 (504). The home appliance control gateway 200 transmits the home appliance status report request command to the home appliance control gateway 200 in order to display the current state of the home appliance. The home appliance status report request command data is transmitted (508). The home appliance status report request command data is generated in a form that can be interpreted by the home appliance 22 by the home appliance control gateway 200.

The home appliance control gateway 200 transmits the home appliance state data indicating the current state of the home appliance 22 to the home appliance control gateway 200. The home appliance control gateway 200 transmits the home appliance state data to the web service client 200 212 to an interpretable format 512 and then delivers it to the web service client 212 (514).

The web service client 212 then displays 516 the home appliance state using the GUI environment and displays graphical objects, text input windows, and the like that the user needs to control the home appliance 22. When the user receives (518) a user input event (518) by manipulating or manipulating a graphic object displayed by the web service client 212 or entering text into a text input window, the web service client 212 analyzes it and transmits information or data necessary for generating the home appliance control command data to the home appliance control gateway 200 (520). The home appliance control gateway 200 generates home appliance control command data 522 and transmits home appliance control command data to the home appliance 22 to be controlled 522.

The home appliance 22 analyzes the received control command data to change its current state 526 and then transmits data indicating its current state to the home appliance control gateway 200, The gateway 200 converts the home appliance status data into a form that can be described by the web service client 212, and then transmits the converted data to the web service client 212. The web service client 212 displays the home appliance status using the GUI environment.

When the home appliance 22 is connected to the home network through a protocol converter, the home appliance status report request command data and the home appliance control command data generated by the home appliance control gateway 200 are transmitted to the home appliance 22 ). ≪ / RTI > The home appliance state data generated by the home appliance 22 is further transmitted to the home appliance control gateway 200 via the protocol converter.

FIG. 6 is a reference diagram illustrating an embodiment of a home appliance control service of FIG. 5 according to an embodiment of the present invention.

6, the registration server 24 registers the home appliance control gateway 200 and the mobile terminal 21 of the smart TV through the network 26 (600). When the portable terminal 21 requests (610) the connection information to connect to the home appliance control gateway 200 to the registration server 24, the registration server 24 sends the connection information to the home appliance control gateway 200 And transmits the IP address and data communication port information to the mobile terminal 21 (620). The registration server 24 may receive and back up the home device control history and home device state data history periodically or at the time of occurrence of the event from the home device control gateway 200 (630).

When the home appliance is connected to the home network 28 using the protocol converter 23, for example, the home appliances 22-1, 22-2 and 22-3 transmit the home appliance status data to the protocol converter 23 (640). In contrast, when the home device is directly connected to the home network 28, for example, the home device 22-4 directly transmits the home device status data to the home device control gateway 200 via the home network 28 (650).

The home appliance control gateway 200 transmits the home appliance status data to the portable terminal 21 through the home network 28 (660), and the portable terminal 21 displays it on the screen. When the user input event is received from the user, the user input event is transmitted to the home appliance control gateway 200 through the home network 28 (670). The home appliance control gateway 200 receives the user input event, generates a home appliance control command, and transmits the home appliance control command to the home appliance 22. At this time, if the home appliance is connected to the home network 28 using the protocol converter 23, when the home appliance control gateway 200 transmits the home appliance control command to the protocol converter 23 (680) (231), and transmits it to the home appliances (22-1, 22-2, and 22-3) (682). In contrast, when the home device is directly connected to the home network 28, the home device control gateway 200 directly transmits the home device control command to the home device 22-4 via the home network 28 690).

The embodiments of the present invention have been described above. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

1: Home appliance control device 2: Home appliance
20: Smart TV 21: Portable terminal
22: home appliance 23: protocol converter
24: registration server 25: notification server
26: Network 27: Network gateway
28: home network 29: remote control device

Claims (1)

A home appliance control gateway included in the smart TV and generating a home appliance control command according to a user input event for home appliance control and transmitting the home appliance control command to the home appliance through a home network and receiving home appliance state data from the home appliance; And
A web service client included in a smart TV or a mobile terminal for providing an interface for home device control or home device status confirmation;
And a control device for controlling the home appliance.

Images