CN108132744B

CN108132744B - Method and equipment for remotely controlling intelligent equipment

Info

Publication number: CN108132744B
Application number: CN201711343619.2A
Authority: CN
Inventors: 刘霞; 鹿茹茹; 张建伟
Original assignee: Liangfengtai Shanghai Information Technology Co ltd
Current assignee: Liangfengtai Shanghai Information Technology Co ltd
Priority date: 2017-12-14
Filing date: 2017-12-14
Publication date: 2020-11-13
Anticipated expiration: 2037-12-14
Also published as: CN108132744A

Abstract

The application aims to provide a method and equipment for remotely controlling intelligent equipment; acquiring touch operation of a user in a touch pad, wherein the touch pad is matched with intelligent equipment; determining second position information of the touch operation in a display device of the intelligent equipment based on first position information of the touch operation in the touch pad and a coordinate mapping relation between the touch pad and the display device; and controlling the intelligent equipment according to the touch operation and the second position information. Compared with the prior art, the touch control panel can effectively avoid a time-consuming human-computer interaction mode and improve the flexibility of human-computer interaction in the process of controlling the intelligent household appliance based on the touch control panel.

Description

Method and equipment for remotely controlling intelligent equipment

Technical Field

The application relates to the field of computers, in particular to a technology for remotely controlling intelligent equipment.

Background

With the development of internet technology, man-machine interaction functions of intelligent home appliances tend to be diversified, interactive information provided by the intelligent home appliances to users is richer than that provided by traditional home appliances, and for example, the intelligent television provides interactive interface information with rich content for users to browse and select. However, the corresponding man-machine interaction mode still needs to be realized by means of a key-type remote controller matched with the intelligent household appliance, for example, a user uses up, down, left and right buttons on the remote controller to operate controls in a display screen of the intelligent household appliance back and forth to select. This input method is time consuming, user experience is not flexible enough, and human-computer interaction is not friendly enough.

Disclosure of Invention

The application aims to provide a method and equipment for remotely controlling intelligent equipment.

According to one aspect of the present application, there is provided a method of remotely controlling a smart device through a touch pad, comprising:

acquiring touch operation of a user in a touch pad, wherein the touch pad is matched with intelligent equipment;

determining second position information of the touch operation in a display device of the intelligent equipment based on first position information of the touch operation in the touch pad and a coordinate mapping relation between the touch pad and the display device;

and controlling the intelligent equipment according to the touch operation and the second position information.

According to yet another aspect of the present application, there is provided a method of remotely controlling a smart device on a touch pad, including:

receiving touch operation of a user in a touch pad;

and sending the touch operation to corresponding intelligent equipment, wherein the touch pad and a display device of the intelligent equipment have a coordinate mapping relation.

According to another aspect of the present application, there is provided a smart device remotely controlled through a touch pad, including:

the device comprises an acquisition device, a processing device and a processing device, wherein the acquisition device is used for acquiring the touch operation of a user in a touch pad, and the touch pad is matched with the intelligent equipment;

the determining device is used for determining second position information of the touch operation in the display device based on first position information of the touch operation in the touch pad and a coordinate mapping relation between the touch pad and the display device of the intelligent equipment;

and the control device is used for controlling the intelligent equipment according to the touch operation and the second position information.

According to still another aspect of the present application, there is provided a touch pad for remotely controlling a smart device, including:

the receiving device is used for receiving the touch operation of a user in the touch pad;

and the sending device is used for sending the touch operation to the corresponding intelligent equipment, wherein the touch pad and the display device of the intelligent equipment have a coordinate mapping relation.

According to another aspect of the present application, there is also provided a system for remotely controlling a smart device, including a smart device of another aspect of the present application remotely controlled by a touch pad and a touch pad of another aspect of the present application remotely controlled by a smart device.

According to another aspect of the present application, there is also provided a smart device remotely controlled through a touch pad, including:

one or more processors;

a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the programs comprising instructions for:

According to another aspect of the present application, there is also provided a computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to:

According to another aspect of the present application, there is also provided a touch panel for remotely controlling a smart device, including:

one or more processors;

a memory; and

receiving touch operation of a user in a touch pad;

Compared with the prior art, after the intelligent device acquires the touch operation of the user in the touch pad matched with the intelligent device, the second position information of the touch operation in the display device is determined based on the first position information in the touch pad and the coordinate mapping relation between the touch pad and the display device of the intelligent device, so that the intelligent device can be controlled based on the touch operation and the second position information. Here, since a preset coordinate mapping relationship exists between the display device and the touch pad, that is, the position information on the display device, and the corresponding position information is matched with the position information on the touch pad, when the user touches and operates the first position information on the touch pad, based on the pre-existing coordinate mapping relationship, the execution of the touch operation is acted on the second position information in the display device matched with the first position information, for example, if the interaction information to be selected is presented on the second position information, the user can select the interaction information by the touch operation on the first position information. Therefore, based on the application, the user can quickly position the second position information in the display device through the touch pad, and then the interactive operation of the display information on the second position information is realized, the operation of operating the intelligent household appliance back and forth through the upper left-right button and the lower left-right button on the remote controller is removed, the application can effectively avoid a time-consuming human-computer interaction mode in the process of controlling the intelligent household appliance based on the touch pad, and the flexibility of human-computer interaction is improved.

Further, compare in current mode based on key-type remote controller control intelligent household electrical appliances, or some mode based on intelligent cell-phone control intelligent household electrical appliances, this application passes through the touch-control board matches with the smart machine to can the multiple smart machine of accurate remote control, simplified user operation, improved control efficiency, improved user experience, still avoided the user to learn the cost of learning of remote control function in multiple remote controller or the smart cell-phone. In addition, because the existing mode of controlling the smart home appliance by using the mobile phone is when the screen of the mobile phone is occupied, such as: when answering a call, a video and a voice, a user cannot control the intelligent household appliances at the same time, and only when the mobile phone screen is not occupied, the intelligent household appliances can be controlled by means of the touch function of the mobile phone screen, so that the mode cannot guarantee that the intelligent household appliances can be effectively controlled at any time, and the intelligent household appliances can be controlled continuously and stably by the method, so that the man-machine interaction operation is more friendly.

Drawings

Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:

FIG. 1 illustrates a schematic diagram of a method for remotely controlling a smart device via a trackpad, according to one aspect of the present application;

FIG. 2 illustrates a schematic diagram of a method for remotely controlling a smart device via a trackpad, according to one embodiment of the present application;

FIG. 3 illustrates an apparatus diagram of a smart device remotely controlled via a trackpad in accordance with an aspect of the present application;

FIG. 4 illustrates a system diagram of a remote control smart device in accordance with an aspect of the subject application;

FIG. 5 illustrates an exemplary diagram of the shape of the active touch area of a trackpad matching the shape of the remote control interface of a display device according to one embodiment of the present application;

FIG. 6 illustrates an exemplary diagram of a coordinate mapping relationship of a display device and a touch pad according to one embodiment of the present application;

FIG. 7 illustrates an exemplary diagram of a coordinate mapping relationship of a remote control interface and a touch pad in a display device according to one embodiment of the present application;

FIG. 8 illustrates an example diagram of remotely controlling a smart device via a trackpad according to one embodiment of the present application.

The same or similar reference numbers in the drawings identify the same or similar elements.

Detailed Description

The present application is described in further detail below with reference to the attached figures.

In a typical configuration of the present application, the terminal, the device serving the network, and the computing device include one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (transient media), such as modulated data signals and carrier waves.

The application provides a method for remotely controlling an intelligent device through a touch pad, which can be implemented in the intelligent device. Fig. 1 shows a schematic diagram of a method for remote control of a smart device 1 via a touch pad according to an aspect of the present application. Wherein the method comprises step S101, step S102 and step S103. In step S101, the smart device 1 may obtain a touch operation of a user in a touch pad, where the touch pad is paired with the smart device 1; next, in step S102, the smart device 1 may determine second position information of the touch operation in the display device based on first position information of the touch operation in the touch pad and a coordinate mapping relationship between the touch pad and the display device of the smart device 1; next, in step S103, the smart device 1 may control the smart device 1 according to the touch operation and the second position information.

In one implementation, the smart device 1 may include various smart appliances, such as smart playing devices, e.g., a smart television, a smart sound; such as an intelligent washing machine, etc. In one implementation, the smart appliance includes a smart television, where the smart television may include a device based on a wireless network application technology, having an open operating system and a chip, having an open application platform, and being capable of implementing a bidirectional human-computer interaction function and integrating multiple functions such as audio and video, entertainment, and data. In one implementation, the smart tv may include a combination of a normal tv and a smart component, and the smart component may include, but is not limited to, a set-top box, or various network boxes; the intelligent television can also comprise an intelligent television directly integrated with the intelligent assembly. In one implementation, the intelligent household appliance may establish a communication connection with other corresponding devices, such as the touch pad in this application, in a wired communication manner, or in a wireless communication manner such as infrared or bluetooth.

In this application, the touch pad may be a stand-alone touch device; the touchpad may also be integrated into existing remote control devices, such as embedded in existing touch-tone remote controls. In one implementation, the touch pad may include a touch pad supporting single-point touch, and may also include a touch pad supporting multi-point touch. That is, in the present application, the user can touch the touch pad in a single point or in multiple points.

In the present application, the display device may include a display screen, which may be, for example, one or more display screens; the intelligent device 1 or a projection device contained in the intelligent device 1 can project a projection surface; a combination of display units, such as a combination of a plurality of display lamps corresponding to the intelligent device 1; the display device may also comprise a combination of the types described above. In an implementation manner of the present application, if the display device includes a display screen or a projection surface, the touch panel may control display information in the display screen or the projection surface. In one implementation manner of the present application, if the display device includes a display unit combination, for example, a combination including a plurality of display lamps, the switch corresponding to one or more of the display lamps may be controlled through the touch pad. It should be understood by those skilled in the art that the above-mentioned various display devices are only examples, and other types of display devices, which are currently or later come into existence, should be included in the scope of the present application if they can be applied to the present application, and are included herein by reference.

Specifically, in step S101, the smart device 1 may acquire a touch operation of a user in a touch pad, where the touch pad is paired with the smart device 1. In one implementation, the touch operation mode may include, but is not limited to, clicking, such as single clicking or multi-clicking; pressing, such as pressing at different pressure levels, pressing for different durations; moving; lifting the finger to release; and combinations of the above. It should be understood by those skilled in the art that the above-mentioned touch operation manner is only an example, and other touch operation manners existing in the present application or appearing in the future are also included in the protection scope of the present application if applicable to the present application, and are included in the form of reference. Here, the touch operation submitted by the user may be realized by the user touching the touch pad with a finger, or may be realized by the user touching the touch pad with another touch component, such as a stylus.

In one implementation manner, the touch operation may be used to implement an interactive operation on interactive information in the display device, and a manner of the touch operation matches an execution result of a subsequent touch operation. For example, the touch operation can be performed to implement any customized interactive operation such as selection, confirmation, deletion and the like of the corresponding interactive information in the display device.

Here, the touch pad is paired with the smart device 1. I.e. it is determined that the smart device 1 can be controlled by means of the touch pad. In an implementation manner, a pairing manner of the touch pad and the smart device 1 may be a default, for example, the touch pad and the smart device 1 are in a one-to-one matching relationship, and the pairing relationship is stable. In another implementation manner, the pairing relationship between the touch pad and the smart device 1 may be arbitrarily combined, that is, in practical application, the touch pad may control different smart devices, and the smart devices may also be controlled by different touch pads. In the application, when the pairing relationship between the touch pad and the intelligent device 1 is determined, the operation of remotely controlling the intelligent device through the touch pad can be realized.

Next, in step S102, the smart device 1 determines second position information of the touch operation in the display device based on the first position information of the touch operation in the touch pad and the coordinate mapping relationship between the touch pad and the display device of the smart device.

In an implementation manner, the coordinate mapping relationship between the touch pad and the display device of the smart device may include a coordinate mapping relationship between the touch pad and the entire display device, and at this time, since the display device and the touch pad are fixed, after the coordinate mapping relationship between the touch pad and the display device is established in advance, the coordinate mapping relationship also exists relatively fixedly. In another implementation manner, the coordinate mapping relationship between the touch pad and the display device of the smart device may further include a coordinate mapping relationship between a remote control interface in the display device and the touch pad. Here, the display device may include a remote interface, that is, the interactive information in the display device is the remote interface. In one implementation, the remote control interface may include a function selection interface, such as various control selection interfaces, and in the example of an intelligent electronic device, the remote control interface may include various application controls to be selected; the remote control interface can also comprise an input method interface, the input method interface can comprise letter keys, numeric keys, symbol keys, other function keys and the like, and corresponding information can be input through the operation of a user on the input method interface. In addition, the remote control interface can also comprise other interactive interfaces such as a search interface and the like; the remote control interface may also include a combination of the various interactive interfaces described above. It should be understood by those skilled in the art that the various remote control interfaces described above are exemplary only, and that other types of remote control interfaces, whether currently available or later developed, are also within the scope of the present application and are hereby incorporated by reference. In this case, since the remote control interface in the display device may be changed according to different practical applications, the coordinate mapping relationship between the remote control interface in the display device and the touch pad may also be flexibly changed.

Here, the coordinate mapping relationship may include position information on the display device, and corresponding position information on the touch pad is matched thereto, for example, when a user touches and operates first position information (x0, y0) on the touch pad, the touch operation is performed to act on second position information (x, y) in the display device matched to the first position information based on a pre-existing coordinate mapping relationship.

For example, a plurality of function controls to be selected by the user are sequentially arranged in the display device, the user needs to find the control "setting", and the user can realize the function only by touching and operating the first position information on the touch pad, which is matched with the second position information of the control "setting" in the display device.

As another example, the display device includes one column of input methods: 1234567890, the user wants to find the key "0", and only needs to touch the first location information on the touch pad matching the second location information of the key "0" on the display device.

For another example, the display device still includes one column of input methods: 1234567890, the user wants to go from the current key "0" to the key "1"; or the predetermined target key of the user is the key "8", but there is a deviation before, and the touch operation is to the first position information corresponding to "0". In the application scenario, the user may move from the first position information corresponding to the second position information of the key "0" to the first position information corresponding to the second position information of the key "1" or the key "8" through a sliding touch operation, so as to select the key "1" or the key "8". Here, the touch operation performed based on the coordinate mapping relationship may be implemented by continuously sliding a finger, without performing an operation of pressing a button of a remote controller for many times in the prior art, thereby effectively reducing interaction time.

Next, in step S103, the smart device 1 controls the smart device according to the touch operation and the second position information.

In one implementation, the controlling the smart device may include the smart device 1 performing the touch operation based on the second position information. Here, the performing of the touch operation is a response to a touch operation of the user on the first position information. In one implementation, the touch operation may be performed to implement any customized interaction operation, such as selection, confirmation, deletion, and the like, of corresponding interaction information in the display device. For example, it may be set that the touch operation includes a selection operation, the touch operation is performed in a manner including a sliding operation, when the current sliding passes through first position information on the touch pad, the touch operation is performed to select interactive information on second position information in the display device corresponding to the first position information, when a remote control interface in the display device is a function selection interface, and when a user's finger slides over a current control "setting", the selection operation on the control "setting" is performed. For another example, it may also be set that the touch operation includes a confirmation operation, and in an implementation manner, the touch operation includes a pressing operation, and continuing the above example, the selected control "setting" is confirmed, that is, it is determined to enter a new remote control interface corresponding to the selected control "setting". In another implementation manner, the confirmation operation may also be set to include a release operation, that is, after the user selects the control "set" through a sliding operation, the confirmation operation of the control "set" is completed through the release operation of lifting the finger on the first position information; in another implementation manner, the setting of the confirmation operation may further include automatically performing the confirmation operation when the touch duration exceeds a predetermined duration, that is, continuing the above example, and automatically performing the confirmation operation when the user "sets" the corresponding first position information by sliding to the control and then stays at the position for a time exceeding the predetermined duration.

For another example, when the remote control interface in the display device is an input method interface, and the user's finger currently crosses the number key "1", the selection operation on the number key "1" is performed. For another example, it may also be provided that the touch operation includes a confirmation operation, and in an implementation manner, the touch operation includes a pressing operation, and continuing the above example, confirming the selected numeric key "1", that is, determining to input the selected numeric key "1", and after the user performs the pressing operation on the first position information corresponding to the second position information matching the numeric key "1", performing the confirmation operation on the numeric key "1"; in another implementation manner, the confirmation operation may be further configured to include a release operation, that is, in the above example, after the user selects the numeric key "1" through a sliding operation, the confirmation operation on the numeric key "1" is completed through the release operation of lifting the finger on the first position information; in another implementation manner, the manner of confirming the operation may further include automatically performing the confirmation operation when the touch duration exceeds a predetermined duration, that is, continuing the above example, after the user slides to the first position information corresponding to the numeric key "1", and then stays at the position for a time exceeding the predetermined duration, automatically performing the confirmation operation.

In another implementation, the controlling the intelligent device 1 may further include displaying the touch operation on the display device according to the second position information, for example, if the touch operation includes a sliding operation, when the touch operation slides through each piece of first position information on the touch pad, the interactive information on each piece of second position information corresponding to the display device is sequentially displayed in a differentiated manner, for example, the control selected to pass through in the function selection interface is sequentially highlighted, or the shape, size, color, and the like of the control selected to pass through at present are changed, so that a user can conveniently know the progress of the touch operation, and human-computer interaction is more friendly.

In another implementation, the controlling the smart device may further include displaying information of a result of the execution of the touch operation on the display apparatus. For example, the touch operation includes a confirmation operation on a corresponding key in the input method interface, if the letter "a" is input based on the touch operation in an english input state, the selected letter "a" is displayed in a corresponding presentation area on the display device, such as at a cursor for inputting text; for another example, in the pinyin input state, the input letter "a" is confirmed based on the touch operation, and then the corresponding area on the input method interface is displayed with the option of the kanji character that may correspond after the letter "a" is confirmed. As another example, the touch operation includes confirming the "setting" of the selected control, that is, displaying the execution result information of the touch operation, that is, switching from the current interface to a new remote control interface corresponding to the "setting" of the control.

Here, it should be understood by those skilled in the art that the above-mentioned manner of controlling the smart device according to the touch operation and the second position information is only an example, and other manners, which exist now or later, of controlling the smart device according to the touch operation and the second position information should be included in the scope of the present application if applicable to the present application, and are included herein by reference.

In one implementation, the touch pad may support multi-touch operation, and at this time, a plurality of touch operations of the user in the touch pad may be acquired at the same time, for example, the touch operations of a plurality of fingers of the user may be acquired. For example, when a plurality of fingers of the user move to the corresponding first position information, the second position information corresponding to each first position information is determined, for example, the keys in the input method interface corresponding to each second position information are highlighted, and then the touch operation may be executed according to each second position information according to the sequence of expected confirmation, for example, the user releases the fingers on the first position information corresponding to each second position information in sequence, so as to implement the corresponding confirmation operation in sequence.

In the application, after the intelligent device 1 obtains the touch operation of the user in the touch pad matched with the intelligent device, the second position information of the touch operation in the display device is determined based on the first position information in the touch pad and by combining the coordinate mapping relation between the touch pad and the display device of the intelligent device, so that the intelligent device can be controlled based on the touch operation and the second position information. Here, since a preset coordinate mapping relationship exists between the display device and the touch pad, that is, the position information on the display device, and the corresponding position information is matched with the position information on the touch pad, when the user touches and operates the first position information on the touch pad, based on the pre-existing coordinate mapping relationship, the execution of the touch operation is acted on the second position information in the display device matched with the first position information, for example, if the interaction information to be selected is presented on the second position information, the user can select the interaction information by the touch operation on the first position information. Therefore, based on the application, the user can quickly position the second position information in the display device through the touch pad, and then the interactive operation of the display information on the second position information is realized, the operation of operating the intelligent household appliance back and forth through the upper left-right button and the lower left-right button on the remote controller is removed, the application can effectively avoid a time-consuming human-computer interaction mode in the process of controlling the intelligent household appliance based on the touch pad, and the flexibility of human-computer interaction is improved.

In an embodiment of the present application, the method further includes step S104 (not shown), in step S104, the smart device 1 may establish a pairing relationship between the touch pad and the smart device 1, and a coordinate mapping relationship between the touch pad and the display apparatus of the smart device 1; next, in step S102, the smart device 1 may determine second position information of the touch operation in the display apparatus based on the first position information of the touch operation in the touch pad and the coordinate mapping relationship.

In an implementation manner, the smart device 1 and the touch pad may be configured with corresponding infrared function or bluetooth function, so as to establish a communication connection between the smart device 1 and the touch pad, thereby establishing a pairing relationship between the touch pad and the smart device 1. In an implementation manner, the touch pad and the intelligent device 1 both start bluetooth, the touch pad may initiate device search, find device information of the intelligent device 1, and further initiate a pairing request to the intelligent device 1, where the intelligent device 1 may be set to receive pairing by default, and the intelligent device 1 may be set to receive pairing by confirmation operation. In another implementation manner, the smart device 1 may initiate device search to find device information of the touch pad, and then initiate a pairing request to the touch pad, where the touch pad may be set to receive pairing by default, and the touch pad may also be set to receive pairing by confirmation operation. In an implementation manner, in the pairing process, the smart device 1 acquires device information, such as identification information, of the touch pad.

In the application, in order to avoid that a user performs complicated key operations through buttons of a remote controller of the intelligent device, and meanwhile, in order to quickly locate interactive information in the display device through the touch pad, such as the location of a control in a function selection interface, the location of a key in an input method interface, and the like, and reduce time overhead, the display device and the touch pad can be scaled according to relative proportion to form a coordinate mapping relationship. In one implementation, the regions of the touch pad and the regions of the display device may be mapped in a one-to-one coordinate mapping relationship. In another mode, specifically, based on a remote control interface in a display device, a one-to-one coordinate mapping relationship may be established between the areas of the touch pad and the arrangement order and the position relationship of the interactive interface units in the remote control interface.

An example of establishing the coordinate mapping relationship between the display device and the touch panel is shown in fig. 6. Assume that the resolution of the touchpad is x1 y1 and the display device resolution is x2 y 2. Assuming that the user's finger touches the first position information (x0, y0) on the touch panel, it falls to the second position information (x, y) in the display device. The calculation formula is as follows:

can obtain the product

Can obtain the product

Thereby, the coordinate mapping relation between the display device and the touch panel can be obtained. In one implementation, the mapped location information may be found in the touch panel for each location information in the display device based on the coordinate mapping relationship. In another implementation manner, based on the coordinate mapping relationship, it may also be set that part of the position information in the display device may find the mapped position information in the touch panel, for example, the coordinate mapping relationship is established based on the position information corresponding to the remote control interface in the display device.

It should be understood by those skilled in the art that the above-mentioned method for establishing the coordinate mapping relationship between the display device and the touch panel is only an example, and other existing or later-appearing methods for establishing the coordinate mapping relationship between the display device and the touch panel are also included in the scope of the present application if they are applicable to the present application, and are included herein by reference.

In one implementation, the establishment of the coordinate mapping relationship between the remote control interface in the display device and the touch panel may also refer to an establishment method of the coordinate mapping relationship between the whole display device and the touch panel.

In one embodiment, in step S104, a pairing relationship between the touch pad and the smart device 1 may be established first; and then, when the pairing is successful, establishing a coordinate mapping relation between the touch pad and the display device of the intelligent equipment 1. In practical applications, since the establishment of the coordinate mapping relationship needs to take into account the device specifications of the touch pad and the smart device 1, the coordinate mapping relationship between the touch pad and the display apparatus of the smart device 1 may be established after the pairing relationship is established. Further, in an embodiment, the establishing a coordinate mapping relationship between the touch pad and the display device of the smart device includes: acquiring touch area information of the touch pad; and establishing a coordinate mapping relation between the touch pad and the display device according to the touch area information and the display area information of the display device of the intelligent equipment 1.

In one implementation, the touch area information may include, but is not limited to, size information, shape information, direction information, and the like of the touch area of the touch pad. In an implementation manner, the smart device 1 may obtain touch area information sent by the touch pad in a process of establishing a pairing relationship with the touch pad; alternatively, the smart device 1 may request the touch pad or actively submit the touch area information to the touch pad after establishing a pairing relationship with the touch pad. In another implementation, the acquiring of the touch area information of the touch pad may also be information that is retained in the smart device 1 based on a pairing history and is directly read when pairing is performed again. In another implementation manner, the obtaining of the touch area information of the touch pad may further include sending a touch area query request about the touch pad to a network device corresponding to the smart device 1, where the touch area query request includes identification information of the touch pad; and further receiving touch area information of the touch pad, which is returned by the network device based on the touch area query request. In one implementation, the network device may include a cloud database corresponding to the smart device 1, where the cloud database may manage a plurality of smart devices including the smart device 1, and further, the cloud database may store history uploads or touch area information of the touch pad stored based on history connection with the smart device 1 or other smart devices, so that the network device may return the touch area information of the touch pad based on a touch area query request including identification information of the touch pad initiated by the current smart device 1.

In one implementation, the display area information of the display device of the smart device 1 may include, but is not limited to, information related to a display area of a display screen, a projection surface, or an area where a display lamp is located, or various combinations thereof. For example, if the display device includes a display screen, the display area information may include, but is not limited to, size information, shape information, orientation information, and the like of the display screen. For another example, if the display device includes a projection surface, the display area information may include, but is not limited to, size information, shape information, direction information, and the like of the projection surface, and in an implementation, the size information of the projection surface may be set by a projection device corresponding to the smart device 1, for example, an external projector or an internal projection component, and the like, for example, the projection device sets a resolution of projection, and after a projection distance is determined, the size information of the corresponding projection surface is calculated. Furthermore, in one implementation, the display area information of the display device of the smart device 1 may be directly read from the configuration information of the smart device 1; the display area information of the display device of the smart device 1 may be read from other devices corresponding to the smart device 1, for example, the display area information corresponding to the projection plane is read from an external projection device.

In an embodiment of the present application, the method further includes step S105 (not shown), in step S105, the smart device 1 establishes a coordinate mapping relationship between the remote control interface in the display apparatus and the touch pad; in S102, the smart device 1 determines second position information of the touch operation in the display device based on the first position information of the touch operation in the touch pad and the coordinate mapping relationship between the touch pad and the remote control interface.

Here, the display device may include a remote interface, that is, the interactive information in the display device is the remote interface. In one implementation, the remote control interface may include a function selection interface, such as various control selection interfaces, and in the example of an intelligent electronic device, the remote control interface may include various application controls to be selected; the remote control interface can also comprise an input method interface, the input method interface can comprise letter keys, numeric keys, symbol keys, other function keys and the like, and corresponding information can be input through the operation of a user on the input method interface. In addition, the remote control interface can also comprise other interactive interfaces such as a search interface and the like; the remote control interface may also include a combination of the various interactive interfaces described above.

In the application, in order to avoid that a user performs complicated key operations through buttons of a remote controller of the intelligent device, and meanwhile, in order to quickly locate interactive information in the display device through the touch pad, such as the location of a control in a function selection interface, the location of a key in an input method interface, and the like, and reduce time overhead, the display device and the touch pad can be scaled according to relative proportion to form a coordinate mapping relationship. In one implementation manner, a one-to-one coordinate mapping relationship may be established between the area of the touch pad and the arrangement order and the position relationship of the interactive interface unit in the remote control interface, and taking a function selection interface as an example, the interactive interface unit may include various application controls; taking the input method interface as an example, the interactive interface unit may include various letter keys, number keys, symbol keys, other function keys, and the like in the input method interface.

Fig. 8 illustrates an example of remotely controlling an intelligent device 1 through a touch pad according to an embodiment of the present application, where the intelligent device 1 may be an intelligent television, a display apparatus of the intelligent television, such as a remote control interface in a display screen, is sequentially arranged with a plurality of function controls to be selected by a user, such as local applications, videos, electronic books, pictures … …, and the like in the figure, and a coordinate mapping relationship between the remote control interface in the display apparatus and the touch pad is established, i.e., each of the controls is matched with corresponding position information on the touch pad based on its position information in the remote control interface. For example, the second position information of the "native application" control is matched with the corresponding first position information on the touch pad pointed by the dotted line in the figure. Furthermore, if the user needs to select the control "native application" in the display device, the user only needs to touch and operate the first position information on the touch pad, which is matched with the second position information of the control "native application" in the display device.

An example of establishing a coordinate mapping relationship between the remote control interface and the touch panel in the display device may also be as shown in fig. 7. Assume that the resolution of the touchpad is x1 y1 and the display device resolution is x2 y 2. Assuming that the user's finger touches the first position information (x0, y0) on the touch panel, it falls to the second position information (x, y) of the remote interface in the display device. The calculation formula is as follows:

can obtain the product

Can obtain the product

Thus, the coordinate mapping relation between the remote control interface of the display device and the touch pad can be obtained. Here, the remote control interface may occupy a part or all of a location area of the display screen.

It should be understood by those skilled in the art that the above-mentioned manner of establishing the coordinate mapping relationship between the remote control interface of the display device and the touch pad is only an example, and other manners existing or appearing in the future for establishing the coordinate mapping relationship between the remote control interface of the display device and the touch pad, if applicable to the present application, should be included in the scope of protection of the present application and are included herein by reference.

Further, in an embodiment, in step S105, the smart device 1 may establish a coordinate mapping relationship between the remote control interface in the display apparatus and the touch pad when the remote control interface in the display apparatus is updated. In practical application, the coordinate mapping relationship can be reestablished when the remote control interface is switched. For example, after the style of the input method interface is changed based on the selection of the user, the coordinate mapping relationship is reestablished, and if an application control in the function selection interface is selected and the application control enters the application interface, the current remote control interface is switched and changed, and the coordinate mapping relationship may also be reestablished. Therefore, the matching degree and accuracy of the man-machine interaction operation can be guaranteed, and friendly user experience is brought.

In one embodiment, in step S105, the smart device 1 establishes a coordinate mapping relationship between the remote control interface in the display apparatus and the effective touch area in the touch pad. In practical application, a coordinate mapping relation with a remote control interface in the display device can be established based on part or all of the touch areas of the touch pad. If the effective touch area is a partial touch area, the touch operation performed by the user in the area is effective; and if the effective touch area comprises all touch areas, the touch operation performed by the user in all the touch areas of the touch pad is effective.

Further, in an embodiment, the method further includes step S106 (not shown), in step S106, when the first position information of the touch operation in the touch pad is outside the effective touch area, the smart device 1 provides corresponding operation prompt information. In one implementation, the operation prompt message may be used to prompt the user that the current touch area is invalid, or guide the user to enter the valid touch area to perform a valid touch operation, or the like. For example, a prompt of "please click on the effective interaction area", or a prompt of "please move the touch operation in the xx direction", or the like may be prompted. In one implementation, the operation prompt information may include, but is not limited to, a voice prompt, a text prompt in a display device, and the like.

In one embodiment, the shape of the active touch area matches the shape of the remote control interface.

In practical applications, the shapes of the remote control interfaces in the display device, such as the shapes of the function selection interface and the input method interface layout, may be different, and further, the shapes of the matched effective touch areas may be set based on the shapes of the remote control interfaces. Also, the remote control interface may be presented at any position in the display device. FIG. 5 illustrates several examples of matching the shape of the active touch area of a trackpad to the shape of the remote control interface of a display device, according to one embodiment of the present application. Wherein the remote control interface may occupy the entire display device or a portion of the area presented in the display device. In one implementation, the layout of the effective touch area in the touch pad may be adjusted according to the shape of the remote control interface in the display device, for example: the shape of the remote control interface is square, and the shape of an effective touch area of the touch pad can be preferably square, so that the established mapping relation is accurate, and the touch accuracy is high; for another example, the shape of the remote control interface is an ellipse, and the effective area of the touch pad may also be a rectangle. In one implementation, a mapping relationship between the active touch area and the remote control interface can be established even if the shapes of the active touch area and the remote control interface are not identical.

In one embodiment, the second location information includes location information of one or more interactive interface units on a remote control interface in a display device. In one implementation, the interactive interface unit is an action object in the remote control interface, which is provided for a user to perform an interactive operation. For example, in the function selection interface, each application control can be an interactive interface unit; for another example, in the input method interface, each key, such as an alphabetic key, a numeric key, a symbol key, other function keys, etc., may correspond to an interactive interface unit. Here, the second location information may correspond to only location information of one interactive interface unit on the remote control interface included in the display device, or may correspond to location information of a plurality of interactive interface units at the same time.

Further, in an embodiment, in the step S103, the smart device 1 may perform the touch operation on the one or more interactive interface units corresponding to the second position information according to the second position information.

Specifically, in an implementation manner, if only one interactive interface unit corresponding to the second location information is provided, the touch operation may be directly performed to implement any self-defined interactive operation, such as selection, confirmation, deletion, and the like, of the interactive interface unit. For example, it may be set that the touch operation includes a selection operation, the touch operation is performed in a manner of a sliding operation, and the current sliding operation passes through first position information on the touch pad, and then the touch operation is performed to select interactive information on second position information in the display device corresponding to the first position information, for example, when a remote control interface in the display device is an input method interface and a user's finger currently strokes a numeric key "1", then a selection operation on the numeric key "1" is performed.

In another implementation, if the second location information includes location information of a plurality of interactive interface units on a remote control interface in a display device; in step S103, the smart device 1 may execute the touch operation on the multiple interactive interface units corresponding to the second location information according to the second location information; acquiring the selection operation of a user in the touch pad; and executing the selection operation to realize the selection of the target interactive interface unit in the plurality of interactive interface units corresponding to the second position information.

In an implementation manner, if a user expects to select one or more target interactive interface units in the multiple interactive interface units corresponding to the second location information, the intelligent device 1 locks the second location information as a result of performing the touch operation on the multiple interactive interface units corresponding to the second location information according to the second location information. And further, on the basis of the touch operation, the user can further perform touch operation, namely selection operation, in the touch pad to select the target interactive interface unit.

For example, when the second position information corresponds to the positions of two keys in the input method interface, the two keys are highlighted simultaneously, and then one key is selected by touching up and down or left and right again; similarly, when the second position information corresponds to the adjacent positions of the four keys in the input method interface, the four keys are highlighted simultaneously, and then one key is selected by touching the four keys up, down, left and right again. It will be appreciated by those skilled in the art that the above-described selection operations are merely exemplary, and that other selection operations now or later developed, if applicable to the present application, are intended to be encompassed within the scope of the present application and are hereby incorporated by reference.

For another example, if there are a plurality of target interactive interface units in the plurality of interactive interface units corresponding to the second location information, and if there are a plurality of keys in the input method interface corresponding to the second location information and some of the keys need to be selected continuously, then at this time, a plurality of selection operations of the user may be obtained continuously based on an expected selected order of each target interactive interface unit. For example, when the second position information corresponds to the positions of two keys in the input method interface, and the two keys are two keys that the user expects to select consecutively, highlighting the two keys simultaneously, wherein the touch operation is actually locking the two keys corresponding to the second position information, and selecting the target key in the previous sequence by touching up and down or left and right again, the selection operation may include, but is not limited to, a stress operation or a release operation, and after one selection, i.e. a target key is confirmed, and further selection of the next target key can be performed, e.g. if the selection comprises a depressing operation, under the condition of not releasing the finger, continuously touching up and down or left and right again to select the target key in the later order, executing the repressing operation again and finishing the selection operation of the target key in the later order; for another example, if the selection operation includes a release operation, the selection operation of the target key in the subsequent order may be completed by continuously touching again up and down or left and right within the preset effective operation time to select the target key in the subsequent order and perform the release operation again. It will be appreciated by those skilled in the art that the above-described selection operations are merely exemplary, and that other selection operations now or later developed, if applicable to the present application, are intended to be encompassed within the scope of the present application and are hereby incorporated by reference.

The application also provides a method for remotely controlling the intelligent equipment on the touch pad. The method may be implemented in the touch pad. Fig. 2 shows a schematic diagram of a method for remotely controlling a smart device via a touch pad according to an embodiment of the present application. The method includes step S201 ', step S202 ', step S101 ', step S102 ', and step S103 '.

In step S201', the touch pad 2 may receive a touch operation of a user in the touch pad 2; next, in step S202', the touch pad 2 may send the touch operation to the corresponding smart device 1, where the touch pad and the display device of the smart device have a coordinate mapping relationship; next, in step S101', the smart device 1 may obtain a touch operation of a user in a touch pad 2, where the touch pad 2 is paired with the smart device 1; next, in step S102', the smart device 1 may determine second position information of the touch operation in the display device based on the first position information of the touch operation in the touch pad 2 and the coordinate mapping relationship between the touch pad 2 and the display device of the smart device 1; next, in step S103', the smart device 1 may control the smart device 1 according to the touch operation and the second position information. Here, the touch pad 2 may correspond to the touch pad in the embodiment of fig. 1. Here, the contents of step S101 ', step S102', and step S103 'are the same as or similar to those of step S101', step S102, and step S103 in fig. 1, and are not repeated herein and are included herein by reference.

Here, compare in current mode based on key-type remote controller control intelligent household electrical appliances, or some mode based on intelligent cell-phone control intelligent household electrical appliances, this application passes through touch-control panel 2 matches with intelligent equipment 1 to can the multiple intelligent equipment of accurate remote control, simplified user operation, improved and controlled efficiency, improved user experience, still avoided the user to learn the cost of learning of remote control function in multiple remote controller or the intelligent cell-phone. In addition, because the existing mode of controlling the smart home appliance by using the mobile phone is when the screen of the mobile phone is occupied, such as: when answering a call, a video and a voice, a user cannot control the intelligent household appliances at the same time, and only when the mobile phone screen is not occupied, the intelligent household appliances can be controlled by means of the touch function of the mobile phone screen, so that the mode cannot guarantee that the intelligent household appliances can be effectively controlled at any time, and the intelligent household appliances can be controlled continuously and stably by the method, so that the man-machine interaction operation is more friendly.

Further, in an embodiment, the method further includes step S203 '(not shown), in step S203', a pairing relationship between the touch pad and the smart device may be established; next, in step S202', the touch pad 2 may send the touch operation to the smart device that has established a pairing relationship with the touch pad, where the touch pad and the display device of the smart device have a coordinate mapping relationship. Here, the touch pad is paired with the smart device 1. I.e. it is determined that the smart device 1 can be controlled by means of the touch pad. In an implementation manner, a pairing manner of the touch pad and the smart device 1 may be a default, for example, the touch pad and the smart device 1 are in a one-to-one matching relationship, and the pairing relationship is stable. In another implementation manner, the pairing relationship between the touch pad and the smart device 1 may be arbitrarily combined, that is, in practical application, the touch pad may control different smart devices, and the smart devices may also be controlled by different touch pads. In the application, when the pairing relationship between the touch pad and the intelligent device 1 is determined, the operation of remotely controlling the intelligent device through the touch pad can be realized.

In an implementation manner, the smart device 1 and the touch pad 2 may be configured with corresponding infrared functions or bluetooth functions, so as to establish a communication connection between the smart device 1 and the touch pad 2, thereby establishing a pairing relationship between the touch pad 2 and the smart device 1. In an implementation manner, the touch pad 2 and the intelligent device 1 both start bluetooth, the touch pad 2 initiates device search, finds device information of the intelligent device 1, and further initiates a pairing request to the intelligent device 1, where the intelligent device 1 may be set to receive pairing by default, and the intelligent device 1 may be set to receive pairing by confirmation operation. In another implementation manner, the smart device 1 may initiate device search to find device information of the touchpad 2, and further initiate a pairing request to the touchpad 2, where the touchpad 2 may be set to receive pairing by default, and the touchpad 2 may be set to receive pairing by confirmation operation. In one implementation, during the pairing process, the touch pad 2 may send its device information, such as identification information, to the smart device 1.

The application provides a smart device 1 remotely controlled by a touch pad. Fig. 3 shows a device schematic of a smart device 1 remotely controlled by a touch pad according to an aspect of the present application. The intelligent device 1 includes an obtaining device 301, a determining device 302 and a control device 303. The obtaining device 301 may obtain a touch operation of a user in a touch pad, where the touch pad is paired with the smart device 1; the determining device 302 may determine second position information of the touch operation in the display device based on first position information of the touch operation in the touch pad and a coordinate mapping relationship between the touch pad and the display device of the smart device 1; the control device 303 may control the smart device 1 according to the touch operation and the second position information.

Specifically, the obtaining device 301 may obtain a touch operation of the user in a touch pad, where the touch pad is paired with the smart device 1. In one implementation, the touch operation mode may include, but is not limited to, clicking, such as single clicking or multi-clicking; pressing, such as pressing at different pressure levels, pressing for different durations; moving; lifting the finger to release; and combinations of the above. It should be understood by those skilled in the art that the above-mentioned touch operation manner is only an example, and other touch operation manners existing in the present application or appearing in the future are also included in the protection scope of the present application if applicable to the present application, and are included in the form of reference. Here, the touch operation submitted by the user may be realized by the user touching the touch pad with a finger, or may be realized by the user touching the touch pad with another touch component, such as a stylus.

Here, the determining device 302 may determine second position information of the touch operation in the display device based on first position information of the touch operation in the touch pad and a coordinate mapping relationship between the touch pad and the display device of the smart device.

Here, the control device 303 controls the smart device according to the touch operation and the second position information.

In an embodiment of the present application, the smart device 1 further includes a first establishing device (not shown), where the first establishing device may establish a pairing relationship between the touch pad and the smart device 1 and a coordinate mapping relationship between the touch pad and a display device of the smart device 1; here, the determining means 302 may determine second position information of the touch operation in the display means based on first position information of the touch operation in the touch pad and the coordinate mapping relationship.

can obtain the product

Can obtain the product

In one embodiment, the first establishing means may first establish a pairing relationship between the touch pad and the smart device 1; and then, when the pairing is successful, establishing a coordinate mapping relation between the touch pad and the display device of the intelligent equipment 1. In practical applications, since the establishment of the coordinate mapping relationship needs to take into account the device specifications of the touch pad and the smart device 1, the coordinate mapping relationship between the touch pad and the display apparatus of the smart device 1 may be established after the pairing relationship is established. Further, in an embodiment, the establishing a coordinate mapping relationship between the touch pad and the display device of the smart device includes: acquiring touch area information of the touch pad; and establishing a coordinate mapping relation between the touch pad and the display device according to the touch area information and the display area information of the display device of the intelligent equipment.

In an embodiment of the present application, the smart device 1 further includes a second establishing device (not shown), where the second establishing device may establish a coordinate mapping relationship between a remote control interface in the display device and the touch pad; the determining device may determine second position information of the touch operation in the display device based on first position information of the touch operation in the touch pad and a coordinate mapping relation between the touch pad and the remote control interface.

can obtain the product

Can obtain the product

Further, in an embodiment, the second establishing means may establish a coordinate mapping relationship between the remote control interface in the display device and the touch pad when the remote control interface in the display device is updated. In practical application, the coordinate mapping relationship can be reestablished when the remote control interface is switched. For example, after the style of the input method interface is changed based on the selection of the user, the coordinate mapping relationship is reestablished, and if an application control in the function selection interface is selected and the application control enters the application interface, the current remote control interface is switched and changed, and the coordinate mapping relationship may also be reestablished. Therefore, the matching degree and accuracy of the man-machine interaction operation can be guaranteed, and friendly user experience is brought.

In one embodiment, the second establishing means may establish a coordinate mapping relationship between a remote control interface in the display device and an effective touch area in the touch pad. In practical application, a coordinate mapping relation with a remote control interface in the display device can be established based on part or all of the touch areas of the touch pad. If the effective touch area is a partial touch area, the touch operation performed by the user in the area is effective; and if the effective touch area comprises all touch areas, the touch operation performed by the user in all the touch areas of the touch pad is effective.

Further, in an embodiment, the smart device 1 may include a prompting device (not shown), and when the first position information of the touch operation in the touch pad is outside the effective touch area, the prompting device may provide corresponding operation prompting information. In one implementation, the operation prompt message may be used to prompt the user that the current touch area is invalid, or guide the user to enter the valid touch area to perform a valid touch operation, or the like. For example, a prompt of "please click on the effective interaction area", or a prompt of "please move the touch operation in the xx direction", or the like may be prompted. In one implementation, the operation prompt information may include, but is not limited to, a voice prompt, a text prompt in a display device, and the like.

Further, in an embodiment, the control device 303 may perform the touch operation on the one or more interactive interface units corresponding to the second position information according to the second position information.

In another implementation, if the second location information includes location information of a plurality of interactive interface units on a remote control interface in a display device; the control device 303 may execute the touch operation on the multiple interactive interface units corresponding to the second position information according to the second position information; acquiring the selection operation of a user in the touch pad; and executing the selection operation to realize the selection of the target interactive interface unit in the plurality of interactive interface units corresponding to the second position information.

The application also provides a touch control panel for remotely controlling the intelligent equipment. Fig. 4 shows a system diagram of a remote control smart device 1 according to an aspect of the present application. The system comprises a smart device 1 and a touch pad 2, wherein the smart device 1 comprises an acquisition device 301 ', a determination device 302 ' and a control device 303 ', and the touch pad comprises a receiving device 401 ' and a transmitting device 402 '.

Wherein, the receiving device 401' of the touch pad 2 can receive the touch operation of the user in the touch pad 2; then, the sending device 402' of the touch pad 2 may send the touch operation to the corresponding smart device 1, where the touch pad and the display device of the smart device have a coordinate mapping relationship; next, the obtaining device 301' may obtain a touch operation of the user in the touch pad 2, where the touch pad 2 is paired with the smart device 1; then, the determining device 302' may determine second position information of the touch operation in the display device based on the first position information of the touch operation in the touch pad 2 and the coordinate mapping relationship between the touch pad 2 and the display device of the smart device 1; then, the control device 303' may control the smart device 1 according to the touch operation and the second position information. Here, the touch pad 2 may correspond to the touch pad in the embodiment of fig. 3. Here, the acquiring device 301 ', the determining device 302 ', and the controlling device 303 ' are the same as or similar to the acquiring device 301, the determining device 302, and the controlling device 303 in fig. 3, and are not repeated herein and are included herein by reference.

Further, in an embodiment, the touch pad 2 further includes a third establishing device (not shown), and the third establishing device may establish a pairing relationship between the touch pad and the smart device; then, the sending device 402' may send the touch operation to the smart device that has established a pairing relationship with the touch pad, where the touch pad and a display device of the smart device have a coordinate mapping relationship. Here, the touch pad is paired with the smart device 1. I.e. it is determined that the smart device 1 can be controlled by means of the touch pad. In an implementation manner, a pairing manner of the touch pad and the smart device 1 may be a default, for example, the touch pad and the smart device 1 are in a one-to-one matching relationship, and the pairing relationship is stable. In another implementation manner, the pairing relationship between the touch pad and the smart device 1 may be arbitrarily combined, that is, in practical application, the touch pad may control different smart devices, and the smart devices may also be controlled by different touch pads. In the application, when the pairing relationship between the touch pad and the intelligent device 1 is determined, the operation of remotely controlling the intelligent device through the touch pad can be realized.

The application also provides a smart machine through touch pad remote control, include:

one or more processors;

a memory; and

Further, the program of the apparatus may also be used to perform corresponding operations in other related embodiments based on the above operations.

The present application further provides a computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to:

Further, the computer program may also be adapted to be executed by the processor for corresponding operations in other related embodiments based on the above-described operations.

The application also provides a touch pad for remotely controlling the intelligent device, which comprises:

one or more processors;

a memory; and

receiving touch operation of a user in a touch pad;

It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

It should be noted that the present invention may be implemented in software and/or in a combination of software and hardware, for example, as an Application Specific Integrated Circuit (ASIC), a general purpose computer or any other similar hardware device. In one embodiment, the software program of the present invention may be executed by a processor to implement the steps or functions described above. Also, the software programs (including associated data structures) of the present invention can be stored in a computer readable recording medium, such as RAM memory, magnetic or optical drive or diskette and the like. Further, some of the steps or functions of the present invention may be implemented in hardware, for example, as circuitry that cooperates with the processor to perform various steps or functions.

In addition, some of the present invention can be applied as a computer program product, such as computer program instructions, which when executed by a computer, can invoke or provide the method and/or technical solution according to the present invention through the operation of the computer. Program instructions which invoke the methods of the present invention may be stored on a fixed or removable recording medium and/or transmitted via a data stream on a broadcast or other signal-bearing medium and/or stored within a working memory of a computer device operating in accordance with the program instructions. An embodiment according to the invention herein comprises an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the apparatus to perform a method and/or solution according to embodiments of the invention as described above.

It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the apparatus claims may also be implemented by one unit or means in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.

Claims

1. A method of remotely controlling a smart device via a trackpad, wherein the method comprises:

the method comprises the steps of obtaining touch operation of a user in a touch pad, wherein the touch pad is matched with intelligent equipment, a display device of the intelligent equipment comprises a corresponding remote control interface, the remote control interface comprises interactive information in the display device, and the remote control interface is presented in a part of area in the display device;

adjusting the layout of an effective touch area in the touch pad according to the shape of the remote control interface, and establishing a coordinate mapping relation between the remote control interface of the display device and the effective touch area in the touch pad;

determining second position information of the touch operation in the display device based on first position information of the touch operation in the touch pad and a coordinate mapping relation between an effective touch area in the touch pad and the remote control interface, wherein the coordinate mapping relation comprises that the position information on the remote control interface of the display device has corresponding position information matched with the position information on the effective touch area of the touch pad;

2. The method of claim 1, wherein the method further comprises:

establishing a pairing relation between a touch pad and intelligent equipment and a coordinate mapping relation between the touch pad and a display device of the intelligent equipment;

wherein the determining, based on the first position information of the touch operation in the touch pad and the coordinate mapping relationship between the touch pad and the display device of the smart device, the second position information of the touch operation in the display device comprises:

and determining second position information of the touch operation in the display device based on the first position information of the touch operation in the touch pad and the coordinate mapping relation.

3. The method of claim 2, wherein the establishing a pairing relationship between a touch pad and a smart device and a coordinate mapping relationship between the touch pad and a display device of the smart device comprises:

establishing a pairing relation between a touch pad and intelligent equipment;

and when the pairing is successful, establishing a coordinate mapping relation between the touch pad and a display device of the intelligent equipment.

4. The method of claim 3, wherein the establishing a coordinate mapping relationship of the trackpad to a display device of the smart device comprises:

acquiring touch area information of the touch pad;

and establishing a coordinate mapping relation between the touch pad and the display device according to the touch area information and the display area information of the display device of the intelligent equipment.

5. The method of claim 4, wherein the obtaining touch area information of the touch pad comprises:

sending a touch area query request about the touch pad to network equipment corresponding to the intelligent equipment, wherein the touch area query request comprises identification information of the touch pad;

and receiving touch area information of the touch pad returned by the network equipment based on the touch area query request.

6. The method of claim 1, wherein the establishing a coordinate mapping relationship of a remote control interface in the display device to the trackpad comprises:

and when the remote control interface in the display device is updated, establishing a coordinate mapping relation between the remote control interface in the display device and the touch pad.

7. The method of claim 1, wherein a shape of the active touch area matches a shape of the remote control interface.

8. The method of claim 1 or 7, wherein the method further comprises:

and when the first position information of the touch operation in the touch pad is out of the effective touch area, providing corresponding operation prompt information.

9. The method of claim 1, wherein the second location information comprises location information of one or more interactive interface units on a remote control interface in a display device.

10. The method of claim 9, wherein the controlling the smart device according to the touch operation and the second location information comprises:

and executing the touch operation on the one or more interactive interface units corresponding to the second position information according to the second position information.

11. The method of claim 10, wherein if the second location information includes location information of a plurality of interactive interface units on a remote control interface in a display device;

wherein the controlling the smart device according to the touch operation and the second position information comprises:

according to the second position information, the touch operation is executed on the plurality of interactive interface units corresponding to the second position information;

acquiring the selection operation of a user in the touch pad;

and executing the selection operation to realize the selection of the target interactive interface unit in the plurality of interactive interface units corresponding to the second position information.

12. The method of claim 1, wherein the smart device comprises a smart appliance.

13. A method of remotely controlling a smart device on a touch pad, wherein the method comprises:

receiving touch operation of a user in a touch pad; sending the touch operation to a corresponding intelligent device, wherein the touch pad is paired with the intelligent device, the display device of the intelligent equipment comprises a corresponding remote control interface, the remote control interface comprises interactive information in the display device, the remote control interface is presented in a part of area of the display device, the touch operation and the second position information of the touch operation in the display device are used for controlling the intelligent equipment, the second position information is determined based on the first position information of the touch operation in the touch pad and the coordinate mapping relation between the effective touch area in the touch pad and the remote control interface, the coordinate mapping relation comprises that the position information on the remote control interface of the display device is matched with the corresponding position information on the effective touch area in the touch pad, and the effective touch area in the touch pad is adjusted according to the shape of the remote control interface.

14. The method of claim 13, wherein the method further comprises:

establishing a pairing relation between a touch pad and intelligent equipment;

sending the touch operation to a corresponding intelligent device, wherein the existence of a coordinate mapping relationship between the touch pad and a display device of the intelligent device includes:

and sending the touch operation to the intelligent equipment, wherein the touch pad and a display device of the intelligent equipment have a coordinate mapping relation.

15. A smart device remotely controlled by a touch pad, wherein the smart device comprises:

the device comprises an acquisition device, a display device and a control device, wherein the acquisition device is used for acquiring the touch operation of a user in a touch pad, the touch pad is matched with intelligent equipment, the display device of the intelligent equipment comprises a corresponding remote control interface, the remote control interface comprises interactive information in the display device, and the remote control interface is presented in a part of area in the display device;

the second establishing device is used for adjusting the layout of the effective touch area in the touch pad according to the shape of the remote control interface and establishing a coordinate mapping relation between the remote control interface of the display device and the effective touch area in the touch pad;

the determining device is used for determining second position information of the touch operation in the display device based on first position information of the touch operation in the touch pad and a coordinate mapping relation of an effective touch area in the touch pad and the remote control interface, wherein the coordinate mapping relation comprises that the position information on the remote control interface of the display device has corresponding position information matched with the position information on the effective touch area of the touch pad;

16. The smart device of claim 15, wherein the smart device further comprises:

the system comprises a first establishing device and a second establishing device, wherein the first establishing device is used for establishing a pairing relation between a touch pad and intelligent equipment and a coordinate mapping relation between the touch pad and a display device of the intelligent equipment;

wherein the determining means is for:

17. The smart device of claim 16, wherein the first establishing means is configured to:

establishing a pairing relation between a touch pad and intelligent equipment;

18. The smart device of claim 17, wherein the establishing a coordinate mapping relationship of the trackpad to a display of the smart device comprises:

acquiring touch area information of the touch pad;

19. The smart device of claim 18, wherein the obtaining touch area information of the touch pad comprises:

20. The smart device of claim 15, wherein the second establishing means is configured to:

21. The smart device of claim 15, wherein a shape of the active touch area matches a shape of the remote control interface.

22. The smart device of claim 1 or 21, wherein the smart device further comprises:

and the prompt device is used for providing corresponding operation prompt information when the first position information of the touch operation in the touch pad is outside the effective touch area.

23. The smart device of claim 15, wherein the second location information includes location information of one or more interactive interface units on a remote control interface in a display.

24. The smart device of claim 23, wherein the control means is configured to:

25. The intelligent device according to claim 24, wherein if the second location information includes location information of a plurality of interactive interface units on a remote control interface in a display apparatus;

wherein the control device is configured to:

acquiring the selection operation of a user in the touch pad;

26. The smart device of claim 15, wherein the smart device comprises a smart appliance.

27. A trackpad for remotely controlling a smart device, wherein the trackpad comprises:

a sending device, configured to send the touch operation to a corresponding smart device, where the touch pad is paired with the smart device, a display device of the smart device includes a corresponding remote control interface, the remote control interface includes interaction information in the display device, the remote control interface is presented in a part of an area of the display device, second location information of the touch operation and the touch operation in the display device is used to control the smart device, the second location information is determined based on first location information of the touch operation in the touch pad and a coordinate mapping relationship between an effective touch area in the touch pad and the remote control interface, the coordinate mapping relationship includes that location information on the remote control interface of the display device matches corresponding location information on the effective touch area in the touch pad, the effective touch area in the touch pad is adjusted according to the shape of the remote control interface.

28. The trackpad of claim 27, wherein the trackpad further comprises:

the third establishing device is used for establishing the pairing relation between the touch pad and the intelligent equipment;

wherein the transmitting device is configured to:

29. A system for remotely controlling a smart device, wherein the system comprises a smart device as claimed in any one of claims 15 to 26 and a trackpad as claimed in any one of claims 27 or 28.

30. A smart device remotely controlled by a touch pad, comprising:

one or more processors;

a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the programs comprising instructions for performing the method of any of claims 1-12.

31. A computer-readable storage medium, on which a computer program is stored, which computer program can be executed by a processor to perform the method according to any of claims 1-14.

32. A trackpad for remotely controlling a smart device, comprising:

one or more processors;

a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the programs comprising instructions for performing the method of claim 13 or 14.