CN105335136A - Control method and device of intelligent equipment - Google Patents
Control method and device of intelligent equipment Download PDFInfo
- Publication number
- CN105335136A CN105335136A CN201410339814.8A CN201410339814A CN105335136A CN 105335136 A CN105335136 A CN 105335136A CN 201410339814 A CN201410339814 A CN 201410339814A CN 105335136 A CN105335136 A CN 105335136A
- Authority
- CN
- China
- Prior art keywords
- image
- button
- image information
- corresponding relation
- triggered
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F3/0383—Signal control means within the pointing device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a control method and device of intelligent equipment. The method comprises the following steps: receiving a key signal of a triggered key, sent by a control device of the intelligent equipment; obtaining image information corresponding to the triggered key of the control device from a pre-stored corresponding relationship between the keys and image information according to the key signal; determining a matched image from the currently display view according to the image information; and simulating a click event for the matched image. According to the control method and device of the intelligent equipment, the problem that an application program in a mobile terminal touch screen manner does not support handle operation and needs to modify the application program code after being transplanted to an intelligent television system is solved, and the development cost of the application program is decreased.
Description
Technical field
The application relates to technical field of intelligent equipment, particularly relates to a kind of control method and device of smart machine.
Background technology
At present, most of application program (APP, APPlication) such as game is based on touch-screen smart mobile phone or personal digital assistant (PDA, PersonalDigitalAssistant) develop, usually these interactive modes adopted of playing are screen touch mode, run if the game of these support screen touch manners is transplanted in intelligent television, then need to use game paddle to operate, but, the operation of other modes is not supported in the existing game that can be operated by touch manner on smart mobile phone or PAD, user cannot will support that the game of touch manner is transplanted in intelligent television.
At present, by the mode of amendment game source code, the mode of operation of change game, make to play and can support the mode of operation of game paddle, this just needs to modify to the source code of the game of all screen touch modes, and this mode not only workload is large, and cost of development is high.
Summary of the invention
The application is intended to solve one of technical matters in correlation technique at least to a certain extent.
For this reason, first object of the application is the control method proposing a kind of smart machine, the method can solve the application migration of screen of mobile terminal mode after intelligent television system, do not support the lever operated problem needing to revise application code, decrease Develop Application System cost.
Second object of the application is the control device proposing a kind of smart machine.
For reaching above-mentioned purpose, the application's first aspect embodiment proposes a kind of control method of smart machine, comprising: the push button signalling of the button that is triggered that the actuation means receiving described smart machine sends; According to described push button signalling, from the corresponding relation of the button preserved in advance and image information, obtain described actuation means and to be triggered image information corresponding to button; From the view of current display, the image mated is determined according to described image information; And the image simulation click event to described coupling.
The control method of the smart machine of the embodiment of the present application, the push button signalling of the button that is triggered sent according to the actuation means of smart machine from the button preserved in advance with obtain actuation means the corresponding relation of image information and to be triggered image information corresponding to button, and from the view of current display, the image of coupling is determined according to image information, and the image simulation click event to coupling, solve the application migration of screen of mobile terminal mode after intelligent television system, do not support the lever operated problem needing to revise application code, decrease Develop Application System cost, make user can manipulate APP by actuation means.
For reaching above-mentioned purpose, the application's second aspect embodiment proposes a kind of control device of smart machine, comprising: receiver module, the push button signalling of the button that is triggered that the actuation means for receiving described smart machine sends; Acquisition module, for according to described push button signalling, from the corresponding relation of the button preserved in advance and image information, obtains described actuation means and to be triggered image information corresponding to button; Determination module, for determining the image mated from the view of current display according to described image information; And click module, for the image simulation click event to described coupling.
The control device of the smart machine of the embodiment of the present application, the push button signalling of the button that is triggered that the actuation means receiving smart machine by receiver module sends, acquisition module according to key signals from the button preserved in advance with obtain image information corresponding to the button that is triggered the corresponding relation of image information, determination module determines the image mated from the view of current display according to image information, and click the image simulation click event of module to coupling, thus, solve the application migration of screen of mobile terminal mode after intelligent television system, do not support the lever operated problem needing to revise application code, decrease Develop Application System cost, make user can manipulate APP by actuation means.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of the control method of the smart machine of the application's embodiment.
Fig. 2 is the schematic diagram at the interface of application program in the smart machine of the application's embodiment.
Fig. 3 a is the schematic diagram one of button and image information corresponding relation in the guiding interface of the application's embodiment.
Fig. 3 b is the schematic diagram two of button and image information corresponding relation in the guiding interface of the application's embodiment.
Fig. 4 is the structural representation of the control device of the smart machine of the application's embodiment.
Fig. 5 is the structural representation of the control device of the smart machine of another embodiment of the application.
Embodiment
Be described below in detail the embodiment of the application, the example of described embodiment is shown in the drawings, and wherein same or similar label represents same or similar element or has element that is identical or similar functions from start to finish.Be exemplary below by the embodiment be described with reference to the drawings, be intended to for explaining the application, and the restriction to the application can not be interpreted as.
Below with reference to the accompanying drawings control method and the device of the smart machine of the embodiment of the present application are described.
Fig. 1 is the process flow diagram of the control method of the smart machine of the application's embodiment, and as shown in Figure 1, the method comprises:
S101, the push button signalling of the button that is triggered that the actuation means receiving smart machine sends.
In this embodiment, take smart machine as intelligent television for example is described, wherein the system of intelligent television can be Android (Android) system, also can be internet operating system IOS (InternetworkOperatingSystem), this embodiment of operating system for intelligent television does not limit.
Above-mentioned actuation means is the device that can control smart machine, and comprises multiple button in control device, and each button correspond to different key value.Particularly, whether the button in the actuation means of monitoring intelligent equipment is triggered, if the button monitored in actuation means is triggered, then and the push button signalling of the button that is triggered that the actuation means receiving smart machine sends.
Such as, when user plays a game as shown in Figure 2 in intelligent television, actuation means can be game paddle, wherein, the buttons such as A, B, X, Y, upper and lower, left and right are comprised in game paddle, if user triggers the button such as button A on game paddle, then receive the push button signalling that the button A that is triggered of game paddle transmission is corresponding.
S102, according to push button signalling, from the corresponding relation of the button preserved in advance and image information, obtains actuation means and to be triggered image information corresponding to button.
Wherein, the button preserved can be corresponding with the mark of application A PP (APPlication) with the corresponding relation of image information, that is, different application programs correspond to different buttons and the corresponding relation of image information, can be distinguished by the mark of application program to the corresponding relation of the button corresponding to different application and image information.
Particularly, receive smart machine actuation means send the button that is triggered push button signalling after, the mark of application A PP corresponding to the picture of the current display of smart machine can be obtained, and according to the mark of application program, from with corresponding relation corresponding to mark namely from the corresponding relation of the button preserved in advance and image information, acquisition actuation means is triggered image information corresponding to button.
In order to can from the button preserved in advance with obtain actuation means the corresponding relation of image information and to be triggered image information corresponding to button, can also preserve in advance the corresponding relation of button and image information, particularly, the guiding interface that corresponding relation is set can be shown on smart machine, user can select according to the prompting guided in the page button that image is corresponding, user selects the mode of the corresponding relation of image and button to comprise: receive user to the button guiding the image that interface is selected to input, and preserve the corresponding relation of the image information of this button and image.It should be noted that, when receiving user to the button guiding the image that interface is selected to input, the mark of application program corresponding to current guiding interface can also be obtained, and when preserving the corresponding relation of image information of button and image, preserve the mark of current application program.
If only comprise characteristic image in image information, before the corresponding relation preserving button and characteristic image, also can propose characteristic of correspondence image based on different feature extraction modes from current APP, and the corresponding relation of button and characteristic image is preserved.
If image information comprises characteristic image and the characteristic image positional information at intelligent set screen, preservation button and characteristic image before the corresponding relation of the positional information of intelligent set screen, also can extract characteristic image and the positional information of characteristic image in screen of intelligent device based on different feature extraction modes from current APP.
With a concrete implementation, extraction characteristic image and characteristic image are described in the process of the positional information of screen of intelligent device below.
For the game in the intelligent television shown in Fig. 2, if the guided missile in Fig. 2 is characteristic image, and user selects the button that this characteristic image is corresponding to be button A, when extracting positional information at smart machine of characteristic image and characteristic image, the image that a frame comprises the guided missile shown in Fig. 2 can be intercepted, and intercept out the positional information corresponding to guided missile according to this two field picture, after acquisition characteristic image and the positional information of characteristic image in intelligent television, can by key assignments corresponding for button A, the one-to-one relationship of guided missile and the guided missile positional information in intelligent television is preserved, can above-mentioned one-to-one relationship be kept in network data base furthermore, and also need to preserve the mark corresponding to this game when preserving, thus, make user that the corresponding relation of button and image can be set according to the hobby of oneself and use habit, improve the Experience Degree of user.
In this embodiment, the image that the image the setting up corresponding relation control object that can select to respond click event is corresponding, such as, in Fig. 2, missile image is a control object that can respond click event, namely, when user clicks this guided missile icon, corresponding function can be triggered.In a concrete embodiment, in order to set up the corresponding relation of the button image corresponding with control object, before the corresponding relation of image information preserving button and image, the corresponding relation set up between image information and the control object that can respond click event can also be comprised, by setting up the corresponding relation between image information and the control object that can respond click event, when can make there is clicking operation in image information, click event can be simulated to the control object corresponding with this image information.
In addition, in this embodiment, after the corresponding relation that user preserves button and image information, be triggered before image information corresponding to button obtaining actuation means, can also comprise: display arranges the guiding interface of corresponding relation, guide interface to comprise the initial corresponding relation of button and image information, receive user to the modify instruction of initial corresponding relation, and preserve the corresponding relation of the image information of amended button and image.Wherein, this initial corresponding relation can be the corresponding relation that system generates automatically, also can be by corresponding relation that user revised.
Particularly, when user is after the one-to-one relationship guiding button and image information interface inputted as shown in Figure 3 a, if user is in the process using operating means controlling application program APP, find that the corresponding relation of button and the image information arranged does not meet the use habit of oneself a bit, user also can revise the corresponding relation of button and image information as required, such as, image and button are set to corresponding relation as shown in Figure 3 a by user, if user is in the process used, find image A button B, image party B-subscriber button A controls more comfortable, now, button A corresponding for image A is revised as button B by the guiding page of corresponding relation by user, the button B that image B is corresponding is revised as button A, the amended button of user and image information one-to-one relationship are as shown in Figure 3 b, thus, make user can revise the corresponding relation of button and image-region according to use habit, improve the Experience Degree of user.
S103, determines the image mated from the view of current display according to image information.
Particularly, if image information comprises characteristic image, now the image mated with characteristic image can be determined according to characteristic image from the view of current display.Such as, the method by image recognition identifies the image mated with characteristic image from the view of current display.
If image information comprises characteristic image and the positional information of characteristic image in screen of intelligent device, then can obtain the image of correspondence position in the view of the current display of smart machine according to positional information, then determine the image mated with characteristic image in the image got.
Particularly, the image of correspondence position in the view of the current display of smart machine can be intercepted out according to the positional information of characteristic image in smart machine, and after intercepting out the image of correspondence position, the similarity between similarity measurements quantity algorithm computed image and characteristic image can be utilized, wherein, similarity measurements quantity algorithm can comprise Cross Correlation Matching algorithm, Cross Correlation Matching algorithm is a kind of matching algorithm of classics, it determines the matching degree of the two by the cross correlation measure value calculated between the image that intercepts in characteristic image and current picture, namely the similarity degree between characteristic image and current picture truncated picture is determined by the size of cross correlation measure value, the larger expression of cross correlation measure value two image similarities are higher.
In this embodiment, we represent cross correlation measure value with NC (i, j), and wherein, i represents the image intercepted out from present image, j representation feature image, and the formula calculating cross correlation measure value NC (i, j) is as follows:
Wherein, the m that T (m, n) is characteristic image is capable, the pixel value of the n-th row; S (m, n) for the m of the image intercepted out capable, n-th row pixel value.
Obtaining the cross correlation measure value NC (i between characteristic image and the image intercepted out from current picture, j) after, if cross correlation measure value NC (i, j) calculated is greater than predetermined threshold value such as 0.8, then determine that the image acquired mates with characteristic image.
S104, to the image simulation click event of coupling.
Particularly, after determining the image mated with characteristic image, can click or double-click event the image simulation of coupling, namely the control object simulation can simulating click event be clicked or double-click event, and after simulation is clicked, corresponding the clicking or double-click event of response.
Such as, intelligent television shows the picture of a flying games as shown in Figure 2, game paddle comprises button A, B, X, Y, on, under, left, right etc., wherein, the function of the guided missile on the right side of picture accelerates aircraft, if when user shows picture as shown in Figure 2 on intelligent television, press the button A corresponding on handle with the right side guided missile of flying games, the image be truncated to from the view of the current display of intelligent television if determine and button A characteristic of correspondence image similarity are greater than 0.8, then to the image simulation click event be truncated to, namely corresponding to the aircraft control object simulation click event can simulating click event, and namely the functional response click event corresponding according to this image accelerated the aircraft in Fig. 2.
The control method embodiment of above-mentioned smart machine, the push button signalling of the button that is triggered sent according to the actuation means of smart machine from the button preserved in advance with obtain actuation means the corresponding relation of image information and to be triggered image information corresponding to button, and from the view of current display, the image of coupling is determined according to image information, and the image simulation click event to coupling, solve the application migration of screen of mobile terminal mode after intelligent television system, do not support the lever operated problem needing to revise application code, decrease Develop Application System cost, make user can manipulate APP by actuation means.
In order to realize above-described embodiment, the application also proposes a kind of control device of smart machine.
Fig. 4 is the structural representation of the control device of the smart machine of the application's embodiment, and as shown in Figure 4, this device comprises: receiver module 100, acquisition module 200, determination module 300 and click module 400.Wherein:
The push button signalling of the button that is triggered that receiver module 100 sends for the actuation means receiving above-mentioned smart machine; Acquisition module 200 for according to above-mentioned push button signalling, from the corresponding relation of the button preserved in advance and image information, obtains above-mentioned actuation means and to be triggered image information corresponding to button; Determination module 300 for determining the image mated from the view of current display according to above-mentioned image information; And click module 400 for the image simulation click event to above-mentioned coupling.
In this embodiment, take smart machine as intelligent television for example is described, wherein the system of intelligent television can be Android (Android) system, also can be internet operating system IOS (InternetworkOperatingSystem), this embodiment of operating system for intelligent television does not limit.
Above-mentioned actuation means is the device that can control smart machine, and comprises multiple button in control device, each button this different key value corresponding.Particularly, whether the button in the actuation means of monitoring intelligent equipment is triggered, if the button monitored in actuation means is triggered, then and the push button signalling of the button that is triggered that the actuation means that receiver module 100 receives smart machine sends.
Above-mentioned corresponding relation is corresponding with the mark of application A PP, above-mentioned acquisition module 200 is specifically for the mark that obtains APP corresponding to the picture of the current display of above-mentioned smart machine, and according to above-mentioned mark, from the corresponding relation corresponding with above-mentioned mark namely from the corresponding relation of the button preserved in advance and image information, obtain the image information that the above-mentioned button that is triggered is corresponding.
When above-mentioned image information comprises characteristic image, above-mentioned determination module 300 specifically for: according to above-mentioned characteristic image, determine and the image that above-mentioned characteristic image mates from the view of current display.
When above-mentioned image information comprises positional information in screen of intelligent device of characteristic image and above-mentioned characteristic image, above-mentioned determination module 300 is specifically for the image obtaining correspondence position in the view of the current display of above-mentioned smart machine according to above-mentioned positional information; Determine the image mated with above-mentioned characteristic image in the image got.
In order to user can from the button preserved in advance with obtain actuation means the corresponding relation of image information and to be triggered image information corresponding to button, as shown in Figure 5, said apparatus can also comprise Graphics Processing module 500, this Graphics Processing module 500 is triggered before image information corresponding to button for obtaining above-mentioned actuation means at above-mentioned acquisition module 200, display arranges the guiding interface of above-mentioned corresponding relation, receive the button of above-mentioned user to the image input that above-mentioned guiding interface is selected, preserve the corresponding relation of the image information of above-mentioned button and above-mentioned image; Or, display arranges the guiding interface of above-mentioned corresponding relation, above-mentioned guiding interface comprises the initial corresponding relation of button and image information, receives the modify instruction of above-mentioned user to above-mentioned initial corresponding relation, and preserves the corresponding relation of the image information of amended above-mentioned button and above-mentioned image.User can be facilitated to arrange according to oneself needs by Graphics Processing module 500 or the corresponding relation of image information of amendment button and image, meet the individual demand of user.Wherein, this initial corresponding relation can be the corresponding relation that system generates automatically, also can be by corresponding relation that user revised.
If only comprise characteristic image in image information, before the corresponding relation that Graphics Processing module 500 preserves button and characteristic image, also can propose characteristic of correspondence image based on different feature extraction modes from current APP, and the corresponding relation of button and characteristic image is preserved.
If image information comprises characteristic image and the characteristic image positional information at intelligent set screen, preservation button and characteristic image before the corresponding relation of the positional information of intelligent set screen, also can extract characteristic image and the positional information of characteristic image in screen of intelligent device based on different feature extraction modes from current APP.
It should be noted that, Graphics Processing module 500 is when preserving the corresponding relation of button and image information, the mark of application program corresponding to current guiding interface can also be obtained, and when preserving the corresponding relation of image information of button and image, preserve the mark of current application program, by preserving the mark of application program to distinguish the button of different application and the corresponding relation of image information.
Image corresponding to the image information in above-mentioned corresponding relation comprises: can respond the image that the control object of click event is corresponding.
Above-mentioned click module 400 specifically for: to above-mentioned control object simulation click event.
In addition, said apparatus can also comprise respond module 600, and respond module 600, for after above-mentioned click module 400 is to the image simulation click event of above-mentioned coupling, responds above-mentioned click event.
The process that the control device comprising the smart machine of receiver module 100, acquisition module 200, determination module 300 and click module 400 controls smart machine see Fig. 1, can not repeat herein.
The control device embodiment of above-mentioned smart machine, the push button signalling of the button that is triggered that the actuation means receiving smart machine by receiver module sends, acquisition module according to key signals from the button preserved in advance with obtain image information corresponding to the button that is triggered the corresponding relation of image information, determination module determines the image mated from the view of current display according to image information, and click the image simulation click event of module to coupling, thus, solve the application migration of screen of mobile terminal mode after intelligent television system, do not support the lever operated problem needing to revise application code, decrease Develop Application System cost, make user can manipulate APP by actuation means.
In the description of this instructions, at least one embodiment that specific features, structure, material or feature that the description of reference term " embodiment ", " some embodiments ", " example ", " concrete example " or " some examples " etc. means to describe in conjunction with this embodiment or example are contained in the application or example.In this manual, to the schematic representation of above-mentioned term not must for be identical embodiment or example.And the specific features of description, structure, material or feature can combine in one or more embodiment in office or example in an appropriate manner.In addition, when not conflicting, the feature of the different embodiment described in this instructions or example and different embodiment or example can carry out combining and combining by those skilled in the art.
In addition, term " first ", " second " only for describing object, and can not be interpreted as instruction or hint relative importance or imply the quantity indicating indicated technical characteristic.Thus, be limited with " first ", the feature of " second " can express or impliedly comprise at least one this feature.In the description of the application, the implication of " multiple " is at least two, such as two, three etc., unless otherwise expressly limited specifically.
Describe and can be understood in process flow diagram or in this any process otherwise described or method, represent and comprise one or more for realizing the module of the code of the executable instruction of the step of specific logical function or process, fragment or part, and the scope of the preferred implementation of the application comprises other realization, wherein can not according to order that is shown or that discuss, comprise according to involved function by the mode while of basic or by contrary order, carry out n-back test, this should understand by the embodiment person of ordinary skill in the field of the application.
In flow charts represent or in this logic otherwise described and/or step, such as, the sequencing list of the executable instruction for realizing logic function can be considered to, may be embodied in any computer-readable medium, for instruction execution system, device or equipment (as computer based system, comprise the system of processor or other can from instruction execution system, device or equipment instruction fetch and perform the system of instruction) use, or to use in conjunction with these instruction execution systems, device or equipment.With regard to this instructions, " computer-readable medium " can be anyly can to comprise, store, communicate, propagate or transmission procedure for instruction execution system, device or equipment or the device that uses in conjunction with these instruction execution systems, device or equipment.The example more specifically (non-exhaustive list) of computer-readable medium comprises following: the electrical connection section (electronic installation) with one or more wiring, portable computer diskette box (magnetic device), random access memory (RAM), ROM (read-only memory) (ROM), erasablely edit ROM (read-only memory) (EPROM or flash memory), fiber device, and portable optic disk ROM (read-only memory) (CDROM).In addition, computer-readable medium can be even paper or other suitable media that can print described program thereon, because can such as by carrying out optical scanning to paper or other media, then carry out editing, decipher or carry out process with other suitable methods if desired and electronically obtain described program, be then stored in computer memory.
Should be appreciated that each several part of the application can realize with hardware, software, firmware or their combination.In the above-described embodiment, multiple step or method can with to store in memory and the software performed by suitable instruction execution system or firmware realize.Such as, if realized with hardware, the same in another embodiment, can realize by any one in following technology well known in the art or their combination: the discrete logic with the logic gates for realizing logic function to data-signal, there is the special IC of suitable combinational logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA) etc.
Those skilled in the art are appreciated that realizing all or part of step that above-described embodiment method carries is that the hardware that can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, this program perform time, step comprising embodiment of the method one or a combination set of.
In addition, each functional unit in each embodiment of the application can be integrated in a processing module, also can be that the independent physics of unit exists, also can be integrated in a module by two or more unit.Above-mentioned integrated module both can adopt the form of hardware to realize, and the form of software function module also can be adopted to realize.If described integrated module using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.
The above-mentioned storage medium mentioned can be ROM (read-only memory), disk or CD etc.Although illustrate and described the embodiment of the application above, be understandable that, above-described embodiment is exemplary, can not be interpreted as the restriction to the application, and those of ordinary skill in the art can change above-described embodiment, revises, replace and modification in the scope of the application.
Claims (16)
1. a control method for smart machine, is characterized in that, comprising:
The push button signalling of the button that is triggered that the actuation means receiving described smart machine sends;
According to described push button signalling, from the corresponding relation of the button preserved in advance and image information, obtain described actuation means and to be triggered image information corresponding to button;
From the view of current display, the image mated is determined according to described image information; And
To the image simulation click event of described coupling.
2. method according to claim 1, is characterized in that, described image information comprises characteristic image; The described image determining to mate according to described image information from the view of current display, comprising:
According to described characteristic image, determine and the image that described characteristic image mates from the view of current display.
3. method according to claim 1, is characterized in that, described image information comprises characteristic image and the positional information of described characteristic image in screen of intelligent device; The described image determining to mate according to described image information from the view of current display, comprising:
The image of correspondence position in the view of the current display of described smart machine is obtained according to described positional information; Determine the image mated with described characteristic image in the image got.
4. the method according to claim 1 or 2 or 3, it is characterized in that, described corresponding relation is corresponding with the mark of application A PP;
The corresponding relation of described button from preserving in advance and image information, obtaining described actuation means and to be triggered image information corresponding to button, comprising:
Obtain the mark of APP corresponding to the picture of the current display of described smart machine, and according to described mark, from identifying corresponding corresponding relation with described, the image information that the button that is triggered described in acquisition is corresponding.
5. the method according to claim 1 or 2 or 3, is characterized in that, before the described actuation means of described acquisition is triggered image information corresponding to button, also comprises:
Display arranges the guiding interface of described corresponding relation, receives the button of described user to the image input that described guiding interface is selected, preserves the corresponding relation of the image information of described button and described image; Or,
Display arranges the guiding interface of described corresponding relation, described guiding interface comprises the initial corresponding relation of button and image information, receive the modify instruction of described user to described initial corresponding relation, and preserve the corresponding relation of the image information of amended described button and described image.
6. method according to claim 5, is characterized in that, image corresponding to the image information in described corresponding relation comprises: can respond the image that the control object of click event is corresponding.
7. method according to claim 6, is characterized in that, the described image simulation click event to described coupling, comprising: to described control object simulation click event.
8. the method according to claim 1 or 7, is characterized in that, after the described image simulation click event to described coupling, also comprises: respond described click event.
9. a control device for smart machine, is characterized in that, comprising:
Receiver module, the push button signalling of the button that is triggered that the actuation means for receiving described smart machine sends;
Acquisition module, for according to described push button signalling, from the corresponding relation of the button preserved in advance and image information, obtains described actuation means and to be triggered image information corresponding to button;
Determination module, for determining the image mated from the view of current display according to described image information; And
Click module, for the image simulation click event to described coupling.
10. device according to claim 9, is characterized in that, described image information comprises characteristic image; Described determination module, specifically for:
According to described characteristic image, determine and the image that described characteristic image mates from the view of current display.
11. devices according to claim 9, is characterized in that, described image information comprises characteristic image and the positional information of described characteristic image in screen of intelligent device; Described determination module, specifically for:
The image of correspondence position in the view of the current display of described smart machine is obtained according to described positional information; Determine the image mated with described characteristic image in the image got.
12. devices according to claim 9 or 10 or 11, it is characterized in that, described corresponding relation is corresponding with the mark of application A PP;
Described acquisition module, specifically for:
Obtain the mark of APP corresponding to the picture of the current display of described smart machine, and according to described mark, from identifying corresponding corresponding relation with described, the image information that the button that is triggered described in acquisition is corresponding.
13. devices according to claim 9 or 10 or 11, is characterized in that, also comprise:
Graphics Processing module, be triggered before image information corresponding to button for obtaining described actuation means at described acquisition module, display arranges the guiding interface of described corresponding relation, receive the button of described user to the image input that described guiding interface is selected, preserve the corresponding relation of the image information of described button and described image; Or, display arranges the guiding interface of described corresponding relation, described guiding interface comprises the initial corresponding relation of button and image information, receives the modify instruction of described user to described initial corresponding relation, and preserves the corresponding relation of the image information of amended described button and described image.
14. devices according to claim 13, is characterized in that, image corresponding to the image information in described corresponding relation comprises: can respond the image that the control object of click event is corresponding.
15. devices according to claim 14, is characterized in that, described click module, specifically for: to described control object simulation click event.
16. devices according to claim 9 or 15, is characterized in that, also comprise:
Respond module, for after described click module is to the image simulation click event of described coupling, responds described click event.
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410339814.8A CN105335136B (en) | 2014-07-16 | 2014-07-16 | The control method and device of smart machine |
| TW104102872A TWI675314B (en) | 2014-07-16 | 2015-01-28 | Smart device control method and device |
| PCT/US2015/040376 WO2016011027A1 (en) | 2014-07-16 | 2015-07-14 | Method and apparatus of controlling a smart device |
| US14/799,225 US10101827B2 (en) | 2014-07-16 | 2015-07-14 | Method and apparatus for controlling a touch-screen based application ported in a smart device |
| HK16107099.7A HK1219157A1 (en) | 2014-07-16 | 2016-06-21 | Method for controlling intelligent device and apparatus thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410339814.8A CN105335136B (en) | 2014-07-16 | 2014-07-16 | The control method and device of smart machine |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105335136A true CN105335136A (en) | 2016-02-17 |
| CN105335136B CN105335136B (en) | 2019-08-09 |
Family
ID=55074576
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410339814.8A Active CN105335136B (en) | 2014-07-16 | 2014-07-16 | The control method and device of smart machine |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US10101827B2 (en) |
| CN (1) | CN105335136B (en) |
| HK (1) | HK1219157A1 (en) |
| TW (1) | TWI675314B (en) |
| WO (1) | WO2016011027A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106775701A (en) * | 2016-12-09 | 2017-05-31 | 武汉中软通证信息技术有限公司 | A kind of client automatic evidence-collecting method and system |
| CN110187953A (en) * | 2019-06-05 | 2019-08-30 | 北京视游互动科技有限公司 | A kind of operation method and device of application program |
| CN111124152A (en) * | 2019-12-26 | 2020-05-08 | 厦门市美亚柏科信息股份有限公司 | Controller for mobile intelligent terminal screen |
| WO2020151068A1 (en) * | 2019-01-23 | 2020-07-30 | 深圳市利达成科技有限公司 | Synchronization configuration method, synchronization configuration device, storage medium and processor |
| WO2020151067A1 (en) * | 2019-01-23 | 2020-07-30 | 深圳市利达成科技有限公司 | Synchronously configured control circuit and processor |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107368298B (en) * | 2017-06-22 | 2020-09-11 | 努比亚技术有限公司 | Text control simulation touch method, terminal and computer readable storage medium |
| CN108932090A (en) * | 2018-05-29 | 2018-12-04 | 北京小米移动软件有限公司 | terminal control method, device and storage medium |
| CN109240759A (en) * | 2018-08-01 | 2019-01-18 | Oppo广东移动通信有限公司 | Application program launching method, device, terminal device and readable storage medium storing program for executing |
| CN111273971B (en) * | 2018-12-04 | 2022-07-29 | 腾讯科技（深圳）有限公司 | Method and device for processing information in view and storage medium |
| US11445107B2 (en) * | 2019-08-08 | 2022-09-13 | Qorvo Us, Inc. | Supervised setup for control device with imager |
| CN114089906A (en) * | 2021-11-08 | 2022-02-25 | 百度在线网络技术（北京）有限公司 | Intelligent mirror control method, device, equipment, storage medium and intelligent mirror |
| CN114347788B (en) * | 2021-11-30 | 2023-10-13 | 岚图汽车科技有限公司 | Intelligent cabin man-machine interaction key control system based on service |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102662559A (en) * | 2012-03-13 | 2012-09-12 | 西安交通大学 | Design method of virtual touch screen technology based on scene identification |
| US20130054954A1 (en) * | 2011-08-30 | 2013-02-28 | Samsung Electronics Co., Ltd. | Display device and booting method thereof |
| CN103272382A (en) * | 2013-05-23 | 2013-09-04 | 深圳市时讯互联科技有限公司 | Method and device for using Bluetooth gamepad to simulate intelligent terminal touch screen to control game |
| CN103480153A (en) * | 2013-09-04 | 2014-01-01 | 张家港保税区润桐电子技术研发有限公司 | Method for simulating computer gamepad with smartphone |
Family Cites Families (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6788880B1 (en) | 1998-04-16 | 2004-09-07 | Victor Company Of Japan, Ltd | Recording medium having a first area for storing an audio title set and a second area for storing a still picture set and apparatus for processing the recorded information |
| WO2002005081A1 (en) | 2000-05-11 | 2002-01-17 | Nes Stewart Irvine | Zeroclick |
| GB0123793D0 (en) * | 2001-10-04 | 2001-11-21 | Pace Micro Tech Plc | STB web browser fast link selection |
| US7224903B2 (en) | 2001-12-28 | 2007-05-29 | Koninklijke Philips Electronics N. V. | Universal remote control unit with automatic appliance identification and programming |
| US7653212B2 (en) * | 2006-05-19 | 2010-01-26 | Universal Electronics Inc. | System and method for using image data in connection with configuring a universal controlling device |
| US8775964B2 (en) | 2005-03-23 | 2014-07-08 | Core Wireless Licensing, S.a.r.l. | Method and mobile terminal device for mapping a virtual user input interface to a physical user input interface |
| US8659400B2 (en) | 2006-09-05 | 2014-02-25 | Universal Electronics Inc. | System and method for configuring the remote control functionality of a portable device |
| WO2008099456A1 (en) * | 2007-02-09 | 2008-08-21 | Mitsubishi Electric Corporation | Application executing terminal |
| US20090027334A1 (en) | 2007-06-01 | 2009-01-29 | Cybernet Systems Corporation | Method for controlling a graphical user interface for touchscreen-enabled computer systems |
| US9111176B2 (en) * | 2008-04-24 | 2015-08-18 | Nec Corporation | Image matching device, image matching method and image matching program |
| US20100083338A1 (en) * | 2008-10-01 | 2010-04-01 | I-Jen Chiang | Remote control device and remote control system |
| KR20100052203A (en) * | 2008-11-10 | 2010-05-19 | 삼성전자주식회사 | Broadcasting display device and control method thereof |
| US10996774B2 (en) | 2010-04-30 | 2021-05-04 | Nokia Technologies Oy | Method and apparatus for providing interoperability between devices |
| JP5449044B2 (en) * | 2010-06-10 | 2014-03-19 | シャープ株式会社 | Server device, terminal device, and application control system |
| US8558716B2 (en) * | 2010-06-10 | 2013-10-15 | Verizon Patent And Licensing Inc. | Systems and methods to adaptively change functionality of a remote control device to execute the script on a client program for reprogramming buttons on the remote control device |
| CN103069833A (en) * | 2010-08-06 | 2013-04-24 | 松下电器产业株式会社 | Data processing device |
| KR101832761B1 (en) * | 2011-05-26 | 2018-02-27 | 엘지전자 주식회사 | Display device, method for remotely controlling display device |
| WO2013022221A2 (en) * | 2011-08-05 | 2013-02-14 | Samsung Electronics Co., Ltd. | Method for controlling electronic apparatus based on voice recognition and motion recognition, and electronic apparatus applying the same |
| KR101394291B1 (en) * | 2011-12-05 | 2014-06-03 | 건국대학교 산학협력단 | A system and method automatically of personalized media device selection and data management in smart media cloud environment |
| KR101943441B1 (en) * | 2012-05-22 | 2019-01-29 | 삼성전자주식회사 | Remote control apparatus and method for controlling function of display apparatus |
| US8717500B1 (en) * | 2012-10-15 | 2014-05-06 | At&T Intellectual Property I, L.P. | Relational display of images |
| US8847909B2 (en) * | 2012-11-11 | 2014-09-30 | Nomovok Co., Ltd. | Touchable mobile remote control without display |
| KR20140077015A (en) * | 2012-12-13 | 2014-06-23 | 삼성전자주식회사 | display apparatus, remote control apparatus and method for providing user interdface using the same |
| CN103076978A (en) | 2013-01-10 | 2013-05-01 | 深圳市夏瑞电子有限公司 | Method and device for controlling remote equipment through touch screen mobile equipment and mobile equipment |
| KR101379398B1 (en) * | 2013-01-29 | 2014-03-28 | 은명진 | Remote control method for a smart television |
| JP2017504868A (en) * | 2013-11-29 | 2017-02-09 | ▲華▼▲為▼▲終▼端有限公司 | Installation package authorization method and apparatus |
| US11455086B2 (en) * | 2014-04-14 | 2022-09-27 | Comcast Cable Communications, Llc | System and method for content selection |
| US9766781B2 (en) * | 2014-04-28 | 2017-09-19 | Google Inc. | Methods, systems, and media for presenting related content in a user interface navigated using directional controls |
| US9880705B2 (en) * | 2014-04-28 | 2018-01-30 | Google Llc | Methods, systems, and media for navigating a user interface using directional controls |
-
2014
- 2014-07-16 CN CN201410339814.8A patent/CN105335136B/en active Active
-
2015
- 2015-01-28 TW TW104102872A patent/TWI675314B/en not_active IP Right Cessation
- 2015-07-14 US US14/799,225 patent/US10101827B2/en active Active
- 2015-07-14 WO PCT/US2015/040376 patent/WO2016011027A1/en active Application Filing
-
2016
- 2016-06-21 HK HK16107099.7A patent/HK1219157A1/en unknown
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130054954A1 (en) * | 2011-08-30 | 2013-02-28 | Samsung Electronics Co., Ltd. | Display device and booting method thereof |
| CN102662559A (en) * | 2012-03-13 | 2012-09-12 | 西安交通大学 | Design method of virtual touch screen technology based on scene identification |
| CN103272382A (en) * | 2013-05-23 | 2013-09-04 | 深圳市时讯互联科技有限公司 | Method and device for using Bluetooth gamepad to simulate intelligent terminal touch screen to control game |
| CN103480153A (en) * | 2013-09-04 | 2014-01-01 | 张家港保税区润桐电子技术研发有限公司 | Method for simulating computer gamepad with smartphone |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106775701A (en) * | 2016-12-09 | 2017-05-31 | 武汉中软通证信息技术有限公司 | A kind of client automatic evidence-collecting method and system |
| CN106775701B (en) * | 2016-12-09 | 2021-02-05 | 武汉中软通证信息技术有限公司 | Client automatic evidence obtaining method and system |
| WO2020151068A1 (en) * | 2019-01-23 | 2020-07-30 | 深圳市利达成科技有限公司 | Synchronization configuration method, synchronization configuration device, storage medium and processor |
| WO2020151067A1 (en) * | 2019-01-23 | 2020-07-30 | 深圳市利达成科技有限公司 | Synchronously configured control circuit and processor |
| CN110187953A (en) * | 2019-06-05 | 2019-08-30 | 北京视游互动科技有限公司 | A kind of operation method and device of application program |
| CN111124152A (en) * | 2019-12-26 | 2020-05-08 | 厦门市美亚柏科信息股份有限公司 | Controller for mobile intelligent terminal screen |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105335136B (en) | 2019-08-09 |
| TWI675314B (en) | 2019-10-21 |
| US10101827B2 (en) | 2018-10-16 |
| WO2016011027A1 (en) | 2016-01-21 |
| US20160018909A1 (en) | 2016-01-21 |
| TW201604719A (en) | 2016-02-01 |
| HK1219157A1 (en) | 2017-03-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105335136A (en) | Control method and device of intelligent equipment | |
| CN104756060B (en) | Cursor control based on gesture | |
| CN104246659B (en) | The gesture object that can be instantiated | |
| US20090083710A1 (en) | Systems and methods for creating, collaborating, and presenting software demonstrations, and methods of marketing of the same | |
| US20120017161A1 (en) | System and method for user interface | |
| CN108292231A (en) | It generates and applies from data | |
| CN106777229A (en) | Personalized recommendation real-time testing method and device and electronic equipment | |
| CN112558824A (en) | Page display method and device and computer storage medium | |
| CN107066188A (en) | A kind of method and terminal for sending screenshot picture | |
| KR102664318B1 (en) | Device and method to control based on voice | |
| CN109045694B (en) | Virtual scene display method, device, terminal and storage medium | |
| CN104270680A (en) | Resource playing control method and device | |
| CN106921724A (en) | Game promotion content processing method and device | |
| CN104503994A (en) | Information recommendation method and device based on input method | |
| CN107294835A (en) | Document sending method and device in a kind of instant messaging | |
| CN106855772A (en) | A kind of information displaying method and device | |
| CN105843594A (en) | Method and device for displaying application program page of mobile terminal | |
| CN112752132A (en) | Cartoon picture bullet screen display method and device, medium and electronic equipment | |
| CN110389749A (en) | Software development methodology, device and storage medium, computer equipment | |
| US10796593B2 (en) | Flight deck simulation and training system and method | |
| CN109669589B (en) | Document editing method and device | |
| CN106873947A (en) | The control method and device of application program breaker in middle class control | |
| CN114035725B (en) | Teaching method and device of ultrasonic equipment, ultrasonic imaging equipment and storage medium | |
| CN105681856A (en) | Electronic apparatus and Method for controlling the electronic apparatus thereof | |
| US8803808B1 (en) | Keyboard event detection and network event generation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1219157 Country of ref document: HK |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201211 Address after: Room 603, 6 / F, Roche Plaza, 788 Cheung Sha Wan Road, Kowloon, China Patentee after: Zebra smart travel network (Hong Kong) Limited Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Patentee before: Alibaba Group Holding Ltd. |
|
| TR01 | Transfer of patent right |