CN109218145A - Display methods, system, equipment and the storage medium of IOT appliance control interface - Google Patents
Display methods, system, equipment and the storage medium of IOT appliance control interface Download PDFInfo
- Publication number
- CN109218145A CN109218145A CN201810971551.0A CN201810971551A CN109218145A CN 109218145 A CN109218145 A CN 109218145A CN 201810971551 A CN201810971551 A CN 201810971551A CN 109218145 A CN109218145 A CN 109218145A
- Authority
- CN
- China
- Prior art keywords
- image
- user terminal
- identification number
- device identification
- control centre
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2807—Exchanging configuration information on appliance services in a home automation network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- User Interface Of Digital Computer (AREA)
- Selective Calling Equipment (AREA)
Abstract
The present invention provides display methods, system, equipment and the storage mediums of a kind of IOT appliance control interface, this method includes that user terminal obtains relevant first image of IOT equipment, and it is sent to control centre, control centre identifies device identification number by the machine learning algorithm model of setting；If control centre identifies successfully, control centre's returning equipment identifier, user terminal shows corresponding control interface；If control centre's recognition failures, control centre's returning equipment identifier list, user terminal selects device identification number according to user instructions, and the first image storage signal is sent to control centre, control centre stores the first image after user identifies to training set of images, training set of images includes the image for being labeled with device identification number, is used for training machine learning algorithm model.The present invention is to show the control interface of IOT equipment automatically by image recognition, is solved the problems, such as difficult and cumbersome with appliance control interface is manually searched caused by IOT equipment increase.
Description
Technical field
The present invention relates to internet of things field, specifically, be related to a kind of display methods of IOT appliance control interface, system,
Equipment and storage medium.
Background technique
IOT (Internet of things, Internet of Things) is the important component of generation information technology, and " letter
The important development stage in breathization " epoch.The development of IOT utilizes comprehensive wiring technology, network communication skill so that using house as platform
The integrated smart home system of the related facility of the home life such as art, security precautions technology, automatic control technology is possibly realized.
Smart home system can construct the management system of efficient housing facilities (IOT equipment) and family's schedule things,
In, IOT equipment includes controlling intelligent household appliances: such as air-conditioning, central air conditioner system, refrigerator, the kitchen and bath of modernization, whole kitchen, electricity
Rice cooker, TV, home entertaining, home theater, central background music system, instant shower heater, integral bathroom, washing machine, dust suction
Device and electric heating installation etc.；It further include intelligent home network sensor: as wireless gas leakage detector, gas componant sense
Device, temperature inductor, humidity sensor, wireless door magnetic inductor, window magnetic inductor.It further include video sensing intelligent system: door
Prohibit video intelligent system, old young living safety video intelligent system and garage video intelligent system etc.；It further include that intelligent energy is dynamic
Power switching system: intelligent power supply case, Intelligent current socket, it can remote control and management electrical parameter: electric current, voltage, power,
Power consumption；Electronic gas valve, electric water valve, radiator heat source system electrically operated valve etc., or even may also include intelligent building and ring
Border monitoring.
The general of the IOT equipment of smart home system realizes management by user terminal, such as APP of mobile phone, the end PAD or the end PC,
But with increasing for IOT equipment, artificial lookup, the display of a variety of operation interfaces of the management APP and same equipment of distinct device
It is time-consuming and cumbersome, therefore, a kind of display methods of efficient automatic IOT appliance control interface is needed to adapt to smart home development
Needs.
It should be noted that information is only used for reinforcing the reason to background of the invention disclosed in above-mentioned background technology part
Solution, therefore may include the information not constituted to the prior art known to persons of ordinary skill in the art.
Summary of the invention
For the problems of the prior art, the object of the present invention is to provide a kind of displays of IOT appliance control interface
Method, system, equipment and storage medium solve difficult with appliance control interface is manually searched caused by IOT equipment increase
And cumbersome problem.
The embodiment provides a kind of display methods of IOT appliance control interface, which is characterized in that this method packet
Include following steps:
User terminal obtains relevant first image of IOT equipment, and the first image is sent to control centre, the control
System is provided centrally with the machine learning algorithm model of classification capacity；
The control centre receives the first image, identifies device identification number by the machine learning algorithm model；
If the control centre identifies successfully, control centre's returning equipment identifier is described to the user terminal
User terminal shows control interface corresponding to the device identification number；
If control centre's recognition failures, control centre's returning equipment identifier list to the user terminal,
The user terminal selects device identification number according to the user instruction, and the user terminal sends the first image storage signal to described
Control centre, the control centre store the first image after user identifies to training set of images, described image instruction
Practice image of the collection comprising being labeled with device identification number, for training the machine learning algorithm model.
Preferably, the machine learning algorithm model includes at least any in the first model, the second model and third model
One model；
The input of first model is the image for including equipment, is exported as corresponding device identification number；
The input of second model is the image for including equipment and background, is exported as corresponding device identification number；
The input of the third model is the image for including scene corresponding to equipment, is exported as the identification of corresponding equipment
Number.
Preferably, the following steps training machine learning algorithm model is passed through using described image training set:
The characteristics of image of described image training set is extracted, described image feature is indicated using vector form, obtains machine
The model parameter of device learning algorithm model.
Preferably, the control centre can set the frequency of the training machine learning algorithm model or start training
Condition.
Preferably, the control centre identifies that device identification number includes following step by the machine learning algorithm model
It is rapid:
The control centre extracts the first characteristics of image of the first image received, and by the first characteristics of image with
Characteristics of image in the machine learning algorithm model is compared, and obtaining the first image identification is the general of each device identification number
Rate.
Preferably, the control centre determines the maximum probability in the probability, sets a special value；
It is to identify success status, maximum probability is corresponding when the maximum probability is more than or equal to a special value
Device identification number be back to the user terminal as the corresponding device identification number of described image；
It is recognition failures state when the maximum probability is less than a special value, the control centre returns and sets
For identifier list to the user terminal.
Preferably, to the user terminal, the list is big by probability for control centre's returning equipment identifier list
Each device identification number of minispread.
The embodiments of the present invention also provide a kind of display systems of IOT appliance control interface, which is characterized in that the system
Including user terminal and control centre；
The user terminal has camera function；
The control centre includes control unit, analytical calculation unit, elementary area and training unit；
The user terminal obtains relevant first image of IOT equipment, and the first image is sent to the control list
Member, described control unit are provided with the machine learning algorithm model of classification capacity；
Described control unit receives the first image, and the analytical calculation unit is identified by the machine learning algorithm model
Device identification number；
If the analytical calculation unit identifies successfully, described control unit returning equipment identifier to the user terminal,
The user terminal shows control interface corresponding to the device identification number；
If the analytical calculation unit recognition failures, described control unit returning equipment identifier list to the user
End, the user terminal select device identification number according to the user instruction, the user terminal send the first image storage signal to
The first image after user identifies is stored the figure into described image unit by described control unit, described control unit
As training set, described image training set includes the image for being labeled with device identification number, and the training unit is instructed using described image
Practice the collection training machine learning algorithm model.
The embodiment of the invention also provides a kind of display equipment of IOT appliance control interface characterized by comprising
Processor；
Memory, wherein being stored with the executable instruction of the processor；
Wherein, the processor is configured to execute the IOT appliance control interface via the executable instruction is executed
Display methods the step of.
A kind of computer readable storage medium of the embodiment of the present invention, for storing program, which is characterized in that described program quilt
The step of display methods of the IOT appliance control interface is realized when execution.
The present invention is to show the control interface of IOT equipment automatically by image recognition, solve to increase with IOT equipment and
Caused artificial lookup appliance control interface is difficult and cumbersome problem, the present invention are calculated by the study of training set of images training machine
On the one hand method model can increase the data of training set of images with the increase of user's access times, machine learning therewith is calculated
Method model is more optimized, to improve the accuracy and efficiency that IOT appliance control interface is shown in use process, meanwhile, according to making
Also make it possible the demand of user individual with the training set of images that corresponding application scenarios generate is accustomed to, i.e., each user can
Training is with personalized machine learning algorithm model.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the application
Example, and together with specification it is used to explain the principle of the application, by reading referring to the following drawings to non-limiting embodiment institute
The detailed description of work, other features, purposes and advantages of the invention will become more apparent.It should be evident that in being described below
Attached drawing be only some embodiments of the present invention, for those of ordinary skill in the art, do not making the creative labor
Under the premise of, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is the display methods application scenarios schematic diagram of the IOT appliance control interface of one embodiment of the invention figure；
Fig. 2 is the flow chart of the display methods of the IOT appliance control interface of one embodiment of the invention figure；
Fig. 3 is the interactive interface schematic diagram of the initial setting up of this practical embodiment；
Fig. 4 is the schematic diagram that IOT appliance control interface is shown after this practical embodiment identifies successfully；
Fig. 5 is the schematic diagram of user terminal interactive interface after this practical embodiment recognition failures；
Fig. 6 is the schematic diagram of the display system of the IOT appliance control interface of one embodiment of the invention；
Fig. 7 is the structural schematic diagram of the display equipment of the IOT appliance control interface of one embodiment of the invention；And
Fig. 8 is the structural schematic diagram of the computer readable storage medium of one embodiment of the invention.
Specific embodiment
Example embodiment is described more fully with reference to the drawings.However, example embodiment can be with a variety of shapes
Formula is implemented, and is not understood as limited to example set forth herein；On the contrary, thesing embodiments are provided so that the disclosure will more
Fully and completely, and by the design of example embodiment comprehensively it is communicated to those skilled in the art.Described feature, knot
Structure or characteristic can be incorporated in any suitable manner in one or more embodiments.
In addition, attached drawing is only the schematic illustrations of the disclosure, it is not necessarily drawn to scale.Identical attached drawing mark in figure
Note indicates same or similar part, thus will omit repetition thereof.Some block diagrams shown in the drawings are function
Energy entity, not necessarily must be corresponding with physically or logically independent entity.These function can be realized using software form
Energy entity, or these functional entitys are realized in one or more hardware modules or integrated circuit, or at heterogeneous networks and/or place
These functional entitys are realized in reason device device and/or microcontroller device.
Fig. 1 is the structural schematic diagram of smart home system, which includes: user terminal 10, control centre 20 and multiple IOT
Equipment 30.
Between user terminal 10 and control centre 20, between control centre 20 and multiple IOT equipment 30 by cable network or
Wireless network is connected.
The network protocol that IOT equipment 30 uses includes but is not limited at least one of following agreement:
Network protocol based on Zigbee (Zigzag Flying of Bees, purple honeybee) agreement；
Network protocol based on wireless networking specification Z-Wave；
Network protocol based on Wi-Fi (Wireless Fidelity, Wireless Fidelity) agreement；
Network protocol based on BLE (Bluetooth Low Energy, Bluetooth Low Energy) agreement；
Based on the network protocol of RF (Radio Frequency, radio frequency) 433 agreements, which uses 433Mhz frequency
Section；
Based on the network protocol of RF2.4G agreement, which uses 2.4Ghz frequency range；
Based on the network protocol of radio frequency 5G agreement, which uses 5Ghz frequency range.
Fig. 2 is the flow chart of the display methods of the IOT appliance control interface of one embodiment of the invention, and this method specifically includes
Following steps:
S100 user terminal obtains relevant first image of IOT equipment, and user terminal can be the mobile phone terminal with camera function
11, the end Pad 12 or the end PC 13.
S100 is the process that user shoots IOT equipment, and the first image is sent to control centre, the control by user terminal
System is provided centrally with the machine learning algorithm model of classification capacity；
Control centre described in S200 receives the first image；
Control centre described in S300 identifies device identification number by the machine learning algorithm model, equipment identification here
The number that number can be each IOT equipment, plays the role of that each IOT equipment can be identified；
If the S400 control centre identifies successfully, control centre's returning equipment identifier to the user terminal,
In embodiment, user terminal can prestore the mapping table of device identification number with corresponding control interface, and user terminal passes through institute
It states that display mapping table determines corresponding control interface and shows it.
The mapping table of table 1 device identification number and corresponding control interface
| Device identification number | The corresponding control interface of IOT equipment |
| ID0001 | The control interface of refrigerator |
| ID0002 | The control interface of air-conditioning |
| IDXXXX | The control interface of speaker |
If S500 control centre's recognition failures, control centre's returning equipment identifier list to the user
End, the user terminal select device identification number according to the user instruction, the user terminal send the first image storage signal to
The control centre, the control centre store the first image after user identifies to training set of images, the figure
Image as training set comprising being labeled with device identification number, for training the machine learning algorithm model.
Initial training set of images can be the pre-stored device-dependent general image training set of control centre, setting
There is the machine learning algorithm model of classification capacity can be to calculate by the pre-stored trained machine learning of general image training set
Method model.
In an embodiment of the present invention, training set of images is also possible to user individual setting, user terminal of the invention
The interactive interface of setting initial pictures training set can be provided, as shown in Figure 3.Specifically, user selects one on interactive interface
IOT equipment, such as the equipment 001 in option parlor, user terminal enters screening-mode, shoots to equipment 001, and when shooting can examine
Consider routine use habit, the same equipment is from multiple angles, multiple distance shootings, to obtain the image at each visual angle of equipment, and
It is uploaded to the training set of images of control centre, image is automatically arranged in the Graphical User end shot after selecting equipment
Corresponding device identification number, i.e., training set of images storage is the image for being marked with device identification number, and it is complete that user repeats above-mentioned steps
Classify at IOT equipment image identification each under domestic environment.The method of user terminal input setting training set of images is without being limited thereto, example
If can also be first shot image, user fills in facility information etc. manually.
After the completion of the training set of images of above-mentioned user individual is established, the training of machine learning algorithm model extraction described image
The characteristics of image of collection, characteristics of image are indicated using vector form, obtain the model parameter of machine learning algorithm model, machine
Learning algorithm model training is completed.
Actual in use, being only to identify equipment by equipment shape when the shape of equipment is same or like, it may appear that
The low problem of discrimination.Therefore, machine learning algorithm model of the invention may include the model of different images identification method, such as
First model, the second model and third model etc..The input of first model is defined in our embodiment to include to set
Standby image exports as corresponding device identification number；The input of second model is the image for including equipment and background, defeated
It is out corresponding device identification number；The input of the third model is the image for including scene corresponding to equipment, export for pair
The device identification number answered.Equipment same or similar for shape, capture apparatus when, may include background, such as the portion of surrounding
Packing decorations scene；If background locating for equipment is also same or like, can in equipment affixed some cognizable decorations
To improve recognition correct rate.
To illustrate that the present invention not only can determine device identification number by the equipment in identification image, can also set
The image of scene corresponding to specific equipment is determined to identify that equipment, such as sweeping robot are cleaning a bottom, and user is in parlor
Ground is shot, control centre identifies the image on ground, finds the corresponding sweeping robot identifier in ground, and user terminal may bring up
The control interface of sweeping robot, to control it.Knowledge of the quantity and model of machine learning algorithm model to image
Other mode is not limited to above-mentioned elaboration, can determine according to actual needs.
Control centre described in S300 identifies device identification number by the machine learning algorithm model, can be in embodiment
Specifically includes the following steps:
The control centre extracts the first characteristics of image for receiving the first image, and by the first characteristics of image with it is described
Characteristics of image in machine learning algorithm model is compared, ratio of the comparison of characteristics of image between multiple vectors used
It is right, according to the similarity between vector, obtain the probability that the first image identification is each device identification number.
The control centre determines the maximum probability in the probability, sets a special value；When the maximum probability is big
When being equal to a special value, to identify success status, using the corresponding device identification number of maximum probability as described image
Corresponding device identification number be back to the user terminal.Fig. 4 is that user terminal 10 is aobvious after this practical embodiment identifies successfully
Show the schematic diagram of IOT appliance control interface, it is speaker in this embodiment that user, which controls IOT equipment by the control interface,
Control interface.
It is recognition failures state when the maximum probability is less than a special value, the control centre returns and sets
For identifier list to the user terminal.Fig. 5 is the signal of 10 interactive interface of user terminal after this practical embodiment recognition failures
Figure, the list are each device identification number by the big minispread of probability.Device identification number in actual list is possibly more than Fig. 5
The number of middle display is shown in the return list area 8 of Fig. 5.For example, if user selects " air-conditioning " in Fig. 5 for above-mentioned identification mistake
Equipment corresponding to the first image lost, then shown first image labeling is " air-conditioning " corresponding device identification number by user terminal, and
The first image storage signal is sent to the control centre, the control centre stores the first image to image training
Collection, it is process that user terminal updates training set of images that this process is practical.Control centre can set the training machine learning algorithm
The frequency of model or the condition of starting training.Such as it can set periodically according to the training set of images training machine learning algorithm
The training machine learning algorithm model after model or the every increase certain amount image of training set of images.
For convenience, when recognition failures 10 interactive interface of user terminal can also provide again obtain IOT equipment it is relevant
The option of image, is shown in the functional areas 9 of Fig. 5, to return to step S100 of the invention, repeats the stream of display methods of the invention
Journey.
Fig. 6 is the schematic diagram of the display system of the IOT appliance control interface of one embodiment of the invention, which includes user
End 10 and control centre 20；The user terminal 10 has camera function, and the control centre includes control unit 21, analytical calculation
Unit 22, elementary area 23 and training unit 24；
The user terminal obtains relevant first image of IOT equipment, and the first image is sent to the control list
Member 21, described control unit 21 is provided with the machine learning algorithm model of classification capacity；
Described control unit 21 receives the first image, and the analytical calculation unit 22 passes through the machine learning algorithm model
Identify device identification number；
If the analytical calculation unit 22 identifies successfully, 21 returning equipment identifier of described control unit to the user
End, the user terminal show control interface corresponding to the device identification number；
If 22 recognition failures of analytical calculation unit, 21 returning equipment identifier list of described control unit to the use
Family end, the user terminal select device identification number according to the user instruction, and the user terminal sends the first image and stores signal
To described control unit 21, described control unit 21 stores the first image after user identifies to described image unit
Training set of images in 23, described image training set include the image for being labeled with device identification number, and the training unit 24 uses
The described image training set training machine learning algorithm model.
The embodiment of the present invention also provides a kind of IOT appliance control interface equipment, including processor；Memory, wherein storing
There is the executable instruction of processor.Wherein, processor is configured to be performed IOT equipment control circle via execution executable instruction
The step of face method.
Person of ordinary skill in the field it is understood that various aspects of the invention can be implemented as system, method or
Program product.Therefore, various aspects of the invention can be embodied in the following forms, it may be assumed that complete hardware embodiment, complete
The embodiment combined in terms of full Software Implementation (including firmware, microcode etc.) or hardware and software, can unite here
Referred to as " circuit ", " module " or " platform ".
The electronic equipment 600 of this embodiment according to the present invention is described referring to Fig. 7.The electronics that Fig. 7 is shown
Equipment 600 is only an example, should not function to the embodiment of the present invention and use scope bring any restrictions.
As shown in fig. 7, electronic equipment 600 is showed in the form of universal computing device.The component of electronic equipment 600 can wrap
Include but be not limited to: at least one processing unit 610, at least one storage unit 620, connection different platform component (including storage
Unit 620 and processing unit 610) bus 630, display unit 640 etc..
Wherein, storage unit is stored with program code, and program code can be executed with unit 610 processed, so that processing is single
Member 610 executes various exemplary implementations according to the present invention described in this specification above-mentioned electronic prescription circulation processing method part
The step of mode.For example, processing unit 610 can execute step as shown in Figure 2.
Storage unit 620 may include the readable medium of volatile memory cell form, such as Random Access Storage Unit
(RAM) 6201 and/or cache memory unit 6202, it can further include read-only memory unit (ROM) 6203.
Storage unit 620 can also include program/utility with one group of (at least one) program module 6205
6204, such program module 6205 includes but is not limited to: operating system, one or more application program, other program moulds
It may include the realization of network environment in block and program data, each of these examples or certain combination.
Bus 630 can be to indicate one of a few class bus structures or a variety of, including storage unit bus or storage
Cell controller, peripheral bus, graphics acceleration port, processing unit use any bus structures in a variety of bus structures
Local bus.
Electronic equipment 600 can also be with one or more external equipments 700 (such as keyboard, sensing equipment, bluetooth equipment
Deng) communication, can also be enabled a user to one or more equipment interact with the electronic equipment 600 communicate, and/or with make
Any equipment (such as the router, modulation /demodulation that the electronic equipment 600 can be communicated with one or more of the other calculating equipment
Device etc.) communication.This communication can be carried out by input/output (I/O) interface 650.Also, electronic equipment 600 can be with
By network adapter 660 and one or more network (such as local area network (LAN), wide area network (WAN) and/or public network,
Such as internet) communication.Network adapter 660 can be communicated by bus 630 with other modules of electronic equipment 600.It should
Understand, although not shown in the drawings, other hardware and/or software module can be used in conjunction with electronic equipment 600, including but unlimited
In: microcode, device driver, redundant processing unit, external disk drive array, RA identification information system, tape drive
And data backup storage platform etc..
The embodiment of the present invention also provides a kind of computer readable storage medium, and for storing program, program is performed realization
The step of display methods of IOT appliance control interface.In some possible embodiments, various aspects of the invention can be with
It is embodied as a kind of form of program product comprising program code, when program product is run on the terminal device, program code
It is various according to the present invention described in this specification above-mentioned electronic prescription circulation processing method part for executing terminal device
The step of illustrative embodiments.
Refering to what is shown in Fig. 8, describing the program product for realizing the above method of embodiment according to the present invention
800, can using portable compact disc read only memory (CD-ROM) and including program code, and can in terminal device,
Such as it is run on PC.However, program product of the invention is without being limited thereto, in this document, readable storage medium storing program for executing can be with
To be any include or the tangible medium of storage program, the program can be commanded execution system, device or device use or
It is in connection.
Program product can be using any combination of one or more readable mediums.Readable medium can be readable signal Jie
Matter or readable storage medium storing program for executing.Readable storage medium storing program for executing for example can be but be not limited to electricity, magnetic, optical, electromagnetic, infrared ray or partly lead
System, device or the device of body, or any above combination.More specific example (the non exhaustive column of readable storage medium storing program for executing
Table) it include: the electrical connection with one or more conducting wires, portable disc, hard disk, random access memory (RAM), read-only storage
Device (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read only memory (CD-
ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.
Computer readable storage medium may include in a base band or as carrier wave a part propagate data-signal,
In carry readable program code.The data-signal of this propagation can take various forms, including but not limited to electromagnetic signal,
Optical signal or above-mentioned any appropriate combination.Readable storage medium storing program for executing can also be any readable Jie other than readable storage medium storing program for executing
Matter, the readable medium can send, propagate or transmit for by instruction execution system, device or device use or and its
The program of combined use.The program code for including on readable storage medium storing program for executing can transmit with any suitable medium, including but not
It is limited to wireless, wired, optical cable, RF etc. or above-mentioned any appropriate combination.
The program for executing operation of the present invention can be write with any combination of one or more programming languages
Code, programming language include object oriented program language-Java, C++ etc., further include conventional process
Formula programming language-such as " C " language or similar programming language.Program code can be calculated fully in user
It executes in equipment, partly execute on a user device, executing, as an independent software package partially in user calculating equipment
Upper part executes on a remote computing or executes in remote computing device or server completely.It is being related to remotely counting
In the situation for calculating equipment, remote computing device can pass through the network of any kind, including local area network (LAN) or wide area network
(WAN), it is connected to user calculating equipment, or, it may be connected to external computing device (such as utilize ISP
To be connected by internet).
In conclusion the present invention provides a kind of display methods of IOT appliance control interface, which is characterized in that this method
Relevant first image of IOT equipment is obtained including user terminal, and the first image is sent to control centre, in the control
The heart is provided with the machine learning algorithm model of classification capacity；The control centre receives the first image, passes through the engineering
It practises algorithm model and identifies device identification number；If the control centre identifies successfully, control centre's returning equipment identifier is extremely
The user terminal, the user terminal show control interface corresponding to the device identification number；If control centre's identification is lost
It loses, control centre's returning equipment identifier list to the user terminal, the user terminal is selected according to the user instruction
Device identification number, the user terminal send the first image storage signal to the control centre, and the control centre will be through user
The first image after identification is stored to training set of images, and described image training set includes the figure for being labeled with device identification number
Picture, for training the machine learning algorithm model.The present invention is to show control circle of IOT equipment automatically by image recognition
Face, solves the problems, such as difficult and cumbersome with appliance control interface is manually searched caused by IOT equipment increase, and the present invention passes through
On the one hand training set of images training machine learning algorithm model can increase training set of images with the increase of user's access times
Data, machine learning algorithm model therewith is more optimized, to improve the standard that IOT appliance control interface is shown in use process
True property and efficiency, meanwhile, the need of user individual are also made according to the training set of images that the corresponding application scenarios of use habit generate
It asks and is possibly realized, i.e., each user can train with personalized machine learning algorithm model.
The above content is a further detailed description of the present invention in conjunction with specific preferred embodiments, and it cannot be said that
Specific implementation of the invention is only limited to these instructions.It is obvious to a person skilled in the art that the application be not limited to it is above-mentioned
The details of exemplary embodiment, and without departing substantially from spirit herein or essential characteristic, it can be with others tool
Body form realizes the application.It therefore, in all respects, the embodiments should be taken as exemplary, and is non-limit
Property processed, scope of the present application is indicated by the appended claims rather than the foregoing description, it is intended that claim will be fallen in
All changes in the meaning and scope of equivalency are included in the application.It should not be by any appended drawing reference in claim
It is construed as limiting the claims involved.Furthermore, it is to be understood that one word of " comprising " does not exclude other units or steps, odd number is not excluded for multiple
Number.The multiple units or device stated in device claim can also by a unit or device by software or hardware come
It realizes.First, second equal words are used to indicate names, and are not indicated any particular order.
Claims (10)
1. a kind of display methods of IOT appliance control interface, which is characterized in that method includes the following steps:
User terminal obtains relevant first image of IOT equipment, and the first image is sent to control centre, in the control
The heart is provided with the machine learning algorithm model of classification capacity；
The control centre receives the first image, identifies device identification number by the machine learning algorithm model；
If the control centre identifies successfully, control centre's returning equipment identifier to the user terminal, the user
End shows control interface corresponding to the device identification number；
If control centre's recognition failures, control centre's returning equipment identifier list is described to the user terminal
User terminal selects device identification number according to the user instruction, and the user terminal sends the first image storage signal to the control
Center, the control centre store the first image after user identifies to training set of images, described image training set
Image comprising being labeled with device identification number, for training the machine learning algorithm model.
2. the display methods of IOT appliance control interface according to claim 1, which is characterized in that the machine learning is calculated
Method model is including at least any one model in the first model, the second model and third model；
The input of first model is the image for including equipment, is exported as corresponding device identification number；
The input of second model is the image for including equipment and background, is exported as corresponding device identification number；
The input of the third model is the image for including scene corresponding to equipment, is exported as corresponding device identification number.
3. the display methods of IOT appliance control interface according to claim 1, which is characterized in that instructed using described image
Practice collection and pass through the following steps training machine learning algorithm model:
The characteristics of image of described image training set is extracted, described image feature is indicated using vector form, obtains engineering
Practise the model parameter of algorithm model.
4. the display methods of IOT appliance control interface according to claim 1, which is characterized in that the control centre can
The frequency of the setting training machine learning algorithm model or the condition of starting training.
5. the display methods of IOT appliance control interface according to claim 1, which is characterized in that the control centre is logical
Cross machine learning algorithm model identification device identification number the following steps are included:
The control centre extracts the first characteristics of image for receiving the first image, and by the first characteristics of image and the machine
Characteristics of image in learning algorithm model is compared, and obtains the probability that the first image identification is each device identification number.
6. the display methods of IOT appliance control interface according to claim 5, which is characterized in that the control centre is true
Maximum probability in the fixed probability, sets a special value；
When the maximum probability is more than or equal to a special value, to identify success status, set maximum probability is corresponding
Standby identifier is back to the user terminal as the corresponding device identification number of described image；
It is recognition failures state when the maximum probability is less than a special value, control centre's returning equipment is known
Alias list is to the user terminal.
7. the display methods of IOT appliance control interface according to claim 6, which is characterized in that the control centre returns
Device identification number list is returned to the user terminal, the list is each device identification number by the big minispread of probability.
8. a kind of display system of IOT appliance control interface, which is characterized in that the system includes user terminal (10) and control centre
(20)；
The user terminal (10) has camera function；
The control centre includes control unit (21), analytical calculation unit (22), elementary area (23) and training unit (24)；
The user terminal obtains relevant first image of IOT equipment, and the first image is sent to described control unit
(21), described control unit (21) is provided with the machine learning algorithm model of classification capacity；
Described control unit (21) receives the first image, and the analytical calculation unit (22) passes through the machine learning algorithm model
Identify device identification number；
If the analytical calculation unit (22) identifies successfully, described control unit (21) returning equipment identifier to the user
End, the user terminal show control interface corresponding to the device identification number；
If analytical calculation unit (22) recognition failures, described control unit (21) returning equipment identifier list is to described
User terminal, the user terminal select device identification number according to the user instruction, and the user terminal sends the first image storage letter
Number described control unit (21) are given, described control unit (21) stores the first image after user identifies to the figure
As the training set of images in unit (23), described image training set includes the image for being labeled with device identification number, and the training is single
First (24) use the described image training set training machine learning algorithm model.
9. a kind of display equipment based on IOT appliance control interface characterized by comprising
Processor；
Memory, wherein being stored with the executable instruction of the processor；
Wherein, the processor is configured to come any one of perform claim requirement 1 to 7 institute via the execution executable instruction
The step of stating the display methods of IOT appliance control interface.
10. a kind of computer readable storage medium, for storing program, which is characterized in that described program is performed realization power
Benefit require any one of 1 to 7 described in IOT appliance control interface method the step of.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810971551.0A CN109218145B (en) | 2018-08-24 | 2018-08-24 | IOT equipment control interface display method, system, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810971551.0A CN109218145B (en) | 2018-08-24 | 2018-08-24 | IOT equipment control interface display method, system, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109218145A true CN109218145A (en) | 2019-01-15 |
| CN109218145B CN109218145B (en) | 2021-10-08 |
Family
ID=64989301
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810971551.0A Active CN109218145B (en) | 2018-08-24 | 2018-08-24 | IOT equipment control interface display method, system, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109218145B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110457101A (en) * | 2019-07-26 | 2019-11-15 | 联想(北京)有限公司 | A kind of information processing method, electronic equipment and storage medium |
| CN111835604A (en) * | 2019-04-19 | 2020-10-27 | 东芝生活电器株式会社 | Remote operation system, remote operation terminal, and remote operation program |
| CN112953961A (en) * | 2021-03-14 | 2021-06-11 | 国网浙江省电力有限公司电力科学研究院 | Equipment type identification method in power distribution room Internet of things |
| CN113504831A (en) * | 2021-07-23 | 2021-10-15 | 电光火石(北京)科技有限公司 | IOT (input/output) equipment control method based on facial image feature recognition, IOT and terminal equipment |
| CN113703382A (en) * | 2021-07-13 | 2021-11-26 | 特科能(株洲)科技有限公司 | Antechamber pre-vacuumizing multipurpose atmosphere nitriding furnace workpiece identification system |
| EP4089581A1 (en) * | 2021-05-10 | 2022-11-16 | Carrier Corporation | Machine learning assisted contactless control of a physical device through a user device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011145709A1 (en) * | 2010-05-21 | 2011-11-24 | 日本電気株式会社 | Device cooperation system, operation instructing device, device user interface configuring means, method for providing cooperation of devices and program |
| CN105204742A (en) * | 2015-09-28 | 2015-12-30 | 小米科技有限责任公司 | Control method and device of electronic equipment and terminal |
| CN105739315A (en) * | 2016-02-02 | 2016-07-06 | 杭州鸿雁电器有限公司 | Indoor user electric appliance equipment control method and device |
| CN107038462A (en) * | 2017-04-14 | 2017-08-11 | 广州机智云物联网科技有限公司 | Equipment control operation method and system |
| US9753687B1 (en) * | 2014-01-03 | 2017-09-05 | Sony Interactive Entertainment America Llc | Wearable computer using programmed local tag |
| CN107480725A (en) * | 2017-08-23 | 2017-12-15 | 京东方科技集团股份有限公司 | Image-recognizing method, device and computer equipment based on deep learning |
| CN107664950A (en) * | 2016-07-27 | 2018-02-06 | 霍尼韦尔国际公司 | For the system and method based on domestic automation system is controlled via WI FI fingerprint recognitions customer locations |
| CN108010302A (en) * | 2016-10-31 | 2018-05-08 | 深圳市掌网科技股份有限公司 | Remote controlling system for electric appliances and method based on augmented reality |
-
2018
- 2018-08-24 CN CN201810971551.0A patent/CN109218145B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011145709A1 (en) * | 2010-05-21 | 2011-11-24 | 日本電気株式会社 | Device cooperation system, operation instructing device, device user interface configuring means, method for providing cooperation of devices and program |
| US9753687B1 (en) * | 2014-01-03 | 2017-09-05 | Sony Interactive Entertainment America Llc | Wearable computer using programmed local tag |
| CN105204742A (en) * | 2015-09-28 | 2015-12-30 | 小米科技有限责任公司 | Control method and device of electronic equipment and terminal |
| CN105739315A (en) * | 2016-02-02 | 2016-07-06 | 杭州鸿雁电器有限公司 | Indoor user electric appliance equipment control method and device |
| CN107664950A (en) * | 2016-07-27 | 2018-02-06 | 霍尼韦尔国际公司 | For the system and method based on domestic automation system is controlled via WI FI fingerprint recognitions customer locations |
| CN108010302A (en) * | 2016-10-31 | 2018-05-08 | 深圳市掌网科技股份有限公司 | Remote controlling system for electric appliances and method based on augmented reality |
| CN107038462A (en) * | 2017-04-14 | 2017-08-11 | 广州机智云物联网科技有限公司 | Equipment control operation method and system |
| CN107480725A (en) * | 2017-08-23 | 2017-12-15 | 京东方科技集团股份有限公司 | Image-recognizing method, device and computer equipment based on deep learning |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111835604A (en) * | 2019-04-19 | 2020-10-27 | 东芝生活电器株式会社 | Remote operation system, remote operation terminal, and remote operation program |
| CN111835604B (en) * | 2019-04-19 | 2022-04-05 | 东芝生活电器株式会社 | Remote operation system, remote operation terminal, and remote operation program |
| CN110457101A (en) * | 2019-07-26 | 2019-11-15 | 联想(北京)有限公司 | A kind of information processing method, electronic equipment and storage medium |
| CN112953961A (en) * | 2021-03-14 | 2021-06-11 | 国网浙江省电力有限公司电力科学研究院 | Equipment type identification method in power distribution room Internet of things |
| EP4089581A1 (en) * | 2021-05-10 | 2022-11-16 | Carrier Corporation | Machine learning assisted contactless control of a physical device through a user device |
| CN113703382A (en) * | 2021-07-13 | 2021-11-26 | 特科能(株洲)科技有限公司 | Antechamber pre-vacuumizing multipurpose atmosphere nitriding furnace workpiece identification system |
| CN113504831A (en) * | 2021-07-23 | 2021-10-15 | 电光火石(北京)科技有限公司 | IOT (input/output) equipment control method based on facial image feature recognition, IOT and terminal equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109218145B (en) | 2021-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109218145A (en) | Display methods, system, equipment and the storage medium of IOT appliance control interface | |
| CN108931924B (en) | Control method and device of intelligent household system, processor and storage medium | |
| CN105760106B (en) | A kind of smart home device exchange method and device | |
| CN104808499B (en) | A kind of method and control device based on linkage rule control smart home device | |
| CN108731207B (en) | Air conditioning equipment and control method and control equipment thereof | |
| US10295972B2 (en) | Systems and methods to operate controllable devices with gestures and/or noises | |
| US9100207B2 (en) | Systems, devices, and methods for mapping devices to realize building automation and energy management | |
| CN108845503A (en) | The providing method and its system of Intelligent household scene service | |
| CN110799978B (en) | Face recognition in a residential environment | |
| KR20170075597A (en) | Method and appratus for controlling a device | |
| CN108920046A (en) | Control method and device of intelligent household equipment and computer storage medium | |
| CN109672720A (en) | For controlling the electronic device and its operating method of IoT device | |
| CN108475044A (en) | Information processing unit, electronic equipment, method and program | |
| CN109901539A (en) | A kind of man-machine interactive system and its control method applied to smart home | |
| CN108490832A (en) | Method and apparatus for sending information | |
| US20170123502A1 (en) | Wearable gesture control device and method for smart home system | |
| CN111970180A (en) | Networking configuration method and device for intelligent household equipment, electronic equipment and storage medium | |
| CN112732380A (en) | Visual display method and device for smart home, storage medium and electronic device | |
| CN106911768A (en) | Intelligent equipment, intelligent home system and setting method and device thereof | |
| CN111650842A (en) | Household appliance control method and device | |
| CN108196461A (en) | Control method, device and the intelligent domestic system of smart home device | |
| CN110361978B (en) | Intelligent equipment control method, device and system based on Internet of things operating system | |
| CN207502942U (en) | home terminal control device and system | |
| KR101958068B1 (en) | Method of servicing smart home automation and apparatuses performing the same | |
| CN105571045A (en) | Somatosensory identification method, apparatus and air conditioner controller |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |