CN111077783A - Household appliance customized control system and method and customized action processing system and method - Google Patents
Household appliance customized control system and method and customized action processing system and method Download PDFInfo
- Publication number
- CN111077783A CN111077783A CN201811213680.XA CN201811213680A CN111077783A CN 111077783 A CN111077783 A CN 111077783A CN 201811213680 A CN201811213680 A CN 201811213680A CN 111077783 A CN111077783 A CN 111077783A
- Authority
- CN
- China
- Prior art keywords
- household appliance
- action
- module
- action instruction
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000009471 action Effects 0.000 title claims abstract description 231
- 238000012545 processing Methods 0.000 title claims abstract description 48
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000004048 modification Effects 0.000 claims abstract description 30
- 238000012986 modification Methods 0.000 claims abstract description 30
- 238000013507 mapping Methods 0.000 claims abstract description 26
- 238000003672 processing method Methods 0.000 claims abstract description 6
- 239000013598 vector Substances 0.000 claims description 37
- 230000033001 locomotion Effects 0.000 claims description 19
- 230000006870 function Effects 0.000 claims description 10
- 230000006835 compression Effects 0.000 claims description 9
- 238000007906 compression Methods 0.000 claims description 9
- 230000008859 change Effects 0.000 claims description 8
- 238000009432 framing Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 5
- 238000003062 neural network model Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 4
- 230000000875 corresponding effect Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 4
- 230000001276 controlling effect Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 241000282414 Homo sapiens Species 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000016776 visual perception Effects 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000004851 dishwashing Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 238000004880 explosion Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000004630 mental health Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000026676 system process Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Selective Calling Equipment (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a household appliance self-defining control system, a household appliance self-defining control method, a household appliance self-defining action processing system and a household appliance self-defining action processing method, wherein an operation action instruction is set in a household appliance, and a modification action instruction is set; establishing a mapping relation between the operation action command and the household appliance control, and correspondingly controlling the household appliance when the household appliance captures the operation action command of the user; when the household appliance captures the modification action command of the user, redefining the mapping relation between the operation action command and the household appliance control through the modification action command. According to the invention, by setting the operation action instruction and the modification action instruction, the household appliance executes corresponding operation when the operation action is captured, and when the modification action instruction is captured, the mapping relation between the operation action instruction and the household appliance control is redefined, so that a user can record and define any new action instruction by himself, the household appliance is controlled more conveniently, and the user experience effect is good.
Description
Technical Field
The invention relates to the field of household appliance control, in particular to a household appliance self-defining control system and method and a self-defining action processing system and method.
Background
The household appliances are released from heavy, trivial and time-consuming household work, create more comfortable and beautiful life and working environment which are more beneficial to physical and mental health for human beings, provide rich and colorful cultural and entertainment conditions, and become necessities of modern family life.
Along with the development of the times, household appliances have basically realized intellectualization, more convenient and faster service is provided for the life of people, people increasingly need beautiful life, the experience requirement on the aspect of household appliances is higher, people hope not to be limited to using remote controllers, entity manual buttons and other modes to control household appliances, but because electronic equipment such as remote controllers needs to replace batteries, is easy to dirty, lose and damage due to dust, the entity manual buttons need to be contacted with a machine by people to realize interaction, and inconvenience is brought to the control of the household appliances by people.
The explosion of internet big data makes artificial intelligence technique development at a rapid pace, visual perception technique based on camera has obtained quick development, some visual perception techniques, for example face identification, gesture recognition etc. has used to each field, so can combine artificial intelligence technique to be applied to the domestic appliance field, utilize the human action control operation domestic appliance of lighter-weight, promote people and experience well in the domestic appliance control, but at present stage, the user can not change the control action that the domestic appliance producer defaulted and supported, bring inconvenience for domestic appliance's operation, user experience is relatively poor.
Disclosure of Invention
The invention aims to overcome the technical problems that a user cannot change the control action supported by a default of a household appliance manufacturer, inconvenience is brought to the operation of the household appliance, and user experience is poor in the prior art, and provides a household appliance custom control system, a household appliance custom control method, a custom action processing system and a household appliance custom action processing method.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows: a household appliance self-defining control method is applied to household appliances with action control, and comprises the following steps:
setting an operation action instruction and a modification action instruction in the household appliance;
establishing a mapping relation between the operation action command and the household appliance control, and correspondingly controlling the household appliance when the household appliance captures the operation action command of the user;
when the household appliance captures the modification action command of the user, redefining the mapping relation between the operation action command and the household appliance control through the modification action command.
Further, the modified action instruction comprises a replacement action instruction, a digital gesture action instruction and a custom action instruction.
Furthermore, when the household appliance captures the change action command, the household appliance is ready to redefine work, when the household appliance captures the digital gesture action command, the household appliance is associated with the corresponding household appliance control, after association, the household appliance captures the custom action command, replaces the custom action command with the operation action command, and redefines the mapping relation between the operation action command and the household appliance control.
Furthermore, the household appliance captures at least two digital gesture motion instructions, and the captured digital gesture motions are the same, so that the association of the corresponding function items is completed.
Furthermore, the household appliance captures at least two self-defined action instructions, and when the captured self-defined actions are the same, the mapping relation between the operation action instruction and the household appliance control is redefined.
Further, household electrical appliances catch and feed back through the pilot lamp when setting up the instruction.
The household appliance self-defining control system comprises an establishing module, a capturing module, a judging module and an executing module
The establishing module is used for establishing a mapping relation between the operation action instruction and the household appliance control;
the capturing module is used for capturing motion instructions of a user;
the judging module is used for judging the action instruction of the user;
the execution module is used for correspondingly controlling the household appliance when the action instruction of the user is an operation action instruction; and when the action command of the user is a modification action command, redefining the mapping relation between the operation action command and the household appliance control.
Further, the setting module is used for setting an operation action instruction and a modification action instruction in the household appliance.
The household appliance control system further comprises an association module and a change module, wherein the association module is used for associating household appliance function items corresponding to the digital gesture actions, and the change module is used for changing the user-defined action instruction into an operation action instruction.
Further, the device also comprises an indication module which is used for responding to the captured action instruction.
Further, the indication module comprises a first indication unit and a second indication unit, and the first indication unit and the second indication unit respectively respond to the captured modification action instruction.
A household appliance custom action processing method processes a custom action instruction in the household appliance custom control method, and the method comprises the following steps:
collecting frame action pictures of the user-defined action within a continuous period of time;
and identifying the frame action picture to obtain a sequence of the custom action and storing the sequence.
Further, the identification processing includes extracting a frame motion picture for identification to obtain floating point data of a fixed dimension vector, arranging the floating point data according to a processing sequence to obtain vector set data, and compressing the vector set data after removing redundant information to obtain a binary sequence.
A household appliance custom action instruction processing system processes the custom action instruction in the household appliance custom control method, and is characterized in that: comprises an image acquisition module, an identification processing module and a storage module
The image acquisition module is used for acquiring frame action pictures of the user-defined action within a continuous period of time;
the recognition processing module is used for recognizing and processing the frame action picture to obtain a sequence of the user-defined action;
and the storage module is used for storing the sequence of the self-defining action.
The identification processing module comprises an identification unit, a framing processing unit and a vector compression unit, wherein the identification unit is used for extracting a frame motion picture for identification to obtain double-precision floating point data of a fixed dimension vector, a user of the framing processing unit arranges the floating point data according to a processing sequence to obtain vector set data, and the vector compression unit is used for removing redundant information from the vector set data and then compressing the vector set data to obtain a binary sequence of a user-defined motion.
Further, the identification unit comprises a multi-layer neural network model.
Further, the vector compression unit includes an encoder.
A household appliance comprises the household appliance self-defining control system and the household appliance self-defining action instruction processing system.
Compared with the prior art, the household appliance self-defining control system, the household appliance self-defining control method, the household appliance self-defining action processing system and the household appliance self-defining action processing method capture the corresponding operation executed by the household appliance during operation action by setting the operation action instruction and the modification action instruction, redefine the mapping relation between the operation action instruction and the household appliance control when capturing the modification action instruction, enable a user to record any self-defining new action instruction, enable the household appliance to be controlled more conveniently and rapidly, and achieve a good user experience effect.
Drawings
FIG. 1 is a block diagram of motion model training;
FIG. 2 is a block diagram of a home appliance detecting user actions;
FIG. 3 is a block diagram of a custom control system for household appliances according to the present invention;
FIG. 4 is a flowchart illustrating the redefinition of the mapping relationship between the operation commands and the appliance control according to the present invention;
FIG. 5 is a flow chart of an indicating module of the present invention;
FIG. 6 is a block diagram of a system for processing a user-defined operation of a household appliance according to the present invention;
FIG. 7 is a model diagram of the customized operation of the household appliance of the present invention;
fig. 8 is a control flow chart of the household appliance of the present invention.
Detailed Description
The technical solutions in the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments.
As shown in fig. 1 and 2, when the household appliance leaves the factory, a set of operation instructions is set to perform various operations on the household appliance, specifically,
a large collection of user actions (including pictures and videos) is performed, such as "bailey" actions, "finger circle" actions, etc.;
performing machine learning on the collected action materials on a training platform (such as tensoflow and cafe) by using a neural network, and generating a recognition model and model parameters capable of recognizing various trained and corresponding actions after a period of time;
and storing the model and the parameters into a storage device of the household appliance, and when the chip system of the household appliance is loaded and used, storing the model, namely the action supported by default when the household appliance leaves a factory.
The user makes a specified action around the household appliance, and the user action sequence frame is input by the household appliance camera and sent to the household appliance chip processor for detection.
The user action sequence frame is calculated by combining a household appliance chip processor and a model input to the preparation stage for storage, and a result obtained finally is compared with a result obtained in the training process. A similarity value may be obtained, and if the similarity value is within the threshold range, the action is considered to be matched, otherwise, the action is considered not to be recognized;
after the correct action is recognized, a response operation consistent with the factory leaving action is made, and if the 'kagaku' action is recognized to be correct, a factory default response 'turning off the household appliance' is made. The corresponding action may also be user-defined in the home appliance system, such as associating a "bailey" action to "sleep after 20 minutes".
After the household appliance responds correctly, the user can feel that the household appliance reacts more intuitively. Responses that are not obvious in some cases, such as "sleep after 20 minutes" are successful in setting, but are not necessarily intuitive for the user. At this time, the warning can be given by flashing the light.
As shown in fig. 3, a household appliance self-defining control system includes a setting module 1, an establishing module 2, a capturing module 3, a judging module 4, an executing module 5, an associating module 6, a changing module 7, and an indicating module 8, where the setting module 1, the establishing module 2, the capturing module 3, the judging module 4, the executing module 5, the associating module 6, the changing module 7, and the indicating module 8
The setting module 1 sets an operation action instruction and a modification action instruction in the household appliance;
the establishing module 2 establishes a mapping relation between the operation action command and the household appliance control;
the capturing module 3 captures a motion instruction of a user, adopts a camera, is in signal connection with the household appliance and can be arranged on the household appliance or beside the household appliance through a connecting wire;
the judgment module 4 judges the action instruction of the user;
the execution module 5 correspondingly controls the household appliance when the action instruction of the user is an operation action instruction; when the action instruction of the user is a modification action instruction, redefining the mapping relation between the operation action instruction and the household appliance control;
the correlation module 6 correlates the household appliance function items corresponding to the digital gesture actions;
the changing module 7 changes the user-defined action instruction into an operation action instruction;
the indicating module 8 responds to the captured action instruction, the indicating module comprises a first indicating unit and a second indicating unit, the first indicating unit and the second indicating unit respectively respond to the captured action instruction, and the indicating module adopts an LED lamp.
The household appliance performs corresponding operation when the operation action is captured by setting the operation action instruction and the modification action instruction, the mapping relation between the operation action instruction and the household appliance control is redefined when the modification action instruction is captured, a user can record any self-defined new action instruction, the household appliance is controlled more conveniently, and the user experience effect is good.
A household appliance self-defining control method is applied to household appliances with action control, and comprises the following steps:
setting an operation action instruction and a modification action instruction in the household appliance, wherein the modification action instruction comprises a replacement action instruction, a digital gesture action instruction and a user-defined action instruction;
establishing a mapping relation between the operation action command and the household appliance control, and correspondingly controlling the household appliance when the household appliance captures the operation action command of the user;
when the household appliance captures the modification action command of the user, the mapping relation between the operation action command and the household appliance control is redefined through the modification action command,
specifically, as shown in fig. 4, when the household appliance captures a replacement action instruction, the household appliance prepares to redefine the work, when the household appliance captures a digital gesture action instruction, the household appliance associates the corresponding household appliance function item, after association, when the household appliance captures a custom action instruction, the custom action instruction is changed into an operation action instruction, the mapping relation between the operation action instruction and the household appliance control is redefined, the household appliance captures at least two digital gesture action instructions, when the captured digital gesture actions are the same, the association to the corresponding function item is completed, and the household appliance captures at least two custom action instructions through the response of the indicating module, when the captured custom action instructions are the same, the redefinition to the mapping relation between the operation action instruction and the household appliance control is completed, as shown in fig. 5, when the household appliance captures the replacement action instruction, the first indicating unit in the indicating device displays a color one, after the household appliance captures the digital gesture action for the first time, the first indicating unit displays the first color, the second indicating unit displays the first color, the household appliance captures the digital gesture action for the second time, when the digital gesture action captured for the second time is consistent with the digital gesture action captured for the first time, the first indicating unit displays the first color and the second indicating unit displays the second color, the household appliance captures the custom gesture action for the second time, when the household appliance captures the custom gesture action for the first time, the first indicating unit displays the second color and the second indicating unit displays the second color, and when the custom gesture action captured for the second time is consistent with the custom gesture action captured for the first time, the first indicating unit displays the second color and the second indicating unit displays the second color, and the mapping relation between the operation action command and the household appliance control is redefined, at the moment, the function of replacing actions is quitted, the new user-defined action is associated with the Nth function of the household appliance, the user can record any user-defined new action instruction by himself, and the household appliance can be controlled more conveniently.
As shown in fig. 6, a system for processing a customized action instruction of a household appliance, which processes the customized action instruction in the household appliance customized control method, includes an image capturing module 10, an identification processing module 20, and a storage module 30, where the image capturing module 10, the identification processing module 20, and the storage module 30 are included in the system
The image acquisition module 10 acquires frame motion pictures of the user-defined motion in a continuous period of time, adopts a camera, is in signal connection with the household appliance, and can be arranged on the household appliance or beside the household appliance through a connecting wire;
the identification processing module 20 identifies a frame motion picture to obtain a sequence of a user-defined motion, the identification processing module 20 includes an identification unit 21, a framing processing unit 22, and a vector compression unit 23, the identification unit 21 extracts the frame motion picture to identify the frame motion picture to obtain double-precision floating point data of a fixed dimensional vector, the identification unit 21 adopts a multilayer neural network model, the framing processing unit 22 arranges the floating point data according to a processing sequence to obtain vector set data, the vector compression unit 23 eliminates redundant information from the vector set data and then compresses the vector set data to obtain a binary sequence of the user-defined motion, and the vector compression unit 23 adopts an encoder;
the storage module 30 stores the sequence of custom actions.
A household appliance comprises the household appliance self-defining control system and the household appliance self-defining action instruction processing system, wherein the household appliance comprises any one or more of an air conditioner, a washing machine, a fan, a dish washing machine and a water purifier.
As shown in fig. 7, a method for processing a customized action of a home appliance, which processes a customized action command in the above method for customized control of a home appliance, includes the following steps:
the method comprises the steps of collecting frame action pictures of custom actions in a continuous period of time, specifically, collecting custom actions at any angle by a camera, and collecting action pictures of 2s (counting 50 frames);
the frame action picture is identified and processed to obtain a sequence of the self-defined action and stored,
specifically, frame motion pictures are extracted for recognition, floating point data of fixed dimension vectors are obtained, the floating point data are arranged according to a processing sequence to obtain vector set data, redundant information of the vector set data is removed, and then the vector set data are compressed to obtain a binary sequence.
As shown in fig. 8, when the device is used, the vector value obtained after the action acquisition, identification and framing processing is consistent with the input flow, the compressed action sequence code is read at this time, and is decompressed and restored into an action vector through a decoder (algorithm), the two groups of vectors are compared with the threshold value through comparing the distance, if the two groups of vectors are smaller than the threshold value, the actions are considered to be matched, and when the two groups of vectors are matched, the household appliances are controlled, otherwise, the two groups of vectors are considered to be not matched.
Compared with the prior art, the household appliance self-defining control system, the household appliance self-defining control method, the household appliance self-defining action processing system and the household appliance self-defining action processing method capture the corresponding operation executed by the household appliance during operation action by setting the operation action instruction and the modification action instruction, redefine the mapping relation between the operation action instruction and the household appliance control when capturing the modification action instruction, enable a user to record any self-defining new action instruction, enable the household appliance to be controlled more conveniently and rapidly, and achieve a good user experience effect.
The above description is only a few specific embodiments of the present invention, but the design concept of the present invention is not limited thereto, and any insubstantial modifications made by the design concept should fall within the scope of the present invention.
Claims (18)
1. A household appliance self-defining control method is applied to household appliances with action control, and is characterized in that the method comprises the following steps:
setting an operation action instruction and a modification action instruction in the household appliance;
establishing a mapping relation between the operation action command and the household appliance control, and correspondingly controlling the household appliance when the household appliance captures the operation action command of the user;
when the household appliance captures the modification action command of the user, redefining the mapping relation between the operation action command and the household appliance control through the modification action command.
2. The household appliance customized control method according to claim 1, characterized in that: the modified action instruction comprises a replacement action instruction, a digital gesture action instruction and a custom action instruction.
3. The household appliance customized control method according to claim 2, characterized in that: when the household appliance catches the action change instruction, the household appliance is ready to redefine work, when the household appliance catches the digital gesture action instruction, the household appliance is associated with corresponding household appliance control, after association, the household appliance catches the user-defined action instruction and replaces the user-defined action instruction with the operation action instruction, and the mapping relation between the operation action instruction and the household appliance control is redefined.
4. The household appliance customized control method according to claim 3, characterized in that: the household appliance captures digital gesture motion instructions at least twice, and the captured digital gesture motions are the same, so that the association of the corresponding function items is completed.
5. The household appliance customized control method according to claim 3 or 4, characterized in that: the household appliance captures at least two self-defined action instructions, and when the captured self-defined actions are the same, the mapping relation between the operation action instructions and the household appliance control is redefined.
6. The household appliance customized control method according to claim 2, characterized in that: the household appliance feeds back the setting instruction through the indicating lamp when capturing the setting instruction.
7. The household appliance self-defining control system is characterized in that: comprises an establishing module, a capturing module, a judging module and an executing module, wherein the establishing module, the capturing module, the judging module and the executing module are arranged in the processing module
The establishing module is used for establishing a mapping relation between the operation action instruction and the household appliance control;
the capturing module is used for capturing motion instructions of a user;
the judging module is used for judging the action instruction of the user;
the execution module is used for correspondingly controlling the household appliance when the action instruction of the user is an operation action instruction; and when the action command of the user is a modification action command, redefining the mapping relation between the operation action command and the household appliance control.
8. The household appliance customized control system according to claim 7, characterized in that: the setting module is used for setting an operation action instruction and a modification action instruction in the household appliance.
9. The household appliance customized control system according to claim 7, characterized in that: the household appliance function item association system further comprises an association module and a change module, wherein the association module is used for associating household appliance function items corresponding to the digital gesture actions, and the change module is used for changing the user-defined action instruction into an operation action instruction.
10. The household appliance customized control system according to claim 7, characterized in that: the system further comprises an indication module which is used for responding to the captured action instruction.
11. The household appliance customized control system according to claim 10, characterized in that: the indication module comprises a first indication unit and a second indication unit, and the first indication unit and the second indication unit respectively respond to the captured modification action instruction.
12. A method for processing a customized action of a household appliance, which processes a customized action command in the method for customized control of the household appliance as claimed in any one of claims 1 to 6, characterized in that the method comprises the following steps:
collecting frame action pictures of the user-defined action within a continuous period of time;
and identifying the frame action picture to obtain a sequence of the custom action and storing the sequence.
13. The home appliance custom action processing method according to claim 12, wherein: the identification processing comprises extracting a frame action picture for identification to obtain floating point data of a fixed dimension vector, arranging the floating point data according to a processing sequence to obtain vector set data, and compressing the vector set data after removing redundant information to obtain a binary sequence.
14. A household appliance custom action instruction processing system for processing the custom action instruction in the household appliance custom control method of any one of claims 1 to 6, characterized in that: comprises an image acquisition module, an identification processing module and a storage module
The image acquisition module is used for acquiring frame action pictures of the user-defined action within a continuous period of time;
the recognition processing module is used for recognizing and processing the frame action picture to obtain a sequence of the user-defined action;
and the storage module is used for storing the sequence of the self-defining action.
15. The home appliance custom action instruction processing system according to claim 14, wherein: the identification processing module comprises an identification unit, a framing processing unit and a vector compression unit, wherein the identification unit is used for extracting a frame action picture for identification to obtain double-precision floating point data of a fixed dimension vector, a user of the framing processing unit arranges the floating point data according to a processing sequence to obtain vector set data, and the vector compression unit is used for removing redundant information from the vector set data and then compressing the vector set data to obtain a binary sequence of a user-defined action.
16. The home appliance custom action instruction processing system according to claim 15, wherein: the recognition unit includes a multi-layer neural network model.
17. The home appliance custom action instruction processing system according to claim 15, wherein: the vector compression unit includes an encoder.
18. A household appliance, characterized by: the household appliance comprises the household appliance customized control system of any one of claims 7 to 11 and/or the household appliance customized action instruction processing system of any one of claims 14 to 17.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811213680.XA CN111077783A (en) | 2018-10-18 | 2018-10-18 | Household appliance customized control system and method and customized action processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811213680.XA CN111077783A (en) | 2018-10-18 | 2018-10-18 | Household appliance customized control system and method and customized action processing system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111077783A true CN111077783A (en) | 2020-04-28 |
Family
ID=70308541
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811213680.XA Pending CN111077783A (en) | 2018-10-18 | 2018-10-18 | Household appliance customized control system and method and customized action processing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111077783A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113970888A (en) * | 2020-07-07 | 2022-01-25 | 华为技术有限公司 | Household equipment control method, terminal equipment and computer readable storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202907113U (en) * | 2012-06-14 | 2013-04-24 | 深圳市同洲电子股份有限公司 | A TV set controlled by gesture identification |
| US20150182289A1 (en) * | 2010-09-21 | 2015-07-02 | Intuitive Surgical Operations, Inc. | Method and Apparatus for Hand Gesture Control in a Minimally Invasive Surgical System |
| CN105353634A (en) * | 2015-11-30 | 2016-02-24 | 北京地平线机器人技术研发有限公司 | Household appliance and method for controlling operation by gesture recognition |
| CN105373037A (en) * | 2015-11-02 | 2016-03-02 | 渤海大学 | Kitchen ventilator control system based on gesture recognition |
| CN105717900A (en) * | 2016-04-26 | 2016-06-29 | 华南理工大学 | Smart home control gloves and home control, custom control gesture method thereof |
| CN106991372A (en) * | 2017-03-02 | 2017-07-28 | 北京工业大学 | A kind of dynamic gesture identification method based on interacting depth learning model |
| CN107765573A (en) * | 2017-10-19 | 2018-03-06 | 美的集团股份有限公司 | Control method and household electrical appliance, the storage medium of a kind of household electrical appliance |
| CN108509049A (en) * | 2018-04-19 | 2018-09-07 | 北京华捷艾米科技有限公司 | The method and system of typing gesture function |
| CN108574764A (en) * | 2017-03-07 | 2018-09-25 | 上海传英信息技术有限公司 | A kind of method and device that communication terminal receives calls |
-
2018
- 2018-10-18 CN CN201811213680.XA patent/CN111077783A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150182289A1 (en) * | 2010-09-21 | 2015-07-02 | Intuitive Surgical Operations, Inc. | Method and Apparatus for Hand Gesture Control in a Minimally Invasive Surgical System |
| CN202907113U (en) * | 2012-06-14 | 2013-04-24 | 深圳市同洲电子股份有限公司 | A TV set controlled by gesture identification |
| CN105373037A (en) * | 2015-11-02 | 2016-03-02 | 渤海大学 | Kitchen ventilator control system based on gesture recognition |
| CN105353634A (en) * | 2015-11-30 | 2016-02-24 | 北京地平线机器人技术研发有限公司 | Household appliance and method for controlling operation by gesture recognition |
| CN105717900A (en) * | 2016-04-26 | 2016-06-29 | 华南理工大学 | Smart home control gloves and home control, custom control gesture method thereof |
| CN106991372A (en) * | 2017-03-02 | 2017-07-28 | 北京工业大学 | A kind of dynamic gesture identification method based on interacting depth learning model |
| CN108574764A (en) * | 2017-03-07 | 2018-09-25 | 上海传英信息技术有限公司 | A kind of method and device that communication terminal receives calls |
| CN107765573A (en) * | 2017-10-19 | 2018-03-06 | 美的集团股份有限公司 | Control method and household electrical appliance, the storage medium of a kind of household electrical appliance |
| CN108509049A (en) * | 2018-04-19 | 2018-09-07 | 北京华捷艾米科技有限公司 | The method and system of typing gesture function |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113970888A (en) * | 2020-07-07 | 2022-01-25 | 华为技术有限公司 | Household equipment control method, terminal equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103529762B (en) | A kind of intelligent home furnishing control method based on sensor technology and system | |
| CN106814639A (en) | Speech control system and method | |
| CN105204351B (en) | The control method and device of air-conditioner set | |
| CN110426962A (en) | A kind of control method and system of smart home device | |
| CN108983979B (en) | Gesture tracking recognition method and device and intelligent equipment | |
| CN202907113U (en) | A TV set controlled by gesture identification | |
| CN111197841A (en) | Control method, control device, remote control terminal, air conditioner, server and storage medium | |
| CN108406848A (en) | A kind of intelligent robot and its motion control method based on scene analysis | |
| CN103246879A (en) | Expression-recognition-based intelligent robot system | |
| CN103268150A (en) | Intelligent robot management and control system and intelligent robot management and control method on basis of facial expression recognition | |
| CN102467815B (en) | Multifunctional remote controlller, remote control thereof and energy consumption monitoring method | |
| Verdadero et al. | Hand gesture recognition system as an alternative interface for remote controlled home appliances | |
| CN108762512A (en) | Human-computer interaction device, method and system | |
| CN104658218B (en) | Mobile terminal and its remote control coding method to set up for remote control home appliance | |
| CN111077783A (en) | Household appliance customized control system and method and customized action processing system and method | |
| CN103135746A (en) | Non-touch control method and non-touch control system and non-touch control device based on static postures and dynamic postures | |
| CN103019381B (en) | Control the method for display screen automatic backlight | |
| CN110533898B (en) | Wireless control learning system, method, apparatus, device and medium for controlled device | |
| CN111531580B (en) | Vision-based multi-task robot fault detection method and system | |
| CN109727596B (en) | Method for controlling remote controller and remote controller | |
| CN111736483A (en) | Intelligent feedback housekeeper system and feedback method for same | |
| CN112764349A (en) | Clothes hanger control method, clothes hanger, system and storage medium | |
| CN100385471C (en) | Studying remote control method and device for household electrical appliances | |
| CN111007806B (en) | Smart home control method and device | |
| CN112947102B (en) | Intelligent household appliance control interaction system based on scene change and control method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200428 |
|
| RJ01 | Rejection of invention patent application after publication |