CN114740745A - Intelligent home control method and terminal - Google Patents

Intelligent home control method and terminal Download PDF

Info

Publication number
CN114740745A
CN114740745A CN202210441270.0A CN202210441270A CN114740745A CN 114740745 A CN114740745 A CN 114740745A CN 202210441270 A CN202210441270 A CN 202210441270A CN 114740745 A CN114740745 A CN 114740745A
Authority
CN
China
Prior art keywords
data
terminal
intelligent home
model
operation model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210441270.0A
Other languages
Chinese (zh)
Other versions
CN114740745B (en
Inventor
周尹
王志强
雷访运
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
United Creation Technology Corp ltd
Original Assignee
United Creation Technology Corp ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by United Creation Technology Corp ltd filed Critical United Creation Technology Corp ltd
Priority to CN202210441270.0A priority Critical patent/CN114740745B/en
Publication of CN114740745A publication Critical patent/CN114740745A/en
Application granted granted Critical
Publication of CN114740745B publication Critical patent/CN114740745B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2642Domotique, domestic, home control, automation, smart house
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Selective Calling Equipment (AREA)
  • Telephone Function (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention provides an intelligent home control method and a terminal, wherein the control terminal comprises a wireless communication module for receiving and sending data, a camera module for acquiring first image data of the intelligent home terminal, an audio acquisition module for acquiring first audio data of the intelligent home terminal, a data acquisition module for acquiring attribute data and working data of the intelligent home terminal, a processor for processing the data and a controller. The operation data and the working data of the intelligent home terminal are collected, the basic operation model is established for the intelligent home terminal, the family member model is used for adjusting the basic operation model in a targeted mode, the final operation model is obtained, the operation of the intelligent home terminal can be simplified, an individualized operation mode can be provided for a user, and the working effect of the intelligent home terminal can be more suitable for the individual use requirements.

Description

Intelligent household control method and terminal
Technical Field
The invention relates to the technical field of industrial control, in particular to an intelligent home control method and a terminal.
Background
With the continuous progress of the technology, more and more intelligent household devices are moving into the field of vision of human beings, such as intelligent televisions, intelligent air conditioners, intelligent lamps, intelligent washing machines, intelligent electric cookers and the like, which are gradually replacing traditional household devices. At present, most of various devices of the smart home need a user to set a working mode by himself, and the smart home is still not intelligent enough; especially for some old people, the intelligent home equipment is a strange east and west, the operation mode is different from that of the traditional home equipment, and the operation modes of various intelligent home equipment are different due to different brands, so that the old user is not subjected to operation, misoperation and other problems in the process of using the intelligent home equipment, and the use experience is poor. Through the development of the last decade, the application of the mobile internet is more and more mature, and the old user is more and more familiar and handy with the use of an intelligent mobile terminal (such as a smart phone, a tablet computer and the like).
Currently, an intelligent home control scheme based on an intelligent mobile terminal is needed.
Disclosure of Invention
The invention is based on the above problems, and provides an intelligent home control method and terminal, wherein a final operation model is obtained by acquiring operation data and working data of an intelligent home terminal, establishing a basic operation model for the intelligent home terminal, and performing targeted adjustment on the basic operation model by using a family member model, so that not only can the operation of the intelligent home terminal be simplified, but also a personalized operation mode can be provided for a user, and the working effect of the intelligent home terminal is more suitable for the individual use requirements.
In view of this, an aspect of the present invention provides an intelligent home control terminal, including: the intelligent home terminal comprises a wireless communication module, a camera module, an audio acquisition module, a data acquisition module, a processor and a controller, wherein the wireless communication module is used for receiving and sending data, the camera module is used for acquiring first image data of the intelligent home terminal, the audio acquisition module is used for acquiring first audio data of the intelligent home terminal, the data acquisition module is used for acquiring attribute data and working data of the intelligent home terminal, and the processor and the controller are used for processing data;
the wireless communication module is used for establishing communication connection between the control terminal and the intelligent home terminal;
the processor is used for establishing a basic operation model of the intelligent home terminal through the first image data, the first audio data, the attribute data and the working data;
the processor is also used for acquiring family member data and establishing a family member model;
and the controller is used for adjusting working parameters of the intelligent home terminal according to the family member model and the basic operation model to obtain an operation model.
Optionally, the wireless communication module is configured to receive an intelligent home operation model acquisition request sent by a first terminal;
the processor is used for determining a corresponding first intelligent home terminal from the intelligent home operation model acquisition request;
the controller is used for sending an instruction for feeding back first attribute data and first family member data of the first intelligent home terminal to the first terminal through the wireless communication module;
the wireless communication module is used for receiving the first attribute data and the first family member data;
the processor is used for selecting a corresponding first operation model according to the first attribute data;
the processor is further used for correcting the first operation model according to the first family member data to obtain a second operation model;
the processor is further configured to send the second operation model to the first terminal through the wireless communication module.
Optionally, the processor is configured to establish a basic operation model of the smart home terminal through the first image data, the first audio data, the attribute data, and the working data, specifically:
inputting the first image data, the first audio data, the attribute data and the working data into a trained first model to obtain a basic operation model of the intelligent home terminal.
Optionally, the processor is further configured to obtain family member data, and establish a family member model, specifically:
acquiring age, gender, health state data, diet characteristic data, work and rest data, hobby data and face data of the family members;
and inputting the age, sex, health status data, diet characteristic data, work and rest data, hobby data and face data of the family members into the trained second model to obtain the family member model of the family members.
Optionally, the data acquisition module is further used for
Acquiring second audio data in the communication process between the control terminal and a second terminal;
the processor is further used for analyzing whether the second audio data contain content related to the operation of the intelligent home terminal;
the controller is further used for sending the operation model of the smart home to the second terminal through the wireless communication model when the second audio data contain the content related to the operation of the smart home terminal.
Another aspect of the present invention provides an intelligent home control method, where the intelligent home control terminal includes a wireless communication module for receiving and sending data, a camera module for acquiring first image data of the intelligent home terminal, an audio acquisition module for acquiring first audio data of the intelligent home terminal, a data acquisition module for acquiring attribute data and working data of the intelligent home terminal, a processor for processing data, and a controller, and the method includes:
establishing communication connection between the control terminal and the intelligent home terminal;
establishing a basic operation model of the intelligent home terminal through the first image data, the first audio data, the attribute data and the working data;
acquiring family member data and establishing a family member model;
and adjusting the working parameters of the intelligent home terminal to obtain an operation model according to the family member model and the basic operation model.
Optionally, the method further comprises the step of:
receiving an intelligent home operation model acquisition request sent by a first terminal;
determining a corresponding first intelligent home terminal from the intelligent home operation model acquisition request;
sending an instruction for feeding back first attribute data and first family member data of the first intelligent household terminal to the first terminal through the wireless communication module;
receiving the first attribute data and first family member data;
selecting a corresponding first operation model according to the first attribute data;
correcting the first operation model according to the first family member data to obtain a second operation model;
and sending the second operation model to the first terminal through the wireless communication module.
Optionally, the step of establishing a basic operation model of the smart home terminal through the first image data, the first audio data, the attribute data, and the working data specifically includes:
inputting the first image data, the first audio data, the attribute data and the working data into a trained first model to obtain a basic operation model of the intelligent home terminal.
Optionally, the step of obtaining family member data and establishing a family member model specifically includes:
acquiring age, gender, health state data, diet characteristic data, work and rest data, hobby data and face data of the family members;
and inputting the age, sex, health status data, diet characteristic data, work and rest data, hobby data and face data of the family members into the trained second model to obtain the family member model of the family members.
Optionally, the method further comprises:
acquiring second audio data in the communication process between the control terminal and a second terminal;
analyzing whether the second audio data contain content related to the operation of the intelligent household terminal;
and when the second audio data contains the content related to the operation of the intelligent home terminal, sending the operation model of the intelligent home to the second terminal through the wireless communication model.
By adopting the technical scheme, the control terminal comprises a wireless communication module for receiving and sending data, a camera module for acquiring first image data of the intelligent home terminal, an audio acquisition module for acquiring first audio data of the intelligent home terminal, a data acquisition module for acquiring attribute data and working data of the intelligent home terminal, a processor for processing the data and a controller. The operation data and the working data of the intelligent home terminal are collected, the basic operation model is established for the intelligent home terminal, the family member model is used for adjusting the basic operation model in a targeted mode, the final operation model is obtained, the operation of the intelligent home terminal can be simplified, an individualized operation mode can be provided for a user, and the working effect of the intelligent home terminal can be more suitable for the individual use requirements.
Drawings
Fig. 1 is a schematic block diagram of an intelligent home control terminal according to an embodiment of the present invention;
fig. 2 is a flowchart of a smart home control method according to another embodiment of the present invention.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced otherwise than as specifically described herein, and thus the scope of the present invention is not limited by the specific embodiments disclosed below.
The terms "first," "second," and the like in the description and claims of the present application and in the foregoing drawings are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The following describes an intelligent home control method and a terminal according to some embodiments of the present invention with reference to fig. 1 to 2.
As shown in fig. 1, an embodiment of the present invention provides an intelligent home control terminal, including: the intelligent home terminal comprises a wireless communication module, a camera module, an audio acquisition module, a data acquisition module, a processor and a controller, wherein the wireless communication module is used for receiving and sending data, the camera module is used for acquiring first image data of the intelligent home terminal, the audio acquisition module is used for acquiring first audio data of the intelligent home terminal, the data acquisition module is used for acquiring attribute data and working data of the intelligent home terminal, and the processor and the controller are used for processing data;
the wireless communication module is used for establishing communication connection between the control terminal and the intelligent home terminal;
the processor is used for establishing a basic operation model of the intelligent home terminal through the first image data, the first audio data, the attribute data and the working data;
the processor is also used for acquiring family member data and establishing a family member model;
and the controller is used for adjusting the working parameters of the intelligent home terminal to obtain an operation model according to the family member model and the basic operation model.
It can be understood that, in the embodiment of the present invention, the control terminal is an intelligent mobile terminal, which may be a smart phone, a tablet computer, an intelligent remote controller, a smart watch, a smart bracelet, and the like, and is preferably a smart phone.
The camera module is a camera, and the audio acquisition module is a microphone;
the first image data comprises data such as an appearance image, a working state image and a family member operation image of the intelligent home terminal.
The first audio data comprise working sound data of the intelligent home terminal, voice data in the operation process of family members and the like.
After the wireless communication module establishes communication connection between the control terminal and the intelligent home terminal, the data acquisition module may acquire attribute data and working data of the intelligent home terminal from the intelligent home terminal. The attribute data at least comprises one or more of product name, product function and product brand, and the working data at least comprises one or more of working power, an interactive interface, working sound effect, motion trail and working mode.
The family member data comprises age, gender, health status data, diet characteristic data, work and rest data, hobby data, face data and the like.
By adopting the technical scheme of the embodiment, the control terminal comprises a wireless communication module for receiving and sending data, a camera module for acquiring first image data of the intelligent home terminal, an audio acquisition module for acquiring first audio data of the intelligent home terminal, a data acquisition module for acquiring attribute data and working data of the intelligent home terminal, a processor for processing data and a controller. The operation data and the working data of the intelligent home terminal are collected, the basic operation model is established for the intelligent home terminal, the family member model is used for adjusting the basic operation model in a targeted mode, the final operation model is obtained, the operation of the intelligent home terminal can be simplified, an individualized operation mode can be provided for a user, and the working effect of the intelligent home terminal can be more suitable for the individual use requirements.
It should be noted that the block diagram of the smart home control terminal shown in fig. 1 is only schematic, and the number of the modules shown is not intended to limit the scope of the present invention.
In some possible embodiments of the present invention, the wireless communication module is configured to receive an intelligent home operation model acquisition request sent by a first terminal;
the processor is used for determining a corresponding first intelligent home terminal from the intelligent home operation model acquisition request;
the controller is used for sending an instruction for feeding back first attribute data and first family member data of the first intelligent home terminal to the first terminal through the wireless communication module;
the wireless communication module is used for receiving the first attribute data and the first family member data;
the processor is used for selecting a corresponding first operation model according to the first attribute data;
the processor is further used for correcting the first operation model according to the first family member data to obtain a second operation model;
the processor is further configured to send the second operation model to the first terminal through the wireless communication module.
It can be understood that, in reality, there may be a situation that a first user of the smart home terminal needs remote guidance because he does not know how to operate the smart home terminal, for example, does not know how to adjust a channel of a smart television, does not know how to set a display parameter of the television, and the like.
The first terminal is a terminal capable of communicating, such as a smart phone, a tablet computer, an intelligent remote controller, an intelligent watch, an intelligent bracelet and the like, and is preferably the smart phone.
The intelligent home operation model acquisition request comprises identification information of an intelligent home terminal (such as an intelligent television, an intelligent air conditioner, a sweeping robot and the like) which a first user wants to control, a processor of the control terminal determines a corresponding first intelligent home terminal from the intelligent home operation model acquisition request, and sends an instruction for feeding back first attribute data and first family member data of the first intelligent home terminal to the first terminal; and after receiving the first attribute data and selecting the corresponding first operation model, the control terminal selects the corresponding first operation model according to the first attribute data, and the first operation model is stored in the control terminal. And the control terminal corrects the first operation model according to the first family member data to obtain a second operation model, sends the second operation model to the first terminal, and sends the second operation model to the corresponding first intelligent home terminal through the first terminal so as to control the first intelligent home terminal to work according to the second operation model. According to the scheme, a user who does not know how to operate the first intelligent home terminal can use the first terminal such as a smart phone and a tablet computer to send and obtain the first operation model corresponding to the first intelligent home terminal to the control terminal, after the corresponding first operation model is obtained, the first operation model is corrected according to the first family member data (user data of the user at the first terminal) to obtain the second operation model, the first terminal sends the second operation model to the corresponding first intelligent home terminal, the first intelligent home terminal can work according to the second operation model, manual operation is not needed to be carried out by the user, and great convenience is provided for the user to use the intelligent home terminal.
In some possible embodiments of the present invention, the processor is configured to establish a basic operation model of the smart home terminal through the first image data, the first audio data, the attribute data, and the working data, specifically:
inputting the first image data, the first audio data, the attribute data and the working data into a trained first model to obtain a basic operation model of the intelligent home terminal.
It will be appreciated that the first model works as follows:
acquiring specific operation of each link in the operation flow step of the intelligent home terminal from the first image data, the first audio data, the attribute data and the working data;
establishing an operation database for each specific operation, wherein the operation database comprises a parameter adjustment range, an operation step sequence and the like of the specific operation;
and acquiring interference factors and influences of the intelligent home terminal in work, and correcting each item of specific operation data in the operation database to obtain a basic operation model of the intelligent home terminal.
In the embodiment of the invention, the established basic operation model is more accurate through the processing of the first model.
In some possible embodiments of the present invention, the processor is further configured to obtain family member data, and establish a family member model, specifically:
acquiring age, sex, health state data, diet characteristic data, work and rest data, hobby data and face data of the family members;
and inputting the age, sex, health status data, diet characteristic data, work and rest data, hobby data and face data of the family members into the trained second model to obtain the family member model of the family members.
It can be understood that each family member has a difference to the operation habit and the use demand of the intelligent home terminal, in order to better fit the actual operation needs of the user, the second model can be a trained user portrait model, the family member models of different family members are obtained by inputting the age, sex, health state data, diet characteristic data, work and rest data, interest and hobby data and face data of the family members into the second model, and the operation model conforming to the specific family member can be modified in a targeted manner according to the difference of the family member models.
In some possible embodiments of the present invention, the data obtaining module is further configured to obtain second audio data in a call process between the control terminal and a second terminal;
the processor is further used for analyzing whether the second audio data contain content related to the operation of the intelligent home terminal;
the controller is further configured to send the operation model of the smart home to the second terminal through the wireless communication model when the second audio data includes content related to the operation of the smart home terminal.
It can be understood that, in practice, there is a case that the second user of the smart home terminal directly makes a call or remotely seeks help by connecting voice/video communication without knowing how to operate the smart home terminal, however, in the process of voice communication through remote, a good operation guiding effect cannot be generated. In the embodiment of the invention, the control terminal acquires the second audio data in the conversation process between the control terminal and the second terminal through the data acquisition module, recognizing the content about the operation of the smart home terminal from the second audio data through a voice recognition algorithm, the processor further determines attribute information of the intelligent home terminal from the second audio so as to determine a second intelligent home terminal to be specifically operated by a second terminal user, a third operation model corresponding to the second intelligent home terminal is sent to the second terminal, the second terminal sends the third operation model to the corresponding second intelligent home terminal, and the second intelligent home terminal can work according to the third operation model, and the user does not need to perform manual operation, so that great convenience is provided for the user to use the intelligent home terminal.
It should be noted that, in some possible embodiments of the present invention, before the processor is configured to analyze whether the second audio data includes content related to the operation of the smart home terminal, the processor is further configured to build a language identification model, which is as follows:
determining the role relationship among different communication subjects, such as parents, children, couples or other basic relationships;
acquiring communication data among a plurality of roles, wherein the communication data comprises data in the aspects of voice data, action data, character data and the like;
acquiring role basic data of the ages, sexes, educational programs, accents, hobbies, timbres, words, emotions and the like of all the roles, establishing role models for all the roles according to the role basic data, and determining role model relations among all the role models according to the role relations;
and establishing a communication model between every two character models by extracting key words and recognizing emotional states according to the character models and the communication data.
The processor is configured to analyze whether the second audio data includes content related to the operation of the smart home terminal, specifically:
when a control terminal user communicates with a second terminal user, determining a role model of the control terminal user and a role model of the second terminal user, and determining a role relationship and a communication model between the role model and the second terminal user by combining the role model relationship;
key elements including keywords, special sounds and the like are analyzed from the second audio data.
And according to the role relationship and the communication model, identifying key elements so as to judge whether the second audio data contains the content related to the operation of the intelligent household terminal.
Referring to fig. 2, another embodiment of the present invention provides an intelligent home control method, where the intelligent home control terminal includes a wireless communication module for receiving and sending data, a camera module for collecting first image data of the intelligent home terminal, an audio collection module for collecting first audio data of the intelligent home terminal, a data acquisition module for acquiring attribute data and working data of the intelligent home terminal, a processor for processing data, and a controller, and the method includes:
establishing communication connection between the control terminal and the intelligent home terminal;
establishing a basic operation model of the intelligent home terminal through the first image data, the first audio data, the attribute data and the working data;
acquiring family member data and establishing a family member model;
and adjusting the working parameters of the intelligent home terminal to obtain an operation model according to the family member model and the basic operation model.
It can be understood that, in the embodiment of the present invention, the control terminal is an intelligent mobile terminal, which may be a smart phone, a tablet computer, an intelligent remote controller, a smart watch, a smart bracelet, and the like, and is preferably a smart phone.
The camera module is a camera, and the audio acquisition module is a microphone;
the first image data comprises data such as an appearance image, a working state image and a family member operation image of the intelligent home terminal.
The first audio data comprise working sound data of the intelligent home terminal, voice data in the operation process of family members and the like.
After the wireless communication module establishes communication connection between the control terminal and the intelligent home terminal, the data acquisition module may acquire attribute data and working data of the intelligent home terminal from the intelligent home terminal. The attribute data at least comprises one or more of product name, product function and product brand, and the working data at least comprises one or more of working power, an interactive interface, working sound effect, motion trail and working mode.
The family member data comprises age, gender, health status data, diet characteristic data, work and rest data, hobby data, face data and the like.
By adopting the technical scheme of the embodiment, the control terminal comprises a wireless communication module for receiving and sending data, a camera module for acquiring first image data of the intelligent home terminal, an audio acquisition module for acquiring first audio data of the intelligent home terminal, a data acquisition module for acquiring attribute data and working data of the intelligent home terminal, a processor for processing data and a controller. The operation data and the working data of the intelligent home terminal are collected, the basic operation model is established for the intelligent home terminal, the family member model is used for adjusting the basic operation model in a targeted mode, the final operation model is obtained, the operation of the intelligent home terminal can be simplified, an individualized operation mode can be provided for a user, and the working effect of the intelligent home terminal can be more suitable for the individual use requirements.
In some possible embodiments of the invention, the method further comprises the step of:
receiving an intelligent home operation model acquisition request sent by a first terminal;
determining a corresponding first intelligent home terminal from the intelligent home operation model acquisition request;
sending an instruction for feeding back first attribute data and first family member data of the first intelligent household terminal to the first terminal through the wireless communication module;
receiving the first attribute data and first family member data;
selecting a corresponding first operation model according to the first attribute data;
correcting the first operation model according to the first family member data to obtain a second operation model;
and sending the second operation model to the first terminal through the wireless communication module.
It can be understood that, in reality, there may be a situation that a first user of the smart home terminal needs remote guidance because he does not know how to operate the smart home terminal, for example, does not know how to adjust a channel of a smart television, does not know how to set display parameters of the television, and the like.
The first terminal is a terminal capable of communicating, such as a smart phone, a tablet computer, an intelligent remote controller, an intelligent watch, an intelligent bracelet and the like, and is preferably the smart phone.
The intelligent home operation model obtaining request comprises identification information of an intelligent home terminal (such as an intelligent television, an intelligent air conditioner, a sweeping robot and the like) which a first user wants to control, a processor of a control terminal determines a corresponding first intelligent home terminal from the intelligent home operation model obtaining request, and sends an instruction for feeding back first attribute data and first family member data of the first intelligent home terminal to the first terminal; and after receiving the first attribute data and selecting the corresponding first operation model, the control terminal selects the corresponding first operation model according to the first attribute data, and the first operation model is stored in the control terminal. And the control terminal corrects the first operation model according to the first family member data to obtain a second operation model, sends the second operation model to the first terminal, and sends the second operation model to the corresponding first intelligent home terminal by the first terminal to control the first intelligent home terminal to work according to the second operation model. According to the scheme, a user who does not know how to operate the first intelligent home terminal can use the first terminal such as a smart phone and a tablet personal computer to send and acquire the first operation model corresponding to the first intelligent home terminal to the control terminal, after the corresponding first operation model is acquired, the first operation model is corrected according to the first family member data (user data of the user at the first terminal) to obtain the second operation model, the first terminal sends the second operation model to the corresponding first intelligent home terminal, the first intelligent home terminal can work according to the second operation model, manual operation is not needed to be carried out by the user, and great convenience is provided for the user to use the intelligent home terminal.
In some possible embodiments of the present invention, the step of establishing a basic operation model of the smart home terminal through the first image data, the first audio data, the attribute data, and the working data specifically includes:
inputting the first image data, the first audio data, the attribute data and the working data into a trained first model to obtain a basic operation model of the intelligent home terminal.
It will be appreciated that the first model works as follows:
acquiring specific operation of each link in the operation flow steps of the intelligent home terminal from the first image data, the first audio data, the attribute data and the working data;
establishing an operation database for each specific operation, wherein the operation database comprises a parameter adjustment range, an operation step sequence and the like of the specific operation;
and acquiring interference factors and influences of the intelligent home terminal in work, and correcting each item of specific operation data in the operation database to obtain a basic operation model of the intelligent home terminal.
In the embodiment of the invention, the established basic operation model is more accurate through the processing of the first model.
In some possible embodiments of the present invention, the step of obtaining the family member data and establishing the family member model specifically includes:
acquiring age, gender, health state data, diet characteristic data, work and rest data, hobby data and face data of the family members;
and inputting the age, sex, health status data, diet characteristic data, work and rest data, hobby data and face data of the family members into the trained second model to obtain the family member model of the family members.
It can be understood that each family member has a difference to the operation habit and the use demand of the intelligent home terminal, in order to better fit the actual operation needs of the user, the second model can be a trained user portrait model, the family member models of different family members are obtained by inputting the age, sex, health state data, diet characteristic data, work and rest data, interest and hobby data and face data of the family members into the second model, and the operation model conforming to the specific family member can be modified in a targeted manner according to the difference of the family member models.
In some possible embodiments of the invention, the method further comprises:
acquiring second audio data in the communication process between the control terminal and a second terminal;
analyzing whether the second audio data contains content related to the operation of the intelligent household terminal;
and when the second audio data contains the content related to the operation of the intelligent home terminal, sending the operation model of the intelligent home to the second terminal through the wireless communication model.
It can be understood that, in practice, there is a case that the second user of the smart home terminal directly makes a call or remotely seeks help by connecting voice/video communication without knowing how to operate the smart home terminal, however, in the process of voice communication through remote, a good operation guiding effect cannot be generated. In the embodiment of the invention, the control terminal acquires the second audio data in the conversation process between the control terminal and the second terminal through the data acquisition module, recognizing the content about the operation of the smart home terminal from the second audio data through a voice recognition algorithm, the processor further determines attribute information of the intelligent home terminal from the second audio so as to determine a second intelligent home terminal to be specifically operated by a second terminal user, a third operation model corresponding to the second intelligent home terminal is sent to the second terminal, the second terminal sends the third operation model to the corresponding second intelligent home terminal, and the second intelligent home terminal can work according to the third operation model, and the user does not need to perform manual operation, so that great convenience is provided for the user to use the intelligent home terminal.
It should be noted that, in some possible embodiments of the present invention, before the processor is configured to analyze whether the second audio data includes content related to the operation of the smart home terminal, the processor is further configured to build a language identification model, which is as follows:
determining the role relationship among different communication subjects, such as parents, children, couples, friends, colleagues or other basic relationships;
the method comprises the steps of obtaining communication data among a plurality of roles, wherein the communication data comprises voice data, action data, character data and other data;
acquiring role basic data of the ages, sexes, educational programs, accents, hobbies, timbres, words, emotions and the like of all the roles, establishing role models for all the roles according to the role basic data, and determining role model relations among all the role models according to the role relations;
and establishing a communication model between every two character models by extracting key words and recognizing emotional states according to the character models and the communication data.
The processor is configured to analyze whether the second audio data includes content related to the operation of the smart home terminal, specifically:
when a control terminal user communicates with a second terminal user, determining a role model of the control terminal user and a role model of the second terminal user, and determining a role relationship and a communication model between the role model and the second terminal user by combining the role model relationship;
key elements including keywords, special sounds and the like are analyzed from the second audio data.
And according to the role relationship and the communication model, identifying key elements so as to judge whether the second audio data contains the content related to the operation of the intelligent home terminal.
It should be noted that for simplicity of description, the above-mentioned embodiments of the method are described as a series of acts, but those skilled in the art should understand that the present application is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the above-described units is only one type of logical functional division, and other divisions may be realized in practice, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-mentioned method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Although the present invention is disclosed above, the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions without departing from the spirit and scope of the invention, and all changes and modifications can be made, including different combinations of functions, implementation steps, software and hardware implementations, all of which are included in the scope of the invention.

Claims (10)

1. The utility model provides an intelligence house control terminal which characterized in that includes: the intelligent home terminal comprises a wireless communication module, a camera module, an audio acquisition module, a data acquisition module, a processor and a controller, wherein the wireless communication module is used for receiving and sending data, the camera module is used for acquiring first image data of the intelligent home terminal, the audio acquisition module is used for acquiring first audio data of the intelligent home terminal, the data acquisition module is used for acquiring attribute data and working data of the intelligent home terminal, and the processor and the controller are used for processing data;
the wireless communication module is used for establishing communication connection between the control terminal and the intelligent home terminal;
the processor is used for establishing a basic operation model of the intelligent home terminal through the first image data, the first audio data, the attribute data and the working data;
the processor is also used for acquiring family member data and establishing a family member model;
and the controller is used for adjusting the working parameters of the intelligent home terminal to obtain an operation model according to the family member model and the basic operation model.
2. The intelligent home control terminal according to claim 1, wherein the wireless communication module is configured to receive an intelligent home operation model acquisition request sent by a first terminal;
the processor is used for determining a corresponding first intelligent home terminal from the intelligent home operation model acquisition request;
the controller is used for sending an instruction for feeding back first attribute data and first family member data of the first intelligent home terminal to the first terminal through the wireless communication module;
the wireless communication module is used for receiving the first attribute data and the first family member data;
the processor is used for selecting a corresponding first operation model according to the first attribute data;
the processor is further used for correcting the first operation model according to the first family member data to obtain a second operation model;
the processor is further configured to send the second operation model to the first terminal through the wireless communication module.
3. The smart home control terminal according to claim 2, wherein the processor is configured to establish a basic operation model of the smart home terminal through the first image data, the first audio data, the attribute data, and the working data, specifically:
and inputting the first image data, the first audio data, the attribute data and the working data into a trained first model to obtain a basic operation model of the intelligent home terminal.
4. The smart home control terminal according to claim 3, wherein the processor is further configured to obtain family member data and establish a family member model, specifically:
acquiring age, gender, health state data, diet characteristic data, work and rest data, hobby data and face data of the family members;
and inputting the age, sex, health status data, diet characteristic data, work and rest data, hobby data and face data of the family members into the trained second model to obtain the family member model of the family members.
5. The intelligent home control terminal according to claims 1-4, wherein the data acquisition module is further configured to acquire second audio data during a call between the control terminal and a second terminal;
the processor is further used for analyzing whether the second audio data contain content related to the operation of the intelligent home terminal;
the controller is further configured to send the operation model of the smart home to the second terminal through the wireless communication model when the second audio data includes content related to the operation of the smart home terminal.
6. The intelligent home control method is characterized in that the intelligent home control terminal comprises a wireless communication module for receiving and sending data, a camera module for acquiring first image data of the intelligent home terminal, an audio acquisition module for acquiring first audio data of the intelligent home terminal, a data acquisition module for acquiring attribute data and working data of the intelligent home terminal, a processor for processing the data and a controller, and the method comprises the following steps:
establishing communication connection between the control terminal and the intelligent home terminal;
establishing a basic operation model of the intelligent home terminal through the first image data, the first audio data, the attribute data and the working data;
acquiring family member data and establishing a family member model;
and adjusting the working parameters of the intelligent home terminal to obtain an operation model according to the family member model and the basic operation model.
7. The smart home control method according to claim 6, further comprising the steps of:
receiving an intelligent home operation model acquisition request sent by a first terminal;
determining a corresponding first intelligent home terminal from the intelligent home operation model acquisition request;
sending an instruction for feeding back first attribute data and first family member data of the first intelligent household terminal to the first terminal through the wireless communication module;
receiving the first attribute data and first family member data;
selecting a corresponding first operation model according to the first attribute data;
correcting the first operation model according to the first family member data to obtain a second operation model;
and sending the second operation model to the first terminal through the wireless communication module.
8. The smart home control method according to claim 7, wherein the step of establishing a basic operation model of the smart home terminal through the first image data, the first audio data, the attribute data, and the working data specifically includes:
inputting the first image data, the first audio data, the attribute data and the working data into a trained first model to obtain a basic operation model of the intelligent home terminal.
9. The smart home control method according to claim 8, wherein the step of obtaining family member data and establishing a family member model specifically comprises:
acquiring age, gender, health state data, diet characteristic data, work and rest data, hobby data and face data of the family members;
and inputting the age, sex, health status data, diet characteristic data, work and rest data, hobby data and face data of the family members into the trained second model to obtain the family member model of the family members.
10. The smart home control method according to claim 9, further comprising:
acquiring second audio data in the communication process between the control terminal and a second terminal;
analyzing whether the second audio data contain content related to the operation of the intelligent household terminal;
and when the second audio data contain the content related to the operation of the intelligent home terminal, sending the operation model of the intelligent home to the second terminal through the wireless communication model.
CN202210441270.0A 2022-04-25 2022-04-25 Intelligent household control method and terminal Active CN114740745B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210441270.0A CN114740745B (en) 2022-04-25 2022-04-25 Intelligent household control method and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210441270.0A CN114740745B (en) 2022-04-25 2022-04-25 Intelligent household control method and terminal

Publications (2)

Publication Number Publication Date
CN114740745A true CN114740745A (en) 2022-07-12
CN114740745B CN114740745B (en) 2023-01-24

Family

ID=82284036

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210441270.0A Active CN114740745B (en) 2022-04-25 2022-04-25 Intelligent household control method and terminal

Country Status (1)

Country Link
CN (1) CN114740745B (en)

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103345232A (en) * 2013-07-15 2013-10-09 孟凡忠 Individualized intelligent home control method and system
CN103514240A (en) * 2012-11-29 2014-01-15 Tcl集团股份有限公司 Method and system for mining family member relationship based on remote controller
CN105388777A (en) * 2015-12-16 2016-03-09 江苏惠通集团有限责任公司 Smart home control system
CN105607508A (en) * 2016-03-24 2016-05-25 重庆邮电大学 Smart home device control method and system based on user behavior analysis
US20160321891A1 (en) * 2014-11-10 2016-11-03 Sengled Optoelectronics Co., Ltd. Method, apparatus, and system for controlling smart home environment using led lighting device
CN106647645A (en) * 2015-11-02 2017-05-10 中兴通讯股份有限公司 Method and system for home control adjustment
CN108196461A (en) * 2018-02-07 2018-06-22 宁夏慧百通赢科技有限公司 Control method, device and the intelligent domestic system of smart home device
CN109298637A (en) * 2017-07-25 2019-02-01 ***通信有限公司研究院 A kind of intelligent home equipment control method and device
CN109947029A (en) * 2019-04-10 2019-06-28 广东工业大学 Control method, device and the equipment of smart home device
CN110471301A (en) * 2019-08-23 2019-11-19 宁波智轩物联网科技有限公司 A kind of smart home service recommendation system and method based on user behavior
CN110941199A (en) * 2019-12-10 2020-03-31 上海雷盎云智能技术有限公司 Intelligent household equipment distribution network and control method and device
CN111752165A (en) * 2020-07-10 2020-10-09 广州博冠智能科技有限公司 Intelligent equipment control method and device of intelligent home system
CN111880430A (en) * 2020-08-27 2020-11-03 珠海格力电器股份有限公司 Control method and device for intelligent household equipment
CN112327664A (en) * 2020-11-30 2021-02-05 深圳市艾特智能科技有限公司 Intelligent household equipment control method and device, storage medium and computer equipment
CN112506068A (en) * 2020-12-15 2021-03-16 赣州朝歌科技有限公司 Smart home management system based on accurate recognition and cluster analysis
CN212873230U (en) * 2020-10-28 2021-04-02 常州刘国钧高等职业技术学校(常州市刘国钧职业教育中心) Intelligent home control system for analyzing user habits based on machine learning
CN114063459A (en) * 2020-08-10 2022-02-18 青岛海信电子产业控股股份有限公司 Terminal and intelligent household control method

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103514240A (en) * 2012-11-29 2014-01-15 Tcl集团股份有限公司 Method and system for mining family member relationship based on remote controller
CN103345232A (en) * 2013-07-15 2013-10-09 孟凡忠 Individualized intelligent home control method and system
US20160321891A1 (en) * 2014-11-10 2016-11-03 Sengled Optoelectronics Co., Ltd. Method, apparatus, and system for controlling smart home environment using led lighting device
CN106647645A (en) * 2015-11-02 2017-05-10 中兴通讯股份有限公司 Method and system for home control adjustment
CN105388777A (en) * 2015-12-16 2016-03-09 江苏惠通集团有限责任公司 Smart home control system
CN105607508A (en) * 2016-03-24 2016-05-25 重庆邮电大学 Smart home device control method and system based on user behavior analysis
CN109298637A (en) * 2017-07-25 2019-02-01 ***通信有限公司研究院 A kind of intelligent home equipment control method and device
CN108196461A (en) * 2018-02-07 2018-06-22 宁夏慧百通赢科技有限公司 Control method, device and the intelligent domestic system of smart home device
CN109947029A (en) * 2019-04-10 2019-06-28 广东工业大学 Control method, device and the equipment of smart home device
CN110471301A (en) * 2019-08-23 2019-11-19 宁波智轩物联网科技有限公司 A kind of smart home service recommendation system and method based on user behavior
CN110941199A (en) * 2019-12-10 2020-03-31 上海雷盎云智能技术有限公司 Intelligent household equipment distribution network and control method and device
CN111752165A (en) * 2020-07-10 2020-10-09 广州博冠智能科技有限公司 Intelligent equipment control method and device of intelligent home system
CN114063459A (en) * 2020-08-10 2022-02-18 青岛海信电子产业控股股份有限公司 Terminal and intelligent household control method
CN111880430A (en) * 2020-08-27 2020-11-03 珠海格力电器股份有限公司 Control method and device for intelligent household equipment
CN212873230U (en) * 2020-10-28 2021-04-02 常州刘国钧高等职业技术学校(常州市刘国钧职业教育中心) Intelligent home control system for analyzing user habits based on machine learning
CN112327664A (en) * 2020-11-30 2021-02-05 深圳市艾特智能科技有限公司 Intelligent household equipment control method and device, storage medium and computer equipment
CN112506068A (en) * 2020-12-15 2021-03-16 赣州朝歌科技有限公司 Smart home management system based on accurate recognition and cluster analysis

Also Published As

Publication number Publication date
CN114740745B (en) 2023-01-24

Similar Documents

Publication Publication Date Title
US11327556B2 (en) Information processing system, client terminal, information processing method, and recording medium
CN106873773B (en) Robot interaction control method, server and robot
US8583287B2 (en) Robotic system, robot control method and robot control program
CN105892829A (en) Human-robot interactive device and method based on identity recognition
CN109637518A (en) Virtual newscaster's implementation method and device
US20180085928A1 (en) Robot, robot control method, and robot system
CN105898487B (en) A kind of exchange method and device towards intelligent robot
KR102455966B1 (en) Mediating Apparatus, Method and Computer Readable Recording Medium Thereof
CN109327737A (en) TV programme suggesting method, terminal, system and storage medium
CN112596405B (en) Control method, device, equipment and computer readable storage medium for household appliances
CN110430384A (en) Video call method and device, intelligent terminal and storage medium
CN110446996A (en) A kind of control method, terminal and system
CN104932451A (en) Multi-device cooperative control method and multi-device cooperative control device
CN106572131B (en) The method and system that media data is shared in Internet of Things
CN210490904U (en) Intelligent earphone system based on face recognition
CN116430991A (en) Exhibition hall digital person explanation method and system based on mixed reality and electronic equipment
CN112017495A (en) Information interaction method and system based on learning terminal
CN114740745B (en) Intelligent household control method and terminal
CN110784762B (en) Video data processing method, device, equipment and storage medium
CN113327662A (en) Intelligent household fitness mirror based on Internet of things and control method thereof
CN108597511A (en) Information displaying method, control terminal based on Internet of Things and readable storage medium storing program for executing
CN112488650A (en) Conference atmosphere adjusting method, electronic equipment and related products
CN109976169B (en) Internet television intelligent control method and system based on self-learning technology
CN107820109A (en) TV method to set up, system and computer-readable recording medium
CN109684581B (en) Evaluation method, device, equipment and storage medium based on user characteristic data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant