CN112637024A - Control method, control device, electronic equipment and storage medium - Google Patents

Control method, control device, electronic equipment and storage medium Download PDF

Info

Publication number
CN112637024A
CN112637024A CN202011410068.9A CN202011410068A CN112637024A CN 112637024 A CN112637024 A CN 112637024A CN 202011410068 A CN202011410068 A CN 202011410068A CN 112637024 A CN112637024 A CN 112637024A
Authority
CN
China
Prior art keywords
instruction
conflict
instructions
determining
knowledge graph
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011410068.9A
Other languages
Chinese (zh)
Inventor
李明杰
宋德超
贾巨涛
吴伟
杨昌品
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gree Electric Appliances Inc of Zhuhai
Zhuhai Lianyun Technology Co Ltd
Original Assignee
Gree Electric Appliances Inc of Zhuhai
Zhuhai Lianyun Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gree Electric Appliances Inc of Zhuhai, Zhuhai Lianyun Technology Co Ltd filed Critical Gree Electric Appliances Inc of Zhuhai
Priority to CN202011410068.9A priority Critical patent/CN112637024A/en
Publication of CN112637024A publication Critical patent/CN112637024A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2816Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/2821Avoiding conflicts related to the use of home appliances
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/36Creation of semantic tools, e.g. ontology or thesauri
    • G06F16/367Ontology
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y10/00Economic sectors
    • G16Y10/80Homes; Buildings
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y40/00IoT characterised by the purpose of the information processing
    • G16Y40/30Control
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2642Domotique, domestic, home control, automation, smart house
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Civil Engineering (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Architecture (AREA)
  • Databases & Information Systems (AREA)
  • Structural Engineering (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Programmable Controllers (AREA)

Abstract

The application provides a control method, a control device, an electronic device and a storage medium, wherein the control method comprises the following steps: acquiring multi-instruction control information; analyzing the multi-instruction control information to determine a plurality of instructions, and obtaining an initial list based on the plurality of instructions; determining an execution sequence of each instruction based on the initial list and a prestored instruction conflict knowledge graph to obtain a target list, wherein the execution sequence between two adjacent instructions in the target list has no conflict relationship, and the instruction conflict knowledge graph comprises the conflict relationship of the execution sequences between the instructions; and sending each instruction to the corresponding target equipment based on the target list so as to enable each target equipment to work based on the corresponding instruction.

Description

Control method, control device, electronic equipment and storage medium
Technical Field
The present application relates to the field of smart home devices, and in particular, to a control method, an apparatus, an electronic device, and a storage medium.
Background
The multiple devices in the family are networked to form the intelligent home system, but each device is simply connected through a network and cannot form intelligent linkage, the devices in the traditional intelligent home system can only execute the sequence controlled by a voice single instruction or a preset scene instruction, and conflict can occur in the process of randomly issuing the multiple instructions, so that the devices cannot execute according to the multiple instructions, and the customer experience is influenced.
Disclosure of Invention
In order to solve the above problems, the present application provides a control method, an apparatus, an electronic device, and a storage medium.
The application provides a control method, comprising the following steps:
acquiring multi-instruction control information;
analyzing the multi-instruction control information to determine a plurality of instructions, and obtaining an initial list based on the plurality of instructions;
determining an execution sequence of each instruction based on the initial list and a prestored instruction conflict knowledge graph to obtain a target list, wherein the execution sequence between two adjacent instructions in the target list has no conflict relationship, and the instruction conflict knowledge graph comprises the conflict relationship of the execution sequences between the instructions;
and sending each instruction to the corresponding target equipment based on the target list so as to enable each target equipment to work based on the corresponding instruction.
In some embodiments, the determining the execution order of the instructions based on the initial list and a pre-stored instruction conflict knowledge-graph comprises:
selecting an ith instruction and an (i + 1) th instruction in the initial list, wherein the ith instruction and the (i + 1) th instruction are adjacent in the initial list, and i is a positive integer;
acquiring a prestored instruction conflict knowledge graph;
determining whether a conflict relation exists between the execution sequence of the ith instruction and the (i + 1) th instruction or not based on the instruction conflict knowledge graph to obtain a first judgment result;
and determining the execution sequence of each instruction based on the first judgment result.
In some embodiments, the determining the execution order of the respective instructions based on the first determination result includes:
determining a first execution sequence between the ith instruction and the (i + 1) th instruction under the condition that the first judgment result represents that the execution sequence between the ith instruction and the (i + 1) th instruction does not have a conflict relationship;
an execution order of the instructions is determined based on the first execution order.
In some embodiments, the determining the execution order of the instructions based on the first determination result further includes:
when the first judgment result represents that the execution sequence between the ith instruction and the (i + 1) th instruction has a conflict relationship, adjusting the execution sequence of the (i + 2) th instruction in the initial list to the execution sequence of the (i + 1) th instruction in the initial list;
determining whether a conflict relation exists between the execution sequence of the ith instruction and the (i + 2) th instruction or not based on the instruction conflict knowledge graph to obtain a second judgment result;
and determining the execution sequence of each instruction based on the second judgment result.
In some embodiments, the method further comprises:
acquiring an instruction set and a conflict relation among instructions in the instruction set;
determining each instruction in the instruction set as each node in the instruction conflict knowledge graph;
determining a connection path of a connection node based on a conflict relation among the instructions to obtain an instruction conflict knowledge graph;
and saving the instruction conflict knowledge graph.
In some embodiments, said determining whether a conflict relationship exists between the execution order of the ith instruction and the (i + 1) th instruction based on the instruction conflict knowledge-graph comprises:
determining a target node in the instruction collision knowledge graph based on the ith instruction, wherein the target node corresponds to the ith instruction;
determining a connection path of the target node;
determining whether the (i + 1) th instruction corresponds to a node on a connection path of the target node or not to obtain a third judgment result;
and determining whether a conflict relationship exists between the execution sequence of the ith instruction and the (i + 1) th instruction based on the third judgment result.
In some embodiments, the parsing the multi-instruction control information to determine a plurality of instructions and obtaining an initial list based on the plurality of instructions includes:
analyzing the multi-instruction control information to obtain each entity word;
determining a vector corresponding to each entity word;
determining a plurality of instructions based on the vector;
an initial list is derived based on the plurality of instructions.
An embodiment of the present application provides a control device, the control device includes:
the first acquisition module is used for acquiring multi-instruction control information;
the first determining module is used for analyzing the multi-instruction control information to determine a plurality of instructions and obtaining an initial list based on the plurality of instructions;
a second determining module, configured to determine an execution order of each instruction based on the initial list and a pre-stored instruction conflict knowledge graph to obtain a target list, where there is no conflict relationship between the execution orders of two adjacent instructions in the target list, and the instruction conflict knowledge graph includes a conflict relationship between the execution orders of the instructions;
and the sending module is used for sending each instruction to the corresponding target equipment based on the target list so as to enable each target equipment to work based on the corresponding instruction.
An embodiment of the present application provides an electronic device, which includes a memory and a processor, where the memory stores a computer program, and the computer program, when executed by the processor, executes the control method described in any one of the above items.
The embodiment of the application provides a storage medium, and a computer program stored in the storage medium can be executed by one or more processors and can be used for realizing any one of the control methods.
According to the control method, the control device, the electronic equipment and the storage medium, when multi-instruction control information is obtained, the multi-instruction control information is analyzed to determine a plurality of instructions, and an initial list is obtained based on the instructions; the conflict-free target list is obtained based on the pre-stored instruction conflict knowledge graph, so that the instruction is issued based on the target list, the target equipment is correspondingly controlled, the multi-instruction control can be realized, and the human-computer interaction experience is improved.
Drawings
The present application will be described in more detail below on the basis of embodiments and with reference to the accompanying drawings.
Fig. 1 is a schematic flow chart illustrating an implementation process of a control method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of an instruction conflict knowledge graph according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating a method for determining an execution order of instructions according to an embodiment of the present disclosure;
FIG. 4 is a schematic flow chart illustrating the establishment of an instruction conflict knowledge graph according to an embodiment of the present application;
fig. 5 is a schematic flow chart illustrating an implementation of a control method according to an embodiment of the present application;
FIG. 6 is a flow chart illustrating knowledge inference provided by an embodiment of the present application;
fig. 7 is a schematic structural diagram of a control device according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
In the drawings, like parts are designated with like reference numerals, and the drawings are not drawn to scale.
Detailed Description
In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the attached drawings, the described embodiments should not be considered as limiting the present application, and all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.
The following description will be added if a similar description of "first \ second \ third" appears in the application file, and in the following description, the terms "first \ second \ third" merely distinguish similar objects and do not represent a specific ordering for the objects, and it should be understood that "first \ second \ third" may be interchanged under certain circumstances in a specific order or sequence, so that the embodiments of the application described herein can be implemented in an order other than that shown or described herein.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the application.
The embodiment of the application provides a control method, and the method is applied to electronic equipment, wherein the electronic equipment can be an air conditioner, a computer, a mobile terminal, a washing machine and the like. The functions realized by the control method provided by the embodiment of the application can be realized by calling a program code by a processor of the electronic equipment, wherein the program code can be stored in a computer storage medium. An embodiment of the present application provides a control method, and fig. 1 is a schematic flow chart illustrating an implementation of the control method provided in the embodiment of the present application, and as shown in fig. 1, the control method includes:
step S101, multi-instruction control information is acquired.
In the embodiment of the application, the multi-instruction control information may be voice information or text information; taking the electronic device as a mobile phone as an example, the multi-instruction control information can be acquired by receiving the voice input of the user. Illustratively, the voice inputs '26-degree cooling mode with the air conditioner on and sweeping up and down, wind speed is medium', so that multi-instruction control information is received.
Step S102, analyzing the multi-instruction control information to determine a plurality of instructions, and obtaining an initial list based on the plurality of instructions.
In the embodiment of the application, after the multi-instruction control information is obtained, the multi-instruction control information can be analyzed by using a bidirectional long and short term memory network (BI-LSTM) entity extraction technology to obtain a plurality of individual instructions, so that an initial list is obtained. In some embodiments, the BI-LSTM is used for analyzing the multi-instruction control information to obtain each entity word; determining a vector corresponding to each entity word; determining a plurality of instructions based on the vector; an initial list is derived based on the plurality of instructions.
In the embodiment of the present application, each instruction includes a device ID and an instruction, and the plurality of instructions may correspond to one device ID, for example, device, instruction 1, instruction 2, and instruction 3.
In some embodiments, it may also be that the plurality of instructions correspond to a plurality of device IDs, e.g., device 1, instruction 1, device 2, instruction 2.
Step S103, determining the execution sequence of each instruction based on the initial list and a prestored instruction conflict knowledge graph to obtain a target list.
In the embodiment of the present application, there is no conflict relationship in the execution sequence between two adjacent instructions in the target list. The instruction conflict knowledge graph includes conflict relationships of execution sequences between instructions, and fig. 2 is a schematic diagram of an instruction conflict knowledge graph provided in an embodiment of the present application, where, as shown in fig. 2, an instruction 1 and an instruction 3 have a conflict relationship, and an instruction 1 and an instruction 2 have a conflict relationship. In the embodiment of the present application, the conflict relationship is that two instructions cannot be executed successively, and for example, if instruction 1 cannot be executed after instruction 2, the execution sequence of instruction 1 and instruction 2 has a conflict relationship. In the embodiment of the application, the electronic equipment can acquire the instruction set and the conflict relationship among the instructions in the instruction set; determining each instruction in the instruction set as each node in the instruction conflict knowledge graph; determining a connection path of a connection node based on a conflict relation among the instructions to obtain an instruction conflict knowledge graph; and saving the instruction conflict knowledge graph. In the embodiment of the application, the execution sequence of each instruction in the initial list can be adjusted based on a pre-stored instruction conflict knowledge graph, and the electronic device can select the ith instruction and the (i + 1) th instruction in the initial list, wherein the ith instruction and the (i + 1) th instruction are adjacent in the initial list, and i is a positive integer; acquiring a prestored instruction conflict knowledge graph; determining whether a conflict relation exists between the execution sequence of the ith instruction and the (i + 1) th instruction or not based on the instruction conflict knowledge graph to obtain a first judgment result; and determining the execution sequence of each instruction based on the first judgment result. Determining a first execution sequence between the ith instruction and the (i + 1) th instruction under the condition that the first judgment result represents that the execution sequence between the ith instruction and the (i + 1) th instruction does not have a conflict relationship; an execution order of the instructions is determined based on the first execution order. When the first judgment result represents that the execution sequence between the ith instruction and the (i + 1) th instruction has a conflict relationship, adjusting the execution sequence of the (i + 2) th instruction in the initial list to the execution sequence of the (i + 1) th instruction in the initial list; determining whether a conflict relation exists between the execution sequence of the ith instruction and the (i + 2) th instruction or not based on the instruction conflict knowledge graph to obtain a second judgment result; and determining the execution sequence of each instruction based on the second judgment result.
And step S104, sending each instruction to the corresponding target equipment based on the target list so as to enable each target equipment to work based on the corresponding instruction.
In the embodiment of the application, the electronic device can acquire each instruction in the target list, and determine the corresponding target device based on the device ID in each instruction, so that each instruction is sent to the corresponding target device, and each target device works based on the corresponding instruction.
According to the control method, when multi-instruction control information is obtained, the multi-instruction control information is analyzed to determine a plurality of instructions, and an initial list is obtained based on the instructions; the conflict-free target list is obtained based on the pre-stored instruction conflict knowledge graph, so that the instruction is issued based on the target list, the target equipment is correspondingly controlled, the multi-instruction control can be realized, and the human-computer interaction experience is improved.
In some embodiments, the step S103 "determining the execution order of each instruction based on the initial list and the pre-stored instruction conflict knowledge graph" may be implemented by the following steps, and fig. 3 is a schematic flowchart of determining the execution order of each instruction provided by an embodiment of the present application, and as shown in fig. 3, the method includes:
step S1, selecting the ith instruction and the (i + 1) th instruction in the initial list.
In this embodiment of the present application, the ith instruction and the (i + 1) th instruction are adjacent to each other in the initial list, and i is a positive integer.
Step S2, and acquiring a prestored instruction conflict knowledge map.
Step S3, determining whether a conflict relationship exists between the execution sequence of the ith instruction and the (i + 1) th instruction based on the instruction conflict knowledge map, and obtaining a first determination result.
In this embodiment of the application, the first determination result may indicate that there is no conflict relationship in the execution sequence between the ith instruction and the (i + 1) th instruction. The first judgment result represents that a conflict relation exists between the execution sequence of the ith instruction and the execution sequence of the (i + 1) th instruction.
In step S4, the execution order of the respective instructions is determined based on the first determination result.
In this embodiment of the application, when the first determination result indicates that there is no conflict relationship in the execution sequence between the ith instruction and the (i + 1) th instruction, determining a first execution sequence between the ith instruction and the (i + 1) th instruction; an execution order of the instructions is determined based on the first execution order. The order of the (i + 1) th instruction and the (i + 2) th instruction is then determined, and thus the order of all instructions can be determined. When the first judgment result represents that the execution sequence between the ith instruction and the (i + 1) th instruction has a conflict relationship, adjusting the execution sequence of the (i + 2) th instruction in the initial list to the execution sequence of the (i + 1) th instruction in the initial list; determining whether a conflict relation exists between the execution sequence of the ith instruction and the (i + 2) th instruction or not based on the instruction conflict knowledge graph to obtain a second judgment result; and determining the execution sequence of each instruction based on the second judgment result. In this embodiment of the application, when the second judgment result indicates that there is no conflict relationship in the execution order between the ith instruction and the (i + 2) th instruction, determining a second execution order between the ith instruction and the (i + 2) th instruction; determining an execution order of the instructions based on the second execution order. The order of the (i + 1) th instruction and the (i + 2) th instruction is then determined, and thus the order of all instructions can be determined.
In some embodiments, before step S2 "and retrieving the pre-stored instruction conflict knowledge-graph", the method further comprises: step of establishing an instruction conflict knowledge graph, fig. 4 is a schematic flowchart of a process for establishing an instruction conflict knowledge graph according to an embodiment of the present application, and as shown in fig. 4, the process includes:
step S11, obtaining the instruction set and the conflict relationship between the instructions in the instruction set.
In the embodiment of the application, the conflict relationship among the instructions can be edited based on the equipment at home, and the conflict relationship among the instruction set and the instructions in the instruction set is input into the electronic equipment, so that the conflict relationship among the instruction set and the instructions in the instruction set is obtained.
Step S12, determining each instruction in the instruction set as each node in the instruction conflict knowledge graph.
In the embodiment of the application, the instruction conflict knowledge graph comprises nodes and connection paths, wherein the nodes correspond to all instructions, and the connection paths correspond to conflict relations. In constructing the instruction conflict knowledge graph, each instruction in the instruction set may be determined to be a respective node. For example, instruction a is determined to be node a and instruction B is determined to be node B.
And step S13, determining the connection path of the connection node based on the conflict relationship among the instructions to obtain an instruction conflict knowledge graph.
In the embodiment of the application, when a conflict relationship exists between instructions, the nodes are connected, and the path is connected, so that an instruction conflict knowledge graph is obtained. And forming an instruction conflict knowledge graph through each node and each connection path.
And step S14, saving the instruction conflict knowledge map.
According to the control method provided by the embodiment of the application, the instruction conflict knowledge graph is established in advance, so that the target list is determined when the multi-instruction is received, the instruction is issued based on the target list, the target equipment is correspondingly controlled, the multi-instruction control can be realized, and the human-computer interaction experience is improved.
In some embodiments, the step S3 "determining whether a conflict relationship exists in the execution order between the ith instruction and the (i + 1) th instruction based on the instruction conflict knowledge map" may be implemented by:
step S21, determining a target node in the instruction conflict knowledge graph based on the ith instruction, wherein the target node corresponds to the ith instruction.
And step S22, determining the connection path of the target node.
Step S23, determining whether the (i + 1) th instruction corresponds to a node on the connection path of the target node, and obtaining a third determination result.
Step S24, determining whether there is a conflict relationship in the execution order between the ith instruction and the (i + 1) th instruction based on the third determination result.
An embodiment of the present application further provides a control method, which is applied to a control device (similar to the electronic device in the foregoing embodiment), where the control device includes: the system comprises a multi-instruction module, a knowledge reasoning module, an equipment instruction conflict knowledge map module, a reasonable instruction control sequence module and an equipment control module. Fig. 5 is a schematic flow chart of an implementation process of a control method provided in an embodiment of the present application, and as shown in fig. 5, the method includes:
and step S31, the multi-instruction module analyzes the voice multi-instruction.
And (3) resolving the voice multiple instructions into an instruction list by using a BI-LSTM entity extraction technology, for example: the voice is input into a 26-degree refrigeration mode of air conditioner opening and up-down wind sweeping, the wind speed is moderate, and the mode is converted into an instruction list: [ device, instruction 1, instruction 2, instruction 3.
In step S32, the knowledge inference module performs knowledge inference.
The query instruction conflicts the knowledge graph by way of a path query.
Illustratively, the instruction list A is an initial list after voice analysis, and the instruction list B is a rationalized instruction list after knowledge reasoning. Fig. 6 is a schematic flow chart of knowledge inference provided by the embodiment of the present application, as shown in fig. 6,
in step S41, the instruction list a is acquired,
in step S42, instruction i is selected.
In step S43, it is determined whether or not the command i +1 conflicts with the command i.
In the embodiment of the present application, when the instruction i +1 conflicts with the instruction i, step S44 is instructed. When the instruction i +1 does not conflict with the instruction i, step S45 is executed.
In step S44, instruction i +1 exchanges positions with instruction i + 2.
In the embodiment of the present application, after the instruction i +1 and the instruction i +2 are exchanged, the instruction continues to step S43. In step S43, instruction i +1 is replaced with instruction i + 2.
In step S45, the instruction list B is determined.
Before step S32, the device command conflict knowledge graph module establishes a device command conflict knowledge graph with commands as nodes and conflicts as management. Therefore, after the knowledge inference module acquires the instruction list A, the instruction conflict knowledge graph is inquired.
In step S33, the logical device control sequence module forms a logical, conflict-free command control sequence (the same as the target list in the above embodiment) after command inference.
And step S34, the device control module issues the final control command sequence to the corresponding device for corresponding control.
According to the method provided by the embodiment, on the basis of combining the voice command and the equipment command conflict through the knowledge inference technology, a conflict-free equipment control sequence meeting the rationalization is generated, and then the equipment command issuing control is carried out, so that the automatic operation of the target-knowledge-parameter-equipment is formed.
Based on the foregoing embodiments, the present application provides a control apparatus, where each module included in the apparatus and each unit included in each module may be implemented by a processor in a computer device; of course, the implementation can also be realized through a specific logic circuit; in the implementation process, the processor may be a Central Processing Unit (CPU), a Microprocessor Unit (MPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), or the like.
Fig. 7 is a schematic structural diagram of a control device according to an embodiment of the present application, and as shown in fig. 7, a control device 700 includes:
a first obtaining module 701, configured to obtain multi-instruction control information;
a first determining module 702, configured to analyze the multi-instruction control information to determine multiple instructions, and obtain an initial list based on the multiple instructions;
a second determining module 703, configured to determine, based on the initial list and a pre-stored instruction conflict knowledge graph, an execution order of each instruction to obtain a target list, where there is no conflict relationship in the execution order between two adjacent instructions in the target list, and the instruction conflict knowledge graph includes a conflict relationship in the execution order between the instructions;
a sending module 704, configured to send each instruction to the corresponding target device based on the target list, so that each target device performs work based on the corresponding instruction.
In some embodiments, the second determining module 703 includes:
a selecting unit, configured to select an ith instruction and an (i + 1) th instruction in the initial list, where the ith instruction and the (i + 1) th instruction are adjacent in the initial list, and i is a positive integer;
the acquisition unit is used for acquiring a prestored instruction conflict knowledge graph;
a first determining unit, configured to determine whether a conflict relationship exists in an execution order between the ith instruction and the (i + 1) th instruction based on the instruction conflict knowledge graph, so as to obtain a first determination result;
and the judging unit is used for determining the execution sequence of each instruction based on the first judgment result.
In some embodiments, the determining unit includes:
a first determining subunit, configured to determine, when the first determination result indicates that there is no conflict relationship in an execution order between the ith instruction and the (i + 1) th instruction, a first execution order between the ith instruction and the (i + 1) th instruction;
a second determining subunit, configured to determine an execution order of the respective instructions based on the first execution order.
In some embodiments, the determining unit includes:
a third determining subunit, configured to, when the first determination result indicates that a conflict relationship exists between the execution order of the ith instruction and the execution order of the (i + 1) th instruction, adjust the execution order of the (i + 2) th instruction in the initial list to the execution order of the (i + 1) th instruction in the initial list;
a fourth determining subunit, configured to determine, based on the instruction conflict knowledge graph, whether a conflict relationship exists between an ith instruction and the (i + 2) th instruction in an execution sequence, so as to obtain a second determination result;
a fifth determining subunit, configured to determine an execution order of the respective instructions based on the second determination result.
In some embodiments, the control device 700 includes:
the second acquisition module is used for acquiring the instruction set and the conflict relationship among the instructions in the instruction set;
a third determining module, configured to determine each instruction in the instruction set as each node in the instruction conflict knowledge graph;
the fourth determining module is used for determining the connection path of the connection node based on the conflict relationship among the instructions to obtain an instruction conflict knowledge graph;
and the storage module is used for storing the instruction conflict knowledge graph.
In some embodiments, the first determination unit comprises:
a sixth determining subunit, configured to determine, based on the ith instruction, a target node in the instruction conflict knowledgegraph, wherein the target node corresponds to the ith instruction;
a seventh determining subunit, configured to determine a connection path of the target node;
an eighth determining subunit, configured to determine whether the (i + 1) th instruction corresponds to a node on a connection path of the target node, to obtain a third determination result;
a ninth determining subunit, configured to determine whether a conflict relationship exists between the execution order of the ith instruction and the (i + 1) th instruction based on the third determination result.
In some embodiments, the first determining module comprises:
the analysis unit is used for analyzing the multi-instruction control information to obtain each entity word;
the second determining unit is used for determining the vector corresponding to each entity word;
a third determination unit to determine a plurality of instructions based on the vector;
a deriving unit configured to derive an initial list based on the plurality of instructions.
It should be noted that, in the embodiment of the present application, if the control method is implemented in the form of a software functional module and sold or used as a standalone product, the control method may also be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or portions thereof contributing to the prior art may be embodied in the form of a software product stored in a storage medium, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a magnetic disk, or an optical disk. Thus, embodiments of the present application are not limited to any specific combination of hardware and software.
Accordingly, an embodiment of the present application provides a storage medium, on which a computer program is stored, wherein the computer program is executed by a processor to implement the steps in the control method provided in the above embodiment.
The embodiment of the application provides an electronic device; fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application, and as shown in fig. 8, the electronic device 800 includes: a processor 801, at least one communication bus 802, a user interface 803, at least one external communication interface 804, memory 805. Wherein the communication bus 802 is configured to enable connective communication between these components. The user interface 803 may include a display screen, and the external communication interface 804 may include a standard wired interface and a wireless interface, among others. The processor 801 is configured to execute a program of a control method stored in the memory to implement the steps in the control method provided in the above-described embodiment.
The above description of the display device and storage medium embodiments is similar to the description of the method embodiments above, with similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the computer device and the storage medium of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.
Here, it should be noted that: the above description of the storage medium and device embodiments is similar to the description of the method embodiments above, with similar advantageous effects as the method embodiments. For technical details not disclosed in the embodiments of the storage medium and apparatus of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: various media that can store program codes, such as a removable Memory device, a Read Only Memory (ROM), a magnetic disk, or an optical disk.
Alternatively, the integrated units described above in the present application may be stored in a computer-readable storage medium if they are implemented in the form of software functional modules and sold or used as independent products. Based on such understanding, the technical solutions of the embodiments of the present application may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a controller to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a removable storage device, a ROM, a magnetic or optical disk, or other various media that can store program code.
The above description is only for the embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (10)

1. A control method, characterized in that the method comprises:
acquiring multi-instruction control information;
analyzing the multi-instruction control information to determine a plurality of instructions, and obtaining an initial list based on the plurality of instructions;
determining an execution sequence of each instruction based on the initial list and a prestored instruction conflict knowledge graph to obtain a target list, wherein the execution sequence between two adjacent instructions in the target list has no conflict relationship, and the instruction conflict knowledge graph comprises the conflict relationship of the execution sequences between the instructions;
and sending each instruction to the corresponding target equipment based on the target list so as to enable each target equipment to work based on the corresponding instruction.
2. The method of claim 1, wherein determining an execution order of the instructions based on the initial list and a pre-stored instruction collision knowledge-graph comprises:
selecting an ith instruction and an (i + 1) th instruction in the initial list, wherein the ith instruction and the (i + 1) th instruction are adjacent in the initial list, and i is a positive integer;
acquiring a prestored instruction conflict knowledge graph;
determining whether a conflict relation exists between the execution sequence of the ith instruction and the (i + 1) th instruction or not based on the instruction conflict knowledge graph to obtain a first judgment result;
and determining the execution sequence of each instruction based on the first judgment result.
3. The method of claim 2, wherein determining the execution order of the instructions based on the first determination comprises:
determining a first execution sequence between the ith instruction and the (i + 1) th instruction under the condition that the first judgment result represents that the execution sequence between the ith instruction and the (i + 1) th instruction does not have a conflict relationship;
an execution order of the instructions is determined based on the first execution order.
4. The method of claim 3, wherein determining the execution order of the instructions based on the first determination further comprises:
when the first judgment result represents that the execution sequence between the ith instruction and the (i + 1) th instruction has a conflict relationship, adjusting the execution sequence of the (i + 2) th instruction in the initial list to the execution sequence of the (i + 1) th instruction in the initial list;
determining whether a conflict relation exists between the execution sequence of the ith instruction and the (i + 2) th instruction or not based on the instruction conflict knowledge graph to obtain a second judgment result;
and determining the execution sequence of each instruction based on the second judgment result.
5. The method of claim 2, further comprising:
acquiring an instruction set and a conflict relation among instructions in the instruction set;
determining each instruction in the instruction set as each node in the instruction conflict knowledge graph;
determining a connection path of a connection node based on a conflict relation among the instructions to obtain an instruction conflict knowledge graph;
and saving the instruction conflict knowledge graph.
6. The method of claim 5, wherein determining whether a conflict relationship exists between the execution order of the ith instruction and the (i + 1) th instruction based on the instruction conflict knowledge-graph comprises:
determining a target node in the instruction collision knowledge graph based on the ith instruction, wherein the target node corresponds to the ith instruction;
determining a connection path of the target node;
determining whether the (i + 1) th instruction corresponds to a node on a connection path of the target node or not to obtain a third judgment result;
and determining whether a conflict relationship exists between the execution sequence of the ith instruction and the (i + 1) th instruction based on the third judgment result.
7. The method of claim 1, wherein parsing the multi-instruction control information to determine a plurality of instructions and deriving an initial list based on the plurality of instructions comprises:
analyzing the multi-instruction control information to obtain each entity word;
determining a vector corresponding to each entity word;
determining a plurality of instructions based on the vector;
an initial list is derived based on the plurality of instructions.
8. A control device, characterized in that the control device comprises:
the first acquisition module is used for acquiring multi-instruction control information;
the first determining module is used for analyzing the multi-instruction control information to determine a plurality of instructions and obtaining an initial list based on the plurality of instructions;
a second determining module, configured to determine an execution order of each instruction based on the initial list and a pre-stored instruction conflict knowledge graph to obtain a target list, where there is no conflict relationship between the execution orders of two adjacent instructions in the target list, and the instruction conflict knowledge graph includes a conflict relationship between the execution orders of the instructions;
and the sending module is used for sending each instruction to the corresponding target equipment based on the target list so as to enable each target equipment to work based on the corresponding instruction.
9. An electronic device, comprising a memory and a processor, the memory having stored thereon a computer program that, when executed by the processor, performs the control method of any one of claims 1 to 7.
10. A storage medium storing a computer program executable by one or more processors and operable to implement a control method as claimed in any one of claims 1 to 7.
CN202011410068.9A 2020-12-03 2020-12-03 Control method, control device, electronic equipment and storage medium Pending CN112637024A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011410068.9A CN112637024A (en) 2020-12-03 2020-12-03 Control method, control device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011410068.9A CN112637024A (en) 2020-12-03 2020-12-03 Control method, control device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN112637024A true CN112637024A (en) 2021-04-09

Family

ID=75308263

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011410068.9A Pending CN112637024A (en) 2020-12-03 2020-12-03 Control method, control device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112637024A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113827270A (en) * 2021-08-24 2021-12-24 深圳市德力凯医疗设备股份有限公司 Instruction conflict resolution method, ultrasound device, and computer-readable storage medium
CN115343984A (en) * 2022-07-29 2022-11-15 青岛海尔科技有限公司 Equipment control method, device, storage medium and electronic device
CN115567567A (en) * 2022-09-20 2023-01-03 中国联合网络通信集团有限公司 Equipment control method, device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190179917A1 (en) * 2017-12-08 2019-06-13 Apple Inc. Geographical knowledge graph
CN110007611A (en) * 2019-03-08 2019-07-12 浙江大学 A kind of implicit collision detection method of smart home of knowledge based map
CN110398947A (en) * 2019-08-23 2019-11-01 珠海格力电器股份有限公司 Control method and device of intelligent household equipment
CN110597075A (en) * 2019-09-09 2019-12-20 珠海格力电器股份有限公司 Method and device for detecting control conflict, electronic equipment and storage medium
US20200118010A1 (en) * 2018-10-16 2020-04-16 Samsung Electronics Co., Ltd. System and method for providing content based on knowledge graph

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190179917A1 (en) * 2017-12-08 2019-06-13 Apple Inc. Geographical knowledge graph
US20200118010A1 (en) * 2018-10-16 2020-04-16 Samsung Electronics Co., Ltd. System and method for providing content based on knowledge graph
CN110007611A (en) * 2019-03-08 2019-07-12 浙江大学 A kind of implicit collision detection method of smart home of knowledge based map
CN110398947A (en) * 2019-08-23 2019-11-01 珠海格力电器股份有限公司 Control method and device of intelligent household equipment
CN110597075A (en) * 2019-09-09 2019-12-20 珠海格力电器股份有限公司 Method and device for detecting control conflict, electronic equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
肖丁等: "智能家居场景联动中基于知识图谱的隐式冲突检测方法研究", 《计算机学报》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113827270A (en) * 2021-08-24 2021-12-24 深圳市德力凯医疗设备股份有限公司 Instruction conflict resolution method, ultrasound device, and computer-readable storage medium
CN113827270B (en) * 2021-08-24 2024-03-12 深圳市德力凯医疗设备股份有限公司 Instruction conflict resolution method, ultrasonic device and computer readable storage medium
CN115343984A (en) * 2022-07-29 2022-11-15 青岛海尔科技有限公司 Equipment control method, device, storage medium and electronic device
CN115567567A (en) * 2022-09-20 2023-01-03 中国联合网络通信集团有限公司 Equipment control method, device and storage medium

Similar Documents

Publication Publication Date Title
CN112637024A (en) Control method, control device, electronic equipment and storage medium
CN110687820B (en) Control method and device of intelligent household equipment, terminal equipment and storage medium
CN109040970B (en) Service planning handling method based on cloud computing and terminal equipment
CN114244644B (en) Control method and device for intelligent home, storage medium and electronic device
WO2020228030A1 (en) Device recommendation method and apparatus, electronic device, and storage medium
CN105827494A (en) Method, device and system for adding equipment
US20140058537A1 (en) Methods, Systems, and Products for Controlling Devices
CN113341754A (en) Scene configuration method, scene engine, user terminal and intelligent home system
EP3104553A1 (en) Method for controlling multiple devices connected via network
CN112423368A (en) Gateway, intelligent device, mobile terminal, network access method and network access auxiliary method and system
CN114385287B (en) Presentation content determining method, apparatus, electronic device and storage medium
CN108711025A (en) It hires a car vehicle inquiring stock method, apparatus, electronic equipment, storage medium
CN110968367A (en) E-commerce commodity field configuration method, device, server and storage medium
CN108062401B (en) Application recommendation method and device and storage medium
CN114826805A (en) Computer readable storage medium, mobile terminal and intelligent home control method
CN116224812A (en) Intelligent device control method and device and electronic device
CN111602412A (en) Device selection apparatus, data set selection apparatus, device selection method, and program
CN112526890A (en) Intelligent household control method and device and computer readable storage medium
CN114095351A (en) Method, device and system for configuring device functions
CN113300919A (en) Intelligent household appliance control method based on social software group function and intelligent household appliance
CN111338217A (en) Information display method, device, equipment and storage medium
CN110634046A (en) Data processing method and device
CN115361247B (en) Scene recommendation method and device, storage medium and electronic equipment
CN115657534A (en) Interaction method, interaction device, electronic equipment and storage medium
CN112929242B (en) Household appliance control method, household appliance and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210409

RJ01 Rejection of invention patent application after publication