WO2024061155A1 - 一种设备控制方法、装置、存储介质 - Google Patents

一种设备控制方法、装置、存储介质 Download PDF

Info

Publication number
WO2024061155A1
WO2024061155A1 PCT/CN2023/119372 CN2023119372W WO2024061155A1 WO 2024061155 A1 WO2024061155 A1 WO 2024061155A1 CN 2023119372 W CN2023119372 W CN 2023119372W WO 2024061155 A1 WO2024061155 A1 WO 2024061155A1
Authority
WO
WIPO (PCT)
Prior art keywords
internet
work order
instruction
things
information
Prior art date
Application number
PCT/CN2023/119372
Other languages
English (en)
French (fr)
Inventor
王鑫
程新洲
唐仁方
汪悦
胡博
王书元
侯赛男
Original Assignee
中国联合网络通信集团有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国联合网络通信集团有限公司 filed Critical 中国联合网络通信集团有限公司
Publication of WO2024061155A1 publication Critical patent/WO2024061155A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/36Creation of semantic tools, e.g. ontology or thesauri
    • G06F16/367Ontology
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y10/00Economic sectors
    • G16Y10/75Information technology; Communication
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y40/00IoT characterised by the purpose of the information processing
    • G16Y40/30Control

Definitions

  • the present application relates to the field of communications, and in particular, to an equipment control method, device, and storage medium.
  • This application provides a device control method, device, and storage medium, which can solve the current problems of complex processes and poor experience when users interact with Internet of Things devices.
  • this application provides a device control method, which method includes: receiving a human-computer interaction message from a terminal; determining an instruction work order based on the human-computer interaction message; the instruction work order is used to control an Internet of Things device; IoT devices send command work orders.
  • the present application determines the instruction work order that the IoT device can recognize according to the human-computer interaction message, converts the user's control intention to the IoT device into a machine instruction that the IoT device can recognize, and sends it to the IoT device, so that the IoT device can perform corresponding operations based on the instruction work order, or report the target data required by the user, so as to meet the user's control intention to the IoT device.
  • the human-computer interaction information can be in the form of RCS messages, so as long as the terminal used by the user has the rich media message service RCS SMS function, it can communicate directly with the IoT device through human language without downloading various APPs.
  • the process is simple and improves the user's experience of using IoT devices.
  • the human-computer interaction message includes the identity ID of the Internet of Things device and statement command information; the statement command information is determined by the terminal in response to the user's interaction operation.
  • determining the instruction work order based on the human-computer interaction message specifically includes: determining the instruction work order based on the statement command information and the instruction map; wherein the instruction map is used to represent the statement command information and the instruction work order. the mapping relationship between them.
  • the method before receiving the human-computer interaction message from the terminal, the method further includes: receiving request information from the terminal; and determining the ID of the Internet of Things device according to the request information from the terminal.
  • the above method further includes: determining a mapping relationship table; wherein the mapping relationship table is used to represent the correspondence between the ID of the Internet of Things device and the URL link of the Internet of Things management platform; the Internet of Things management platform Used to control IoT devices.
  • sending an instruction work order to the IoT device specifically includes: determining the URL link of the IoT management platform based on the ID and mapping relationship table of the IoT device; and sending the URL link to the IoT device based on the URL link of the IoT device.
  • the IoT management platform sends an instruction work order, so that the IoT management platform sends an instruction work order to the IoT device.
  • the above method also includes: constructing capability maps of multiple IoT devices; wherein the capability maps of multiple IoT devices are used to represent capability information of multiple IoT devices, and multiple IoT devices.
  • the instruction map is determined based on the capability maps and user behavior maps of multiple IoT devices, which specifically includes: determining the capability maps and user behavior maps of multiple IoT devices based on time information and geographical location information.
  • the interconnection relationship between the user and multiple IoT devices is periodically adjusted; according to the annotation reference data, the entities in the capability map and user behavior map of multiple IoT devices are classified and annotated to determine the command map; where,
  • the annotation reference data includes one or more of the following: instruction information segment, file address link, time parameter, and quantity parameter.
  • the method before sending the instruction work order to the Internet of Things device, the method further includes: determining the instruction work order confirmation information according to the instruction work order; sending the instruction work order confirmation information; and using the instruction work order confirmation information. Instruct the terminal to confirm the instruction work order; receive the instruction work order feedback information; the instruction work order feedback information is used to represent the terminal's confirmation result of the instruction work order.
  • the above method also includes: receiving target data sent by the Internet of Things device; the target data is data obtained according to the statement command information; performing semantic synthesis on the target data according to the statement command information to determine the first statement information ;Send the first statement information to the terminal.
  • this application provides an equipment control device, which includes: a receiving unit, a processing unit and a sending unit; a receiving unit for receiving human-computer interaction messages from a terminal; a processing unit for Interactive messages determine the command work order; the command work order is used to control the IoT device; the sending unit is used to send the command work order to the IoT device.
  • the human-computer interaction message includes the identity ID of the Internet of Things device and statement command information; the statement command information is determined by the terminal in response to the user's interaction operation.
  • the processing unit is further used to determine the instruction work order based on the statement command information and the instruction map; wherein the instruction map is used to characterize the mapping relationship between the statement command information and the instruction work order.
  • the receiving unit is also used to receive request information from the terminal; the processing unit is also used to determine the ID of the Internet of Things device based on the request information from the terminal.
  • the processing unit is also used to determine a mapping relationship table; wherein the mapping relationship table is used to represent the correspondence between the ID of the IoT device and the URL link of the IoT management platform; IoT management The platform is used to control IoT devices.
  • the processing unit is also used to determine the URL link of the IoT management platform based on the ID and mapping relationship table of the IoT device; the processing unit is also used to determine the URL link to the IoT device based on the URL link of the IoT device.
  • the IoT management platform sends an instruction work order, so that the IoT management platform sends an instruction work order to the IoT device.
  • the processing unit is also used to construct capability maps of multiple IoT devices; wherein the capability maps of multiple IoT devices are used to represent capability information of multiple IoT devices, and multiple The interconnection relationship between IoT devices; the processing unit is also used to construct a user behavior graph; among which, the user behavior graph is used to characterize the user's usage habits of IoT devices, as well as between multiple users and between users and IoT devices. The interconnection relationship between them; the processing unit is also used to determine the instruction map based on the capability map and user behavior map of multiple Internet of Things devices.
  • the processing unit is also used to perform interconnection relationships between users and multiple IoT devices in the capability map and user behavior map of multiple IoT devices based on time information and geographical location information. Cycle adjustment; the processing unit is also used to classify and label the entities in the capability map and user behavior map of multiple IoT devices based on the label reference data to determine the instruction map; wherein the label reference data includes one or more of the following Items: command information segment, file address link, time parameter, quantity parameter.
  • the processing unit is also used to determine the instruction work order confirmation information according to the instruction work order; the sending unit is also used to send the instruction work order confirmation information; the instruction work order confirmation information is used to instruct the terminal to The instruction work order is confirmed; the receiving unit is also used to receive the instruction work order feedback information; the instruction work order feedback information is used to represent the terminal's confirmation result of the instruction work order.
  • the receiving unit is also used to receive target data sent by the Internet of Things device; the target data is the data obtained according to the statement command information; the processing unit is also used to perform semantic analysis on the target data according to the statement command information. Synthesis is used to determine the first sentence information; the sending unit is also used to send the first sentence information to the terminal.
  • the present application provides an equipment control device, which includes: a processor and a communication interface; the communication interface is coupled to the processor, and the processor is used to run computer programs or instructions to implement the first aspect and the first aspect; The device control method described in any possible implementation manner.
  • the present application provides a computer-readable storage medium. Instructions are stored in the computer-readable storage medium. When the instructions are run on a terminal, the terminal causes the terminal to perform the first aspect and any of the possibilities of the first aspect.
  • the present application provides a computer program product containing instructions, which when the computer program product is run on an equipment control device, causes the equipment control device to execute the first aspect and any possible implementation manner of the first aspect.
  • the described device control method is not limited to:
  • the present application provides a chip.
  • the chip includes a processor and a communication interface.
  • the communication interface is coupled to the processor.
  • the processor is used to run computer programs or instructions to implement any of the possibilities of the first aspect and the first aspect.
  • the chip provided in this application also includes a memory for storing computer programs or instructions.
  • the above computer instructions may be stored in whole or in part on a computer-readable storage medium.
  • the computer-readable storage medium may be packaged together with the processor of the device, or may be packaged separately from the processor of the device, which is not limited in this application.
  • Figure 1 is a schematic flowchart of creating a session based on SIP signaling provided by an embodiment of the present application
  • Figure 2 is a schematic flowchart of session modification based on SIP signaling provided by an embodiment of the present application
  • Figure 3 is a schematic flowchart of ending a session based on SIP signaling provided by an embodiment of the present application
  • Figure 4 is a schematic diagram of a NIP spectrum provided by an embodiment of the present application.
  • Figure 5 is a schematic architectural diagram of a device control system provided by an embodiment of the present application.
  • Figure 6 is a schematic flowchart of a device control method provided by an embodiment of the present application.
  • Figure 7 is a schematic flow chart of another device control method provided by an embodiment of the present application.
  • Figure 8 is a schematic flow chart of another device control method provided by an embodiment of the present application.
  • Figure 9 is a schematic flow chart of another device control method provided by an embodiment of the present application.
  • Figure 10 is a schematic diagram of a capability map of an Internet of Things device provided by an embodiment of the present application.
  • Figure 11 is a schematic diagram of a user behavior graph provided by an embodiment of the present application.
  • Figure 12 is a schematic flow chart of another device control method provided by an embodiment of the present application.
  • Figure 13 is a schematic diagram of an instruction map provided by an embodiment of the present application.
  • FIG14 is a schematic diagram of another instruction map provided in an embodiment of the present application.
  • Figure 15 is a schematic diagram of the topological structure of an instruction map provided by an embodiment of the present application.
  • Figure 16 is a schematic flow chart of another device control method provided by an embodiment of the present application.
  • Figure 17 is a schematic flow chart of another device control method provided by an embodiment of the present application.
  • Figure 18 is a schematic structural diagram of an equipment control device provided by an embodiment of the present application.
  • Figure 19 is a schematic structural diagram of another equipment control device provided by an embodiment of the present application.
  • a and/or B can mean: A exists alone, A and B exist simultaneously, and they exist alone. B these three situations.
  • first and second and the like in the specification and drawings of this application are used to distinguish different objects, or to distinguish different processing of the same object, rather than to describe a specific order of objects.
  • references to the terms “including” and “having” and any variations thereof in the description of this application are intended to cover non-exclusive inclusion.
  • a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes other unlisted steps or units, or optionally also Includes other steps or units that are inherent to such processes, methods, products, or devices.
  • Rich communication service is synonymous with the current fifth-generation mobile communication technology (5th-Generation Mobile Communication Technology, 5G) messages, also known as converged communication.
  • RCS messages make up for the text-only limitations of traditional text messages and support multiple formats such as files, videos, pictures, and audio.
  • RCS messaging brings a new human-computer interaction model. Users only need to complete one-stop services such as service search, discovery, interaction, and payment within the message window.
  • RCS messages users do not need to download multiple terminal software (application, app) clients, and can receive RCS messages through the native message portal on the terminal.
  • application application
  • the current problem of declining user perception caused by the excessive number of apps will be effectively solved.
  • Governments and enterprises can also deliver public and commercial services directly to users' terminals through RCS messages.
  • the human-computer interaction message may be in the form of an RCS message.
  • the terminal responds to the user's operation and sends the command statement information entered by the user to the IoT management platform in the form of an RCS message, thereby enabling the user to control the IoT device.
  • IMS is a new form of multimedia service that can meet the needs of terminal users for newer and more diversified multimedia services.
  • IMS is considered to be the core technology of the next generation network and an important way to solve the integration of mobile and fixed networks and introduce differentiated services such as triple integration of voice, data and video.
  • the IMS core network is an important part of the IMS network architecture.
  • the IMS core network elements or modules involved in this application include: CSFS network elements and AS network elements.
  • CSFS Call Session Control Function
  • IMS IMS
  • CSCF Call Session Control Function
  • IMS inquiry call session control function
  • S-CSCF service call session control function S-CSCF
  • the application server network element (Application Server, AS) is used to receive messages sent from the terminal and the APP on the terminal.
  • the present application adds a first network element, a second network element, and messaging as a platform (MaaP) in the IMS core network to enable users to control IoT devices.
  • MaaP is equipped with multiple IoT management platforms to achieve control of different IoT devices. The specific functions of the first network element, the second network element, and the MaaP platform are described below and will not be repeated here.
  • Session initiation protocol SIP
  • SIP session is a session between two user terminals based on IP network, that is, VoIP session.
  • the media of the session It is usually voice or video, but may also be in other forms.
  • SIP itself is only responsible for the establishment of the session. Specifically, it transmits messages through SIP message exchange between two user terminals to complete the establishment of the session.
  • the session establishment and management functions of SIP can specifically include three scenarios: creating a session, modifying a session, and ending a session. The following is a brief description based on Figures 1 to 3:
  • the calling terminal sends INVITE to the called terminal.
  • the INVITE message is used to request the establishment of a session, and the INVITE contains a description of the proposed session parameters.
  • the 200 OK response message contains a description of the accepted session parameters, indicating that the session establishment request is accepted.
  • the calling terminal sends ACK.
  • the ACK message is used to confirm the establishment of the session.
  • Terminal A sends re INVITE to terminal B.
  • the reINVITE message is used to request modification of the session between two terminals, and the reINVITE contains a description of the proposed new session parameters.
  • the 200 OK response message contains a description of the accepted session parameters, indicating that the session establishment request is accepted.
  • Terminal A sends BYE to terminal B.
  • the BYE message is used to request the end of the session between two terminals.
  • the 200 OK response message indicates that the session end request is accepted.
  • connection between the terminal and the IoT management platform is realized based on the SIP session.
  • the IoT management platform obtains the instructions, it realizes the control of different IoT devices, and finally controls the IoT devices through RCS messages.
  • the interaction process between the terminal and the IoT management platform please refer to the description of the embodiment below, and will not be described again here.
  • NLP Neuro-Linguistic Programming
  • NLP is generally used to build a knowledge graph that specifically analyzes the intention of the user's statement.
  • NLP knowledge graph and graph AI calculation the intention in the user's language can be obtained, and then converted into the user's needs, and the next step is performed to control the IoT device.
  • the NLP graph uses word bag, sentence pattern, grammar and other information to build a language knowledge graph, which performs semantic analysis from a user-understandable perspective.
  • Command work orders are used to control IoT devices in the IoT field.
  • statement command information is information that can only be understood by users
  • instruction work orders are machine instructions that can be recognized by IoT devices after being converted by the equipment control device based on the statement command information.
  • IoT devices can perform corresponding operations based on command work orders to meet the user's control intentions for IoT devices.
  • this application provides a device control method.
  • an IoT management platform in the IMS core network, the connection between the user terminal and the IoT management platform is realized in the SIP signaling process.
  • the IoT management platform receives the After sending the human-computer interaction message, based on the instruction map, the sentence command information included in the human-computer interaction message input by the user through the terminal is converted into an instruction work order that can be understood by the Internet of Things device and sent to the Internet of Things device to realize the control of things.
  • the control of Internet-connected devices finally realizes a new way to control Internet of Things devices through human-computer interaction messages.
  • Human-computer interaction messages can be in the form of RCS messages.
  • the user's mobile phone has the RCS SMS function, he can directly interact with the IoT device through a language understandable by the user without downloading various APPs.
  • the process is simple, thereby improving the efficiency of the Internet of Things. user experience.
  • FIG. 5 is a network architecture diagram of a device control system 50 provided in the application.
  • the equipment control system 50 includes: a terminal 51 , an equipment control device 52 , and an Internet of Things device 53 .
  • the terminal 51 and the equipment control device 52 are connected through a communication link, and the equipment control device 52 and the Internet of Things device 53 are connected through a communication link.
  • the communication link may be a wired communication link or a wireless communication link, which is not limited in this application.
  • Terminal 51 is a device with wireless communication functions that can be deployed on land, including indoors or outdoors, handheld or vehicle-mounted. It can also be deployed on water (such as ships, etc.). It can also be deployed in the air (such as on airplanes, balloons, satellites, etc.).
  • the terminal 51 is also called user equipment (UE), mobile station (MS), mobile terminal (MT), terminal, etc., and is a device that provides voice and/or data connectivity to users. equipment.
  • the terminal 51 includes a handheld device, a vehicle-mounted device, etc. with a wireless connection function.
  • the terminal 51 can be: a mobile phone, a tablet computer, a notebook computer, a handheld computer, a mobile internet device (MID), a wearable device (such as a smart watch, a smart bracelet, a pedometer, etc.) , in vehicle equipment (such as cars, bicycles, electric vehicles, airplanes, ships, trains, high-speed rail, etc.), virtual reality (VR) equipment, augmented reality (AR) equipment, and industrial control (industrial control) Wireless terminals, smart home equipment (such as refrigerators, TVs, air conditioners, electricity meters, etc.), intelligent robots, workshop equipment, wireless terminals in self-driving, wireless terminals in remote medical surgery, Wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, or wireless terminals in smart homes, flight equipment (for example, Intelligent robots, hot air balloons, drones, airplanes), etc.
  • vehicle equipment such as cars, bicycles, electric vehicles, airplanes, ships, trains, high-speed rail, etc.
  • VR virtual reality
  • AR
  • the terminal device is often Terminal equipment working on the ground, such as vehicle-mounted equipment.
  • chips deployed in the above devices such as system-on-a-chip (SOC), baseband chips, etc., or other chips with communication functions may also be called terminals 51 .
  • the equipment control device 52 is located on the IMS core network side or is a collection of some specific functional network elements in the IMS core network. Specifically, it may include: CSFS network element 54, AS network element 55, and MaaP platform 56.
  • the CSFS network element 54 is an existing network element in the equipment control device, and this application will not describe it again.
  • this application adds a first network element 57 and a second network element 58 to the AS network element 55.
  • the first network element 57 is specifically responsible for allocating ID numbers of various Internet of Things devices. Since some current IoT devices have SIM cards, and some do not have SIM cards and only connect to the network through WIFI, so if you want to directly contact these devices through rich media messages, you need to assign IDs similar to phone numbers to these devices. .
  • the first network element 57 After the first network element 57 assigns an ID number to the IoT device, the first network element 57 will establish a mapping relationship table to match the URL address of the IoT management platform corresponding to the IoT device with the ID of the IoT device.
  • the terminal when the terminal sends an RCS message to the IoT device in response to the user's operation, it does not directly link to the IoT device, but first connects to the URL address corresponding to the IoT management platform corresponding to the IoT device.
  • the first network element 57 will also obtain the geographical location, network link status, current number of service users, and the corresponding ID of the current service user of each IoT device in real time.
  • mapping relationship table established by the first network element 57 is as shown in Table 1 below:
  • the ID corresponding to the current service user is reflected in the form of the user's mobile phone number. It should be pointed out that the ID corresponding to the current service user can also be reflected in other forms, and this application does not specifically limit this.
  • the first network element 57 can also, after receiving the request information sent by the terminal, query according to the request information and return one or more Internet of Things devices that meet the request information, and these Internet of Things devices
  • the ID is available for users to choose, and users can select the IoT devices they need to interact with based on the device's geographical location or other significant information.
  • the terminal can display the ID of the Internet of Things device.
  • the second network element 58 is specifically used for intelligent computing of the interaction process between users and IoT devices.
  • This network element is responsible for constructing capability maps and user behavior maps of multiple IoT devices, and further constructing deep command maps based on the aforementioned two maps. Then, artificial intelligence (AI) calculations are performed based on the multiple maps constructed, and an instruction work order that can be used to directly control the IoT device is calculated based on the input sentences, instructions, or data from the user and the IoT device.
  • AI artificial intelligence
  • the second network element 58 is also deployed with a semantic synthesis module to convert the data, parameters, and instructions fed back by the Internet of Things device into a language that humans can understand.
  • the MaaP platform 56 is provided with multiple IoT management platforms 59 for receiving command work orders from the second network element 58 and sending the command work orders to the IoT device 53 .
  • the IoT management platform 59 has a chatbot function.
  • the IoT management platform 59 can send RCS messages to the terminal used by the user based on the chatbot function. Furthermore, after receiving the command work order, the IoT management platform 59 can determine the command work order confirmation information according to the chatbot function and send it to the terminal, so that the user corresponding to the terminal can confirm whether the command work order meets the user's own intention. .
  • the IoT management platform 59 has a semantic synthesis function. Specifically, when the RCS message sent by the terminal 51 is to obtain target data from the IoT device 53, the IoT management platform 59 can receive the target data reported by the IoT device 53 and combine it with the statement command information in the RCS message. The target data is semantically synthesized to determine the first sentence information that can be understood by the user corresponding to the terminal, so that the user can obtain the target data.
  • the various instructions of the IoT management platform 59 to control the IoT device 53 will be stored in the instruction map constructed by the second network element 58.
  • the instructions of the IoT management platform 59 with the printing management function to control the holographic printer include: print file, which can print the file when sent to the corresponding IoT device 53.
  • the communication connection between the AS network element 55 and the MaaP platform 56 is through the N2 interface.
  • the equipment control device may be an electronic equipment (such as a computer terminal, a server), a processor in the electronic equipment, a control module for equipment control in the electronic equipment, or a control module in the electronic equipment for Device control client.
  • this application provides a device control method, which specifically includes the following steps:
  • the device control apparatus receives a human-computer interaction message from a terminal.
  • the human-computer interaction message may be in the form of an RCS message. It should be noted that in the following and the following embodiments, the human-computer interaction message is an RCS message as an example, and no redundant explanation will be given below.
  • the RCS message includes the ID and statement command information of the IoT device.
  • the sentence command information is specifically used to record the text information or voice information input by the user through the terminal.
  • the statement command information is determined by the terminal in response to the user's interaction operation, and can reflect the user's control intention for the Internet of Things device.
  • S601 may be executed by an AS network element in the device control apparatus, so that the device control apparatus receives the RCS message.
  • the equipment control device determines the instruction work order based on the human-computer interaction message.
  • command work order is used to control IoT devices.
  • statement command information is information that can only be understood by users
  • instruction work orders are machine instructions that can be recognized by IoT devices after being converted by the equipment control device based on the statement command information.
  • IoT devices can perform corresponding operations based on command work orders to meet the user's control intentions for IoT devices.
  • the equipment control device determines an instruction map, and the instruction map is used to represent the mapping relationship between statement command information and instruction work orders. Furthermore, the equipment control device determines the instruction work order based on the statement command information and the instruction map. It should be noted that the process of determining the instruction map by the specific equipment control device refers to the following S901-S903 and S1201-S1202, which will not be described again here.
  • the determination of the instruction work order based on the RCS message is explained below in conjunction with the specific signaling transmission process:
  • the terminal's RCS message will be sent to the IMS core network, and the signaling layer is specifically: terminal side CSFS network element Send MSRP: request signaling, indicating a request for session establishment; after receiving the request, the CSFS network element replies to the terminal with MSRP: 200 OK response signaling.
  • the MSRP session is successfully established.
  • the statement command information in the RCS information will be sent to the newly added second network element in the AS network element. It will be calculated based on the instruction map to analyze the end user's intention and finally determine the object that can be used by the object. Instruction ticket for networked device identification.
  • S602 may be executed by the first network element and the second network element among the AS network elements in the equipment control device, so that the equipment control device determines the instruction work order according to the RCS message.
  • the equipment control device sends an instruction work order to the Internet of Things device.
  • the command work order is a machine command that can be recognized by the IoT device
  • the IoT device can perform the corresponding operation based on the command work order, or report the target data required by the user. To satisfy users’ control intentions for IoT devices.
  • the device control device determines the URL link of the IoT management platform corresponding to the IoT device based on the ID of the IoT device in the RCS message, and uses the IoT management platform as a relay based on the URL link to send the message to the IoT device.
  • IoT devices send command work orders.
  • the IoT management platform can also be used to receive target data reported by IoT devices and send the target data to the equipment control device.
  • S603 can be executed by the IoT management platform in the equipment control device, so that the equipment control device sends an instruction work order to the IoT device.
  • the embodiment of the present application determines the instruction work order that the Internet of Things device can recognize based on the human-computer interaction message, and assigns the user to the Internet of Things.
  • the control intention of the device is converted into machine instructions that can be recognized by the IoT device, and is sent to the IoT device, so that the IoT device can perform corresponding operations based on the command work order, or report the target data required by the user, so as to meet the user's requirements for the IoT device.
  • Human-computer interaction messages can be in the form of RCS messages. Therefore, as long as the terminal used by the user has the RCS SMS function, the user can directly communicate with the IoT device through human language without downloading various APPs. The process is simple and improved User’s experience using IoT devices.
  • the equipment control device receives request information from the terminal.
  • the request information is used to request to obtain the ID of the Internet of Things device.
  • the request information includes keywords for reflecting the characteristics of the Internet of Things device that the user needs to control.
  • the terminal sends request information to the device control device, that is, the ID of the Internet of Things device controlled by the user according to the terminal requirements is not included in the database of the terminal.
  • the equipment control device determines the ID of the Internet of Things device according to the request information of the terminal.
  • the user selects the search function at the location of the recipient contact on the terminal display interface and enters the keyword of the Internet of Things device, such as searching for "holographic printer”. Then the terminal sends request information to the equipment control device.
  • IoT devices are available for users to choose. Users can choose which IoT device they need to interact with based on the device's geographical location or other significant information. After the user selects and confirms, the recipient address column of the message on the terminal display interface is the ID of the IoT device.
  • S701-S702 may be executed by the first network element in the device control device, so that after receiving the request information from the terminal, the device control device determines the ID of the corresponding Internet of Things device accordingly.
  • the embodiments of this application can receive the request information sent by the terminal when the ID of the IoT device controlled by the user's demand is not included in the terminal's database, and feed back one or more IoT devices to the terminal for the user to select.
  • the IoT device needs to be controlled, and provides the user with the ID of the IoT device that needs to be controlled, so as to subsequently meet the user's control intention for the IoT device.
  • the device control method provided by this application also includes the following steps:
  • the equipment control device determines the mapping relationship table.
  • mapping relationship table is used to represent the correspondence between the ID of the IoT device and the URL link of the IoT management platform.
  • mapping relationship table is the mapping relationship table established by the first network element after allocating ID numbers to the Internet of Things devices.
  • S801 may be executed by the first network element in the device control device, so that the device control device determines the mapping relationship table.
  • the device control device determines the URL link of the IoT management platform based on the ID of the IoT device and the mapping relationship table.
  • the device control device can determine the URL link of the IoT management platform based on the corresponding relationship between the ID of the IoT device and its corresponding IoT management platform in the mapping relationship table.
  • the following describes the specific signaling transmission process to determine the URL link of the IoT management platform based on the ID of the IoT device and the mapping relationship table:
  • the AS network element After receiving the RCS message from the terminal, the AS network element parses the RCS message and determines the URL link of the IoT management platform.
  • IoT devices may not have SIM cards and are connected to the device control device through WiFi, so the terminal cannot directly make calls or send text messages to these IoT devices. Therefore, After the first network element in the AS network element determines the mapping relationship table used to represent the correspondence between the ID of the IoT device and the URL link of the IoT management platform, the AS network element can parse the RCS message to Obtain the ID of the IoT device and determine the URL link of the IoT management platform corresponding to the IoT device that the end user needs to interact with. It should be pointed out that although the address for receiving information on the terminal display interface displays the ID of the IoT device (to facilitate record storage by the terminal), the actual interaction address is the URL address of the IoT management platform determined by the AS network element after analysis. .
  • the terminal When activating the RCS bearer, the terminal needs to interact with the IoT management platform corresponding to the IoT device through SIP signaling to establish the bearer.
  • the specific process is as follows: the terminal sends the SIP:INVITE REQEST command to the CSFS network element; the CSFS network element communicates with the first network element, retrieves the URL address of the IoT management platform determined by the first network element in the above steps, and establishes communication; after the communication is successfully established, the CSFS network element feeds back the SIP:100TRYING, SIP:180RINGING and SIP:200OK commands to the terminal; the terminal sends the SIP:ACK command to the CSFS network element to confirm the establishment of the bearer.
  • S802 may be executed by the first network element in the device control device, so that the device control device determines the URL link of the IoT management platform based on the ID of the IoT device and the mapping relationship table.
  • the device control device sends a command work order to the Internet of Things management platform according to the URL link of the Internet of Things device, so that the Internet of Things management platform sends the command work order to the Internet of Things device.
  • the equipment control device before the equipment control device sends an instruction work order to the IoT management platform according to the URL link of the Internet of Things device, the equipment control device first determines the instruction work order, as described in S502 above.
  • the device control device determines the instruction work order is described below in conjunction with the signaling transmission process described in S802:
  • the SIP session is opened.
  • the terminal's RCS message will be sent to the IMS core network.
  • the signaling layer is specifically: the terminal sends MSRP: request signaling to the CSFS network element. , indicating a request for session establishment; after receiving the request, the CSFS network element replies to the terminal with MSRP: 200 OK response signaling.
  • the MSRP session is successfully established.
  • the statement command information in the RCS information will be sent to the newly added second network element in the AS network element. It will be calculated based on the instruction map to analyze the end user's intention and finally determine the object that can be used by the object. Instruction ticket for networked device identification.
  • the equipment control device sends the command work order to the IoT management platform according to the URL link of the IoT device, so that the IoT management platform sends the command work order to the IoT device to realize the IoT.
  • Management platform controls IoT devices.
  • S803 can be executed by the first network element and the second network element in the device control device, so that an instruction work order is sent to the IoT management platform according to the URL link of the IoT device.
  • the embodiment of the present application can determine the URL link of the IoT management platform corresponding to the IoT device based on the ID of the IoT device in the received human-computer interaction message, and convert the second URL to the IoT device based on the URL link.
  • the command work order determined by the network element is sent to the IoT management platform, so that the IoT management platform sends the command work order to the IoT device, thereby realizing the control of the IoT device by the IoT management platform.
  • the device control method provided by the present application further includes the following steps:
  • the equipment control device constructs capability maps of multiple Internet of Things devices.
  • the capability maps of multiple IoT devices are used to represent the capability information of multiple IoT devices and the interconnection relationships between multiple IoT devices.
  • the capability graphs of multiple IoT devices may be a topological structure, specifically including entities of the graph and edges of the graph.
  • This capability map requires manual input of the basic topology structure in advance.
  • the entities of the map include keywords corresponding to the basic capabilities of the IoT device.
  • the circles are the entities of the map, and the connected edges represent the connections between the entities. relation. In this way, different graphs can be constructed according to the capabilities and characteristics of different IoT devices, and multiple IoT devices are interconnected through different relationship edges.
  • S901 can be executed by the second network element in the device control device to build capability maps of multiple Internet of Things devices.
  • the equipment control device constructs a user behavior graph.
  • the user behavior graph is used to characterize the user's usage behavior habits for IoT devices, as well as the interconnection relationship between multiple users and between users and IoT devices.
  • the user behavior map can be a topological structure, similar to S801.
  • the map entities in the circle in Figure 11 represent characteristic keywords of user behavior habits, such as eyesight, files that may need to be printed, and brightness. Preferences, spectral density of augmented reality (AR), etc.
  • interconnection relationships can be formed between multiple users and between users and IoT devices through the edges of the graph.
  • S902 may be executed by the second network element in the device control device to construct a user behavior map.
  • the equipment control device determines the instruction map based on the capability maps and user behavior maps of multiple Internet of Things devices.
  • the instruction map can represent the mapping relationship between statement command information and instruction work orders.
  • the device control device dynamically connects the entity edge relationships of the entities in the capability graphs and user behavior graphs of multiple IoT devices, that is, adjusts the interconnection relationship between the user and multiple IoT devices. After that, the device control device classifies and labels the entities in the capability graphs and user behavior graphs of multiple IoT devices based on the geographic location, network connection status, current number of service users, and IDs corresponding to the current service users of each IoT device obtained by the first network element described above.
  • the device control device specifically determines the instruction map based on the capability maps and user behavior maps of multiple Internet of Things devices. Please refer to the following S1201-S1202, which will not be described again here.
  • S902 can be executed by the second network element in the device control device, so that the instruction map is determined based on the capability maps and user behavior maps of multiple Internet of Things devices.
  • the second network element further determines an instruction map representing the mapping relationship between statement command information and instruction work orders by constructing capability maps and user behavior maps of multiple Internet of Things devices. To ensure the normal progress of the subsequent IoT device control process.
  • determining the instruction map specifically includes the following steps based on the capability maps and user behavior maps of multiple Internet of Things devices:
  • the equipment control device periodically adjusts the interconnection relationships between users and multiple Internet of Things devices in the capability map and user behavior map of multiple Internet of Things devices based on time information and geographical location information.
  • time information and geographical location information are derived from the geographical location, network link status, current number of service users, and current service users of each IoT device obtained in real time by the first network element described above.
  • the corresponding ID is derived from the geographical location, network link status, current number of service users, and current service users of each IoT device obtained in real time by the first network element described above. The corresponding ID.
  • FIG. 13 shows the determined instruction map, which can reflect the equipment control device’s operation according to the time information.
  • Information and geographical location information are used to adjust the interconnection relationship between users and multiple IoT devices in the capability map and user behavior map of multiple IoT devices.
  • the equipment control device regularly and periodically adjusts the interconnection relationship between the user and multiple Internet of Things devices based on time information, geographical location information, and other common sense logic. For example, when user 2 in Figure 13 If the location moves from the playground to the classroom, then the graph of user 2 and the graphs of all IoT devices in the classroom will be linked by edge relationships; for example, when the time reaches 6 p.m., all user graphs will be linked to the graphs of the IoT device lights.
  • the graph implements edge relationship links; for another example, when the teaching content changes from Chinese class to mathematics class, the weight coefficient of the link relationship between all users' maps and the Chinese teacher's map changes from strong to weak, and the weight of the link relationship between all users' maps and the math teacher's map The coefficient changes from weak to strong.
  • S1201 can be executed by the second network element in the device control device, so that in the capability map and user behavior map of multiple Internet of Things devices based on time information and geographical location information, the user and multiple The interconnection relationship between individual IoT devices is adjusted periodically.
  • the equipment control device classifies and annotates entities in the capability maps and user behavior maps of multiple Internet of Things devices based on the annotation reference data to determine the command map.
  • annotation reference data includes one or more of the following: instruction information segment, file address link, time parameter, and quantity parameter.
  • the instruction information segment is obtained after the device control device extracts fields from the statement command information included in the RCS message, such as "file”, "photo”, "ink” and other instruction information segments.
  • time parameters and quantity parameters can also be obtained based on statement command information.
  • the database will also record the adjustment instructions corresponding to the corresponding IoT operating platform.
  • the instruction corresponding to "bright” for the IoT device light is: LCD FLASH H+++
  • the device control device will obtain the quantity instruction of the user's rich media message.
  • the database corresponding to the instruction map will store the storage addresses of certain entities in the map. Part of the storage address can be determined based on the file address link in the annotation reference data, and the other part can be manually input. For example, the address of a certain "file” stored in the database is "D:/FILE/TEMPER/USER1"; or a certain "ink” is stored on the third floor of the cabinet.
  • the device control device classifies and labels the entities in the capability maps and user behavior maps of multiple IoT devices according to the labeled reference data, and after combining the two maps into one map, the instruction map can be determined.
  • S1201 can be executed by the second network element in the device control device, so that entities in the capability maps and user behavior maps of multiple Internet of Things devices are classified and labeled according to the labeling reference data. Determine the command map.
  • the embodiment of this application analyzes the capability maps and user behaviors of multiple Internet of Things devices.
  • the interconnection relationships in the graphs are periodically adjusted, and the entities in the two graphs are classified and labeled according to the annotation reference data to further determine the instruction graph that represents the mapping relationship between the statement command information and the instruction work order.
  • the thus constructed IoT device instruction map can include the instructions of the IoT device on the basis of user semantic recognition. In this way, after receiving the statement command information, the graph calculation and acquisition can be performed directly based on the instruction map for the IoT device. Command work orders can make it easier to control IoT devices to ensure the normal progress of subsequent IoT device control processes.
  • the second network element analyzes the statement command information and obtains the total command map.
  • the keywords obtained by the second network element's analysis of the sentence include: the subject entities involve “I”, “printer” and “Chinese teacher”, the verbs are “help” and “print”, and the objects are “classmate”, “Chinese teacher” Test paper of a class”, and other keywords such as "previous class, test paper, printing, quantity, subject”, etc.
  • the total command map can be determined (ie, Figure 13).
  • the role of the command map and map calculation is to convert the user-understandable sentences entered in the message into command work orders that can be recognized by the machine.
  • this application can calculate and obtain the instruction work order for controlling the Internet of Things device through the instruction map and the corresponding map calculation, instead of analyzing redundant semantics and wasting computing resources and efficiency.
  • This application enhances entities and edge relationships that are not covered in the human language of messages, but are actually critical and needed to control Internet of Things devices.
  • the second network element determines the sub-command map according to the total command map.
  • Figure 14 includes the entities and edge relationships that need to be included in order to control the Internet of Things devices.
  • the second network element performs graph calculation on the sub-instruction graph to determine the instruction work order.
  • the second network element first performs graph neural topology on the sub-instruction map to obtain the topology. Then, determine the adjacency matrix and degree matrix based on the topological structure diagram, and finally determine the instruction work order.
  • each entity i.e., the ellipse in the graph
  • the linked relationship is used as an edge.
  • the importance of the relationship between each entity is formulated as the W parameter, which becomes the coefficient of the edge connecting the entity points.
  • the statement command information is "Today I need to help my classmates and print ten copies of the test papers assigned by the Chinese teacher in the previous class.”
  • the keywords correspond to the user, classmates, Chinese teacher, previous class, test paper, Print, quantity, account
  • the W parameter between these entities is set to 0.9
  • the edge relationship W of other entities of the holographic printer such as ink, address, canceled print task, and printed file is set to 0.001.
  • the extracted topological structure diagram is shown in Figure 15, including a total of 28 nodes and multiple edges.
  • the adjacency matrix A1 and the degree matrix D1 of the topological structure graph can be obtained respectively according to the graph topology structure: in the degree matrix D1, the non-diagonal numbers are all 0, and the position of the diagonal line is with the point The sum of W parameter weights with edge relationships; in the adjacency matrix A1, the diagonal numbers are all 0, and the off-diagonal position is the value of the W parameter weight corresponding to the node adjacent to the point.
  • the first blue node No. 1 is connected to 6 other nodes.
  • the 2, 3, 4, 5, 6, and 7 columns of the first row of the A1 matrix are W1 and W2 respectively.
  • node 23 represents the Chinese teacher and is connected to another node No. 24, then A1
  • the 24th column of the 23rd row of the matrix is W24, and all other positions are 0
  • node 1 represents the holographic printer and is connected to 6 nodes, then the first row and first column of the diagonal of the D1 matrix is the sum of W1 to W6, The remaining positions are all 0; node No. 4 is connected to the other four nodes, so the 4th row and 4th column of the diagonal of the D1 matrix is the sum of W of the edges connected to node No. 4.
  • graph neural topology is performed on the sub-instruction graph (that is, Figure 14).
  • Each entity serves as a point of the neural topology of the graph, and the linked relationship is used as an edge to construct a topological representation of the instruction graph.
  • the edge relationship coefficient between each entity is set as the M parameter.
  • the degree matrix D2 is an off-diagonal line with numbers all 0.
  • the position of the diagonal line is the weight of the M parameters that have an adjacent edge relationship with the point.
  • the adjacency matrix A2 is that the diagonal numbers are all 0, and the off-diagonal position is the edge relationship value M parameter between the adjacent neighbor nodes of the point.
  • the loss function of P is the difference between the predicted P and the actual label classification of P. For example, when the message statement is "Today I need to help my classmates by printing ten copies of the test paper assigned by the Chinese teacher in the previous class" as input, the information is already included in W ⁇ D1 ⁇ A1. Through the above formula, the entire The probability of the 28 nodes in the instruction map. If the probability is greater than the threshold 1, it means that the node, that is, the entity needs to be added to the instruction work order (for example, the probability of the entity node corresponding to the print quantity file address is calculated to be greater than the threshold 1).
  • the probability is less than the threshold 1, then it means that the node, that is, the entity does not need to be added to the command work order (for example, the brightness of the vision light, the remaining amount of ink in the textbook homework, these entity node probabilities will be less than the threshold 1 after calculation, indicating that it is irrelevant information), and it is not necessary Be added to the work order.
  • the number of prints is "ten"
  • the instruction map of the Internet of Things device constructed by this application can include the instructions of the Internet of Things device on the basis of user semantic recognition.
  • the instruction work order can be directly obtained by performing map calculation according to the instruction map for the Internet of Things device, which can make it easier to control the Internet of Things device and meet the user's control intention for the Internet of Things device. Therefore, as long as the terminal used by the user has the RCS SMS function, it can communicate directly with the Internet of Things device through human language without downloading various APPs. The process is simple and improves the user's experience of using the Internet of Things device.
  • the device control method provided by this application also includes the following steps:
  • the equipment control device determines the command work order confirmation information based on the command work order.
  • the instruction work order confirmation information is used to instruct the terminal to confirm the instruction work order.
  • the instruction work order confirmation message can also be an RCS message.
  • the equipment control device sends command work order confirmation information.
  • the equipment control device receives instruction work order feedback information; the instruction work order feedback information is used to represent the confirmation result of the terminal on the instruction work order.
  • the IoT management platform in the equipment control device is equipped with a chatbot, so that the function of sending RCS messages to the terminal can be implemented.
  • the IoT management platform sends instruction work order confirmation information to the terminal based on the chatbot.
  • the format of the instruction work order confirmation information can be provided to the terminal for confirmation in the form of a suggestion list, thereby avoiding incorrect estimation of the user's intention based on the graph algorithm.
  • the specific signaling process of S1601-S1603 is: the second network element generates a suggestion list and sends it to the terminal in the form of an RCS-MSRP message.
  • the user will receive a reply from CHATBOT on the session interface of the RCS message just sent. message, the reply message can display the command work order, and there will be an operation button under the command work order to confirm whether you agree or not.
  • the user will have a user confirmation button under the work order.
  • the equipment control device sends the instruction work order to the Internet of Things device.
  • the second network element in the equipment control device will calculate the instruction work order again based on the statement command information and the instruction map. , until the user confirms that the instruction work order is correct.
  • the embodiments of the present application can enable users to confirm the instruction work order before sending it to the Internet of Things device, making the control of the Internet of Things device more accurate and further improving the user's use of the Internet of Things device. experience.
  • the device control method provided by this application also includes the following steps:
  • the equipment control device receives the target data sent by the Internet of Things device.
  • the target data is the data obtained according to the instruction of the statement command information.
  • the equipment control device performs semantic synthesis on the target data according to the sentence command information, and determines the first sentence information.
  • the IoT device reports target data to the device control device, it indicates that the user needs to obtain the target data through the IoT device. For example, the user needs the IoT device to feedback the indoor temperature or the brightness of the holographic image. At this time, the target data reported by the IoT device is not necessarily in a form that users can understand. Therefore, the second network element in the equipment control device needs to semantically synthesize the target data according to the sentence command information in the RCS message sent by the terminal in S601, and determine the first sentence message so that the user can understand the message.
  • the equipment control device sends the first sentence information to the terminal.
  • the specific signaling process of S1701-S1703 is: after the IoT device feeds back the required data to the IoT management platform (for example: the student sends an RCS rich media message to the network disk: the homework left by the math teacher is stored in Where on the network disk?)
  • the cloud disk feeds back to the corresponding location ⁇ ftp:10.24.35/math/homework.2022.0327> to the IoT management platform that manages the network disk, and the IoT management platform sends the data to the second network Yuan
  • the second network element performs semantic synthesis: ⁇ The homework left by the math teacher is stored in the network disk at ftp:10.24.35/math/homework.2022.0327>, and feeds this content back to the chatbot deployed by the IoT management platform in MaaP ;
  • the chatbot then establishes SIP signaling contact with the terminal: that is, it sends SIP:INVITE REQEST signaling from the network side to the CSFS network
  • the CSFS network element then communicates with the terminal.
  • the network side MaaP feedback SIP:100TRYING, SIP:180 RINGING and SIP:200OK signaling; the terminal sends SIP:ACK signaling to the network CSFS again to confirm the bearer establishment; after the bearer is established, the MaaP session connection is established: the network side MaaP will send an MSRP:request session establishment request to the CSFS corresponding to the user terminal. After receiving the request, CSFS on the terminal side will reply to MaaP with an MSRP: 200 OK response. At this point, the MSRP session is successfully established, and chatbot can send the synthesized statement to the terminal as an RCS-MSRP message. As a result, the user can receive the new chatbot reply message again on the sent RCS message conversation interface displayed on the terminal.
  • the embodiments of the present application can perform semantic synthesis on the target data when the IoT device feeds back the target data that the user needs to obtain, and determine the message that the user can understand, further improving the user's IoT device usage experience.
  • the embodiment of the present application can divide the functional modules or functional units of the device control device according to the above method example.
  • each functional module or functional unit can be divided according to each function, or two or more functions can be integrated into one processing module.
  • the above integrated module can be implemented in the form of hardware or in the form of software functional modules or functional units.
  • the division of modules or units in the embodiment of the present application is schematic, which is only a logical function division. There may be other division methods in actual implementation.
  • the equipment control device 1800 includes: a receiving unit 1801, a processing unit 1802, and a sending unit 1803.
  • the receiving unit 1801 is used to receive human-computer interaction messages from the terminal.
  • the processing unit 1802 is used to determine the instruction work order according to the human-computer interaction message; the instruction work order is used to control the Internet of Things device.
  • the sending unit 1803 is used to send an instruction work order to the Internet of Things device.
  • the processing unit 1802 is also configured to determine an instruction work order based on the statement command information and the instruction map.
  • the instruction map is used to represent the mapping relationship between statement command information and instruction work orders.
  • the receiving unit 1801 is also used to receive request information from the terminal.
  • the processing unit 1802 is also configured to determine the ID of the Internet of Things device according to the terminal's request information.
  • the processing unit 1802 is also used to determine the mapping relationship table.
  • the mapping relationship table is used to represent the correspondence between the ID of the IoT device and the URL link of the IoT management platform.
  • the IoT management platform is used to control IoT devices.
  • the processing unit 1802 is also configured to determine the URL link of the IoT management platform based on the ID of the IoT device and the mapping relationship table.
  • the processing unit 1802 is also configured to send an instruction work order to the IoT management platform according to the URL link of the IoT device, so that the IoT management platform sends the instruction work order to the IoT device.
  • the processing unit 1802 is also used to construct capability maps of multiple Internet of Things devices.
  • the capability maps of multiple IoT devices are used to represent the capability information of multiple IoT devices and the interconnection relationships between multiple IoT devices.
  • the processing unit 1802 is also used to construct a user behavior graph.
  • the user behavior graph is used to represent users' behavior habits for using IoT devices, as well as the interconnection relationships between multiple users and between users and IoT devices.
  • the processing unit 1802 is also configured to determine the instruction map based on the capability maps and user behavior maps of multiple Internet of Things devices.
  • the processing unit 1802 is also used to determine the interconnection relationship between the user and multiple IoT devices in the capability map and user behavior map of multiple IoT devices based on time information and geographical location information. Make periodic adjustments.
  • the processing unit 1802 is also configured to classify and label entities in the capability maps and user behavior maps of multiple Internet of Things devices according to the labeling reference data to determine the instruction map.
  • the annotation reference data includes one or more of the following: instruction information segment, file address link, time parameter, and quantity parameter.
  • the processing unit 1802 is also configured to determine the instruction work order confirmation information according to the instruction work order.
  • the sending unit 1803 is also used to send instruction work order confirmation information.
  • the instruction work order confirmation information is used to instruct the terminal to confirm the instruction work order.
  • the receiving unit 1801 is also used to receive instruction work order feedback information.
  • the instruction work order feedback information is used to represent the terminal's confirmation result of the instruction work order.
  • the receiving unit 1801 is also used to receive target data sent by the Internet of Things device.
  • the target data is the data obtained as indicated by the statement command information.
  • the processing unit 1802 is also configured to perform semantic synthesis on the target data according to the statement command information, and determine the first statement information.
  • the sending unit 1803 is also configured to send the first sentence information to the terminal.
  • the device control device 1800 may also include a storage unit (shown as a dotted box in FIG. 18 ), which stores a program or instructions.
  • a storage unit shown as a dotted box in FIG. 18
  • the processing unit 1802 executes the program or instructions, such that The device control device 1800 can execute the device control method described in the above method embodiment.
  • the receiving unit 1801, the processing unit 1802, and the sending unit 1803 in the embodiment of the present application can be integrated on the processor.
  • the specific implementation is shown in Figure 19.
  • FIG 19 shows a possible structural diagram of the equipment control device involved in the above embodiment.
  • the device control device 1900 includes: a processor 1902 and a communication interface 1903.
  • the processor 1902 is used to control and manage the actions of the device control device, for example, perform the steps performed by the above-mentioned receiving unit 1801, processing unit 1802, and sending unit 1803, and/or other processes for performing the technology described herein.
  • the communication interface 1903 is used to support communication between the device control device and other network entities, for example, performing the steps performed by the above-mentioned receiving unit 1801, processing unit 1802, and sending unit 1803.
  • the equipment control device may also include a memory 1901 and a bus 1904.
  • the memory 1901 is used to store program codes and data of the equipment control device.
  • the memory 1901 can be a memory in the equipment control device, etc.
  • the memory can include volatile memory, such as random access memory; the memory can also include non-volatile memory, such as read-only memory, flash memory, hard disk or solid state drive; the memory may also include a combination of the above types of memory.
  • the above-mentioned processor 1902 may implement or execute various exemplary logical blocks, modules and circuits described in connection with the disclosure of this application.
  • the processor may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various illustrative logical blocks, modules, and circuits described in connection with this disclosure.
  • the processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.
  • the bus 1904 may be an Extended Industry Standard Architecture (EISA) bus or the like.
  • EISA Extended Industry Standard Architecture
  • the bus 1904 can be divided into an address bus, a data bus, a control bus, etc. For ease of presentation, only one thick line is used in Figure 19, but it does not mean that there is only one bus or one type of bus.
  • the equipment control device in Figure 19 can also be a chip.
  • the chip includes one or more (including two) processors 1902 and communication interfaces 1903.
  • the chip also includes memory 1901, which may include read-only memory and random access memory, and provides operating instructions and data to processor 1902. Part of the memory 1901 may also include non-volatile random access memory (NVRAM).
  • NVRAM non-volatile random access memory
  • memory 1901 stores elements, execution modules, or data structures, or subsets thereof, or extended sets thereof.
  • the corresponding operation is performed by calling the operation instructions stored in the memory 1901 (the operation instructions can be stored in the operating system).
  • Embodiments of the present application provide a computer program product containing instructions.
  • the computer program product When the computer program product is run on a computer, it causes the computer to execute the device control method in the above method embodiment.
  • Embodiments of the present application also provide a computer-readable storage medium. Instructions are stored in the computer-readable storage medium. When the instructions are run on a computer, they cause the computer to perform device control in the method flow shown in the above method embodiment. method.
  • the computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: electrical connections having one or more wires, portable computer disks, hard drives, random access memory (RAM), read-only memory (Read-Only Memory, ROM), Erasable Programmable Read Only Memory (EPROM), register, hard disk, optical fiber, portable compact disk read-only memory (Compact Disc Read-Only Memory, CD-ROM ), an optical storage device, a magnetic storage device, or any suitable combination of the above, or any other form of computer-readable storage medium well known in the art.
  • An exemplary storage medium is coupled to the processor such that the processor can read information from the storage medium and write information to the storage medium.
  • the storage medium can also be an integral part of the processor.
  • the processor and storage medium may be located in an Application Specific Integrated Circuit (ASIC).
  • ASIC Application Specific Integrated Circuit
  • the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus or device.
  • the disclosed systems, devices and methods can be implemented in other ways.
  • the device embodiments described above are only schematic.
  • the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.
  • Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Economics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Health & Medical Sciences (AREA)
  • General Business, Economics & Management (AREA)
  • Medical Informatics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本申请提供一种设备控制方法、装置、存储介质,涉及通信技术领域,能够解决现阶段用户与物联网设备进行交互时,过程复杂、体验较差的问题。该方法包括:接收来自终端的人机交互消息;根据人机交互消息,确定指令工单;指令工单用于对物联网设备进行控制;向物联网设备发送指令工单。本申请用于对物联网设备进行控制。

Description

一种设备控制方法、装置、存储介质
本申请要求于2022年09月20日提交中国专利局、申请号为202211142929.9、申请名称为“一种设备控制方法、装置、存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及通信领域,尤其涉及一种设备控制方法、装置、存储介质。
背景技术
目前用户与物联网设备的交互并不能直接以用户可理解的语言进行直接交互,例如:用户需要知道物联网设备的亮度时,需要是通过平台或者APP分别去控制物联网设备。因此在未来万物互联的背景下,用户需要下载许多不同的物联网设备APP,再去学***台中的复杂功能去控制物联网设备、获取物联网设备的数据,过程较为复杂,导致用户的体验较差。
发明内容
本申请提供一种设备控制方法、装置、存储介质,能够解决现阶段用户与物联网设备进行交互时,过程复杂、体验较差的问题。
为达到上述目的,本申请采用如下技术方案:
第一方面,本申请提供一种设备控制方法,该方法包括:接收来自终端的人机交互消息;根据人机交互消息,确定指令工单;指令工单用于对物联网设备进行控制;向物联网设备发送指令工单。
基于上述技术方案,本申请在接收到来自终端的响应于用户操作生成的人机交互消息后,根据人机交互消息来确定出物联网设备能够识别的指令工单,将用户对物联网设备的控制意图转换为物联网设备能够识别的机器指令,并向物联网设备发送,使得物联网设备能够基于指令工单执行相应操作,或上报用户需求的目标数据,以此来满足用户对物联网设备的控制意图。人机交互信息可以是RCS消息的形式,因此用户所使用的终端只要有富媒体消息服务RCS短信功能,无需下载各类各样的APP就可以通过人类的语言直接与物联网设备进行通信,过程简单且提高了用户的物联网设备使用体验。
在一种可能的实现方式中,人机交互消息包括物联网设备的身份标识ID和语句命令信息;语句命令信息为终端响应于用户的交互操作后确定。
在一种可能的实现方式中,根据人机交互消息,确定指令工单,具体包括:根据语句命令信息和指令图谱,确定指令工单;其中,指令图谱用于表征语句命令信息与指令工单之间的映射关系。
在一种可能的实现方式中,在接收来自终端的人机交互消息之前,方法还包括:接收来自终端的请求信息;根据终端的请求信息,确定物联网设备的ID。
在一种可能的实现方式中,上述方法还包括:确定映射关系表;其中,映射关系表用于表征物联网设备的ID和物联管理平台的URL链接之间的对应关系;物联管理平台用于控制物联网设备。
在一种可能的实现方式中,向物联网设备发送指令工单,具体包括:根据物联网设备的ID和映射关系表,确定物联管理平台的URL链接;根据物联网设备的URL链接,向物联管理平台发送指令工单,以使得物联管理平台向物联网设备发送指令工单。
在一种可能的实现方式中,上述方法还包括:构建多个物联网设备的能力图谱;其中,多个物联网设备的能力图谱用于表征多个物联网设备的能力信息,以及多个物联网设备之间的互联关系;构建用户行为图谱;其中,用户行为图谱用于表征用户对于物联网设备的使用行为习惯,以及多个用户之间、用户与物联网设备之间的互联关系;根据多个物联网设备的能力图谱和用户行为图谱,确定指令图谱。
在一种可能的实现方式中,根据多个物联网设备的能力图谱和用户行为图谱,确定指令图谱,具体包括:根据时间信息、地理位置信息对多个物联网设备的能力图谱和用户行为图谱中,用户与多个物联网设备之间的互联关系进行周期调整;根据标注参考数据,对多个物联网设备的能力图谱和用户行为图谱中的实体进行分类标注,以确定指令图谱;其中,标注参考数据包括以下一项或多项:指令信息段、文件地址链接、时间参数、数量参数。
在一种可能的实现方式中,在向物联网设备发送指令工单之前,方法还包括:根据指令工单,确定指令工单确认信息;发送指令工单确认信息;指令工单确认信息用于指示终端对指令工单进行确认;接收指令工单反馈信息;指令工单反馈信息用于表征终端对指令工单的确认结果。
在一种可能的实现方式中,上述方法还包括:接收物联网设备发送的目标数据;目标数据为语句命令信息指示获取的数据;根据语句命令信息对目标数据进行语义合成,确定第一语句信息;向终端发送第一语句信息。
第二方面,本申请提供一种设备控制装置,该设备控制装置包括:接收单元、处理单元和发送单元;接收单元,用于接收来自终端的人机交互消息;处理单元,用于根据人机交互消息,确定指令工单;指令工单用于对物联网设备进行控制;发送单元,用于向物联网设备发送指令工单。
在一种可能的实现方式中,人机交互消息包括物联网设备的身份标识ID和语句命令信息;语句命令信息为终端响应于用户的交互操作后确定。
在一种可能的实现方式中,处理单元,还用于根据语句命令信息和指令图谱,确定指令工单;其中,指令图谱用于表征语句命令信息与指令工单之间的映射关系。
在一种可能的实现方式中,接收单元,还用于接收来自终端的请求信息;处理单元,还用于根据终端的请求信息,确定物联网设备的ID。
在一种可能的实现方式中,处理单元,还用于确定映射关系表;其中,映射关系表用于表征物联网设备的ID和物联管理平台的URL链接之间的对应关系;物联管理平台用于控制物联网设备。
在一种可能的实现方式中,处理单元,还用于根据物联网设备的ID和映射关系表,确定物联管理平台的URL链接;处理单元,还用于根据物联网设备的URL链接,向 物联管理平台发送指令工单,以使得物联管理平台向物联网设备发送指令工单。
在一种可能的实现方式中,处理单元,还用于构建多个物联网设备的能力图谱;其中,多个物联网设备的能力图谱用于表征多个物联网设备的能力信息,以及多个物联网设备之间的互联关系;处理单元,还用于构建用户行为图谱;其中,用户行为图谱用于表征用户对于物联网设备的使用行为习惯,以及多个用户之间、用户与物联网设备之间的互联关系;处理单元,还用于根据多个物联网设备的能力图谱和用户行为图谱,确定指令图谱。
在一种可能的实现方式中,处理单元,还用于根据时间信息、地理位置信息对多个物联网设备的能力图谱和用户行为图谱中,用户与多个物联网设备之间的互联关系进行周期调整;处理单元,还用于根据标注参考数据,对多个物联网设备的能力图谱和用户行为图谱中的实体进行分类标注,以确定指令图谱;其中,标注参考数据包括以下一项或多项:指令信息段、文件地址链接、时间参数、数量参数。
在一种可能的实现方式中,处理单元,还用于根据指令工单,确定指令工单确认信息;发送单元,还用于发送指令工单确认信息;指令工单确认信息用于指示终端对指令工单进行确认;接收单元,还用于接收指令工单反馈信息;指令工单反馈信息用于表征终端对指令工单的确认结果。
在一种可能的实现方式中,接收单元,还用于接收物联网设备发送的目标数据;目标数据为语句命令信息指示获取的数据;处理单元,还用于根据语句命令信息对目标数据进行语义合成,确定第一语句信息;发送单元,还用于向终端发送第一语句信息。
第三方面,本申请提供了一种设备控制装置,该装置包括:处理器和通信接口;通信接口和处理器耦合,处理器用于运行计算机程序或指令,以实现如第一方面和第一方面的任一种可能的实现方式中所描述的设备控制方法。
第四方面,本申请提供了一种计算机可读存储介质,计算机可读存储介质中存储有指令,当指令在终端上运行时,使得终端执行如第一方面和第一方面的任一种可能的实现方式中所描述的设备控制方法。
第五方面,本申请提供一种包含指令的计算机程序产品,当计算机程序产品在设备控制装置上运行时,使得设备控制装置执行如第一方面和第一方面的任一种可能的实现方式中所描述的设备控制方法。
第六方面,本申请提供一种芯片,芯片包括处理器和通信接口,通信接口和处理器耦合,处理器用于运行计算机程序或指令,以实现如第一方面和第一方面的任一种可能的实现方式中所描述的设备控制方法。
具体的,本申请中提供的芯片还包括存储器,用于存储计算机程序或指令。
需要说明的是,上述计算机指令可以全部或者部分存储在计算机可读存储介质上。其中,计算机可读存储介质可以与装置的处理器封装在一起的,也可以与装置的处理器单独封装,本申请对此不作限定。
本申请中第二方面至第六方面的描述,可以参考第一方面的详细描述;并且,第二方面至第六方面的描述的有益效果,可以参考第一方面的有益效果分析,此处不再赘述。
在本申请中,上述设备控制装置、接收单元、处理单与、发送单元的名字对设备或功能模块本身不构成限定,在实际实现中,这些设备或功能模块可以以其他名称出现。只要各个设备或功能模块的功能和本申请类似,属于本申请权利要求及其等同技术的范围之内。
本申请的这些方面或其他方面在以下的描述中会更加简明易懂。
附图说明
图1为本申请实施例提供的基于SIP信令创建会话的流程示意图;
图2为本申请实施例提供的基于SIP信令修改会话的流程示意图;
图3为本申请实施例提供的基于SIP信令结束会话的流程示意图;
图4为本申请实施例提供的一种NIP图谱的示意图;
图5为本申请实施例提供的一种设备控制***的架构示意图;
图6为本申请实施例提供的一种设备控制方法的流程示意图;
图7为本申请实施例提供的另一种设备控制方法的流程示意图;
图8为本申请实施例提供的另一种设备控制方法的流程示意图;
图9为本申请实施例提供的另一种设备控制方法的流程示意图;
图10为本申请实施例提供的一种物联网设备的能力图谱的示意图;
图11为本申请实施例提供的一种用户行为图谱的示意图;
图12为本申请实施例提供的另一种设备控制方法的流程示意图;
图13为本申请实施例提供的一种指令图谱的示意图;
图14为本申请实施例提供的另一种指令图谱的示意图;
图15为本申请实施例提供的一种指令图谱的拓扑结构的示意图;
图16为本申请实施例提供的另一种设备控制方法的流程示意图;
图17为本申请实施例提供的另一种设备控制方法的流程示意图;
图18为本申请实施例提供的一种设备控制装置的结构示意图;
图19为本申请实施例提供的另一种设备控制装置的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例,都属于本申请保护的范围。
本文中术语“和/或”,仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。
本申请的说明书以及附图中的术语“第一”和“第二”等是用于区别不同的对象,或者用于区别对同一对象的不同处理,而不是用于描述对象的特定顺序。
此外,本申请的描述中所提到的术语“包括”和“具有”以及它们的任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、***、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括其他没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。
需要说明的是,本申请实施例中,“示例性的”或者“例如”等词用于表示作例子、例证或说明。本申请实施例中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言,使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。
在本申请的描述中,除非另有说明,“多个”的含义是指两个或两个以上。
以下,对本申请实施例涉及的名词进行解释,以方便读者理解。
一、富媒体消息服务
富媒体消息服务(rich communication service,RCS),是现在第五代移动通信技术(5th-Generation Mobile CommunicationTechnology,5G)消息的代名词,也被称为融合通信。RCS消息弥补了传统短信的只有文字的局限,支持文件、视频、图片、音频等多种格式。
RCS消息带来了全新的人机交互模式,用户只需要在消息窗口内即可完成服务搜索、发现、交互、支付等一站式业务。
使用RCS消息,用户不需要下载多个终端软件(application,app)客户端,在终端上原生的消息入口就可以接收到RCS消息。当前app数量过多造成的用户感知下降问题,将会得到有效的解决。而政府和企业,也可以通过RCS消息,将公共服务和商业服务直接送达到用户的终端上。
在本申请中,人机交互消息可以是RCS消息的形式。具体的,终端响应于用户的操作,将用户输入的命令语句信息以RCS消息的形式发送至物联管理平台,进而实现用户对物联网设备的控制。
二、IP多媒体子***(IP Multimedia Subsystem)核心网
IMS是一种全新的多媒体业务形式,它能够满足的终端用户更新颖、更多样化多媒体业务的需求。IMS被认为是下一代网络的核心技术,也是解决移动与固网融合,引入语音、数据、视频三重融合等差异化业务的重要方式。
IMS核心网是IMS的网络架构中的重要部分。本申请涉及到的IMS核心网网元或模块包括:CSFS网元、AS网元。
其中,呼叫会话控制功能(Call Session Control Function,CSFS)网元,主要用于基于分组交换的SIP会话控制。在IMS中,CSCF负责对用户多媒体会话进行处理,可以看作IETF架构中的SIP服务器。根据各自不同的主要功能分为代理呼叫会话控制功能P-CSCF(Proxy CSCF)、问询呼叫会话控制功能I-CSCF(Interrogation CSCF)和服务呼叫会话控制功能S-CSCF(Serving CSCF),三个功能在物理上可以分开,也可以独立。
应用服务器网元(Application Server,AS),用于接收来自终端及终端上APP发送的消息。
此外,本申请在IMS核心网中新增了第一网元、第二网元、以及消息即平台(messaging as a Platform,MaaP),用于实现用户对物联网设备的控制。其中,MaaP中设置有多个物联管理平台,以实现对不同的物联网设备的控制。具体第一网元、第二网元以及MaaP平台的功能参见下文,此处不再赘述。
三、会话发起协议(session initiation protocol,SIP)
SIP会话,是两个用户终端之间基于IP网络的会话,即VoIP会话,会话的媒体 一般是语音、视频,也可能有其他形式。
SIP本身只负责会话的建立,具体来说,就是在两个用户终端之间通过SIP消息交换传递消息,完成会话的建立。SIP的会话建立与管理功能具体可包括创建会话、修改会话和结束会话三种场景,下面结合图1至图3进行简单说明:
示例性地,如图1所示,一个SIP创建会话的流程如下:
S101、主叫终端向被叫终端发送INVITE。
其中,INVITE消息用于请求建立会话,INVITE中包含提议的会话参数的描述。
S102、被叫终端返回200 OK。
其中,200 OK响应消息包含接受的会话参数的描述,表示接受会话建立请求。
S103、主叫终端发送ACK。
其中,ACK消息用于确认会话的建立。
示例性地,如图2所示,一个SIP修改会话的流程如下:
S201、终端A向终端B发送re INVITE。
其中,reINVITE消息用于请求修改两终端之间的会话,reINVITE中包含提议的新的会话参数的描述。
S202、终端B返回200 OK。
其中,200 OK响应消息包含接受的会话参数的描述,表示接受会话建立请求。
示例性地,如图3所示,一个SIP结束会话的流程如下:
S301、终端A向终端B发送BYE。
其中,BYE消息用于请求结束两终端之间的会话。
S302、终端B返回200 OK。
其中,200 OK响应消息表示接受会话结束请求。
在本申请中,基于SIP会话来实现终端与物联管理平台的对接,物联管理平台获得指令后,实现对不同的物联网设备的控制,最终实现通过RCS消息控制物联网设备。具体,终端与物联管理平台的交互过程参见下文实施例的说明,此处不再赘述。
四、神经语言程序学(Neuro-Linguistic Programming,NLP)知识图谱
现有技术构建图谱时,主要是为了分析用户语言的意图,一般通过NLP来构建专门分析用户语句意图的知识图谱。通过NLP知识图谱以及图谱AI计算可以获取用户语言中的意图,然后再来转化成为用户的需求,执行下一步操作来控制物联网设备。示例性地,如图4所示,NLP的图谱会将词袋、句型、语法等信息来构建语言知识图谱,是从用户可理解的角度进行语义分析。
五、指令工单
指令工单,在物联网领域中用于控制物联网设备。
指令工单与语句命令信息构成区别的是,语句命令信息是只能够被用户理解的信息,而指令工单是基于语句命令信息,被设备控制装置转换后使得物联网设备能够识别的机器指令,物联网设备能够基于指令工单进行相应的操作,以满足用户对物联网设备的控制意图。
以上对本申请实施例中涉及到的部分名词或概念进行了介绍。
目前用户与物联网设备的交互并不能直接以用户可理解的语言进行直接交互,例 如:用户需要知道物联网设备的亮度时,需要是通过平台或者终端上的APP分别去控制物联网设备。因此在未来万物互联的背景下,用户需要下载许多不同的物联网设备APP,再去学***台中的复杂功能去控制物联网设备、获取物联网设备的数据,过程较为复杂,导致用户的体验较差。
现阶段,虽然也有基于RCS消息,具体通过消息中的选项卡来控制物联网设备的方案。例如,用户可以在消息中选择需要控制的物联网设备、具体对应何种功能。但是这样依旧无法实现以用户可以理解的语言,来直接实现与物联网设备的交互,而且交互是单方向的,也即只能由用户来控制物联网设备,物联网设备回复的数字、参数、复杂文件等数据,也无法以用户能够直接理解的形式向用户直接展现,用户对物联网设备的交互体验仍然较差。
鉴于此,本申请提供了一种设备控制方法,通过在IMS核心网中部署物联管理平台,在SIP信令流程上实现了用户终端到物联管理平台的对接,物联管理平台接收到终端发送的人机交互消息后,基于指令图谱将人机交互消息中包括的用户通过终端输入的语句命令信息,转换为物联网设备可以理解的指令工单并发送至物联网设备,以实现对物联网设备的控制,最终实现了通过人机交互消息控制物联网设备的新方式。人机交互消息可以是RCS消息的形式,因此用户手机只要有RCS短信功能,无需下载各类各样的APP就可以通过用户可理解的语言直接与物联网设备进行交互,流程简单,进而提高了用户体验。
下面将结合说明书附图,对本申请实施例的实施方式进行详细描述。
示例性地,图5为申请提供的一种设备控制***50的网络架构图。如图5所示,该设备控制***50包括:终端51、设备控制装置52、物联网设备53。
其中,终端51与设备控制装置52通过通信链路连接,设备控制装置52与物联网设备53通过通信链路连接。该通信链路可以为有线通信链路,也可以为无线通信链路,本申请对此不作限定。
终端51,是一种具有无线通信功能的设备,可以部署在陆地上,包括室内或室外、手持或车载。也可以部署在水面上(如轮船等)。还可以部署在空中(例如飞机、气球和卫星上等)。终端51又称之为用户设备(user equipment,UE),移动台(mobile station,MS)、移动终端(mobile terminal,MT)以及终端等,是一种向用户提供语音和/或数据连通性的设备。例如,终端51包括具有无线连接功能的手持式设备、车载设备等。目前,终端51可以是:手机(mobile phone)、平板电脑、笔记本电脑、掌上电脑、移动互联网设备(mobile internet device,MID)、可穿戴设备(例如智能手表、智能手环、计步器等),车载设备(例如,汽车、自行车、电动车、飞机、船舶、火车、高铁等)、虚拟现实(virtual reality,VR)设备、增强现实(augmented reality,AR)设备、工业控制(industrial control)中的无线终端、智能家居设备(例如,冰箱、电视、空调、电表等)、智能机器人、车间设备、无人驾驶(self driving)中的无线终端、远程手术(remote medical surgery)中的无线终端、智能电网(smart grid)中的无线终端、运输安全(transportation safety)中的无线终端、智慧城市(smart city)中的无线终端,或智慧家庭(smart home)中的无线终端、飞行设备(例如,智能机器人、热气球、无人机、飞机)等。本申请一种可能的应用的场景中终端设备为经常 工作在地面的终端设备,例如车载设备。在本申请中,为了便于叙述,部署在上述设备中的芯片,例如片上***(System-On-a-Chip,SOC)、基带芯片等,或者其他具备通信功能的芯片也可以称为终端51。
设备控制装置52,位于IMS核心网侧或者为IMS核心网中一些特定功能网元的集合,具体可包括:CSFS网元54、AS网元55、MaaP平台56。
其中,CSFS网元54为设备控制装置中现有的网元,本申请在此不再赘述。
需要说明的是,本申请在AS网元55中新增了第一网元57和第二网元58。
第一网元57,具体用于负责分配各类物联网设备的ID号。由于目前物联网设备有些具备SIM卡的,有些不具备SIM卡只是通过WIFI进行网络连接,因此想要通过富媒体消息与这些设备直接进行联系,就需要给这些设备也分配类似于电话号码的ID。
此外,第一网元57在为物联网设备分配ID编号后,第一网元57将建立映射关系表,将该物联网设备对应的物联管理平台的URL地址与物联网设备的ID对应。
也即,当终端相应用户的操作给物联网设备发送RCS消息时,其实不是直接链接该物联网设备,而是先与该物联网设备对应的物联管理平台对应的URL地址进行对接。
在一种可能的实现方式中,第一网元57还将实时获取各个物联网设备的地理位置、网络链接状态、当前服务用户数量、以及当前服务用户对应的ID。
示例性地,第一网元57建立的映射关系表如下表1所示:
表1映射关系表
在表1中,当前服务用户对应的ID以用户手机号的形式体现。需要指出,当前服务用户对应的ID也可以通过其他形式来体现,本申请对此不做具体限定。
在一种可能的实现方式中,第一网元57还能在接收到终端发送的请求信息后,根据该请求信息查询后返回符合请求信息的一个或者多个物联网设备,以及这些物联网设备的ID供用户选择,用户可以根据设备的地理位置或其他显著信息选择需要交互的物联网设备。在用户选择物联网设备后,终端能够显示出该物联网设备的ID。
第二网元58,具体用于智能计算用户与物联网设备的交互过程,该网元负责构建多个物联网设备的能力图谱、用户行为图谱,并根据前述两个图谱进一步构建深度指令图谱,进而根据构建的多个图谱进行人工智能(artificial intelligence,AI)计算,根据用户与物联网设备的输入语句、指令或数据计算得出能够用于直接控制物联网设备的指令工单。
需要说明的是,具体第二网元58构建多个物联网设备的能力图谱、用户行为图谱,并根据前述两个图谱进一步构建深度指令图谱的流程参见下文S901-903和S1201-S1202,此处不再赘述。
在一种可能的实现方式中,第二网元58还部署有语义合成模块,以实现将物联网设备反馈的数据、参数、指令转变成为人可以理解的语言。
MaaP平台56中设置有多个物联管理平台59,用于接收来自于第二网元58的指令工单,并将该指令工单向物联网设备53发送。
在一种可能的实现方式中,物联管理平台59具备chatbot功能。物联管理平台59能够基于chatbot功能,向用户所使用的终端发送RCS消息。进一步的说,物联管理平台59能够在接收到指令工单后,根据chatbot功能确定出指令工单确认信息并向终端发送,使得终端对应的用户能够对指令工单是否符合用户本身意图进行确认。
在一种可能的实现方式中,物联管理平台59具备语义合成功能。具体来说,在终端51发送的RCS消息是为了从物联网设备53处获取目标数据时,物联管理平台59能够接收物联网设备53上报的目标数据,并结合RCS消息中的语句命令信息对目标数据进行语义合成,确定出能够被终端对应的用户理解的第一语句信息,以使得用户获取目标数据。
在一种可能的实现方式中,物联管理平台59控制物联网设备53的各个指令会储存在第二网元58构建的指令图谱里,例如:具有打印管理功能的物联管理平台59控制全息打印机的指令有:print file,该指令发送给对应的物联网设备53可以打印文件。例如:具有灯控功能的物联管理平台59管理平台控制液晶显示器(liquid crystal display,LCD)灯的指令有:开灯:LCD on key=1,该指令由物联管理平台59发送给LCD灯可以打开LCD灯,调LCD灯光的亮度指令:LCD FLASH H+++等。
需要说明的是,AS网元55与MaaP平台56之间通过N2接口进行通信连接。
以上对本申请提供的一种设备控制***进行了说明。
需要指出的是,在本申请提供的设备控制方法中,执行主体是设备控制装置。该设备控制装置可以是一种电子设备(例如电脑终端、服务器),还可以是电子设备中的处理器,还可以是电子设备中用于设备控制的控制模块,还可以是电子设备中用于设备控制的客户端。
示例性地,如图6所示,本申请提供一种设备控制方法,具体包括以下步骤:
S601、设备控制装置接收来自终端的人机交互消息。
可选地,人机交互消息可以为RCS消息的形式。需要说明的是,下文以及下述实施例中皆以人机交互消息为RCS消息的形式来进行举例介绍,下文不再进行多余说明。
在一种可能的实现方式中,RCS消息包括物联网设备的ID和语句命令信息。语句命令信息具体用于记录用户通过终端输入的文字信息或语音信息等。
示例性地,结合具体场景,用户在通过终端向物联网设备发送RCS消息时,如果终端的数据库中已存有该物联网设备的ID,那么用户可以直接在终端显示界面的消息收件人处录入需要交互的物联网设备ID。例如ID=78006,并根据需求输入消息内容:“调整全息投影的亮度”,或者“发送图片并文字描述投影该图片”,或者发送PDF并文字描述打印该PDF。
在一种可能的实现方式中,语句命令信息是终端响应于用户的交互操作后确定的,能够体现出用户对于物联网设备的控制意图。
在一种可能的实现方式中,S601可由设备控制装置中的AS网元来执行,以使得设备控制装置接收RCS消息。
S602、设备控制装置根据人机交互消息,确定指令工单。
其中,指令工单用于对物联网设备进行控制。指令工单与语句命令信息构成区别的是,语句命令信息是只能够被用户理解的信息,而指令工单是基于语句命令信息,被设备控制装置转换后使得物联网设备能够识别的机器指令,物联网设备能够基于指令工单进行相应的操作,以满足用户对物联网设备的控制意图。
在一种可能的实现方式中,设备控制装置确定指令图谱,该指令图谱用于表征语句命令信息与指令工单之间的映射关系。进而,设备控制装置根据语句命令信息和指令图谱,确定指令工单。需要说明的是,具体设备控制装置确定指令图谱的过程参见下述S901-S903和S1201-S1202,此处不再赘述。
示例性地,下面结合具体信令传输流程,对根据RCS消息确定指令工单进行说明:基于SIP会话,终端的RCS消息会发送到IMS核心网,信令层具体为:终端侧向CSFS网元发送MSRP:request信令,表示会话建立的请求;CSFS网元收到请求后,向终端回复MSRP:200 OK的响应信令。此时MSRP会话成功建立,RCS信息中的语句命令信息,会被发送到AS网元中新增的第二网元中,结合指令图谱进行计算,解析终端用户的意图,最终确定出能被物联网设备识别的指令工单。
在一种可能的实现方式中,S602可由设备控制装置中的AS网元中的第一网元和第二网元执行,以使得设备控制装置根据RCS消息,确定指令工单。
S603、设备控制装置向物联网设备发送指令工单。
可以理解的是,由于指令工单是物联网设备能够识别的机器指令,因此物联网设备在接收到指令工单后,能够基于指令工单执行相应操作,或上报用户需求的目标数据,以此来满足用户对物联网设备的控制意图。
在一种可能的实现方式中,设备控制装置根据RCS消息中的物联网设备的ID确定物联网设备对应的物联管理平台的URL链接,根据该URL链接以物联管理平台为中继,向物联网设备发送指令工单。同时,物联管理平台还能够用于接收物联网设备上报的目标数据,并将目标数据发送至设备控制装置。
在一种可能的实现方式中,S603可由设备控制装置中的物联管理平台执行,以使得设备控制装置向物联网设备发送指令工单。
基于上述技术方案,本申请实施例在接收到来自终端的响应于用户操作生成的人机交互消息后,根据人机交互消息来确定出物联网设备能够识别的指令工单,将用户对物联网设备的控制意图转换为物联网设备能够识别的机器指令,并向物联网设备发送,使得物联网设备能够基于指令工单执行相应操作,或上报用户需求的目标数据,以此来满足用户对物联网设备的控制意图。人机交互消息可以是RCS消息的形式,因此用户所使用的终端只要有RCS短信功能,无需下载各类各样的APP就可以通过人类的语言直接与物联网设备进行通信,过程简单且提高了用户的物联网设备使用体验。
示例性地,结合图6,如图7所示,本申请提供的设备控制方法在接收来自终端 的富媒体消息服务RCS消息之前,还包括以下步骤:
S701、设备控制装置接收来自终端的请求信息。
其中,该请求信息用于请求获取物联网设备的ID。
在一种可能的实现方式中,请求信息中包括有关键字,用于体现用户需求控制的物联网设备的特征。
可以理解的是,终端向设备控制装置发送请求信息,即此次用户根据终端需求控制的物联网设备,其ID并未包括在终端的数据库中。
S702、设备控制装置根据终端的请求信息,确定物联网设备的ID。
示例性地,结合具体场景,用户在终端显示界面的收件联系人的位置选择搜索功能并输入物联网设备的关键字,例如搜索“全息打印机”。进而终端向设备控制装置发送请求信息,其信令格式可以为:<HTTP GET request:func=search:keyword=全息打印机>,进而设备控制装置查询后返回符合关键字要求的一个或者多个全息打印机物联网设备供用户选择,用户可以根据设备的地理位置或其他显著信息选择需要交互的物联网设备是哪一个设备。进而用户选择确定后,终端显示界面的消息的收件人地址栏就是该物联网设备的ID。
在一种可能的实现方式中,S701-S702可由设备控制装置中的第一网元执行,以使得设备控制装置在接收到终端的请求信息后,据此确定出相应的物联网设备的ID。
基于上述技术方案,本申请实施例能够在用户需求控制的物联网设备的ID并未包括在终端的数据库中时,接收终端发送的请求信息,向终端反馈一个或多个物联网设备供用户选择需求控制的物联网设备,并为用户提供其需求控制的物联网设备的ID,以便于后续满足用户对物联网设备的控制意图。
示例性地,结合图6,如图8所示,本申请提供的设备控制方法还包括以下步骤:
S801、设备控制装置确定映射关系表。
其中,映射关系表用于表征物联网设备的ID和物联管理平台的URL链接之间的对应关系。
可以理解的是,映射关系表即为前文在为物联网设备分配ID编号后,第一网元建立的映射关系表。
在一种可能的实现方式中,S801可由设备控制装置中的第一网元执行,以使得设备控制装置确定映射关系表。
S802、设备控制装置根据物联网设备的ID和映射关系表,确定物联管理平台的URL链接。
示例性地,如前文表1所示,设备控制装置能够根据映射关系表中物联网设备的ID与其对应的物联管理平台的对应关系,确定出物联管理平台的URL链接。
示例性地,下面结合具体信令传输流程,对根据物联网设备的ID和映射关系表,确定物联管理平台的URL链接进行说明:
1)在接收到来自终端的RCS消息后,AS网元对RCS消息进行解析,确定物联管理平台的URL链接。
可以理解的是,如前文所说,物联网设备可能不具备SIM卡,是通过WiFi与设备控制装置进行连接的,进而终端无法直接与这些物联网设备打电话、发短信。因此, 在AS网元中的第一网元确定出用于表征物联网设备的ID和物联管理平台的URL链接之间的对应关系的映射关系表后,AS网元能够对RCS消息进行解析,以获取物联网设备的ID,并据此确定终端用户需求进行交互的物联网设备对应的物联管理平台的URL链接。需要指出,虽然在终端显示界面上接收信息的地址显示的是物联网设备的ID(方便终端进行记录储存),但实际的交互地址是由AS网元解析后确定的物联管理平台的URL地址。
2)终端激活RCS承载。
终端在激活RCS承载时,要与物联网设备对应的物联管理平台进行SIP信令交互,以使得承载建立。具体过程为:终端发送SIP:INVITE REQEST指令至CSFS网元;CSFS网元与第一网元进行通信,调取前述步骤中第一网元确定的物联管理平台的URL地址,建立通信;通信建立成功后,CSFS网元向终端反馈SIP:100TRYING,SIP:180RINGING以及SIP:200OK指令;终端向CSFS网元发送SIP:ACK指令确认承载建立。
在一种可能的实现方式中,S802可由设备控制装置中的第一网元执行,以使得设备控制装置根据物联网设备的ID和映射关系表,确定物联管理平台的URL链接。
S803、设备控制装置根据物联网设备的URL链接,向物联管理平台发送指令工单,以使得物联管理平台向物联网设备发送指令工单。
在一种可能的实现方式中,在设备控制装置根据物联网设备的URL链接,向物联管理平台发送指令工单前,设备控制装置会先确定指令工单,如前文S502中所述。
示例性地,下面结合S802中描述的信令传输流程,对设备控制装置确定指令工单进行说明:
可以理解的是,在经过S802完成RCS承载的建立后,SIP会话打开,此时终端的RCS消息会发送到IMS核心网,信令层具体为:终端侧向CSFS网元发送MSRP:request信令,表示会话建立的请求;CSFS网元收到请求后,向终端回复MSRP:200 OK的响应信令。此时MSRP会话成功建立,RCS信息中的语句命令信息,会被发送到AS网元中新增的第二网元中,结合指令图谱进行计算,解析终端用户的意图,最终确定出能被物联网设备识别的指令工单。
进一步地,设备控制装置在确定出指令工单后,根据物联网设备的URL链接,向物联管理平台发送指令工单,以使得物联管理平台向物联网设备发送指令工单,实现物联管理平台对物联网设备的控制。
在一种可能的实现方式中,S803可由设备控制装置中的第一网元和第二网元执行,以使得根据物联网设备的URL链接,向物联管理平台发送指令工单。
基于上述技术方案,本申请实施例能够根据接收到的人机交互消息中物联网设备的ID,来确定出该物联网设备对应的物联管理平台的URL链接,并根据该URL链接将第二网元确定出的指令工单发送至物联管理平台,以使得物联管理平台向物联网设备发送指令工单,实现物联管理平台对物联网设备的控制。
示例性地,结合图6,如图9所示,本申请提供的设备控制方法还包括以下步骤:
S901、设备控制装置构建多个物联网设备的能力图谱。
其中,多个物联网设备的能力图谱用于表征多个物联网设备的能力信息,以及多个物联网设备之间的互联关系。
示例性地,如图10所示,多个物联网设备的能力图谱可以为拓扑结构,具体包括图谱的实体以及图谱的边。该能力图谱需要人工提前输入基础的拓扑结构,图谱的实体包括该物联网设备基本能力对应的关键词,在图9中:圈里的为图谱的实体,连接的边代表的是实体之间的关系。这样可以根据不同物联网设备的能力、特性构建不同的图谱,多个物联网设备之间通过不同的关系边形成互联关系。
在一种可能的实现方式中,S901可由设备控制装置中的第二网元来执行,以构建多个物联网设备的能力图谱。
S902、设备控制装置构建用户行为图谱。
其中,用户行为图谱用于表征用户对于物联网设备的使用行为习惯,以及多个用户之间、用户与物联网设备之间的互联关系。
示例性地,如图11所示,用户行为图谱可以为拓扑结构,与S801类似,图11中圈里的图谱实体代表了用户行为习惯的特征关键词,例如视力、可能需要打印的文件、光亮喜好、增强现实(augmented reality,AR)的光谱密度等。同时,多个用户之间、用户与物联网设备之间可以通过图谱的边形成互联关系。
在一种可能的实现方式中,S902可由设备控制装置中的第二网元来执行,以构建用户行为图谱。
S903、设备控制装置根据多个物联网设备的能力图谱和用户行为图谱,确定指令图谱。
其中,指令图谱能够表征语句命令信息与指令工单之间的映射关系。
在一种可能的实现方式中,设备控制装置对多个物联网设备的能力图谱和用户行为图谱中的实体,进行实体边关系的动态化连接,也即调整用户与多个物联网设备之间的互联关系。在此之后,设备控制装置基于前文所描述的第一网元获取的各个物联网设备的地理位置、网络链接状态、当前服务用户数量、以及当前服务用户对应的ID,对多个物联网设备的能力图谱和用户行为图谱中的实体进行分类标注。
需要说明的是,设备控制装置具体根据多个物联网设备的能力图谱和用户行为图谱,确定指令图谱的过程参见下述S1201-S1202,此处不再赘述。
在一种可能的实现方式中,S902可由设备控制装置中的第二网元来执行,以使得根据多个物联网设备的能力图谱和用户行为图谱,确定指令图谱。
基于上述技术方案,本申请实施例中第二网元通过构建多个物联网设备的能力图谱和用户行为图谱,来进一步确定出表征语句命令信息与指令工单之间的映射关系的指令图谱,以保障后续物联网设备控制流程的正常进行。
示例性地,结合图6,如图12所示,本申请提供的设备控制方法中,根据多个物联网设备的能力图谱和用户行为图谱,确定指令图谱具体包括以下步骤:
S1201、设备控制装置根据时间信息、地理位置信息对多个物联网设备的能力图谱和用户行为图谱中,用户与多个物联网设备之间的互联关系进行周期调整。
可以理解的是,此处的时间信息和地理位置信息,即来源于前文所描述的第一网元实时获取的各个物联网设备的地理位置、网络链接状态、当前服务用户数量、以及当前服务用户对应的ID。
示例性地,图13示出了确定好的指令图谱,能够体现出设备控制装置根据时间信 息、地理位置信息对多个物联网设备的能力图谱和用户行为图谱中,用户与多个物联网设备之间的互联关系进行的调整。具体来说,设备控制装置根据时间信息、地理位置信息、及其它常理逻辑,定时、周期性的对用户与多个物联网设备之间的互联关系进行调整,例如当图13中的用户2的位置从操场移动到教室,那么用户2的图谱与教室内的所有物联网设备的图谱都将实现边关系链接;亦如,当时间到晚上6点后,所有用户图谱将与物联网设备灯的图谱实现边关系链接;再如,当教学内容从语文课变到数学课,所有用户的图谱与语文老师的图谱链接关系权重系数由强变弱,所有用户的图谱与数学老师的图谱链接关系权重系数由弱变强。
在一种可能的实现方式中,S1201可由设备控制装置中的第二网元来执行,以使得根据时间信息、地理位置信息对多个物联网设备的能力图谱和用户行为图谱中,用户与多个物联网设备之间的互联关系进行周期调整。
S1202、设备控制装置根据标注参考数据,对多个物联网设备的能力图谱和用户行为图谱中的实体进行分类标注,以确定指令图谱。
其中,标注参考数据包括以下一项或多项:指令信息段、文件地址链接、时间参数、数量参数。
在一种可能的实现方式中,指令信息段,即设备控制装置对RCS消息中包括的语句命令信息,进行字段提取后获得的,例如“文件”“照片”“油墨”等指令信息段。同理,时间参数、数量参数也可根据语句命令信息获得。
在一种可能的实现方式中,在根据指令信息段进行标注时,对于提取出为动词的指令信息段,指令图谱对应的数据库会记录对应的物联操作平台对应的控制指令,例如:开灯:LCD on key=1;复印printfile。对于提取出为形容词的指令信息段,例如“亮”“暖和”,数据库还会记录对应的物联操作平台对应的调整指令,例如:物联网设备灯对应“亮”的指令是:LCD FLASH H+++,全息打印设备对应“紫色的”指令是:Pintf COLOR=2234。
在一种可能的实现方式中,对于提取出的时间参数、数量参数,设备控制装置会获取用户富媒体消息的数量指令,例如对于全息打印,与数量相关的打印份数指令是NUM=3,对于空调与数量相关的温度指令是Tempra=24,以及时间TIME=8:40等信息补充到相应的位置。
在一种可能的实现方式中,指令图谱对应的数据库中会存储图谱中某些实体的存储地址,该存储地址一部分可根据标注参考数据中的文件地址链接确定,另一部分可由人工输入。例如,某“文件”储存在数据库的地址为“D:/FILE/TEMPER/USER1”;或者,某个“油墨”是储存在柜子第3层。
由此,设备控制装置在根据标注参考数据,对多个物联网设备的能力图谱和用户行为图谱中的实体进行分类标注,将两个图谱结合为一个图谱后,即可确定出指令图谱。
在一种可能的实现方式中,S1201可由设备控制装置中的第二网元来执行,以使得根据标注参考数据,对多个物联网设备的能力图谱和用户行为图谱中的实体进行分类标注来确定指令图谱。
基于上述技术方案,本申请实施例通过对多个物联网设备的能力图谱和用户行为 图谱中的互联关系进行周期调整,以及根据标注参考数据对对这两个图谱中的实体进行分类标注,来进一步确定出表征语句命令信息与指令工单之间的映射关系的指令图谱。由此构建出的物联网设备指令图谱,可以在用户语义识别的基础上再包含物联网设备的指令,这样接收到语句命令信息后,可直接根据该面向物联网设备的指令图谱进行图谱计算获取指令工单,可以更容易实现对物联网设备的控制,以保障后续物联网设备控制流程的正常进行。
示例性地,结合图13、图14及图15,以用户在终端输入的语句命令信息为“今天我需要帮助同学,将语文老师上一节课布置的试卷打印十份”为例,对结合指令图谱,来进行图谱计算以获取指令工单的过程进行介绍。需要说明的是,前文S602中设备控制装置根据语句命令信息和指令图谱,确定指令工单即可参考本距离。以下是具体流程:
S1、第二网元对语句命令信息进行分析,获取总指令图谱。
结合示例,第二网元对语句分析得出的关键词包括:主语实体涉及“我”“打印机”“语文老师”,动词是“帮助”“打印”,宾语是“同学”、“语文老师上一节课的试卷”,以及其他关键词“上一节课、试卷、打印、数量、科目”等。
由此,根据上述分析得出的关键词,结合物联网设备的能力图谱和用户行为图谱,即可确定出总指令图谱(也即图13)。
可以理解的是,初步分析出的内容发送给打印机,打印机是无法识别这些内容的。因此指令图谱与图谱计算的作用就是把消息输入的用户可理解的语句转化为机器可以识别的指令工单。
结合本示例来说,对于“我需要帮助同学”这句话现有技术做NLP自然语义识别是可以的,但是对于物联网设备来说,最终的目的就是打印十份试卷,“帮助同学的信息”其实是多余的,对于物联网设备“打印颜色”、“打印机地址”、“正反面打印”、“端口地址”这些信息反而是缺失的。因此本申请通过指令图谱以及相应的图谱计算可以计算获得控制物联网设备的指令工单,而不是对冗余的语义进行分析,浪费计算资源与效率。本申请增强在消息的人类语言中没有涵盖到、但控制物联网设备实际很关键、很需要的实体及边关系。因此,需要通过指令图谱来确定控制物联网设备的关键实体包括哪些指令,根据这些指令生成控制物联网设备的指令工单,由此可以将用户的语言转化成物联网设备可以理解的指令工单。
S2、第二网元根据总指令图谱,确定子指令图谱。
示例性地,结合示例,第二网元对语句分析得出的关键词中,主要主体为“我”“打印机”“语文老师”,动词是“帮助”“打印”,宾语是“同学”、“语文老师上一节课的试卷”,由此可在图13中确定出一个具有明显关键路径的拓扑结构,该路径在图13中通过五角符号以及箭头进行标示。
进一步的,根据图13中确定出的关键路径的拓扑结构,确定出子指令图谱,也即图14。需要说明,图14中包括为实现对物联网设备的控制,所需包括的实体与边关系。
S3、第二网元对子指令图谱进行图谱计算,确定指令工单。
在一种可能的实现方式中,第二网元首先对子指令图谱进行图神经拓扑,获取拓 扑结构图;之后,根据拓扑结构图确定邻接矩阵和度矩阵,最终确定出指令工单。
示例性地,下面对根据图13进行图神经拓扑,以获取拓扑结构图15的过程进行介绍:
具体包括:每个实体(即图中的椭圆)作为图神经拓扑的节点,将链接的关系作为边,其中各个实体之间的关系重要程度拟定为W参数,成为连接实体点的边的系数。W参数的确认方法:0<Wn<1,根据消息文字中的关键词决定,如果消息文字中包括该实体的关键字,那么这些实体之间的关系,即边的W参数越大,反而越小。例如,本示例中语句命令信息为“今天我需要帮助同学,将语文老师上一节课布置的试卷打印十份”,那么关键词对应了用户、同学、语文老师、上一节课、试卷、打印、数量、科目,那么这些实体之间的W参数设为0.9,全息打印机其他实体例如油墨、地址、取消打印任务、已打印文件的边关系W设为0.001。由此形成一个具有明显关键路径的拓扑结构,该路径在图13中通过五角符号以及箭头进行标示。同时,提取的拓扑结构图如图15所示,共包括28个节点及多个边。
在图15中,该拓扑结构图的邻接矩阵A1、度矩阵D1依据图拓扑结构可以分别获得:其中度矩阵D1中,非对角线的数字全部为0,对角线的位置是与该点具有边关系的W参数权重之合;邻接矩阵A1中,对角线的数字全部为0,非对角线位置是该点相邻的节点对应的W参数权重的值。例如下图拓扑中共有28个节点,第一个蓝色1号节点与6个其他节点相连,那么A1矩阵第一行的2,3,4,5,6,7列分别是W1,W2,W3,W4,W5,W6的数值(4,5,2,3,0.8,0.9,3.1),该行其他位置全为0;23号节点表示语文老师,与一个其他节点24号相连,那么A1矩阵第23行的第24列是W24,其他位置全为0;1号节点表示全息打印机,与6个节点相连接,那么D1矩阵对角线第一行第一列是W1到W6的总和,其余位置全部为0;4号节点与其他4个节点相连,那么D1矩阵对角线第4行第4列就是与4号节点相连的边的W的总和。
最终生成的A1矩阵前11行与14列如下表2所示:
表2 A1矩阵部分示例
最终生成的D1矩阵前9行与9列如下表3所示:
表3 D1矩阵部分示例
示例性地,与上述获取拓扑结构图的过程同理,对子指令图谱(也即图14)进行图神经拓扑。每个实体作为图神经拓扑的点,将链接的关系作为边,构建指令图谱的拓扑表示,各个实体之间的边关系系数定为M参数。类似于以上步骤,构建指令图谱的邻接矩阵A2、度矩阵D2,其中度矩阵D2是非对角线为数字全部为0,对角线的位置是与该点具有相邻边关系的M参数权重之和;邻接矩阵A2是对角线的数字全部为0,非对角线位置是该点相邻的邻居节点之间的边关系值M参数。
需要说明的是,由于图14对应的子指令图谱的M参数与图13对应的总指令图谱的W参数是完全不相同的,因此需要依据图13对应的总指令图谱获得的邻接矩阵A1、度矩阵D1,对图15对应的子指令图谱的M系数矩阵进行训练,以获得最优的边关系矩阵M,具体过程如下:
通过公式P=softMAX[H*W*(D2-A2)*(D1-A1)*M]获得,其中M是图3指令图谱中待训练的系数矩阵,H是消息中人类语言包含的关键词得出一条路径中节点的编号组成的矩阵(例如图1中五角以及箭头所示的各个实体,那么H矩阵应该包括【1,4,7,23,24,25…】)。P的计算结果是概率值,通过迭代反复计算,将初始化的M参数(例如所有M参数都是0.5)代入以上公式后反复调整M参数,直到使得P的损失函数最小时所得到的M参数就是最终值。P的损失函数是计算预判获得的P与实际P的标注分类之间的差值。例如当消息语句是“今天我需要帮助同学,将语文老师上一节课布置的试卷打印十份”作为输入时,该信息已经包括在W\D1\A1中,通过以上公式就可以得出整个指令图谱28个节点的概率,如果概率大于阈值1,那么说明该节点即实体是需要被加入指令工单(例如打印数量文件地址对应的实体节点的概率经过计算大于阈值1),如果概率小于阈值1,那么说明该节点即实体是不需要被加入指令工单(例如视力灯光亮的程度同学课本作业油墨剩余量这些实体节点概率经过计算会小于阈值1,说明是无关紧要的信息),不需要被加入工单中。
最终,将上述公式计算出来概率P大于阈值1的子指令图谱中的所有实体都挑选出来,生成指令工单,该指令工单的示例如下:
“执行的物联网设备主体:全息打印机ID=788654;
执行打印指令“print file”;
文件地址:D:file/temper/10.78 Name=语文一单元试卷;
打印数量“十份”;
打印颜色:Color=2234;
是否3D全息:Null;
打印时间:当前;
是否双面:Null;”
可以理解的是,上述指令工单能够被物联网设备全息打印机识别。因此,本申请构建出的物联网设备的指令图谱,可以在用户语义识别的基础上再包含物联网设备的指令,这样接收到语句命令信息后,可直接根据该面向物联网设备的指令图谱进行图谱计算获取指令工单,可以更容易实现对物联网设备的控制,满足用户对物联网设备的控制意图。因此用户所使用的终端只要有RCS短信功能,无需下载各类各样的APP就可以通过人类的语言直接与物联网设备进行通信,过程简单且提高了用户的物联网设备使用体验。
示例性地,结合图6,如图16所示,本申请提供的设备控制方法还包括以下步骤:
S1601、设备控制装置根据指令工单,确定指令工单确认信息。
其中,指令工单确认信息用于指示终端对指令工单进行确认。
在一种可能的实现方式中,指令工单确认消息也可以是一种RCS消息。
S1602、设备控制装置发送指令工单确认信息。
S1603、设备控制装置接收指令工单反馈信息;指令工单反馈信息用于表征终端对指令工单的确认结果。
在一种可能的实现方式中,设备控制装置中的物联管理平台具备chatbot,由此可以实现向终端发送RCS消息的功能。
在一种可能的实现方式中,在前述S602确定出指令工单后,由物联管理平台基于chatbot,向终端发送指令工单确认信息,该指令工单确认信息的格式可以通过suggestion list的方式提供给终端进行确认,由此避免依据图谱算法错误估计了用户的意图。
示例性地,具体S1601-S1603的信令流程为:由第二网元生成suggestion list,并以RCS-MSRP消息的方式下发给终端,用户会在刚才发送RCS消息会话界面收到CHATBOT的回复消息,该回复信息可以展示指令工单,且指令工单下会有操作按键用以确认是否同意,用户在该工单下方有用户确认的按键。
可以理解的是,当用户确认指令工单,也即指令工单反馈信息表征的对指令工单的确认结果为确认时,设备控制装置将指令工单发送至物联网设备。当用户否定指令工单,也即指令工单反馈信息表征的对指令工单的确认结果为否定时,设备控制装置中的第二网元会重新根据语句命令信息和指令图谱,计算指令工单,直至用户确认指令工单无误。
基于上述技术方案,本申请实施例能够在将指令工单发送至物联网设备前,使得用户对指令工单进行确认,使得对物联网设备的控制更加准确,进一步提高了用户的物联网设备使用体验。
示例性地,结合图6,如图17所示,本申请提供的设备控制方法还包括以下步骤:
S1701、设备控制装置接收物联网设备发送的目标数据。
其中,目标数据为语句命令信息指示获取的数据。
S1702、设备控制装置根据语句命令信息对目标数据进行语义合成,确定第一语句信息。
可以理解的是,物联网设备向设备控制装置上报目标数据的情况,即表明用户需求通过物联网设备来获取目标数据,例如用户需求物联网设备反馈室内温度或全息影像的亮度。此时,物联网设备上报的目标数据,并不一定是用户能够理解的形式。因此,设备控制装置中的第二网元需要根据S601中终端发送的RCS消息中的语句命令信息,来对目标数据进行语义合成,确定出第一语句消息,以使得用户能够理解该消息。
需要说明的是,语义合成的具体方法可参见现有技术,本申请在此不再赘述。
S1703、设备控制装置向终端发送第一语句信息。
示例性地,具体S1701-S1703的信令流程为:当物联网设备反馈所需要的数据给物联管理平台后(例如:学生发RCS富媒体消息给网盘:数学老师留的家庭作业储存在网盘的什么地方?)云盘反馈给对应的位置<ftp:10.24.35/math/homework.2022.0327>给管理该网盘的物联管理平台,物联管理平台将该数据发送到第二网元,第二网元进行语义合成:<数学老师留的家庭作业储存在网盘的ftp:10.24.35/math/homework.2022.0327>,并把这个内容反馈给MaaP中物联管理平台部署的chatbot;chatbot随后要与终端建立SIP信令联系:即从网络侧发送SIP:INVITE REQEST信令到CSFS网元,CSFS网元随后与终端进行通信,网络侧MaaP反馈SIP:100TRYING,SIP:180 RINGING以及SIP:200OK信令;终端再次向网络CSFS发送SIP:ACK信令确认承载建立;承载建立后再建立MaaP会话连接:网络侧MaaP会给用户终端对应的CSFS发送MSRP:request会话建立的请求,用户终端侧的CSFS收到请求后会给MaaP回复MSRP:200 OK的响应。此时MSRP会话成功建立,chatbot可以将合成的语句向终端发送RCS-MSRP消息。由此,用户能够在终端显示的发送的RCS消息会话界面再次收到新的chatbot的回复消息。
基于上述技术方案,本申请实施例能够在物联网设备反馈用户需求获取的目标数据时,来对目标数据进行语义合成,确定用户能够理解的消息,进一步提高了用户的物联网设备使用体验。
本申请实施例可以根据上述方法示例对设备控制装置进行功能模块或者功能单元的划分,例如,可以对应各个功能划分各个功能模块或者功能单元,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块或者功能单元的形式实现。其中,本申请实施例中对模块或者单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。
如图18所示,为本申请实施例提供的一种设备控制装置1800的结构示意图,该设备控制装置1800包括:接收单元1801、处理单元1802、发送单元1803。
其中,接收单元1801,用于接收来自终端的人机交互消息。
处理单元1802,用于根据人机交互消息,确定指令工单;指令工单用于对物联网设备进行控制。
发送单元1803,用于向物联网设备发送指令工单。
在一种可能的实现方式中,处理单元1802,还用于根据语句命令信息和指令图谱,确定指令工单。其中,指令图谱用于表征语句命令信息与指令工单之间的映射关系。
在一种可能的实现方式中,接收单元1801,还用于接收来自终端的请求信息。
在一种可能的实现方式中,处理单元1802,还用于根据终端的请求信息,确定物联网设备的ID。
在一种可能的实现方式中,处理单元1802,还用于确定映射关系表。其中,映射关系表用于表征物联网设备的ID和物联管理平台的URL链接之间的对应关系。物联管理平台用于控制物联网设备。
在一种可能的实现方式中,处理单元1802,还用于根据物联网设备的ID和映射关系表,确定物联管理平台的URL链接。
在一种可能的实现方式中,处理单元1802,还用于根据物联网设备的URL链接,向物联管理平台发送指令工单,以使得物联管理平台向物联网设备发送指令工单。
在一种可能的实现方式中,处理单元1802,还用于构建多个物联网设备的能力图谱。其中,多个物联网设备的能力图谱用于表征多个物联网设备的能力信息,以及多个物联网设备之间的互联关系。
在一种可能的实现方式中,处理单元1802,还用于构建用户行为图谱。其中,用户行为图谱用于表征用户对于物联网设备的使用行为习惯,以及多个用户之间、用户与物联网设备之间的互联关系。
在一种可能的实现方式中,处理单元1802,还用于根据多个物联网设备的能力图谱和用户行为图谱,确定指令图谱。
在一种可能的实现方式中,处理单元1802,还用于根据时间信息、地理位置信息对多个物联网设备的能力图谱和用户行为图谱中,用户与多个物联网设备之间的互联关系进行周期调整。
在一种可能的实现方式中,处理单元1802,还用于根据标注参考数据,对多个物联网设备的能力图谱和用户行为图谱中的实体进行分类标注,以确定指令图谱。其中,标注参考数据包括以下一项或多项:指令信息段、文件地址链接、时间参数、数量参数。
在一种可能的实现方式中,处理单元1802,还用于根据指令工单,确定指令工单确认信息。
在一种可能的实现方式中,发送单元1803,还用于发送指令工单确认信息。指令工单确认信息用于指示终端对指令工单进行确认。
在一种可能的实现方式中,接收单元1801,还用于接收指令工单反馈信息。指令工单反馈信息用于表征终端对指令工单的确认结果。
在一种可能的实现方式中,接收单元1801,还用于接收物联网设备发送的目标数据。目标数据为语句命令信息指示获取的数据。
在一种可能的实现方式中,处理单元1802,还用于根据语句命令信息对目标数据进行语义合成,确定第一语句信息。
在一种可能的实现方式中,发送单元1803,还用于向终端发送第一语句信息。
在一种可能的实现方式中,设备控制装置1800还可以包括存储单元(图18中以虚线框示出),该存储单元存储有程序或指令,当处理单元1802执行该程序或指令时,使得设备控制装置1800可以执行上述方法实施例所述的设备控制方法。
此外,图18所述的设备控制装置的技术效果可以参考上述实施例所述的设备控制方法的技术效果,此处不再赘述。
在通过硬件实现时,本申请实施例中的接收单元1801、处理单元1802、发送单元1803可以集成在处理器上。具体实现方式如图19所示。
图19示出了上述实施例中所涉及的设备控制装置的一种可能的结构示意图。该设备控制装置1900包括:处理器1902和通信接口1903。处理器1902用于对设备控制装置的动作进行控制管理,例如,执行上述接收单元1801、处理单元1802、发送单元1803执行的步骤,和/或用于执行本文所描述的技术的其它过程。通信接口1903用于支持设备控制装置与其他网络实体的通信,例如,执行上述接收单元1801、处理单元1802、发送单元1803执行的步骤。设备控制装置还可以包括存储器1901和总线1904,存储器1901用于存储设备控制装置的程序代码和数据。
其中,存储器1901可以是设备控制装置中的存储器等,该存储器可以包括易失性存储器,例如随机存取存储器;该存储器也可以包括非易失性存储器,例如只读存储器,快闪存储器,硬盘或固态硬盘;该存储器还可以包括上述种类的存储器的组合。
上述处理器1902可以是实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。该处理器可以是中央处理器,通用处理器,数字信号处理器,专用集成电路,现场可编程门阵列或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。该处理器也可以是实现计算功能的组合,例如包含一个或多个微处理器组合,DSP和微处理器的组合等。
总线1904可以是扩展工业标准结构(Extended Industry Standard Architecture,EISA)总线等。总线1904可以分为地址总线、数据总线、控制总线等。为便于表示,图19中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。
图19中的设备控制装置还可以为芯片。该芯片包括一个或两个以上(包括两个)处理器1902和通信接口1903。
在一些实施例中,该芯片还包括存储器1901,存储器1901可以包括只读存储器和随机存取存储器,并向处理器1902提供操作指令和数据。存储器1901的一部分还可以包括非易失性随机存取存储器(non-volatile random access memory,NVRAM)。
在一些实施方式中,存储器1901存储了如下的元素,执行模块或者数据结构,或者他们的子集,或者他们的扩展集。
在本申请实施例中,通过调用存储器1901存储的操作指令(该操作指令可存储在操作***中),执行相应的操作。
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的***,装置和单元的具体工作 过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
本申请实施例提供一种包含指令的计算机程序产品,当该计算机程序产品在计算机上运行时,使得该计算机执行上述方法实施例中的设备控制方法。
本申请实施例还提供一种计算机可读存储介质,计算机可读存储介质中存储有指令,当该指令在计算机上运行时,使得该计算机执行上述方法实施例所示的方法流程中的设备控制方法。
其中,计算机可读存储介质,例如可以是但不限于电、磁、光、电磁、红外线、或半导体的***、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机存取存储器(Random Access Memory,RAM)、只读存储器(Read-Only Memory,ROM)、可擦式可编程只读存储器(Erasable Programmable Read Only Memory,EPROM)、寄存器、硬盘、光纤、便携式紧凑磁盘只读存储器(Compact Disc Read-Only Memory,CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合、或者本领域熟知的任何其它形式的计算机可读存储介质。一种示例性的存储介质耦合至处理器,从而使处理器能够从该存储介质读取信息,且可向该存储介质写入信息。当然,存储介质也可以是处理器的组成部分。处理器和存储介质可以位于特定用途集成电路(Application Specific Integrated Circuit,ASIC)中。在本申请实施例中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行***、装置或者器件使用或者与其结合使用。
由于本申请的实施例中的设备控制装置、计算机可读存储介质、计算机程序产品可以应用于上述方法,因此,其所能获得的技术效果也可参考上述方法实施例,本申请实施例在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的***、设备和方法,可以通过其它的方式实现。例如,以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个***,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应该以权利要求的保护范围为准。

Claims (22)

  1. 一种设备控制方法,其特征在于,所述方法包括:
    接收来自终端的人机交互消息;
    根据所述人机交互消息,确定指令工单;所述指令工单用于对物联网设备进行控制;
    向所述物联网设备发送所述指令工单。
  2. 根据权利要求1所述的方法,其特征在于,所述人机交互消息包括所述物联网设备的身份标识ID和语句命令信息;所述语句命令信息为所述终端响应于用户的交互操作后确定。
  3. 根据权利要求2所述的方法,其特征在于,所述根据所述人机交互消息,确定指令工单,具体包括:
    根据所述语句命令信息和指令图谱,确定指令工单;其中,所述指令图谱用于表征所述语句命令信息与所述指令工单之间的映射关系。
  4. 根据权利要求3所述的方法,其特征在于,在所述接收来自终端的人机交互消息之前,所述方法还包括:
    接收来自所述终端的请求信息;
    根据所述终端的请求信息,确定所述物联网设备的ID。
  5. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    确定映射关系表;其中,所述映射关系表用于表征所述物联网设备的ID和物联管理平台的URL链接之间的对应关系;所述物联管理平台用于控制所述物联网设备。
  6. 根据权利要求5所述的方法,其特征在于,所述向所述物联网设备发送所述指令工单,具体包括:
    根据所述物联网设备的ID和所述映射关系表,确定所述物联管理平台的URL链接;
    根据所述物联网设备的URL链接,向所述物联管理平台发送所述指令工单,以使得所述物联管理平台向所述物联网设备发送所述指令工单。
  7. 根据权利要求6所述的方法,其特征在于,所述方法还包括:
    构建多个物联网设备的能力图谱;其中,所述多个物联网设备的能力图谱用于表征所述多个物联网设备的能力信息,以及所述多个物联网设备之间的互联关系;
    构建用户行为图谱;其中,所述用户行为图谱用于表征所述用户对于所述物联网设备的使用行为习惯,以及多个所述用户之间、所述用户与所述物联网设备之间的互联关系;
    根据所述多个物联网设备的能力图谱和所述用户行为图谱,确定所述指令图谱。
  8. 根据权利要求7所述的方法,其特征在于,所述根据所述多个物联网设备的能力图谱和所述用户行为图谱,确定所述指令图谱,具体包括:
    根据时间信息、地理位置信息对所述多个物联网设备的能力图谱和所述用户行为图谱中,所述用户与所述多个物联网设备之间的互联关系进行周期调整;
    根据标注参考数据,对所述多个物联网设备的能力图谱和所述用户行为图谱中的实体进行分类标注,以确定所述指令图谱;其中,所述标注参考数据包括以下一项或 多项:指令信息段、文件地址链接、时间参数、数量参数。
  9. 根据权利要求8所述的方法,其特征在于,在所述向物联网设备发送所述指令工单之前,所述方法还包括:
    根据所述指令工单,确定指令工单确认信息;
    发送所述指令工单确认信息;所述指令工单确认信息用于指示所述终端对所述指令工单进行确认;
    接收指令工单反馈信息;所述指令工单反馈信息用于表征所述终端对所述指令工单的确认结果。
  10. 根据权利要求9所述的方法,其特征在于,所述方法还包括:
    接收所述物联网设备发送的目标数据;所述目标数据为所述语句命令信息指示获取的数据;
    根据所述语句命令信息对所述目标数据进行语义合成,确定第一语句信息;
    向所述终端发送所述第一语句信息。
  11. 一种设备控制装置,其特征在于,所述设备控制装置包括:接收单元、处理单元和发送单元;
    所述接收单元,用于接收来自终端的人机交互消息;
    所述处理单元,用于根据所述人机交互消息,确定指令工单;所述指令工单用于对物联网设备进行控制;
    所述发送单元,用于向所述物联网设备发送所述指令工单。
  12. 根据权利要求11所述的设备控制装置,其特征在于,所述人机交互消息包括所述物联网设备的身份标识ID和语句命令信息;所述语句命令信息为所述终端响应于用户的交互操作后确定。
  13. 根据权利要求12所述的设备控制装置,其特征在于,
    所述处理单元,还用于根据所述语句命令信息和指令图谱,确定指令工单;其中,所述指令图谱用于表征所述语句命令信息与所述指令工单之间的映射关系。
  14. 根据权利要求13所述的设备控制装置,其特征在于,
    所述接收单元,还用于接收来自所述终端的请求信息;
    所述处理单元,还用于根据所述终端的请求信息,确定所述物联网设备的ID。
  15. 根据权利要求11所述的设备控制装置,其特征在于,
    所述处理单元,还用于确定映射关系表;其中,所述映射关系表用于表征所述物联网设备的ID和物联管理平台的URL链接之间的对应关系;所述物联管理平台用于控制所述物联网设备。
  16. 根据权利要求15所述的设备控制装置,其特征在于,
    所述处理单元,还用于根据所述物联网设备的ID和所述映射关系表,确定所述物联管理平台的URL链接;
    所述处理单元,还用于根据所述物联网设备的URL链接,向所述物联管理平台发送所述指令工单,以使得所述物联管理平台向所述物联网设备发送所述指令工单。
  17. 根据权利要求16所述的设备控制装置,其特征在于,
    所述处理单元,还用于构建多个物联网设备的能力图谱;其中,所述多个物联网 设备的能力图谱用于表征所述多个物联网设备的能力信息,以及所述多个物联网设备之间的互联关系;
    所述处理单元,还用于构建用户行为图谱;其中,所述用户行为图谱用于表征所述用户对于所述物联网设备的使用行为习惯,以及多个所述用户之间、所述用户与所述物联网设备之间的互联关系;
    所述处理单元,还用于根据所述多个物联网设备的能力图谱和所述用户行为图谱,确定所述指令图谱。
  18. 根据权利要求17所述的设备控制装置,其特征在于,
    所述处理单元,还用于根据时间信息、地理位置信息对所述多个物联网设备的能力图谱和所述用户行为图谱中,所述用户与所述多个物联网设备之间的互联关系进行周期调整;
    所述处理单元,还用于根据标注参考数据,对所述多个物联网设备的能力图谱和所述用户行为图谱中的实体进行分类标注,以确定所述指令图谱;其中,所述标注参考数据包括以下一项或多项:指令信息段、文件地址链接、时间参数、数量参数。
  19. 根据权利要求18所述的设备控制装置,其特征在于,
    所述处理单元,还用于根据所述指令工单,确定指令工单确认信息;
    所述发送单元,还用于发送所述指令工单确认信息;所述指令工单确认信息用于指示所述终端对所述指令工单进行确认;
    所述接收单元,还用于接收指令工单反馈信息;所述指令工单反馈信息用于表征所述终端对所述指令工单的确认结果。
  20. 根据权利要求19所述的设备控制装置,其特征在于,
    所述接收单元,还用于接收所述物联网设备发送的目标数据;所述目标数据为所述语句命令信息指示获取的数据;
    所述处理单元,还用于根据所述语句命令信息对所述目标数据进行语义合成,确定第一语句信息;
    所述发送单元,还用于向所述终端发送所述第一语句信息。
  21. 一种设备控制装置,其特征在于,包括:处理器和通信接口;所述通信接口和所述处理器耦合,所述处理器用于运行计算机程序或指令,以实现如权利要求1-10中任一项所述的设备控制方法。
  22. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质中存储有指令,当计算机执行该指令时,该计算机执行如权利要求1-10中任一项所述的设备控制方法。
PCT/CN2023/119372 2022-09-20 2023-09-18 一种设备控制方法、装置、存储介质 WO2024061155A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211142929.9 2022-09-20
CN202211142929.9A CN115567567A (zh) 2022-09-20 2022-09-20 一种设备控制方法、装置、存储介质

Publications (1)

Publication Number Publication Date
WO2024061155A1 true WO2024061155A1 (zh) 2024-03-28

Family

ID=84741283

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/119372 WO2024061155A1 (zh) 2022-09-20 2023-09-18 一种设备控制方法、装置、存储介质

Country Status (2)

Country Link
CN (1) CN115567567A (zh)
WO (1) WO2024061155A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115567567A (zh) * 2022-09-20 2023-01-03 中国联合网络通信集团有限公司 一种设备控制方法、装置、存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020213758A1 (ko) * 2019-04-17 2020-10-22 엘지전자 주식회사 음성으로 상호작용하는 인공 지능 장치 및 그 방법
CN112151035A (zh) * 2020-10-14 2020-12-29 珠海格力电器股份有限公司 一种语音控制方法、装置、电子设备及可读存储介质
CN113127609A (zh) * 2019-12-31 2021-07-16 华为技术有限公司 语音控制方法、装置、服务器、终端设备及存储介质
CN113220202A (zh) * 2021-05-31 2021-08-06 中国联合网络通信集团有限公司 一种物联网设备的控制方法和装置
CN114743554A (zh) * 2022-06-09 2022-07-12 武汉工商学院 基于物联网的智能家居交互方法及装置
CN115567567A (zh) * 2022-09-20 2023-01-03 中国联合网络通信集团有限公司 一种设备控制方法、装置、存储介质

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10541958B2 (en) * 2015-08-05 2020-01-21 Facebook, Inc. Controlling a device cloud
CN107872379A (zh) * 2016-09-28 2018-04-03 中兴通讯股份有限公司 一种基于rcs消息的终端控制方法及装置
WO2018158047A1 (en) * 2017-02-28 2018-09-07 Nokia Solutions And Networks Oy IMS-BASED IoT INTERACTION
CN112637024A (zh) * 2020-12-03 2021-04-09 珠海格力电器股份有限公司 控制方法、装置、电子设备及存储介质
CN112965603A (zh) * 2021-03-26 2021-06-15 南京阿凡达机器人科技有限公司 一种人机交互的实现方法和***
CN113111186A (zh) * 2021-03-31 2021-07-13 青岛海尔科技有限公司 用于控制家电设备的方法、存储介质及电子设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020213758A1 (ko) * 2019-04-17 2020-10-22 엘지전자 주식회사 음성으로 상호작용하는 인공 지능 장치 및 그 방법
CN113127609A (zh) * 2019-12-31 2021-07-16 华为技术有限公司 语音控制方法、装置、服务器、终端设备及存储介质
CN112151035A (zh) * 2020-10-14 2020-12-29 珠海格力电器股份有限公司 一种语音控制方法、装置、电子设备及可读存储介质
CN113220202A (zh) * 2021-05-31 2021-08-06 中国联合网络通信集团有限公司 一种物联网设备的控制方法和装置
CN114743554A (zh) * 2022-06-09 2022-07-12 武汉工商学院 基于物联网的智能家居交互方法及装置
CN115567567A (zh) * 2022-09-20 2023-01-03 中国联合网络通信集团有限公司 一种设备控制方法、装置、存储介质

Also Published As

Publication number Publication date
CN115567567A (zh) 2023-01-03

Similar Documents

Publication Publication Date Title
WO2024061155A1 (zh) 一种设备控制方法、装置、存储介质
CN108449418A (zh) 一种混合云平台管理***及方法
CN106686339A (zh) 电子会议智能
US20040117513A1 (en) Intelligent total access system
Rudolph Project oxygen: Pervasive, human-centric computing–an initial experience
US11888941B2 (en) Function-as-a-service for two-way communication systems
CN112084315B (zh) 问答互动方法、装置、存储介质及设备
CN106293554A (zh) 一种云打印***及云打印机
CN110415569A (zh) 校园课堂共享教育方法和***
CN110019731A (zh) 智能交互方法、装置、终端设备及存储介质
CN206773993U (zh) 一种远程教育***
CN115022304B (zh) 基于rpa和ai实现ia的跨平台文件处理方法、装置和***
CN111599228A (zh) 一种在线教育培训***、设备及可读存储介质
KR102282798B1 (ko) 지능형 학습서비스장치 및 그 장치의 구동방법
KR102056774B1 (ko) 온라인 강의 기반 학생 간 소통 방법, 그리고 이를 위한 스마트 디바이스, 서버 및 시스템
CN109542647A (zh) 信息发送管理方法及装置、电子设备、存储介质
Chalmers Contextual mediation to support ubiquitous computing
US10938973B2 (en) Method and system for searching for object in network
CN107646199A (zh) 邻域知悉网络数据链路简档
CN112866294B (zh) 一种多协议适配方法、装置及可读存储介质
CN108833256A (zh) 一种即时通讯方法及***
CN107920057A (zh) 一种智能数字教育终端***
Bouyakoub et al. A similarity measure for the negotiation in web services
CN111200552B (zh) 一种即时通讯方法及其装置、设备和存储介质
WO2021056852A1 (zh) 考勤方法、装置、设备、***及计算机存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23867444

Country of ref document: EP

Kind code of ref document: A1