CN109784018B

CN109784018B - Operation identification method and device and electronic equipment

Info

Publication number: CN109784018B
Application number: CN201910054994.8A
Authority: CN
Inventors: 高田
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2015-09-25
Filing date: 2015-09-25
Publication date: 2021-07-16
Anticipated expiration: 2035-09-25
Also published as: CN105224837B; CN105224837A; CN109784018A

Abstract

The invention discloses an operation identification method, an operation identification device and electronic equipment, wherein the method comprises the following steps: when information indicating that the state of the controlled equipment is changed is detected, determining the occurrence time; determining operator characteristic information corresponding to the occurrence time and aiming at the operation of a control device, wherein the control device is a device for controlling the state change of the controlled device by sending a control instruction to the controlled device; determining the corresponding relation between the state change information of the controlled equipment and the operator characteristic information; the invention realizes the identification of the user equipment for operating the controlled equipment.

Description

Operation identification method and device and electronic equipment

The present application is a divisional application of the invention having an application date of 2015, 09/25, entitled "a method, an apparatus, and an electronic device for operation recognition", and an application number of 201510622877.9.

Technical Field

The invention relates to the technical field of information processing, in particular to an operation identification method and device and electronic equipment.

Background

Various controlled devices gradually enter people's lives, and people can realize the control of the controlled devices in various operation modes, such as voice control, mobile phone Application (APP) control, remote controller operation, intelligent switch operation and the like. In practical application, if the user identity for operating the controlled device can be identified, complete historical usage record data for the controlled device can be obtained, which is further beneficial to establishing a control system of the controlled device and is convenient for user behavior prediction.

In the prior art, although the identification of the user identity of the controlled device can be realized in some scenes, for example, when the user uses the mobile phone APP to control the controlled device, the user name of the login APP can be recorded, but there are many scenes in which the identification of the user identity of the controlled device cannot be realized, such as remote controller operation, switch operation, and the like.

Therefore, how to realize the identification of the user identity in the above scenario becomes a technical problem to be solved urgently by those skilled in the art.

Disclosure of Invention

In view of this, the present invention provides an operation identification method, an operation identification device and an electronic device, so as to identify the user identity of an operation controlled device.

In order to achieve the purpose, the invention provides the following technical scheme:

an operation identification method comprising:

when information indicating that the state of the controlled equipment is changed is detected, determining the occurrence time;

determining operator characteristic information corresponding to the occurrence time and aiming at the operation of a control device, wherein the control device is a device for controlling the state change of the controlled device by sending a control instruction to the controlled device;

and determining the corresponding relation between the state change information of the controlled equipment and the operator characteristic information.

Preferably, the determining the correspondence between the state change information of the controlled device and the operator characteristic information includes:

determining a user identifier for controlling the state change of the controlled device based on the operator characteristic information;

and determining the corresponding relation between the state change information of the controlled equipment and the user identification.

Preferably, the determining the operator characteristic information for the operation of the control device corresponding to the occurrence time includes:

determining a target user who operates the control device at the occurrence time and is acquired by a first acquisition device; the first acquisition equipment is positioned in a preset space range where the control equipment is positioned;

acquiring operator characteristic information of the target user;

or the control equipment is specifically provided with second acquisition equipment;

the determining of the operator characteristic information corresponding to the occurrence time and aiming at the operation of the control equipment specifically includes:

and acquiring the operator characteristic information acquired by the second acquisition equipment at the occurrence time.

Preferably, the determining the operation characteristic information for the operation of the control device corresponding to the occurrence time includes:

acquiring user activity parameters acquired by at least two third acquisition devices corresponding to the occurrence time;

determining a target user activity parameter that controls a change in a state of the controlled device based on the user activity parameter;

the determining the corresponding relation between the state change information of the controlled device and the operator characteristic information comprises:

determining a user identifier of a third acquisition device for acquiring the target activity parameter;

Preferably, the at least two third acquisition devices are respectively arranged at first parts of corresponding users, and the user activity parameters are used for representing activity states of the users where the third acquisition devices are located;

the first portion is a portion corresponding to an operation body of the user, and the operation body is specifically configured to control the control device so that the control device generates the control instruction.

Preferably, the determining a target user activity parameter for controlling a state change of the controlled device based on the user activity parameter includes:

judging whether the change mode of the user activity parameter meets a preset change mode or not;

and determining the collected user activity parameters meeting the preset change mode as target user activity parameters.

determining a standard user activity parameter that causes a change in a state of the controlled device;

and determining the target user activity parameter matched with the standard user parameter.

Preferably, the determining a standard user activity parameter that changes the state of the controlled device includes:

determining an operation mode which causes the state of the controlled equipment to change;

and acquiring standard user activity parameters corresponding to the operation modes.

Preferably, the method further comprises the following steps:

monitoring behavior operations occurring for the control device in real time;

determining a time range containing the occurrence time;

and acquiring the operator characteristic information for the control equipment operation in the time range.

Preferably, the determining the corresponding relationship between the state change information of the controlled device and the operator characteristic information specifically includes:

determining a device identifier of the controlled device and a state change mode of the controlled device;

and determining the corresponding relation between the equipment identification, the state change mode and the operator characteristic information.

Preferably, after determining the corresponding relationship between the state change information of the controlled device and the operator characteristic information, the method further includes:

monitoring image data of a space range where the controlled equipment is located;

determining an active first object based on the image data;

determining characteristic information of the first object;

determining state change information of the controlled equipment corresponding to the characteristic information of the first object based on the corresponding relation;

controlling a current state of the controlled device based on the state change information.

searching a first corresponding relation set of the operator characteristic information in a pre-stored main set; the first corresponding relation set comprises a plurality of subsets, and each subset comprises state change information of at least two controlled devices with a sequential control sequence; wherein, the operator characteristic information of different corresponding relation sets is different;

determining a first subset containing the state change information in the first corresponding relation set;

determining second state change information of a second controlled device which is adjacent to the controlled device in a control sequence and is later than the controlled device in the first subset;

controlling a current state of the second controlled device based on the second state change information.

An electronic device, comprising:

timing means for determining a current time;

the controller is used for determining the current time of the timing device as the occurrence time when information indicating that the state of the controlled equipment is changed is detected, determining operator characteristic information corresponding to the occurrence time and aiming at the operation of the control equipment, and determining the corresponding relation between the state change information of the controlled equipment and the operator characteristic information;

the control device is a device for controlling the state change of the controlled device by sending a control instruction to the controlled device.

Preferably, the method further comprises the following steps:

and the memory is used for storing the corresponding relation.

Preferably, the controller is configured to connect to a first acquisition device, determine a target user who is acquired by the first acquisition device and operates the control device at the occurrence time, and acquire operator characteristic information of the target user; the first acquisition equipment is positioned in a preset space range where the control equipment is positioned;

or the controller is used for being connected with second acquisition equipment to acquire the operator characteristic information acquired by the second acquisition equipment at the occurrence time; wherein the second acquisition device is disposed on the control device.

Preferably, the system further comprises a first communication device for communicating with at least two third acquisition devices;

the controller is specifically configured to acquire, through the first communication device, user activity parameters adopted by at least two third acquisition devices corresponding to the occurrence time, and determine, based on the user activity parameters, target user activity parameters that control a change in state of the controlled device, thereby determining a user identifier of the third acquisition device that acquires the target activity parameters, and establishing a correspondence between state change information of the controlled device and the operator characteristic information.

Preferably, the electronic device is a central control device, and the central control device further includes:

second communication means for communicating with the control device and the controlled device, respectively;

the central control device is used for receiving the control instruction sent by the control device through the second communication device and controlling the state change of the controlled device based on the control instruction.

Preferably, the electronic device is the controlled device, and the controlled device is connected to the control device and configured to control a state change of the electronic device based on the control instruction after receiving the control instruction sent by the control device.

An operation recognition apparatus comprising:

a detection determination unit for determining an occurrence time when information indicating that a state of a controlled device has changed is detected;

a first determining unit, configured to determine operator characteristic information for an operation of a control device, corresponding to the occurrence time, where the control device is a device configured to control a state change of the controlled device by sending a control instruction to the controlled device;

and the second determining unit is used for determining the corresponding relation between the state change information of the controlled equipment and the operator characteristic information.

As can be seen from the foregoing technical solutions, compared with the prior art, an embodiment of the present invention provides an operation identification method, where when information indicating a state change of a controlled device is detected, an occurrence time is determined, so as to determine operator characteristic information for controlling a device operation, which corresponds to the occurrence time, and since a control device is a device for controlling a state change of the controlled device by sending the control device to the controlled device, the operator characteristic information for controlling the device operation can be used to characterize a user identity controlling the state change of the controlled device, and then, by determining a corresponding relationship between the state change information of the controlled device and the operator characteristic information, the identification of the user identity controlling the state change of the controlled device is implemented.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.

Fig. 1 is a schematic flowchart of an operation identification method according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of an operation identification method according to a third embodiment of the present invention;

fig. 3 is a flowchart illustrating an implementation manner of determining a target user activity parameter of a state change of a controlled device based on the user activity parameter according to a third embodiment of the present invention;

fig. 4 is a flowchart illustrating another implementation manner of determining a target user activity parameter of a state change of a controlled device based on the user activity parameter according to a third embodiment of the present invention;

fig. 5 is a schematic flowchart of an operation identification method according to a fourth embodiment of the present invention;

fig. 6 is a schematic flowchart of an operation identification method according to a fifth embodiment of the present invention;

fig. 7 is a schematic flowchart of an operation identification method according to a sixth embodiment of the present invention;

fig. 8 is a schematic structural diagram of an electronic device according to a seventh embodiment of the present invention;

fig. 9 is a schematic structural diagram of an electronic device in an eighth implementation manner according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of an electronic device in a second implementation manner according to an eighth embodiment of the present invention;

fig. 11 is a schematic structural diagram of an electronic device in a third implementation manner according to an eighth implementation manner of the present invention;

fig. 12 is a schematic structural diagram of a central control apparatus according to a ninth embodiment of the present invention;

fig. 13 is a schematic structural diagram of an operation recognition device according to a tenth embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The embodiment of the invention discloses an operation identification method, which comprises the following steps: when information indicating that the state of the controlled equipment is changed is detected, determining the occurrence time; determining operator characteristic information corresponding to the occurrence time and aiming at the operation of a control device, wherein the control device is a device for controlling the state change of the controlled device by sending a control instruction to the controlled device; and determining the corresponding relation between the state change information of the controlled equipment and the operator characteristic information, and realizing the identification of the user identity for controlling the state change of the controlled equipment by the invention.

It should be noted that the operation identification method may be applied to a controlled device, where the controlled device is a device whose state needs to be controlled by a control device, and for example, the controlled device may be an intelligent air conditioner controlled by a remote controller, an intelligent electric lamp controlled by a switch, or the like; the operation identification method may also be applied to a central control device, where the central control device is an intermediate control medium between a controlled device and a control device, and is used to control at least one controlled device, and specifically, can control a state of a corresponding controlled device based on a control instruction of the control device, for example, the central control device may be a server. For convenience of description, in the following method embodiments, the main body of the method is described as a system, that is, the system may be a system of a controlled device or a system of a central control device.

Embodiments of the present application will be described in detail below with reference to the accompanying drawings.

The embodiment of the invention discloses an operation identification method, which comprises the following processes as shown in figure 1:

step 101: when information indicating that the state of the controlled equipment is changed is detected, determining the occurrence time;

wherein the state change of the controlled device is controlled by the control device, and the operator can make the state change of the controlled device by operating the control device.

It should be noted that the controlled device may control the control device in a wired manner, for example, the controlled device is a wall switch, and the wall switch is connected to the controlled device through a cable; of course, the controlled device may also control the control device in a wireless manner, for example, the controlled device is an infrared remote controller.

Specifically, in the process of detecting whether the state of the controlled device changes, the system may directly detect the state of the controlled device itself, or may indirectly detect whether the state of the controlled device changes, that is, determine whether the state of the controlled device changes by detecting the state of a control device for controlling the controlled device.

The change of the state of the controlled equipment specifically means that the current state of the controlled equipment is changed from one state to another state; the state change of the controlled device can be any state change or a preset state change, and the specific situation can be set according to the actual situation.

Taking the controlled device as the intelligent air conditioner as an example, if the change of the controlled device to any state occurs, the information indicating the change of the state of the intelligent air conditioner is detected, such as the change of the intelligent air conditioner from the off state to the on state, the decrease and increase of the current control temperature of the intelligent air conditioner, the change of the intelligent air conditioner from one output mode to another output mode, and the like. If the controlled device is changed to the preset state, if the preset intelligent air conditioner is changed from the off state to the on state, the state of the intelligent air conditioner is changed, and the system does not determine that the state of the intelligent air conditioner is changed when the state of the intelligent air conditioner is changed.

And when the information indicating that the state of the controlled equipment is changed is detected, determining the current time as the time when the state of the controlled equipment is changed.

Step 102: determining operator characteristic information corresponding to the occurrence time for controlling the operation of the device;

Since the change of state of the controlled device is controlled by the control device, the operator characteristic information for the operation of the control device, corresponding to the occurrence time, can characterize the identity of the operator who caused the change of state of the controlled device by operating the control device.

It is emphasized that the control device in the present invention is a device which does not have an identification mark, such as a remote controller, a wall switch, etc. This is different from the device with an identification identifier in the prior art, for example, when the existing control device is taken as a mobile phone, when a user uses a mobile phone APP to control a controlled device, the user needs to input a user name to log in to the APP, so as to control the controlled device.

Step 103: determining the corresponding relation between the state change information of the controlled equipment and the characteristic information of the operator;

the state change information of the controlled device can be directly acquired by the system when detecting the information indicating that the state of the controlled device is changed, so that after the characteristic information of the operator is determined, the corresponding relation between the state change information of the controlled device and the characteristic information of the operator can be determined.

After the corresponding relationship between the state change information of the controlled device and the operator characteristic information is determined, the behavior of the user can be predicted on the spot based on the corresponding relationship, that is, the corresponding relationship can be used in a linkage control scene of the controlled device, and the process will be described in detail later. Of course, the corresponding relationship may also be stored, so as to predict the behavior of the user in the future, and correspondingly, the corresponding relationship between the state change information of the controlled device and the operator characteristic information may be specifically determined as follows: and establishing and storing the corresponding relation between the state change information of the controlled equipment and the characteristic information of the operator.

In the present invention, the state change information of the controlled device at least includes a device identifier and a state change mode of the controlled device, and correspondingly, the determining of the corresponding relationship between the state change information of the controlled device and the operator characteristic information includes the following steps: firstly, determining a device identifier of the controlled device and a state change mode of the controlled device; secondly, determining the corresponding relation between the equipment identification, the state change mode and the operator characteristic information.

The device identifier of the controlled device is pre-stored in the controlled device, and when the state of the controlled device changes, the state change mode of the controlled device can be determined, and the device identifier of the controlled device is acquired, so that the corresponding relation among the device identifier, the state change mode and the operator characteristic information is determined.

Optionally, the state change information of the controlled device may further include occurrence time, and accordingly, a correspondence between the device identifier, the state change manner, the occurrence time, and the operator characteristic information may be determined.

In the process of determining the corresponding relationship between the state change information of the controlled device and the operator characteristic information, the operator characteristic information can also be referred to by the user identifier, that is, the process of determining the corresponding relationship between the state change information of the controlled device and the characteristic information of the operator comprises the following steps:

firstly, determining a user identifier for controlling the state change of the controlled equipment based on the operator characteristic information; secondly, determining the corresponding relation between the state change information of the controlled equipment and the user identification.

Specifically, the system may store in advance a corresponding relationship between various operator characteristic information and a user identifier, and the user identifier has uniqueness. After the operator characteristic information is determined, the user identifier corresponding to the operator characteristic information can be searched, so that the corresponding relation between the state change information of the controlled device and the user identifier is established and stored.

In this embodiment, the occurrence time is determined when the information indicating the state change of the controlled device is detected, so as to determine the operator characteristic information for the operation of the control device corresponding to the occurrence time, and since the control device is a device for controlling the state change of the controlled device by transmitting the control device to the controlled device, the operator characteristic information for the operation of the control device can be used to characterize the identity of the user operating the controlled device, and then, the identity of the user operating the controlled device is recognized by determining the corresponding relationship between the state change information of the controlled device and the operator characteristic information.

In the present invention, there are various implementation manners for determining the operator characteristic information, and the following are respectively detailed below:

the embodiment two of the invention discloses an operation identification method, which is used for describing two implementation modes for determining the characteristic information of an operator, and specifically comprises the following steps:

in a first implementation manner, the determining the operator characteristic information corresponding to the occurrence time for controlling the operation of the device in the first embodiment includes the following processes:

firstly, determining a target user who operates the control device at the occurrence time and is acquired by first acquisition equipment; and secondly, acquiring the operator characteristic information of the target user.

The first acquisition equipment is equipment located in a preset space range where the control equipment is located.

Specifically, the first acquisition device can monitor and acquire the preset space range where the control device is located in real time, and when the state of the controlled device changes, the target user who operates the control device and is acquired by the first acquisition device can be determined, so that the operator characteristic information of the target user can be acquired.

The first acquisition device is taken as a camera, the control device is taken as an on-wall switch for explanation, specifically, the camera is arranged at a certain position capable of monitoring the operation of an operator on the on-wall switch, when a person operates the on-wall switch to change the state of the intelligent lamp controlled by the on-wall switch, the system can determine a target user who operates the on-wall switch and acquires the operator characteristic information of the target user, such as image information of the target user.

In a second implementation manner, the determining of the operator characteristic information corresponding to the occurrence time and aiming at the operation of the control device in the first implementation manner specifically includes: and acquiring the operator characteristic information acquired by the second acquisition equipment at the occurrence time.

The second capturing device is a device provided on the control device, and in particular, the second capturing device may be provided at a position which is usually touched by an operator when the controlled device is controlled by the control device.

Wherein, the second collection equipment can be the fingerprint collection appearance, can be used for gathering operator's fingerprint information. Of course, the present invention is not limited to fingerprint collectors, and other devices capable of collecting characteristic information of an operator are within the scope of the present invention.

The third embodiment of the invention discloses an operation identification method which is used for specifically describing a third implementation mode for determining the characteristic information of an operator.

As shown in fig. 2, an operation recognition method includes the following processes:

step 201: when information indicating that the state of the controlled equipment is changed is detected, determining the occurrence time;

step 202: acquiring user activity parameters acquired by at least two third acquisition devices corresponding to the occurrence time;

the at least two third acquisition devices are respectively arranged at the first parts of corresponding users, and the user activity parameters are used for representing the activity states of the users where the third acquisition devices are located; the first portion is a portion corresponding to an operation body of a user, and the operation body is specifically configured to control the control device so that the control device generates the control instruction.

The third acquisition equipment can acquire the user activity parameters of the operation body for controlling the operation of the equipment because the third acquisition equipment is worn by the user to which the operation body belongs.

For example, the third acquiring device is a smart band, the user wears the third acquiring device on the wrist, at least two family members in one family wear the smart band, and when a family member operates the control device by wearing the smart band, so that the state of the controlled device changes, the system can acquire the user activity parameters acquired by all the smart bands in the family to determine which family member operates the control device.

Step 203: determining a target user activity parameter that controls a change in a state of the controlled device based on the user activity parameter;

and determining a target user activity parameter matched with the state change of the controlled equipment based on the user activity parameter, wherein the user to which the third acquisition equipment for acquiring the target user activity parameter belongs is the user for operating the control equipment.

Step 204: determining a user identifier of a third acquisition device for acquiring the target activity parameter;

each third acquisition device stores therein a user identifier for characterizing a user to which the third acquisition device belongs, and therefore, the obtained user identifier stored by the target acquisition device is used for characterizing a user identity of the operation control device.

Step 205: and determining the corresponding relation between the state change information of the controlled equipment and the user identification.

The determining of the corresponding relationship between the state change information of the controlled device and the user identifier may specifically be: and establishing and storing the corresponding relation between the state change information of the controlled equipment and the user identification.

In the invention, the user identification of the third acquisition device for acquiring the target activity parameter can represent the identity identification of the user operating the controlled device, so that the identity of the user operating the controlled device is identified by determining the corresponding relation between the state change information of the controlled device and the user identification.

Fig. 3 is a flowchart illustrating an implementation manner of determining a target user activity parameter of a state change of a controlled device based on the user activity parameter, including the following steps:

step 301: judging whether the change mode of the user activity parameter meets a preset change mode or not;

after the user activity parameters of the at least two third acquisition devices are acquired, it is required to determine which user activity parameter change mode meets the preset change mode, where the preset change mode is used to represent an activity change mode that should occur to a user who operates the control device to change the state of the controlled device, and the preset change mode can be specifically set according to an actual situation.

Step 302: and determining the collected user activity parameters meeting the preset change mode as target user activity parameters.

The user wearing the third acquisition device which acquires the user activity parameters which do not satisfy the preset variation mode is not the user who operates the control device to change the state of the controlled device, and the user wearing the third acquisition device which acquires the user activity parameters which satisfy the preset variation mode is the user who operates the control device to change the state of the controlled device, so that the user activity parameters which satisfy the preset variation mode are determined to be the target user activity parameters.

In an actual application process, when a user operates a control device to control a controlled device, there may be a common activity change mode, and the activity change modes of different control devices may be different. Taking the control device as an on-wall switch as an example, if a user needs to control the related controlled device by operating the on-wall switch, the user generally needs to walk to the on-wall switch first, then stop to operate the on-wall switch, and finally leave the on-wall switch, that is, the user's activity is a change process of walking-stopping-walking, therefore, for the control device being the on-wall switch, the change mode of walking-stopping-walking can be set as a pre-change mode, and of course, in the pre-change mode, a stay time range can be set so as to determine the accuracy of the target collection device, and the stay time range can be counted in advance through experiments. Taking the control device as a remote controller for example, if a user needs to control the related controlled device by operating the remote controller, the user generally needs to pick up the remote controller, then stop operating the remote controller, and finally put down the remote controller, i.e. the user's activity is a pick-up-stop-put-down variation mode.

It should be noted that, regardless of the above-described variations of go-stop-go, or pick-up-stop-drop, the related activity parameters can be used for representation, and the above is only a simple illustration for easy understanding.

Fig. 4 is a schematic flow chart of another implementation of determining a target user activity parameter for controlling a change in a state of the control device based on the user activity parameter, including the following steps:

step 401: determining a standard user activity parameter that causes a change in a state of the controlled device;

the standard user activity parameter is a standard of a user for judging which third acquisition device for acquiring the user activity parameter belongs to the user who operates the control device so as to change the state of the controlled device.

Specifically, when the user operates the control device to change the state of the controlled device, the standard user activity parameters for operating different control devices are different. In one approach, determining a standard user activity parameter that causes a change in a state of a controlled device includes the following processes:

firstly, determining an operation mode which enables the state of the controlled equipment to be changed; and secondly, acquiring standard user activity parameters corresponding to the operation modes.

The operation mode may correspond to the type of the control device, and if the user operates the remote controller to change the state of the controlled device, the determined operation mode is the remote controller operation mode; and if the user operates the wall switch to change the state of the controlled equipment, determining the operation mode as the wall switch operation mode.

And different operation modes correspond to different standard user activity parameters and are stored in advance, so that the standard user activity parameters corresponding to the operation modes can be acquired after the operation modes which change the state of the controlled equipment are determined.

In determining the operation mode, the system may determine the operation mode in which the state of the controlled device is changed by receiving a control instruction for controlling the state change of the controlled device. If the system receives the control instruction through the cable, the determined operation mode is a wall switch operation mode, and if the system receives the control instruction through infrared, the determined operation mode is an infrared remote controller operation mode. Of course, the control device may also directly send a control instruction carrying a control device identifier to the system, and the system determines the operation mode in which the state of the controlled device is changed according to the control device identifier. The specific setting can be set according to the actual situation, and the invention is not limited.

Step 402: and determining the target user activity parameter matched with the standard user parameter.

And matching each user activity parameter of the obtained user activity parameters of the at least two third acquisition devices with the standard user parameter so as to determine a target user activity parameter matched with the standard user activity parameter, wherein the user to which the third acquisition device for acquiring the target user activity parameter belongs is the user for operating the control device.

The fourth embodiment of the present invention further discloses an operation identification method, as shown in fig. 5, the method includes the following steps:

step 501: monitoring behavior operation occurring aiming at the control equipment in real time;

in order to acquire characteristic information of an operator immediately before the state of the controlled device is changed when the user operates the control device to control the state of the controlled device, it is necessary to monitor a behavior operation occurring in the control device in real time.

Step 502: when information indicating that the state of the controlled equipment is changed is detected, determining the occurrence time;

step 503: determining a time range containing the occurrence time;

in the process that an operator controls the state change of the controlled equipment through the control equipment, the state change of the controlled equipment generally has a certain time delay, so that in order to ensure that the characteristic information of the operator can be obtained in time, a time range corresponding to the occurrence time can be determined based on the occurrence time, wherein the time range is from a first time to a second time, the first time is earlier than the occurrence time, the second time is later than the occurrence time, and the specific time length of the first time which is earlier than the occurrence time and the specific time length of the second time which is later than the occurrence time can be set according to actual conditions. For example, the period of time including the front and rear 10s of the occurrence time is determined as the time range corresponding to the occurrence time.

Step 504: acquiring operator characteristic information for the operation of the control equipment in the time range;

the behavior operation of the control equipment is monitored in real time, so that the characteristic information of the operator before the occurrence time can be acquired, and the characteristic information of the operator after the occurrence time can be acquired after the occurrence time is determined.

Step 505: and determining the corresponding relation between the state change information of the controlled equipment and the operator characteristic information.

Based on the above embodiments, after the user identity of the controlled device is identified, the behavior prediction of the subsequent user can be performed.

Specifically, the fifth embodiment of the present invention further discloses an operation identification method, as shown in fig. 6, the method includes the following processes:

step 601: when information indicating that the state of the controlled equipment is changed is detected, determining the occurrence time;

step 602: determining operator characteristic information corresponding to the occurrence time for controlling the operation of the device;

step 603: determining a device identifier of a controlled device and a state change mode of the controlled device;

step 604: determining the corresponding relation between the equipment identification, the state change mode and the operator characteristic information;

step 605: monitoring image data of a space range where the controlled equipment is located;

specifically, an image capturing device, such as a camera, may be set at a certain position within a spatial range where the controlled device can be monitored, and the image data within the spatial range where the controlled device is located is monitored by the image capturing device.

Step 606: determining an active first object based on the image data;

when the first object which moves is monitored to exist in the space range of the controlled equipment, the first object is determined.

Step 607: determining characteristic information of the first object;

the specific type of the operator characteristic information in the corresponding relationship between the state change information of the controlled device and the operator characteristic information relates to a manner of determining the characteristic information of the first object, and can be specifically set according to actual conditions. Several ways of determination are as follows:

if the operator characteristic information in the corresponding relationship between the state change information of the controlled device and the operator characteristic information is information acquired by an image acquisition device (the first acquisition device in the above embodiment may be an image acquisition device, such as a camera), when determining the characteristic information of the first object, the characteristic information of the moving first object may be determined directly by using the image acquisition device in which the user monitors image data of the spatial range in which the controlled device is located.

It should be noted that the image acquisition device that acquires the operator characteristic information in the correspondence relationship is a device that monitors a preset spatial range in which the control device is located, and the image acquisition device that determines the operator characteristic information of the first object is a device that monitors a spatial range in which the controlled device is located, and the two devices may be different devices, for example, the spatial range in which the control device is located is different from the spatial range in which the controlled device is located; of course, if the spatial range of the control device and the spatial range of the controlled device are the same spatial range, the two devices may be the same device.

If the operator characteristic information in the correspondence between the state change information of the controlled device and the operator characteristic information is acquired by the second acquisition device arranged on the control device, a second correspondence between the image information of different objects and the corresponding characteristic information may be stored in advance, and in the process of determining the characteristic information of the first object, first, the image information of the first object may be determined based on the image data, and then the characteristic information corresponding to the image information of the first object may be searched in the second correspondence.

It should be noted that, if the corresponding relationship between the state change information of the controlled device and the operator characteristic information is the corresponding relationship between the state change information of the controlled device and the user identifier, a third corresponding relationship between the image information of different objects and the corresponding user identifier may also be stored in advance, and the characteristic information of the first object, specifically, the user identifier of the first object, may be determined.

Step 608: determining state change information of the controlled equipment corresponding to the characteristic information of the first object based on the corresponding relation;

step 609: controlling a current state of the controlled device based on the state change information.

After the state change information of the controlled device corresponding to the characteristic information of the first object is found, the current state of the controlled device can be controlled based on the found information, and therefore the user behavior can be predicted without the need of operating the control device by a user.

For the convenience of understanding, an application example is used for illustration, and in particular, the system with the operation identification method can be applied to a home to realize the control of various smart home devices in the home. Taking the control of various controlled devices in a living room as an example, a camera may be disposed at a certain position in the living room, and the camera monitors whether a person is in the living room to move, when it is determined that a person is in the living room to move, the characteristic information of the first object of the movement may be determined, if the first object is mom, the state change information of the controlled device corresponding to the characteristic information of mom is searched, and if the searched state change information of the controlled device is to control the intelligent air conditioner to be turned on, the intelligent air conditioner may be controlled to be turned on, and certainly, if the intelligent air conditioner is already in an on state, the intelligent air conditioner does not need to be controlled again.

It should be noted that, when the state change information includes the occurrence time of the state change of the controlled device, when the state change information of the controlled device corresponding to the user identifier is found, it may be determined whether the occurrence time corresponds to the current time, and in the corresponding case, the state change of the controlled device is controlled to prevent the occurrence of the false control.

As shown in fig. 7, an operation identification method disclosed in the sixth embodiment of the present invention includes the following steps:

step 701: when information indicating that the state of the controlled equipment is changed is detected, determining the occurrence time;

step 702: determining operator characteristic information corresponding to the occurrence time for controlling the operation of the device;

step 703: determining a device identifier of a controlled device and a state change mode of the controlled device;

step 704: determining the corresponding relation between the equipment identification, the state change mode and the operator characteristic information;

step 705: searching a first corresponding relation set of the operator characteristic information in a pre-stored main set;

the main set comprises a plurality of corresponding relation sets, each corresponding relation set comprises a plurality of sub-sets, and each sub-set comprises state change information of at least two controlled devices with a control sequence. That is to say, the found first corresponding relationship set includes a plurality of subsets, and each subset includes state change information of at least two controlled devices having a control sequence in sequence.

It should be noted that the operator characteristic information is different for different sets of correspondence relationships. That is, in order to realize the linkage control of the devices, in the present invention, the linkage control scenes corresponding to different users are determined in advance, so that after the correspondence between the state change information of the controlled device and the operator characteristic information is determined, the control of the next controlled device in the linkage scene of the user to which the operator characteristic information belongs is realized.

For the convenience of understanding, the example of the family member including the member a and the member B is taken as an example for explanation, and the linkage control scene of the member a includes: the intelligent television is opened after the intelligent door is opened, the intelligent air conditioner is closed after the intelligent lamp is opened, and three linkage control scenes of the intelligent door are opened after the intelligent lamp is closed. The linkage control scenes of the member B comprise two linkage control scenes of opening the intelligent computer after opening the intelligent door and pulling up the intelligent curtain after closing the intelligent electric lamp. Then, the main set includes two corresponding relationship sets, one is a corresponding relationship set of the member a, and the corresponding relationship set of the member a includes a subset 1, a subset 2 and a subset 3, where the subset 1 is to turn on the smart door-turn on the smart television, the subset 2 is to turn on the smart lamp-turn off the smart air conditioner, and the subset 3 is to turn off the smart lamp-turn on the smart door. The other is a corresponding relation set of the member B, the corresponding relation set of the member B comprises a subset 1 and a subset 2, wherein the subset 1 is: and (3) opening an intelligent door, opening an intelligent computer, and closing an intelligent lamp, and opening an intelligent curtain in the subset 2. In this embodiment, as in the pre-stored primary set, the corresponding relationship set of the member a is found.

Step 706: determining a first subset containing the state change information in the first corresponding relation set;

if the first set of correspondences includes a plurality of subsets, then a first subset of state change information that includes the determined correspondences of state change information and operator characteristic information may be searched.

Still taking the above application as an example, if the determined correspondence between the state change information and the operator characteristic information is the correspondence between the open intelligent door and the characteristic information of the member a, then the subset including the open intelligent door can be searched in the correspondence set of the member a, and the subset 1 and the subset 3 are determined to be included through the search.

Step 707: determining second state change information of a second controlled device which is adjacent to the controlled device in a control sequence and is later than the controlled device in the first subset;

in the linkage control scenario, the state change of the next controlled device is triggered by the state change of the current controlled device, and therefore, the second state change information of the second controlled device adjacent to the controlled device and later than the controlled device is information for controlling the change of the next controlled device in the linkage control scenario.

Still taking the above application as an example, in the subset 1 and the subset 3, the subset 1 is to open the smart gate first and then open the smart tv, and the subset 3 is to close the smart lamp first and then open the smart gate, obviously, the closed smart lamp in the subset 3 is adjacent to the opened smart gate and is earlier than the information for opening the smart gate, and the opened smart tv in the subset 1 is adjacent to the opened smart gate and is later than the information for opening the smart gate, so that the second state change information can be determined as opening the smart tv.

Step 708: controlling a current state of the second controlled device based on the second state change information.

The second state change information at least includes a device identifier and a state change mode, and therefore, the state of the second controlled device with the device identifier can be controlled to change corresponding to the state change mode.

Therefore, in the invention, the control of the next controlled device under the linkage scene of the user to which the operator characteristic information belongs can be realized through the corresponding relation between the state change information of the controlled device and the operator characteristic information, and the establishment of the control system of the intelligent device is promoted.

Corresponding to the operation identification methods included in the above embodiments, the seventh embodiment of the present invention further discloses an electronic device, as shown in fig. 8, the electronic device includes a timing device 810 and a controller 820; wherein:

a timing device 810 for determining the current time;

and a controller 820 configured to determine, when information indicating that a state of a controlled device is changed is detected, a current time of the timing device as a generation time, determine operator characteristic information for controlling an operation of the controlled device corresponding to the generation time, and determine a correspondence between the state change information of the controlled device and the operator characteristic information.

In the present invention, the controller is configured to determine a corresponding relationship between the state change information of the controlled device and the operator characteristic information, and specifically may be:

the controller is used for determining a user identifier for controlling the state of the controlled device to change based on the operator characteristic information, and determining the corresponding relation between the state change information of the controlled device and the user identifier. The control device is a device for controlling the state change of the controlled device by sending a control instruction to the controlled device.

Optionally, the electronic device may further include a memory for storing the correspondence.

The eighth embodiment of the present invention discloses various implementation manners for determining the operator characteristic information by the controller, and the following are respectively detailed below:

in a first implementation manner, a schematic structural diagram of an electronic device is shown in fig. 9, where the electronic device includes a timing device 910 and a controller 920, where:

the timing device 910 is configured to determine a current time;

the controller 910 is connected to the first collection device 100, and configured to determine, when detecting information indicating that a state of a controlled device changes, a current time of the timing device as a generation time, determine a target user who operates the control device at the generation time and is collected by the first collection device 100, and obtain operator characteristic information of the target user.

Wherein, the first collecting device 100 is located in a preset space range where the control device is located.

In a second implementation manner, a schematic structural diagram of an electronic device is shown in fig. 10, the electronic device includes a timing device 1010 and a controller 1020, where:

the timing device 1010 is used for determining the current time;

the controller 1020 is connected to the second collection device 200, and configured to determine the current time of the timing device as an occurrence time when detecting information indicating that the state of the controlled device changes, and acquire the operator characteristic information collected by the second collection device 200 at the occurrence time.

Wherein the second collecting device 200 is arranged on the control device 300.

In a third implementation manner, a schematic structural diagram of an electronic device is shown in fig. 11, where the electronic device includes a timing device 1110, a controller 1120, and a first communication device 1130; specifically, the method comprises the following steps:

the timing device 1110 is used for determining the current time;

the first communication means 1130 is used for communicating with at least two third collecting devices, and in this embodiment, the first communication means 1130 is used for communicating with the third collecting device 400A and the third collecting device 400B.

The controller 1120 is configured to determine, when information indicating that the state of the controlled device is changed is detected, that the current time of the timing device is the occurrence time, obtain, through the first communication device 1130, user activity parameters, corresponding to the occurrence time, adopted by at least two third acquisition devices, determine, based on the user activity parameters, target user activity parameters for controlling that the state of the controlled device is changed, thereby determining a user identifier of the third acquisition device that acquires the target activity parameters, and establishing a correspondence relationship between the state change information of the controlled device and the operator characteristic information.

In the present invention, the electronic device may be a central control device or a controlled device.

And when the electronic equipment is controlled equipment, the controlled equipment is connected with the control equipment and is used for controlling the state change of the electronic equipment based on the control instruction after receiving the control instruction sent by the control equipment.

The controlled device may be connected to the control device in a wired manner, such as a cable, or in a wireless manner, such as an infrared or wireless network.

When the electronic equipment is the central control equipment, the central control equipment also comprises second communication devices which are respectively used for communicating with the control equipment and the controlled equipment besides the timing device and the controller;

specifically, the second communication device may be connected to the control device and the controlled device by a wired manner, such as a cable, or, of course, the second communication device may also be connected to the control device and the controlled device by a wireless manner, such as a wireless network.

When the central control device controls the state of the corresponding controlled device to change based on the control instruction of the control device, the central control device may pre-store the corresponding relationship between the control device identifier and the controlled device identifier, so that when the control instruction carrying the control device identifier is received, the controlled device identifier corresponding to the control device identifier is queried, and the state of the corresponding controlled device is controlled. Of course, the control device may also directly send the control instruction carrying the identifier of the controlled device to the central control device, so that the central control device directly controls the controlled device having the identifier of the controlled device.

It should be noted that, in the present invention, the central control device may implement control on one controlled device based on a plurality of control devices, and the specific control manner is as described above; of course, the central control device implements control over multiple control devices based on one control device, and in this case, the control device may send a control instruction with a control device identifier to the central control device, so that the central control device controls the controlled device corresponding to the control device identifier.

For convenience of understanding, a specific example is described how the central control device controls the state change of the controlled device based on the control command of the control device, as shown in fig. 12, which is a schematic structural diagram of a central control device according to a ninth embodiment of the present invention;

the central control apparatus comprises a timing device 1210, a controller 1220 and a second communication device 1230, wherein:

the timing device 1210 is used to determine the current time.

The second communication device 1230 is connected to the wall switch 300A and the remote controller 300B, and the second communication device 1230 is further connected to the smart lamp 500A, the smart air conditioner 500B, and the smart tv 500C.

The wall switch 300A is used for controlling the intelligent electric energy 500A, and the remote controller 300B is used for controlling the intelligent air conditioner 500A and the intelligent television 500C respectively.

The wall switch 300A and the remote controller 300B all belong to control equipment, and the intelligent electric lamp 500A, the intelligent air conditioner 500B and the intelligent television 500C all belong to controlled equipment.

The controller 1220 is configured to receive a control command sent by a control device through the second communication apparatus 1230, and control a state change of the controlled device based on the control command.

For example, when the controller 1220 receives a control instruction for controlling the smart lamp to turn on from the wall switch 300A through the second communicator 1230, it is determined that the wall switch 300A corresponds to the smart lamp 500A through the pre-stored correspondence relationship, and thus, the smart lamp 500A may be controlled to turn on based on the control instruction.

When the controller 1220 receives a control instruction of the remote controller 300B for controlling the smart air conditioner 500B to be turned off through the second communication device 1230, the controller 1220 may control the smart air conditioner 500B to be turned off through the device identifier of the smart air conditioner carried in the control instruction.

The controller 1220 is further configured to determine, when detecting information indicating that a state of a controlled device has changed, a current time of the timing device as an occurrence time, and determine operator characteristic information for controlling an operation of the controlled device corresponding to the occurrence time, and determine a corresponding relationship between the state change information of the controlled device and the operator characteristic information.

The tenth embodiment of the present invention further discloses an operation recognition apparatus, as shown in fig. 13, including: a detection determination unit 1301, a first determination unit 1302, and a second determination unit 1303; wherein:

a detection determining unit 1301, configured to determine an occurrence time when information indicating that a state of a controlled device changes is detected;

a first determining unit 1302, configured to determine operator characteristic information corresponding to the occurrence time and aiming at an operation of a control device, where the control device is a device configured to control a state change of the controlled device by sending a control instruction to the controlled device;

and a second determining unit 1303, configured to determine a corresponding relationship between the state change information of the controlled device and the operator characteristic information.

The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An operation recognition method, comprising:

determining operator characteristic information corresponding to the occurrence time and aiming at the operation of a control device, wherein the control device is a device used for controlling the state change of the controlled device by sending a control command to the controlled device, and the operator characteristic information is the operator characteristic information for operating the control device when the state of the controlled device is changed;

2. The method of claim 1, wherein the determining the correspondence of the state change information of the controlled device to the operator characteristic information comprises:

3. The method of claim 1,

the determining of the operator characteristic information corresponding to the occurrence time for the operation of the control device includes:

acquiring operator characteristic information of the target user;

4. The method of claim 1, wherein determining operational characteristic information corresponding to the occurrence time for controlling operation of the device comprises:

determining a user identifier of a third acquisition device for acquiring the target user activity parameter;

5. The method according to claim 4, wherein the at least two third capturing devices are respectively arranged at the first part of the corresponding user, and the user activity parameter is used for representing the activity state of the user where the third capturing devices are located;

the first portion is a portion corresponding to an operation body of a user, and the operation body is specifically configured to control the control device so that the control device generates the control instruction.

6. The method according to claim 1, wherein the determining of the correspondence between the state change information of the controlled device and the operator characteristic information is specifically:

7. The method according to claim 6, wherein after determining the corresponding relationship between the state change information of the controlled device and the operator characteristic information, the method further comprises:

determining an active first object based on the image data;

determining characteristic information of the first object;

8. The method according to claim 7, wherein after determining the corresponding relationship between the state change information of the controlled device and the operator characteristic information, the method further comprises:

9. An electronic device, comprising:

timing means for determining a current time;

the control device is a device for controlling the state change of the controlled device by sending a control instruction to the controlled device, and the operator characteristic information is the operator characteristic information for operating the control device when the state of the controlled device is changed.

10. An operation recognition apparatus characterized by comprising:

a first determining unit, configured to determine operator characteristic information for operation of a control device, corresponding to the occurrence time, where the control device is a device configured to control a state change of the controlled device by sending a control instruction to the controlled device, and the operator characteristic information is operator characteristic information for operating the control device when the state of the controlled device changes;