CN109539495B

CN109539495B - Control method, air conditioning apparatus, and storage medium

Info

Publication number: CN109539495B
Application number: CN201811458724.5A
Authority: CN
Inventors: 陈俊吉
Original assignee: Midea Group Co Ltd; GD Midea Air Conditioning Equipment Co Ltd
Current assignee: Midea Group Co Ltd; GD Midea Air Conditioning Equipment Co Ltd
Priority date: 2018-11-30
Filing date: 2018-11-30
Publication date: 2021-07-23
Anticipated expiration: 2038-11-30
Also published as: CN109539495A

Abstract

The invention provides a control method, an air conditioning apparatus, and a storage medium. The linkage operation control method comprises the following steps: the method comprises the steps that a plurality of air conditioning devices respectively collect gait characteristics of users; and determining a target user according to the plurality of gait characteristics so as to control the at least one air conditioning device to operate according to the operation mode matched with the target user. According to the technical scheme, the finally identified target user can be determined through fusion or comparison of multiple groups of gait features, so that the accuracy of identifying the user by adopting the gait features is improved, and the accuracy of controlling the automatic operation matching mode by acquiring the gait features of the user is improved by controlling the air conditioning equipment to operate by adopting the operation mode matched with the identified user.

Description

Control method, air conditioning apparatus, and storage medium

Technical Field

The present invention relates to the field of home appliances, and more particularly, to a linkage operation control method, a linkage operation control device, a terminal, an air conditioning apparatus, and a computer-readable storage medium.

Background

In the related art, the user identification can be performed through the collected gait features, but a large misjudgment rate exists because the gait features in the image information collected under a single scene are usually extracted.

Disclosure of Invention

The embodiment of the application provides a linkage operation control method, and solves the technical problem that a single gait feature recognition user has a high probability of misjudgment in the prior art.

According to a first aspect of the present invention, there is provided a linked operation control method including: the method comprises the steps that a plurality of air conditioning devices respectively collect gait characteristics of users; and determining a target user according to the plurality of gait characteristics so as to control the at least one air conditioning device to operate according to the operation mode matched with the target user.

In the above technical solution, preferably, determining the target user according to a plurality of gait features specifically includes: respectively inputting the gait characteristics into a preset gait recognition database to generate a matching degree between a recognition user and the corresponding gait recognition database; and determining the identified user with the highest matching degree as the target user so as to control the operation of the at least one air conditioning device according to the operation mode matched with the target user.

In any of the above technical solutions, preferably, determining the target user according to a plurality of gait features specifically includes: performing multi-view fusion on the plurality of gait features to generate fused gait features; and inputting the fusion gait characteristics into a preset gait recognition database to determine the user with the highest matching degree as a target user.

In any one of the above technical solutions, preferably, the plurality of air conditioning devices respectively collect gait characteristics of the user, and specifically includes: the method comprises the steps that a plurality of air conditioning devices respectively collect video information; for each piece of video information, when a plurality of human body features are detected, one to-be-identified user in the plurality of human body features is determined according to a preset identification rule, and a gait image sequence of the to-be-identified user is extracted as gait features.

In any of the above technical solutions, preferably, the step of inputting the plurality of gait features into a preset gait recognition matching database respectively to generate a matching degree between the recognition user and the corresponding recognition user specifically includes: determining a gait cycle according to the gait image sequence; positioning and cutting the gait image sequence according to the gait cycle to generate gait features to be matched; and inputting the gait features to be matched into a gait recognition database to output the recognized user and the matching degree.

In any of the above technical solutions, preferably, for each piece of video information, when a plurality of human body features are detected, determining a user to be identified in the plurality of human body features according to a preset identification rule, specifically including: and when the plurality of human body features are detected, determining the user with the highest resolution in the plurality of human body features as the user to be identified.

In any of the above technical solutions, preferably, for each piece of video information, when a plurality of human body features are detected, determining a user to be identified in the plurality of human body features according to a preset identification rule, specifically including: and when the plurality of human body features are detected, determining the user with the largest outline area extracted from the plurality of human body features as the user to be identified.

In any of the above technical solutions, preferably, the gait feature is collected at one of the plurality of air-conditioning apparatuses, and prompt guidance information is generated to prompt the user to enter the gait feature into the other air-conditioning apparatuses.

In any of the above technical solutions, preferably, a plurality of air conditioning apparatuses are in the same local area network; and/or multiple air conditioning devices are associated with the same control account.

In any of the above technical solutions, preferably, the controlling at least one air conditioning device to operate according to an operation mode matched with a target user specifically includes: determining a gait frequency according to a gait cycle; determining attitude information according to analysis of gait amplitude change in a gait image sequence; and determining a pre-stored mode which is the highest in matching with the gait frequency and the posture information from a plurality of pre-stored modes associated with the target user as an operation mode.

In any of the above technical solutions, preferably, the controlling at least one air conditioning device to operate according to an operation mode matched with a target user specifically includes: and controlling the operation of the plurality of air conditioning devices according to the operation mode.

In any of the above technical solutions, preferably, the operation mode includes at least one of a humidity setting parameter, a temperature setting parameter, an air cleanliness setting parameter, a wind direction setting parameter, and an operation duration setting parameter.

According to a second aspect of the present invention, there is provided a linked operation control method adapted to an air conditioning apparatus, the method including: acquiring gait characteristics of a user; inputting the user gait characteristics into a preset gait recognition database to generate the matching degree of the recognized user and the corresponding gait recognition database and generate a broadcast data packet; and after the broadcast data packet is sent through the local broadcast channel, receiving a control parameter packet of the operation mode fed back by other air conditioning equipment according to the broadcast data packet so as to operate according to the operation mode.

In the above technical solution, preferably, the acquiring gait characteristics of the user specifically includes: collecting video information; when the video information is detected to have a plurality of human body features, one to-be-identified user in the plurality of human body features is determined according to a preset identification rule, and a gait image sequence of the to-be-identified user is extracted as gait features.

In any of the above technical solutions, preferably, the step of inputting the gait characteristics of the user into a preset gait recognition database to generate a matching degree between the recognized user and the corresponding user includes: determining a gait cycle according to the gait image sequence; positioning and cutting the gait image sequence according to the gait cycle to generate gait features to be matched; and inputting the gait features to be matched into a gait recognition database to output the recognized user and the matching degree.

In any of the above technical solutions, preferably, determining a user to be identified in a plurality of human body features according to a preset identification rule specifically includes: and when the plurality of human body features are detected, determining the user with the highest resolution in the plurality of human body features as the user to be identified.

In any of the above technical solutions, preferably, determining a user to be identified in a plurality of human body features according to a preset identification rule specifically includes: and when the plurality of human body features are detected, determining the user with the largest outline area extracted from the plurality of human body features as the user to be identified.

According to a third aspect of the present invention, there is provided a linked operation control method adapted to an air conditioning apparatus, the method comprising: acquiring gait characteristics of a user; inputting the gait characteristics of the user into a preset gait recognition database to generate a first recognition user and a corresponding first matching degree; receiving at least one gait feature data packet through a local broadcast channel, wherein the gait feature data packet comprises at least one second identification user and a corresponding second matching degree; and determining the first identified user or the second identified user with the highest matching degree as the target user so as to determine the operation mode matched with the target user.

In the above technical solution, preferably, the method further includes: and transmitting the control parameter packet of the operation mode to a transmitting end of the gait feature data packet through a local broadcast channel.

In any of the above technical solutions, preferably, the acquiring gait characteristics of the user specifically includes: collecting video information; when the video information is detected to have a plurality of human body features, one to-be-identified user in the plurality of human body features is determined according to a preset identification rule, and a gait image sequence of the to-be-identified user is extracted as gait features.

In any of the above technical solutions, preferably, after receiving the acquisition instruction, the acquisition instruction is sent to other air conditioning equipment, and the acquisition instruction is used to start an image acquisition module that executes an acquisition operation.

According to a fourth aspect of the present invention, there is provided a linked operation control device comprising: a memory and a processor; a memory for storing program code; a processor for invoking program code execution: the method comprises the steps that a plurality of air conditioning devices respectively collect gait characteristics of users; and determining a target user according to the plurality of gait characteristics so as to control the at least one air conditioning device to operate according to the operation mode matched with the target user.

According to a fifth aspect of the present invention, there is provided a linked operation control device comprising: a memory and a processor; a memory for storing program code; a processor for invoking program code execution: acquiring gait characteristics of a user; inputting the user gait characteristics into a preset gait recognition database to generate the matching degree of the recognized user and the corresponding gait recognition database and generate a broadcast data packet; and after the broadcast data packet is sent through the local broadcast channel, receiving a control parameter packet of the operation mode fed back by other air conditioning equipment according to the broadcast data packet so as to operate according to the operation mode.

According to a sixth aspect of the present invention, there is provided a linked operation control device comprising: a memory and a processor; a memory for storing program code; a processor for invoking program code execution: acquiring gait characteristics of a user; inputting the gait characteristics of the user into a preset gait recognition database to generate a first recognition user and a corresponding first matching degree; receiving at least one gait feature data packet through a local broadcast channel, wherein the gait feature data packet comprises at least one second identification user and a corresponding second matching degree; and determining the first identified user or the second identified user with the highest matching degree as the target user so as to determine the operation mode matched with the target user.

According to a seventh aspect of the present invention, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the linked operation control method according to any one of the above-described aspects of the first to third aspects.

According to an eighth aspect of the present invention, there is provided a terminal comprising: a processor; a memory for storing executable instructions of the processor, wherein the processor is configured to implement the steps of the linked operation control method according to any one of the above-mentioned aspects of the first aspect when executing the executable instructions stored in the memory.

According to a ninth aspect of the present invention, there is provided an air conditioning apparatus comprising: a processor; a memory for storing executable instructions of the processor, wherein the processor is configured to implement the steps of the linked operation control method according to any one of the above-mentioned second aspect when executing the executable instructions stored in the memory.

According to a tenth aspect of the present invention, there is provided an air conditioning apparatus comprising: a processor; a memory for storing executable instructions of the processor, wherein the processor is configured to implement the steps of the linked operation control method according to any one of the above-mentioned third aspect when executing the executable instructions stored in the memory.

One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

the gait features of the user are respectively collected by the air conditioning equipment, the collected gait features are processed to realize the identification of the target user, because the single air conditioning equipment can usually only collect the gait features of a certain angle of the user, if two similar users exist in the region, the larger misjudgment probability can occur, the accuracy of identifying the user by adopting the gait features is improved by arranging the air conditioning equipment, on one hand, when the gait features of the user are respectively collected by the air conditioning equipment, the finally identified target user can be determined by the fusion or comparison of a plurality of groups of gait features, and the running of the air conditioning equipment is controlled by adopting the running mode matched with the identified user, so that the control accuracy of realizing the automatic running matching mode by collecting the gait features of the user is improved, on the other hand, for a plurality of air conditioning equipment, can control through same control command, and then be favorable to promoting the smoothness of linkage operation.

Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.

Drawings

The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a flowchart illustrating a linked operation control method according to a first embodiment of the present invention;

fig. 2 is a flowchart illustrating a linked operation control method according to a second embodiment of the present invention;

fig. 3 is a flowchart showing a linked operation control method according to a third embodiment of the present invention;

fig. 4 is a flowchart showing a linked operation control method according to a fourth embodiment of the present invention;

FIG. 5 is a schematic block diagram showing a linked operation control apparatus of the first embodiment of the present invention;

FIG. 6 is a schematic block diagram showing a linked operation control apparatus of a second embodiment of the present invention;

fig. 7 shows a schematic block diagram of a linked operation control device of a third embodiment of the present invention.

Detailed Description

Aiming at the technical problem that the control instruction cannot be adjusted in real time according to somatosensory feedback of a user in the prior art, through the linkage operation control method, on one hand, the whole linkage operation control process only needs to be triggered by voice of the user, and then self-adaptive adjustment is carried out based on collected user sign information, so that the user control process is greatly simplified, on the other hand, whether the current control instruction is adjusted or not is combined with user portrait according to real-time sign information through a server, and the server has the advantages of collecting and mining a large amount of user data, so that the adjustment instruction fed back by the server is higher in universality and higher in reliability.

For a better understanding of the above technical solutions, exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

In order to better understand the technical solution, the technical solution will be described in detail with reference to the drawings and the specific embodiments.

The following describes a linked operation control method according to an embodiment of the present invention with reference to fig. 1 and 6.

The first embodiment is as follows:

as shown in fig. 1, a coordinated operation control method according to an embodiment of the present invention is applied to a terminal or an air conditioning apparatus, the method including: 102, respectively acquiring gait characteristics of a user by a plurality of air conditioning devices; and 104, determining a target user according to the plurality of gait characteristics so as to control the at least one air conditioning device to operate according to the operation mode matched with the target user.

In the embodiment, the gait features of the user are respectively collected by the plurality of air conditioning devices, the collected gait features are processed to realize the identification of the target user, as the single air conditioning device can usually collect the gait features of a certain angle of the user, if two similar users exist in the region, the larger misjudgment probability can occur, the accuracy of identifying the user by adopting the gait features is improved by arranging the plurality of air conditioning devices, and when the gait features of the user are respectively collected by the plurality of air conditioning devices, on one hand, the finally identified target user can be determined by fusion or comparison of a plurality of groups of gait features, and the operation of the air conditioning devices is controlled by adopting the operation mode matched with the identified user, so that the accuracy of realizing the automatic operation matching mode control by collecting the gait features of the user is improved, on the other hand, for a plurality of air conditioning equipment, can control through same control command, and then be favorable to promoting the smoothness of linkage operation.

The plurality of air conditioning devices collect gait characteristics of the user respectively, the plurality of air conditioning devices can be arranged in a limited area, and the collection operation can be finished within a specified time period.

Further, after the collection function is started by one of the plurality of air conditioning devices, the air conditioning device can also be controlled to send a starting instruction to the other air conditioning devices so as to start the collection function.

It is understood by those skilled in the art that, in this embodiment, the execution subject of the linkage operation control method may be a control terminal, may also be an air conditioning device, and may also be a server.

The air conditioning equipment may be equipment integrating functions of a humidifier, a purifier, an air conditioner, and the like, and is used for adjusting the humidity, the temperature, and the cleanliness of indoor air.

In the above embodiment, preferably, the determining the target user according to a plurality of gait features specifically includes: respectively inputting the gait characteristics into a preset gait recognition database to generate a matching degree between a recognition user and the corresponding gait recognition database; and determining the identified user with the highest matching degree as the target user so as to control the operation of the at least one air conditioning device according to the operation mode matched with the target user.

In this embodiment, as an implementation manner for improving the recognition accuracy, the collected gait features may be respectively input into a preset gait recognition database to output recognition results, including recognition users and corresponding matching degrees, the recognition user with the highest matching degree is used as a matching user by comparing the output results, and the air conditioning equipment is operated according to an operation mode associated with the user.

In any of the above embodiments, preferably, determining the target user according to a plurality of gait characteristics specifically includes: performing multi-view fusion on the plurality of gait features to generate fused gait features; and inputting the fusion gait characteristics into a preset gait recognition database to determine the user with the highest matching degree as a target user.

In the embodiment, because different air conditioning equipment can collect the gait characteristics of the user at different angles, the gait characteristics at a plurality of different angles can be fused and then identified through the gait identification database, so that the integrity of the gait characteristics can be improved through gait fusion, the accuracy of user identification is improved, and the purpose of misjudgment is reduced.

In any of the above embodiments, preferably, the plurality of air conditioning devices respectively collect gait characteristics of the user, and specifically includes: the method comprises the steps that a plurality of air conditioning devices respectively collect video information; for each piece of video information, when a plurality of human body features are detected, one to-be-identified user in the plurality of human body features is determined according to a preset identification rule, and a gait image sequence of the to-be-identified user is extracted as gait features.

In this embodiment, the gait extraction may be performed by capturing video information through an image capture module disposed on the air conditioning device, and if the video information has a plurality of human body features, the user to be identified needs to be determined first, and then the gait features of the user to be identified are extracted to perform the identification operation, so as to solve the problem of how to identify when the video information has a plurality of users, and ensure smooth performance of the gait identification operation.

In any of the above embodiments, preferably, the step of inputting the plurality of gait features into a preset gait recognition matching database respectively to generate a matching degree between the recognition user and the corresponding recognition user includes: determining a gait cycle according to the gait image sequence; positioning and cutting the gait image sequence according to the gait cycle to generate gait features to be matched; and inputting the gait features to be matched into a gait recognition database to output the recognized user and the matching degree.

In the embodiment, for each extracted video information, firstly, a gait cycle is determined according to a gait image sequence to extract a cycle number of image frames, then, the operations of positioning and gait cutting are carried out on the cycle number of image frames to obtain gait characteristics, and the identified user and the matching degree are obtained by identifying the gait characteristics.

The gait feature extraction algorithm may specifically be any one or a combination of the following algorithms: a gait feature extraction algorithm based on Hough (Hough) transformation, a gait feature extraction algorithm based on particle filter tracking, a gait feature extraction algorithm based on a support vector machine and the like.

In any of the above embodiments, preferably, for each piece of video information, when a plurality of human body features are detected, determining a user to be identified in the plurality of human body features according to a preset identification rule, specifically including: and when the plurality of human body features are detected, determining the user with the highest resolution in the plurality of human body features as the user to be identified.

In this embodiment, when a plurality of human body features are detected, as a distinguishing method of the target user, the user whose facial features are acquired may be used as the target user, and if the facial features of a plurality of users are acquired, the user whose facial resolution is the highest is selected as the user to be identified, because the user who faces the air conditioning apparatus generally has control intention, and the higher the resolution is, the closer the target user is to the air conditioning apparatus is indicated, thereby realizing the identification of the target user.

In any of the above embodiments, preferably, for each piece of video information, when a plurality of human body features are detected, determining a user to be identified in the plurality of human body features according to a preset identification rule, specifically including: and when the plurality of human body features are detected, determining the user with the largest outline area extracted from the plurality of human body features as the user to be identified.

In this embodiment, when a plurality of human body features are detected, as another distinguishing method of the target user, a human body contour may be extracted when the human body features are detected, and a contour area is calculated, where a larger contour area indicates that the target user is closer to the air conditioning device, and the target user can also be identified.

In any of the above embodiments, preferably, the gait characteristics are collected at one of the plurality of air-conditioning apparatuses, and prompt guidance information is generated to prompt the user to enter the gait characteristics into the other air-conditioning apparatuses.

In this embodiment, when one air conditioning device acquires the gait feature, a prompt message may be generated to prompt the user to approach another air conditioning device, so that the other air conditioning devices can conveniently acquire the gait feature, the gait feature identification process can be simpler and more definite, further, the identification of the user to be identified can be omitted, and the accuracy of identifying the target user through the gait can be further improved.

In any of the above embodiments, preferably, the plurality of air conditioning devices are in the same local area network; and/or multiple air conditioning devices are associated with the same control account.

In this embodiment, the plurality of air conditioning devices are located in the same local area network, and/or the plurality of air conditioning devices are associated with the same control account, so that communication interaction among the plurality of air conditioning devices can be controlled, and thus the control parameter of one air conditioning device can be transmitted to other air conditioning devices, so that linkage control is realized, and the control process is simpler.

The users in the same local area network are in the same area, so that the gait recognition accuracy is improved, and meanwhile, the multiple air conditioning devices in the same area can be controlled to operate in a linkage mode.

And if the plurality of air conditioning equipment are associated with the same control account, the plurality of air conditioning equipment can be controlled to operate in a linkage manner through the same control account.

In any of the above embodiments, preferably, the controlling at least one air conditioning device to operate according to an operation mode matched with the target user specifically includes: determining a gait frequency according to a gait cycle; determining attitude information according to analysis of gait amplitude change in a gait image sequence; and determining a pre-stored mode which is the highest in matching with the gait frequency and the posture information from a plurality of pre-stored modes associated with the target user as an operation mode.

In this embodiment, when a target user is associated with a plurality of pre-stored operation modes, the gait frequency of the user may be further detected, for example, the gait frequency is higher, the gait frequency may be associated with a cooling mode, the specific frequency is lower, the gait frequency may be associated with a heating mode or an air purification mode, and the like.

In any of the above embodiments, preferably, the controlling at least one air conditioning device to operate according to an operation mode matched with the target user specifically includes: and controlling the operation of the plurality of air conditioning devices according to the operation mode.

In the embodiment, the function that the plurality of air conditioning devices are synchronously started in the same operation mode in the designated area is realized by controlling the plurality of air conditioning devices to operate together according to the operation mode, the operation mode is related to the target user, and the operation of the air conditioning mode can be controlled only by collecting the gait characteristics of the user, so that the operation mode meets the requirements of the user and the control process is simplified.

In any of the above embodiments, preferably, the operation mode includes at least one of a humidity setting parameter, a temperature setting parameter, an air cleanliness setting parameter, a wind direction setting parameter, and a duration setting parameter.

Example two:

as shown in fig. 2, a linked operation control method according to another embodiment of the present invention is applied to an air conditioning apparatus, the method including: step 202, collecting gait characteristics of a user; step 204, inputting the user gait characteristics into a preset gait recognition database to generate the matching degree of the recognition user and the corresponding recognition user and generate a broadcast data packet; and step 206, after the broadcast data packet is sent through the local broadcast channel, receiving a control parameter packet of the operation mode fed back by other air conditioning equipment according to the broadcast data packet so as to operate according to the operation mode.

In the embodiment, the air conditioning equipment is used as a receiving end of the control instruction of the operation module, mainly performs two functions, firstly collects the gait characteristics of the user to identify the user, sends the identification result to other air conditioning equipment after obtaining the identification result, generates a corresponding control parameter packet according to the identification result by other air conditioning equipment, and then starts to operate according to the control parameter packet, so that the air conditioning equipment realizes the linkage operation of the operation of collecting the gait.

It will be understood by those skilled in the art that, for step 204, the step of user identification may be performed locally, or may be transmitted to a server or a terminal for execution, depending on the processing capabilities of the air conditioning apparatus.

In the above embodiment, preferably, the acquiring the gait characteristics of the user specifically includes: collecting video information; when the video information is detected to have a plurality of human body features, one to-be-identified user in the plurality of human body features is determined according to a preset identification rule, and a gait image sequence of the to-be-identified user is extracted as gait features.

In any of the above embodiments, preferably, the step of inputting the gait features of the user into a preset gait recognition database to generate a matching degree between the recognized user and the corresponding user includes: determining a gait cycle according to the gait image sequence; positioning and cutting the gait image sequence according to the gait cycle to generate gait features to be matched; and inputting the gait features to be matched into a gait recognition database to output the recognized user and the matching degree.

In any of the above embodiments, preferably, determining a user to be identified in a plurality of human body features according to a preset identification rule specifically includes: and when the plurality of human body features are detected, determining the user with the highest resolution in the plurality of human body features as the user to be identified.

In any of the above embodiments, preferably, determining a user to be identified in a plurality of human body features according to a preset identification rule specifically includes: and when the plurality of human body features are detected, determining the user with the largest outline area extracted from the plurality of human body features as the user to be identified.

As shown in fig. 3, a linked operation control method according to another embodiment of the present invention is applied to an air conditioning apparatus, the method including: step 302, collecting gait characteristics of a user; step 304, inputting the gait characteristics of the user into a preset gait recognition database to generate a first recognition user and a corresponding first matching degree; step 306, receiving at least one gait feature data packet through a local broadcast channel, wherein the gait feature data packet comprises at least one second identification user and a corresponding second matching degree; and 308, determining the first identified user or the second identified user with the highest matching degree as the target user so as to determine the running mode matched with the target user.

In the above embodiment, preferably, the method further includes: and transmitting the control parameter packet of the operation mode to a transmitting end of the gait feature data packet through a local broadcast channel.

In this embodiment, the air conditioning equipment serves as a processing end for determining a target user and an operation mode, obtains a first matching degree between a first identified user and the first identified user according to the collected gait characteristics, receives a second matching degree between a second identified user and a second identified user sent by other air conditioning equipment in the local area network, determines the target user through comparison of the matching degrees, and determines a corresponding operation mode according to the target user.

In any of the above embodiments, preferably, the acquiring the gait characteristics of the user specifically includes: collecting video information; when the video information is detected to have a plurality of human body features, one to-be-identified user in the plurality of human body features is determined according to a preset identification rule, and a gait image sequence of the to-be-identified user is extracted as gait features.

In any of the above embodiments, preferably, after receiving the acquisition instruction, the acquisition instruction is sent to other air conditioning equipment, and the acquisition instruction is used to start an image acquisition module for performing an acquisition operation.

In this embodiment, in order to save resources, the image acquisition module on the air conditioning equipment is not in an open state all the time, so before acquiring gait characteristics, the image acquisition module needs to be triggered and started by an acquisition instruction, and after one air conditioning equipment receives the acquisition instruction, the acquisition instruction can be forwarded to other air conditioning equipment by the air conditioning equipment, so that the other air conditioning equipment also starts an acquisition function, and thus, a user does not need to control to start the acquisition function of each air conditioning equipment one by one, and the operation process of the user is simplified.

Example four:

as shown in fig. 4, a linked operation control method according to still another embodiment of the present invention includes:

step 402, shooting a video by a first air conditioning device;

step 404, extracting a first group of gait features;

step 406, searching a local database to determine a first target user with the highest matching degree with the first group of gait features;

step 408, the second air conditioning equipment shoots a video;

step 410, extracting a second group of gait features;

step 412, searching a local database to determine a second target user with the highest matching degree with the second group of gait features;

and step 414, comparing the matching degrees of the first target user and the second target user, and selecting the user with the highest matching degree as the final target user.

As shown in fig. 5, a linked operation control device 50 according to an embodiment of the present invention includes: a memory 502 and a processor 504; a memory 502 for storing program code for memory 502; a processor 504 for invoking program code to perform: the method comprises the steps that a plurality of air conditioning devices respectively collect gait characteristics of users; and determining a target user according to the plurality of gait characteristics so as to control the at least one air conditioning device to operate according to the operation mode matched with the target user.

In the foregoing embodiment, preferably, the processor 504 is specifically configured to: respectively inputting the gait characteristics into a preset gait recognition database to generate a matching degree between a recognition user and the corresponding gait recognition database; and determining the identified user with the highest matching degree as the target user so as to control the operation of the at least one air conditioning device according to the operation mode matched with the target user.

In any of the above embodiments, preferably, the processor 504 is specifically configured to: performing multi-view fusion on the plurality of gait features to generate fused gait features; and inputting the fusion gait characteristics into a preset gait recognition database to determine the user with the highest matching degree as a target user.

In any of the above embodiments, preferably, the processor 504 is specifically configured to: the method comprises the steps that a plurality of air conditioning devices respectively collect video information; for each piece of video information, when a plurality of human body features are detected, one to-be-identified user in the plurality of human body features is determined according to a preset identification rule, and a gait image sequence of the to-be-identified user is extracted as gait features.

In any of the above embodiments, preferably, the processor 504 is specifically configured to: determining a gait cycle according to the gait image sequence; positioning and cutting the gait image sequence according to the gait cycle to generate gait features to be matched; and inputting the gait features to be matched into a gait recognition database to output the recognized user and the matching degree.

In any of the above embodiments, preferably, the processor 504 is specifically configured to: and when the plurality of human body features are detected, determining the user with the highest resolution in the plurality of human body features as the user to be identified.

In any of the above embodiments, preferably, the processor 504 is specifically configured to: and when the plurality of human body features are detected, determining the user with the largest outline area extracted from the plurality of human body features as the user to be identified.

In any of the above embodiments, preferably, the processor 504 is specifically configured to: when one of the air conditioning devices collects the gait characteristics, prompt guide information is generated to prompt a user to input the gait characteristics to other air conditioning devices.

In any of the above embodiments, preferably, the processor 504 is specifically configured to: a plurality of air conditioning devices are in the same local area network; and/or multiple air conditioning devices are associated with the same control account.

In any of the above embodiments, preferably, the processor 504 is specifically configured to: determining a gait frequency according to a gait cycle; determining attitude information according to analysis of gait amplitude change in a gait image sequence; and determining a pre-stored mode which is the highest in matching with the gait frequency and the posture information from a plurality of pre-stored modes associated with the target user as an operation mode.

In any of the above embodiments, preferably, the processor 504 is specifically configured to: and controlling the operation of the plurality of air conditioning devices according to the operation mode.

As shown in fig. 6, a linked operation control device 60 according to another embodiment of the present invention includes: a memory 602 and a processor 604; a memory 602 for storing the memory 602 for storing program code; a processor 604 for invoking program code to perform: controlling the image acquisition module 606 to acquire gait characteristics of the user; inputting the user gait characteristics into a preset gait recognition database to generate the matching degree of the recognized user and the corresponding gait recognition database and generate a broadcast data packet; and after the broadcast data packet is sent through the local broadcast channel, receiving a control parameter packet of the operation mode fed back by other air conditioning equipment according to the broadcast data packet so as to operate according to the operation mode.

It will be appreciated by those skilled in the art that the step of user identification may be performed locally, or may be transmitted to a server or terminal for execution, depending on the processing capabilities of the air conditioning unit.

In the foregoing embodiment, preferably, the processor 604 is specifically configured to: collecting video information; when the video information is detected to have a plurality of human body features, one to-be-identified user in the plurality of human body features is determined according to a preset identification rule, and a gait image sequence of the to-be-identified user is extracted as gait features.

In any of the above embodiments, preferably, the processor 604 is specifically configured to: determining a gait cycle according to the gait image sequence; positioning and cutting the gait image sequence according to the gait cycle to generate gait features to be matched; and inputting the gait features to be matched into a gait recognition database to output the recognized user and the matching degree.

In any of the above embodiments, preferably, the processor 604 is specifically configured to: and when the plurality of human body features are detected, determining the user with the highest resolution in the plurality of human body features as the user to be identified.

In any of the above embodiments, preferably, the processor 604 is specifically configured to: and when the plurality of human body features are detected, determining the user with the largest outline area extracted from the plurality of human body features as the user to be identified.

As shown in fig. 7, a linked operation control device 70 according to still another embodiment of the present invention includes: a memory 702 and a processor 704; a memory 702 for storing the memory 702 for storing program code; a processor 704 for invoking program code to perform: controlling the image acquisition module 706 to acquire gait characteristics of the user; inputting the gait characteristics of the user into a preset gait recognition database to generate a first recognition user and a corresponding first matching degree; receiving at least one gait feature data packet through a local broadcast channel, wherein the gait feature data packet comprises at least one second identification user and a corresponding second matching degree; and determining the first identified user or the second identified user with the highest matching degree as the target user so as to determine the operation mode matched with the target user.

In the foregoing embodiment, preferably, the processor 704 is specifically configured to: and transmitting the control parameter packet of the operation mode to a transmitting end of the gait feature data packet through a local broadcast channel.

In any of the above embodiments, preferably, the processor 704 is specifically configured to: collecting video information; when the video information is detected to have a plurality of human body features, one to-be-identified user in the plurality of human body features is determined according to a preset identification rule, and a gait image sequence of the to-be-identified user is extracted as gait features.

In any of the above embodiments, preferably, the processor 704 is specifically configured to: determining a gait cycle according to the gait image sequence; positioning and cutting the gait image sequence according to the gait cycle to generate gait features to be matched; and inputting the gait features to be matched into a gait recognition database to output the recognized user and the matching degree.

In any of the above embodiments, preferably, the processor 704 is specifically configured to: and when the plurality of human body features are detected, determining the user with the highest resolution in the plurality of human body features as the user to be identified.

In any of the above embodiments, preferably, the processor 704 is specifically configured to: and when the plurality of human body features are detected, determining the user with the largest outline area extracted from the plurality of human body features as the user to be identified.

In any of the above embodiments, preferably, the processor 704 is specifically configured to: and after receiving the acquisition instruction, sending the acquisition instruction to other air conditioning equipment, wherein the acquisition instruction is used for starting an image acquisition module for executing acquisition operation.

A computer-readable storage medium according to an embodiment of the present invention, on which a computer program is stored, the computer program, when executed by a processor, implementing the steps of the linked operation control method according to any one of the above-described aspects of the first to third aspects.

A terminal according to an embodiment of the present invention includes: a processor; and a memory for storing executable instructions of the processor, wherein the processor is configured to implement the steps of the linked operation control method according to any one of the technical solutions of the first embodiment when executing the executable instructions stored in the memory.

An air conditioning apparatus according to an embodiment of the present invention includes: a processor; and a memory for storing executable instructions of the processor, wherein the processor is configured to implement the steps of the linked operation control method according to any one of the above-mentioned second technical solutions when executing the executable instructions stored in the memory.

An air conditioning apparatus according to another embodiment of the present invention includes: a processor; and a memory for storing executable instructions of the processor, wherein the processor is configured to implement the steps of the linked operation control method according to any one of the third technical solutions of the above embodiments when executing the executable instructions stored in the memory.

The steps in the method of the embodiment of the invention can be sequentially adjusted, combined and deleted according to actual needs.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. A linked operation control method characterized by comprising:

the method comprises the steps that a plurality of air conditioning devices respectively collect gait characteristics of users;

determining a target user according to a plurality of gait characteristics so as to control at least one air conditioning device to operate according to an operation mode matched with the target user;

the determining a target user according to the plurality of gait features specifically includes:

performing multi-perspective fusion on the plurality of gait features to generate fused gait features;

inputting the fusion gait features into a preset gait recognition database so as to determine the user with the highest matching degree as the target user.

2. The method of claim 1, wherein said determining a target user based on a plurality of said gait characteristics comprises:

respectively inputting the gait characteristics into a preset gait recognition database to generate a matching degree between a recognition user and the corresponding gait recognition database;

and determining the identified user with the highest matching degree as a target user so as to control the operation of at least one air conditioning device according to the operation mode matched with the target user.

3. The method as claimed in claim 1, wherein the plurality of air conditioning devices respectively collect gait characteristics of the user, and specifically comprises:

the air conditioning equipment respectively collects video information;

for each piece of video information, when a plurality of human body features are detected, one to-be-identified user in the plurality of human body features is determined according to a preset identification rule, and a gait image sequence of the to-be-identified user is extracted as the gait features.

4. The method according to claim 3, wherein for each piece of video information, when a plurality of human body features are detected, determining a user to be identified in the plurality of human body features according to a preset identification rule, specifically comprising:

and when a plurality of human body features are detected, determining the user with the highest face resolution in the human body features as the user to be identified.

5. The method according to claim 3, wherein for each piece of video information, when a plurality of human body features are detected, determining a user to be identified in the plurality of human body features according to a preset identification rule, specifically comprising:

and when a plurality of human body features are detected, determining the user with the largest contour area extracted from the human body features as the user to be identified.

6. The method according to any one of claims 3 to 5, wherein the controlling of the operation of at least one of the air conditioning devices according to the operation mode matched to the target user specifically comprises:

determining a gait frequency according to the gait features;

determining attitude information according to analysis of gait amplitude change in a gait image sequence;

and determining the pre-stored mode which is most matched with the gait frequency and the posture information from a plurality of pre-stored modes associated with the target user as the operation mode.

7. An air conditioning apparatus comprising a memory, a processor and an operation control program stored on the memory and executable on the processor, the processor implementing the method of any one of claims 1 to 6 when executing the program.

8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the control method according to any one of claims 1 to 6.