CN112989870A - Fan control method, fan and computer readable storage medium - Google Patents
Fan control method, fan and computer readable storage medium Download PDFInfo
- Publication number
- CN112989870A CN112989870A CN201911216437.8A CN201911216437A CN112989870A CN 112989870 A CN112989870 A CN 112989870A CN 201911216437 A CN201911216437 A CN 201911216437A CN 112989870 A CN112989870 A CN 112989870A
- Authority
- CN
- China
- Prior art keywords
- fan
- gesture
- user
- thermal imaging
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000001931 thermography Methods 0.000 claims abstract description 97
- 230000009471 action Effects 0.000 claims abstract description 64
- 230000036760 body temperature Effects 0.000 claims description 42
- 238000004590 computer program Methods 0.000 claims description 14
- 238000012549 training Methods 0.000 claims description 11
- 239000003086 colorant Substances 0.000 claims description 8
- 238000013527 convolutional neural network Methods 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 3
- 238000007781 pre-processing Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 5
- 238000006243 chemical reaction Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000003313 weakening effect Effects 0.000 description 4
- 238000007664 blowing Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000002372 labelling Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000013138 pruning Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 230000036632 reaction speed Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F04—POSITIVE - DISPLACEMENT MACHINES FOR LIQUIDS; PUMPS FOR LIQUIDS OR ELASTIC FLUIDS
- F04D—NON-POSITIVE-DISPLACEMENT PUMPS
- F04D25/00—Pumping installations or systems
- F04D25/02—Units comprising pumps and their driving means
- F04D25/08—Units comprising pumps and their driving means the working fluid being air, e.g. for ventilation
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F04—POSITIVE - DISPLACEMENT MACHINES FOR LIQUIDS; PUMPS FOR LIQUIDS OR ELASTIC FLUIDS
- F04D—NON-POSITIVE-DISPLACEMENT PUMPS
- F04D27/00—Control, e.g. regulation, of pumps, pumping installations or pumping systems specially adapted for elastic fluids
- F04D27/004—Control, e.g. regulation, of pumps, pumping installations or pumping systems specially adapted for elastic fluids by varying driving speed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application relates to the technical field of electric appliance control systems, and discloses a fan control method, a fan and a computer readable storage medium, wherein the method comprises the following steps: when the fan is in a first state, calling a shooting module arranged on the fan to obtain a thermal imaging image containing the gesture action of a user; judging whether a wake-up condition of a second state of the fan is reached or not according to the thermal imaging image, wherein the second state is used for realizing gesture control according to gesture actions of a user; if the wake-up condition of the second state of the fan is reached, the fan is switched from the first state to the second state; when the fan is in a second state, acquiring a working instruction corresponding to the gesture action according to the gesture action in the thermal imaging image; and controlling the fan to realize corresponding operation according to the working instruction. This application utilizes gesture control fan, has realized intelligent control, and the while service temperature is judged, has improved intelligent control's accuracy.
Description
Technical Field
The invention relates to the technical field of electric appliance control systems, in particular to a fan control method, a fan and a computer readable storage medium.
Background
The electric fan is widely used in daily life, the traditional electric fan can only control the wind shield and the on-off through keys on an electric appliance body, and can only cycle periodically according to a fixed rotating speed or a certain specific mode after setting a wind shield, so that the electric fan is poor in adjustment flexibility and very inconvenient to use. The electric fan which is controlled by a remote controller to realize wind gear and on-off control has appeared in the market at present, although keys on the electric fan body do not need to be operated in a short distance, the defects that the remote controller is easy to lose, the searching is troublesome and time-consuming exist, and the defects that the regulation flexibility is poor according to periodic cycle after the wind gear is set exist.
Therefore, how to design an intelligent electric fan control system and method that are convenient to use is a technical problem to be solved urgently in the industry.
Disclosure of Invention
The main purpose of the present application is to provide a fan control method, a fan and a computer-readable storage medium, which utilize gestures to control the fan, so as to realize intelligent control, facilitate the use of users, and improve the accuracy of intelligent control by using temperature judgment.
In a first aspect, the present application provides a fan control method, where the fan is provided with a shooting module, and the fan control method includes:
when the fan is in a first state, calling the shooting module to acquire a thermal imaging image containing the gesture action of the user;
judging whether a wake-up condition of a second state of the fan is reached or not according to the thermal imaging image, wherein the second state is used for realizing gesture control according to gesture actions of a user;
if the wake-up condition of the second state of the fan is reached, the fan is switched from the first state to the second state;
when the fan is in a second state, acquiring a working instruction corresponding to the gesture action according to the gesture action in the thermal imaging image;
and controlling the fan to realize corresponding operation according to the working instruction.
In a second aspect, the present application further provides a fan, including a camera module, a memory, and a processor;
the shooting module is used for shooting a thermal imaging image containing the gesture action of the user;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and implement the steps of the fan control method as described above when executing the computer program.
In a third aspect, the present application further provides a computer-readable storage medium storing a computer program, wherein: if the computer program is executed by a processor, the steps of the fan control method as described above are implemented.
The application provides a fan control method, a fan and a computer readable storage medium, wherein when the fan is in a first state, a shooting module arranged on the fan is called to obtain a thermal imaging image containing gesture actions of a user; then judging whether a wake-up condition of a second state of the fan is reached or not according to the thermal imaging image; if the wake-up condition of the second state of the fan is reached, the fan is switched from the first state to the second state; then acquiring a working instruction corresponding to the gesture action according to the gesture action in the thermal imaging image; and finally, controlling the fan to realize corresponding operation according to the working instruction. This application utilizes gesture motion control fan to realize corresponding operation, has realized intelligent control, joins this judgement condition of temperature threshold value simultaneously, has promoted intelligent control's accuracy.
Drawings
Fig. 1 is a schematic block diagram of a fan according to an embodiment of the present disclosure;
FIG. 2 is a flow chart illustrating a method for controlling a fan according to an embodiment of the present disclosure;
FIG. 3 is a flow diagram illustrating sub-steps for determining whether a wake-up condition for a second state of the fan has been reached based on the thermographic image;
FIG. 4 is a schematic flow diagram of sub-steps for obtaining work instructions corresponding to a gesture motion from the gesture motion in the thermographic image;
FIG. 5 is a schematic diagram of several recognized gesture actions provided by the embodiments of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
It is to be understood that the terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a schematic block diagram of a fan according to an embodiment of the present disclosure. The fan 10 comprises a motor 11, a fan rotor 12, a vertical rod 13 and a base 14. The upright rod 13 is provided with a shooting module 15 and a function control module 16, the shooting module 15 can be used for collecting thermal imaging images containing gesture actions of a user, and the collected thermal imaging images are sent to the function control module 16; the fan rotor 12 is provided with blades 120.
It is understood that the fan 10 may be a table fan, a floor fan, a wall fan, etc. The air supply of the fan 10 may be normal temperature air or cold air.
In some embodiments, the shooting module 15 may include a thermal imaging camera, and the like, and may also include other devices or systems capable of shooting thermal imaging images, and the function control module 16 is electrically connected to the shooting module 15 for processing the thermal imaging images shot by the shooting module 15.
The function control module 16 may include a processor and a memory. The memory and the processor are connected by a bus, such as an I2C (Inter-integrated Circuit) bus.
The Memory is used for storing thermal imaging image data and computer programs, and can be a Flash chip, a Read-Only Memory (ROM) magnetic disk, an optical disk, a usb disk or a mobile hard disk.
The processor is configured to run a computer program stored in the memory and execute the computer program. The Processor may be a Central Processing Unit (CPU), or may be other general-purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, a discrete hardware component, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
When the processor executes the computer program to realize the fan control method, the following steps are specifically realized:
when the fan is in a first state, calling a shooting module arranged on the fan to obtain a thermal imaging image containing the gesture action of a user;
judging whether a wake-up condition of a second state of the fan is reached or not according to the thermal imaging image, wherein the second state is used for realizing gesture control according to gesture actions of a user;
if the wake-up condition of the second state of the fan is reached, the fan is switched from the first state to the second state;
when the fan is in a second state, acquiring a working instruction corresponding to the gesture action according to the gesture action in the thermal imaging image;
and controlling the fan to realize corresponding operation according to the working instruction.
In some embodiments, the processor is configured to, when determining whether the wake-up condition of the second state of the fan is reached according to the thermal imaging image, specifically:
determining a temperature set of the current body temperature of the user according to the thermal imaging image based on the corresponding relation between the colors and the temperatures of the thermal imaging image;
judging whether the body temperature of the user is greater than a temperature threshold value for starting the fan or not according to the temperature set;
and if the body temperature of the user is greater than the temperature threshold, the awakening condition of the second state of the fan is achieved.
In some embodiments, when the processor determines the temperature set of the current body temperature of the user according to the thermal imaging image, the following is specifically implemented:
extracting human body contour information of a user in the thermal imaging image;
determining a target image area where a user is located in the thermal imaging image according to the human body contour information;
and determining the temperature set of the current body temperature of the user according to the color of the target image area.
In some embodiments, the processor determines whether the body temperature of the user is greater than a temperature threshold for turning on the fan according to the temperature set, and specifically implements:
taking the temperature data with the highest temperature in the temperature set as the user body temperature data or taking the average value of the temperature data in the temperature set as the user body temperature data;
and judging whether the body temperature of the user is greater than the temperature threshold value for starting the fan or not according to the body temperature data of the user.
In some embodiments, when the processor obtains the work instruction corresponding to the gesture motion according to the gesture motion in the thermal imaging image, the following is specifically implemented:
inputting the thermal imaging image into a pre-trained gesture recognition model to obtain a corresponding gesture action;
and calling a working instruction corresponding to the gesture action according to the recognized gesture action.
In some embodiments, when the processor implements the inputting of the thermal imaging image into the pre-trained gesture recognition model, the following is specifically implemented:
performing image preprocessing on the thermal imaging image to obtain an image in a preset format;
and inputting the images in the preset format into a pre-trained gesture recognition model.
In some embodiments, when the processor implements the fan control method, the following is specifically implemented:
acquiring sample gesture images and annotation category construction sample data of the sample gesture images, wherein the sample gesture images are shot images of a plurality of gesture actions;
and based on the initialized convolutional neural network, performing model training according to the constructed sample data to obtain the gesture recognition model.
In some embodiments, when the processor implements the fan control method, the following is specifically implemented:
identifying azimuth data of the user according to the thermal imaging image;
and adjusting the working direction of the air supply of the fan according to the azimuth data.
It will be appreciated that the fan 10 of FIG. 1 and the above-described nomenclature for the various components of the fan 10 are for identification purposes only and do not limit the application embodiments accordingly.
The fan control method provided by the embodiment of the present application will be described in detail below based on the fan 10 in fig. 1. Based on the structural schematic block diagram, the embodiment of the application provides a fan control method.
Referring to fig. 2, fig. 2 is a schematic flow chart illustrating a fan control method according to an embodiment of the present disclosure. When the fan is in the first state, the fan control method judges whether a wake-up condition of the second state of the fan is achieved or not by analyzing a thermal imaging image which is shot by a shooting module and contains gesture actions of a user; when the fan is in the second state, the fan control method carries out gesture recognition on the thermal imaging image containing the gesture action of the user, calls a working instruction corresponding to the gesture action according to the recognized gesture action and executes the working instruction so as to realize intelligent control.
As shown in fig. 2, the fan control method includes the steps of:
step S101, when the fan is in a first state, calling the shooting module to obtain a thermal imaging image containing gesture actions of a user;
step S102, judging whether a wake-up condition of a second state of the fan is reached or not according to the thermal imaging image, wherein the second state is used for realizing gesture control according to gesture actions of a user;
step S103, if the awakening condition of the second state of the fan is achieved, the fan is switched from the first state to the second state;
step S104, when the fan is in a second state, obtaining a working instruction corresponding to the gesture action according to the gesture action in the thermal imaging image;
and S105, controlling the fan to realize corresponding operation according to the working instruction.
The embodiment of the application provides a fan control method, corresponding operation is achieved by controlling a fan through gesture motion, intelligent control is achieved, meanwhile, the judgment condition of a temperature threshold value is added, and accuracy of intelligent control is improved.
The following describes in detail the steps of implementing the fan control step by step in the embodiment of the present application:
and S101, when the fan is in the first state, calling the shooting module to acquire a thermal imaging image containing the gesture action of the user.
In some embodiments, the fan is divided into two states: the device comprises a first state and a second state, wherein the second state is used for realizing gesture control according to gesture actions of a user. For example, the first state may be a sleep state, a power-off state or an air circulation blowing state, and the second state may be a standby state or a power-on state. When the fan is in the second state, the fan can realize gesture control according to the gesture action of the user, namely a working instruction corresponding to the gesture action is obtained and executed according to the gesture action of the user; when the fan is in the first state, the fan does not acquire and execute the working instruction corresponding to the gesture motion according to the gesture motion of the user, for example, when the fan is in an air circulation blowing state in the first state, the working instruction corresponding to the gesture motion is not acquired and executed according to the gesture motion of the user, that is, the fan cannot be controlled by the gesture motion of the current user, and the fan still maintains the air circulation blowing state.
The fan is provided with a camera module for taking a thermal image, which may include a thermal imaging camera, but may also include other devices or systems capable of taking a thermal image. And when the fan is in the first state, the shooting module is called at regular time according to a preset time interval so as to obtain a thermal imaging image containing the gesture action of the user. And the fan judges whether the awakening condition of the second state of the fan is reached or not according to the thermal imaging image, namely whether the fan can enter the second state or not is judged.
And S102, judging whether a wake-up condition of a second state of the fan is reached or not according to the thermal imaging image, wherein the second state is used for realizing gesture control according to gesture actions of a user.
Specifically, based on the corresponding relationship between the colors and the temperatures of the thermal imaging images, the fan may determine whether the wake-up condition of the second state of the fan is achieved according to the thermal imaging image containing the gesture motion of the user, that is, determine the temperature corresponding to the current user according to the thermal imaging image, and determine whether the wake-up condition of the second state of the fan is achieved according to the temperature corresponding to the current user.
In some embodiments, as shown in fig. 3, the determining whether the wake-up condition of the second state of the fan is reached according to the thermal imaging image specifically includes: step S1021 to step S1023.
And S1021, determining a temperature set of the current body temperature of the user according to the thermal imaging image based on the corresponding relation between the colors and the temperatures of the thermal imaging image.
The different colors on the thermographic image represent the different temperatures of the object under test. Therefore, according to the color corresponding to the thermal imaging image, the temperature set of the current body temperature corresponding to the user can be determined.
In some embodiments, the determining the temperature set of the current body temperature of the user according to the thermal imaging image specifically includes the following steps:
a1, extracting human body contour information of a user in the thermal imaging image;
a2, determining a target image area where a user is located in the thermal imaging image according to the human body contour information;
and A3, determining the temperature set of the current body temperature of the user according to the color of the target image area.
Illustratively, the step of extracting the human body contour information of the user in the thermal imaging image comprises: acquiring the temperature range of a human body; determining a pseudo color interval corresponding to the temperature range of the human body according to the corresponding relation between the preset temperature range and the pseudo color interval; determining an image of a false color in the thermal imaging image in a false color interval corresponding to the temperature range of the human body as a thermal imaging person image of the user; extracting human body contour information of the user according to the thermal imaging character image of the user; and determining the target image area according to the human body contour information of the user.
Specifically, the corresponding relationship between the temperature range and the pseudo color interval may be preset, where the corresponding relationship may be that one temperature value corresponds to one pseudo color, and one temperature range corresponds to one pseudo color interval, for example: and the temperature range of 36 ℃ corresponds to dark red, the temperature range of 37 ℃ corresponds to red, the temperature range of 38 ℃ corresponds to dark red, and the like, so that the false color interval corresponding to the temperature range of the human body can be determined to be dark red to dark red according to the corresponding relation between the preset temperature range and the false color interval. And then determining the image of the pseudo color in the thermal imaging image in the pseudo color interval corresponding to the temperature range of the human body as the thermal imaging person image of the user.
After the thermal imaging character image of the user is determined, determining the position information of the thermal imaging character image, and extracting the coordinate values of the edge pixel points of the thermal imaging character image from the position information of the thermal imaging character image; and obtaining the human body contour information of the thermal imaging character image according to the coordinate values of the edge pixel points, namely the human body contour information of the user. And determining a target image area where the user is located in the thermal imaging image according to the human body contour information, wherein the target image area is used for determining a temperature set of the current body temperature of the user.
In some embodiments, the determining the temperature set of the current body temperature of the user according to the color of the target image area includes the following steps:
dividing the target image region into a plurality of pixel blocks, the pixel blocks including at least one pixel; acquiring the color of each pixel block in the thermal imaging picture based on the corresponding relation between the color and the temperature of the thermal imaging picture; acquiring the temperature corresponding to each pixel block according to the color corresponding to each pixel block; and generating a temperature set corresponding to the target image area according to the temperature corresponding to each pixel block, and taking the temperature set as the temperature set of the current body temperature of the user.
Specifically, the target image area is divided into a plurality of pixel blocks according to a preset picture division rule, wherein the pixel blocks comprise at least one pixel; then acquiring a corresponding relation between preset thermal imaging image colors and temperature; and finally, based on the corresponding relation between the colors and the temperatures of the thermal imaging images, according to the colors of the pixel blocks in the target image area, determining temperature data corresponding to the pixel blocks in the target image area, and according to the temperature data corresponding to the pixel blocks in the target image area, generating a temperature set corresponding to the target image area.
In the embodiment of the invention, the pseudo color interval corresponding to the temperature range of the human body can be determined by acquiring the predefined temperature range of the human body and the corresponding relation between the preset temperature range and the pseudo color interval, so that the position information of the thermal imaging character image in the thermal imaging image is determined, and the human body contour information of the thermal imaging character image, namely the human body contour information of the user, can be extracted, so that the body temperature of the current user can be determined directly according to the human body contour information of the user, the interference caused by the environmental temperature is avoided, and the error of fan control is reduced.
And step S1022, judging whether the body temperature of the user is greater than the temperature threshold value for starting the fan or not according to the temperature set.
The current temperature information of the user is recorded in the temperature set, and whether the fan needs to be started in the current user state is judged according to the current temperature information of the user. Specifically, whether the body temperature of the user reaches the temperature threshold for starting the fan can be judged according to the temperature data in the temperature set.
Illustratively, the determining whether the body temperature of the user is greater than the temperature threshold for starting the fan according to the temperature set specifically includes the following steps:
b1, taking the temperature data with the highest temperature in the temperature set as the body temperature data of the user or averaging all the temperature data in the temperature set to obtain average temperature data, and taking the average temperature data as the body temperature data of the user;
and B2, judging whether the body temperature of the user is greater than the temperature threshold value for starting the fan or not according to the body temperature data of the user.
The method comprises the steps that temperature data corresponding to a user are recorded in a temperature set acquired according to a thermal imaging picture, highest temperature data can be selected from the temperature data recorded in the temperature set, the highest temperature data serves as user body temperature data, or all the temperature data recorded in the temperature set are averaged to obtain average temperature data, and the average temperature data serves as the user body temperature data; and then judging whether the user body temperature data is greater than a preset temperature threshold value for starting the fan or not according to the determined user body temperature data.
And step S1023, if the body temperature of the user is greater than the temperature threshold, the awakening condition of the second state of the fan is achieved.
Specifically, if the user body temperature data is greater than a preset temperature threshold value for starting the fan, the wake-up condition of the second state of the fan is reached, and the fan can be switched from the first state to the second state.
Step S103, if the wake-up condition of the second state of the fan is reached, the fan is switched from the first state to the second state.
In some embodiments, when the user body temperature data is greater than the preset temperature threshold for turning on the fan, it indicates that the current user state requires the use of the fan, i.e. the wake-up condition of the second state of the fan is reached. In order to avoid misoperation caused by unintentional gesture actions of a user when the user is near the fan, when the fan is in the first state, corresponding operation cannot be generated according to the gesture of the user, and only after the current user state is judged to need to use the fan and enters the second state, corresponding operation can be generated according to the gesture of the user. For example, when a user needs to control the fan by using a gesture, a wake-up condition of the second state of the fan needs to be reached first, and after the wake-up condition is reached, the fan can be switched from the first state to the second state. When the fan is in the second state, a working instruction corresponding to the gesture action can be called according to the gesture action of the user, and corresponding work is completed according to the working instruction, such as starting the fan to supply air.
And step S104, when the fan is in the second state, obtaining a working instruction corresponding to the gesture action according to the gesture action in the thermal imaging image.
Illustratively, when the fan is in the second state, the fan can identify the gesture motion of the user in the thermal imaging image, then call a work instruction corresponding to the gesture motion according to the identified gesture motion, and finally perform corresponding operation according to the work instruction. In some embodiments, the work instruction corresponding to the gesture motion may be preset by a fan manufacturer or may be set by a user in a customized manner.
In some embodiments, as shown in fig. 4, the obtaining of the work instruction corresponding to the gesture motion according to the gesture motion in the thermal imaging image specifically includes: step S1041 and step S1042.
Step S1041, inputting the thermal imaging image into a pre-trained gesture recognition model to obtain a corresponding gesture action.
Specifically, a thermal imaging image acquired by a camera device and containing a gesture of a user is input into a pre-trained gesture recognition model to perform gesture recognition, so as to output a recognition result, where the recognition result may include a gesture contained in the thermal imaging image, as shown in fig. 5, and fig. 5 is a schematic diagram of several recognized gestures provided in an embodiment of the present application.
In some embodiments, the inputting the thermal imaging image into the pre-trained gesture recognition model specifically includes the following steps:
c1, performing image preprocessing on the thermal imaging image to obtain an image with a preset format;
and C2, inputting the image in the preset format into the pre-trained gesture recognition model.
In other words, in order to improve the recognition accuracy of the gesture recognition model for the input image and reduce the computational complexity, after the thermal imaging image including the gesture action of the user is acquired, the acquired thermal imaging image may be preprocessed, which specifically includes: carrying out size adjustment on the thermal imaging image to obtain an image with a preset size; and carrying out format conversion on the image with the preset size to obtain the image with the preset format.
Specifically, the size of the acquired images is adjusted, so that the acquired images with different sizes are adjusted to be uniform in size. After the size IS adjusted, format conversion IS performed on the image with the preset size, wherein due to different sampling formats of the cameras, the format of the acquired image including the gesture action of the user may be different, and for example, the format may be a BMP format, a JPG format, or an IS2 format, etc. The format conversion is carried out on the images with the preset size by using a conversion formula, and the images are converted into a uniform format, for example, the images with the preset size are unified into a JPG format, so that the processing of the images by a gesture recognition model is facilitated, and the recognition accuracy is improved.
It should be noted that, when performing size adjustment and format adjustment on the acquired image, the adjustment sequence of size adjustment and format adjustment is not limited, and the size adjustment and then the format adjustment may be performed first, or the format adjustment and then the size adjustment may be performed first.
Step S1042, a work instruction corresponding to the gesture motion is called according to the recognized gesture motion.
Exemplarily, if the recognized gesture motion is a starting gesture, calling a starting instruction corresponding to the starting gesture; if the recognized gesture action is a closing gesture, calling a closing instruction corresponding to the closing gesture; if the recognized gesture motion is an enhanced gesture, calling an enhanced instruction corresponding to the enhanced gesture; and if the recognized gesture motion is a weakening gesture, calling a weakening instruction corresponding to the weakening gesture.
And S105, controlling the fan to realize corresponding operation according to the working instruction.
Illustratively, the fan is controlled to be started according to the starting instruction; controlling the fan to be closed according to the closing instruction; controlling the wind power supplied by the fan to be enhanced according to the enhancing instruction, for example, selecting the wind power one level higher than the current wind power; and controlling the wind power supplied by the fan to weaken according to the weakening instruction, for example, selecting the wind power one step lower than the current wind power.
In some embodiments, after the fan performs air supply according to the start instruction, the method further includes the following steps:
identifying azimuth data of the user according to the thermal imaging image;
and adjusting the working direction of the air supply of the fan according to the azimuth data.
For example, the position coordinate where the user is located is determined according to the thermal imaging image, the corresponding air supply range is set according to the position coordinate, the rotation angle of the fan is adjusted to supply air according to the air supply range, and air supply range intellectualization is achieved.
In the fan control method provided by the above embodiment, when the fan is in the first state, whether the wake-up condition of the second state of the fan is reached is determined by analyzing the thermal imaging image which is shot by the shooting module and contains the gesture action of the user; when the fan is in the second state, gesture recognition is carried out on the thermal imaging image containing the gesture actions of the user, and a working instruction corresponding to the gesture actions is called and executed according to the recognized gesture actions so as to realize intelligent control. The fan control method controls the fan by using the gesture, achieves intelligent control, and meanwhile uses temperature judgment, so that the accuracy of the intelligent control is improved.
Further, based on the above embodiments, a method for training a gesture recognition model for a fan control method of the present application is provided. The gesture recognition model is obtained by model training based on a convolutional neural network, and can be obtained by training with other networks. The model training of the convolutional neural network will be described as an example. The training method of the gesture recognition model comprises the following steps:
s1, obtaining a sample gesture image and constructing sample data according to the labeling type of the sample gesture image, wherein the sample gesture image is shot images of a plurality of gesture actions;
and S2, performing model training according to the constructed sample data based on the initialized convolutional neural network to obtain the gesture recognition model.
Specifically, a plurality of sample gesture images and annotation category construction sample data of each sample gesture image are obtained, wherein the sample gesture images comprise gesture action images shot from different angles.
Illustratively, the sample gesture image is a captured image that includes a gesture motion. In some embodiments, the sample gesture images may be gesture motion images taken from different angles. Selecting a plurality of different gesture actions, shooting the gesture actions from different angles, and taking the shot images as sample gesture images, wherein the sample gesture images form a sample gesture image set for training a gesture recognition model.
In some embodiments, since the fan control method is applied to the fan, the trained model can be stored in the memory of the fan, so as to increase the data processing speed and the reaction speed of the model, increase the interaction speed, and bring a more real-time experience to the user.
In some embodiments, in order to ensure normal operation of the fan and quickly identify the category of the gesture motion, the trained gesture recognition model needs to be compressed, and the compressed model is stored in a memory of the fan.
The compression processing specifically comprises pruning, quantization, Huffman coding and the like of the gesture recognition model so as to reduce the size of the gesture recognition model and accelerate the recognition operation speed, and the gesture recognition model is conveniently stored in a memory of a fan with small capacity.
According to the training method provided by the embodiment, the sample data is constructed after the plurality of sample gesture images and the labeling types of the sample gesture images are obtained, model training is performed according to the constructed sample data based on the initialized convolutional neural network to obtain the pre-trained gesture recognition model, and the pre-trained gesture recognition model is applied to the fan control method, so that the recognition accuracy of the gesture actions of the user can be improved.
In addition, the embodiment of the application also provides a computer readable storage medium.
The computer readable storage medium of the present application stores a fan control program, wherein the fan control program, when executed by a processor, implements the steps of the fan control method as described above.
The method implemented when the fan control program is executed may refer to various embodiments of the fan control method of the present application, and will not be described herein again.
The computer readable storage medium may be an internal storage unit of the fan described in the foregoing embodiment, for example, a hard disk or a memory controlled by the fan. The computer readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the computer device.
It is to be understood that the terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items. It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments. While the invention has been described with reference to specific embodiments, the scope of the invention is not limited thereto, and those skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A fan control method is characterized in that a shooting module is arranged on a fan, and the fan control method comprises the following steps:
when the fan is in a first state, calling the shooting module to acquire a thermal imaging image containing the gesture action of the user;
judging whether a wake-up condition of a second state of the fan is reached or not according to the thermal imaging image, wherein the second state is used for realizing gesture control according to gesture actions of a user;
if the wake-up condition of the second state of the fan is reached, the fan is switched from the first state to the second state;
when the fan is in a second state, acquiring a working instruction corresponding to the gesture action according to the gesture action in the thermal imaging image;
and controlling the fan to realize corresponding operation according to the working instruction.
2. The fan control method of claim 1, wherein said determining whether a fan second state wake-up condition is reached based on the thermographic image comprises:
determining a temperature set of the current body temperature of the user according to the thermal imaging image based on the corresponding relation between the colors and the temperatures of the thermal imaging image;
judging whether the body temperature of the user is greater than a temperature threshold value for starting the fan or not according to the temperature set;
and if the body temperature of the user is greater than the temperature threshold, the awakening condition of the second state of the fan is achieved.
3. The fan control method of claim 2, wherein said determining a set of temperatures of a user's current body temperature from said thermographic image comprises:
extracting human body contour information of a user in the thermal imaging image;
determining a target image area where a user is located in the thermal imaging image according to the human body contour information;
and determining the temperature set of the current body temperature of the user according to the color of the target image area.
4. The method as claimed in claim 2, wherein said determining whether the body temperature of the user is greater than a temperature threshold for turning on the fan according to the temperature set comprises:
taking the temperature data with the highest temperature in the temperature set as the user body temperature data or taking the average value of the temperature data in the temperature set as the user body temperature data;
and judging whether the body temperature of the user is greater than the temperature threshold value for starting the fan or not according to the body temperature data of the user.
5. The fan control method according to claim 1, wherein the obtaining of the work instruction corresponding to the gesture motion according to the gesture motion in the thermal imaging image comprises:
inputting the thermal imaging image into a pre-trained gesture recognition model to obtain a corresponding gesture action;
and calling a working instruction corresponding to the gesture action according to the recognized gesture action.
6. The fan control method of claim 5, wherein said inputting the thermographic image into a pre-trained gesture recognition model comprises:
performing image preprocessing on the thermal imaging image to obtain an image in a preset format;
and inputting the images in the preset format into a pre-trained gesture recognition model.
7. The fan control method as claimed in claim 5, further comprising:
acquiring sample gesture images and annotation category construction sample data of the sample gesture images, wherein the sample gesture images are shot images of a plurality of gesture actions;
and based on the initialized convolutional neural network, performing model training according to the constructed sample data to obtain the gesture recognition model.
8. The fan control method according to any one of claims 1 to 7, further comprising:
identifying azimuth data of the user according to the thermal imaging image;
and adjusting the working direction of the air supply of the fan according to the azimuth data.
9. A fan, characterized in that the fan comprises a shooting module, a memory and a processor;
the shooting module is used for shooting a thermal imaging image containing the gesture action of the user;
the memory is used for storing a computer program;
the processor for executing the computer program and implementing the fan control method according to any of claims 1-8 when executing the computer program.
10. A computer-readable storage medium storing a computer program, characterized in that: the computer program, when executed by a processor, implements a fan control method as claimed in any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911216437.8A CN112989870A (en) | 2019-12-02 | 2019-12-02 | Fan control method, fan and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911216437.8A CN112989870A (en) | 2019-12-02 | 2019-12-02 | Fan control method, fan and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112989870A true CN112989870A (en) | 2021-06-18 |
Family
ID=76331478
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911216437.8A Pending CN112989870A (en) | 2019-12-02 | 2019-12-02 | Fan control method, fan and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112989870A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114326999A (en) * | 2021-12-30 | 2022-04-12 | 苏州浪潮智能科技有限公司 | Thermal imaging based heat dissipation regulation and control method, system, equipment and storage medium |
| CN116686605A (en) * | 2023-08-09 | 2023-09-05 | 山东东普永磁电机有限公司 | Air state control method and equipment based on permanent magnet motor |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101504169A (en) * | 2008-02-05 | 2009-08-12 | Lg电子株式会社 | Air conditioner and its control method |
| CN103188537A (en) * | 2011-10-05 | 2013-07-03 | 索尼公司 | Input apparatus and input recognition method |
| CN103363633A (en) * | 2012-04-02 | 2013-10-23 | 三菱电机株式会社 | Indoor unit of air-conditioning apparatus |
| CN104965535A (en) * | 2015-05-27 | 2015-10-07 | 小米科技有限责任公司 | Temperature adjusting device control method and apparatus |
| CN106020495A (en) * | 2016-06-30 | 2016-10-12 | 广东美的制冷设备有限公司 | Gesture recognition method, gesture recognition module and device |
| CN106321483A (en) * | 2016-08-26 | 2017-01-11 | 珠海格力电器股份有限公司 | Fan, fan control method and system |
| CN106650704A (en) * | 2017-01-10 | 2017-05-10 | 广东美的制冷设备有限公司 | Gesture recognition module, gesture recognition method and device and electric equipment |
| CN106839290A (en) * | 2017-01-16 | 2017-06-13 | 广东美的制冷设备有限公司 | The control method and control device and air-conditioner of gesture identification |
| CN108105136A (en) * | 2017-11-03 | 2018-06-01 | 珠海格力电器股份有限公司 | Fan control method and device and fan |
| CN108775682A (en) * | 2018-08-22 | 2018-11-09 | 广东美的制冷设备有限公司 | Air conditioner and its control method, device and computer readable storage medium |
| CN109114032A (en) * | 2018-08-07 | 2019-01-01 | 珠海格力电器股份有限公司 | Electric fan control method and device, storage medium and electric fan |
| KR101939721B1 (en) * | 2017-08-31 | 2019-01-17 | 동국대학교 산학협력단 | A smart fan having face/gesture recognition function |
| CN110018705A (en) * | 2019-05-16 | 2019-07-16 | 格力电器（重庆）有限公司 | Electric appliance control system with intelligent motion sensing function and control method |
-
2019
- 2019-12-02 CN CN201911216437.8A patent/CN112989870A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101504169A (en) * | 2008-02-05 | 2009-08-12 | Lg电子株式会社 | Air conditioner and its control method |
| CN103188537A (en) * | 2011-10-05 | 2013-07-03 | 索尼公司 | Input apparatus and input recognition method |
| CN103363633A (en) * | 2012-04-02 | 2013-10-23 | 三菱电机株式会社 | Indoor unit of air-conditioning apparatus |
| CN104965535A (en) * | 2015-05-27 | 2015-10-07 | 小米科技有限责任公司 | Temperature adjusting device control method and apparatus |
| CN106020495A (en) * | 2016-06-30 | 2016-10-12 | 广东美的制冷设备有限公司 | Gesture recognition method, gesture recognition module and device |
| CN106321483A (en) * | 2016-08-26 | 2017-01-11 | 珠海格力电器股份有限公司 | Fan, fan control method and system |
| CN106650704A (en) * | 2017-01-10 | 2017-05-10 | 广东美的制冷设备有限公司 | Gesture recognition module, gesture recognition method and device and electric equipment |
| CN106839290A (en) * | 2017-01-16 | 2017-06-13 | 广东美的制冷设备有限公司 | The control method and control device and air-conditioner of gesture identification |
| KR101939721B1 (en) * | 2017-08-31 | 2019-01-17 | 동국대학교 산학협력단 | A smart fan having face/gesture recognition function |
| CN108105136A (en) * | 2017-11-03 | 2018-06-01 | 珠海格力电器股份有限公司 | Fan control method and device and fan |
| CN109114032A (en) * | 2018-08-07 | 2019-01-01 | 珠海格力电器股份有限公司 | Electric fan control method and device, storage medium and electric fan |
| CN108775682A (en) * | 2018-08-22 | 2018-11-09 | 广东美的制冷设备有限公司 | Air conditioner and its control method, device and computer readable storage medium |
| CN110018705A (en) * | 2019-05-16 | 2019-07-16 | 格力电器（重庆）有限公司 | Electric appliance control system with intelligent motion sensing function and control method |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114326999A (en) * | 2021-12-30 | 2022-04-12 | 苏州浪潮智能科技有限公司 | Thermal imaging based heat dissipation regulation and control method, system, equipment and storage medium |
| CN114326999B (en) * | 2021-12-30 | 2023-07-14 | 苏州浪潮智能科技有限公司 | Thermal imaging heat dissipation regulation and control method, system, equipment and storage medium |
| CN116686605A (en) * | 2023-08-09 | 2023-09-05 | 山东东普永磁电机有限公司 | Air state control method and equipment based on permanent magnet motor |
| CN116686605B (en) * | 2023-08-09 | 2023-10-10 | 山东东普永磁电机有限公司 | Air state control method and equipment based on permanent magnet motor |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107992794B (en) | A kind of biopsy method, device and storage medium | |
| RU2629469C1 (en) | Method and device for alarm | |
| CN106225174B (en) | Air conditioner control method and system and air conditioner | |
| CN108006889B (en) | Air conditioner control method and device | |
| CN112855594A (en) | Air supply control method, fan and computer readable storage medium | |
| CN112989870A (en) | Fan control method, fan and computer readable storage medium | |
| CN110308661B (en) | Intelligent device control method and device based on machine learning | |
| CN107566227A (en) | Control method and device of household appliance, intelligent device and storage medium | |
| JP2011095862A (en) | Apparatus and method for processing image and program | |
| US20190080119A1 (en) | Unlocking control methods and related products | |
| CN112926358A (en) | Fan control method, device and computer readable storage medium | |
| CN111965991A (en) | Authority adjusting method and device of intelligent control switch, intelligent control switch and storage medium | |
| CN107977437B (en) | Image processing method, image processing apparatus, storage medium, and electronic device | |
| CN113093556A (en) | Clothing collection reminding method, clothes hanger, system and storage medium | |
| CN113047018A (en) | Clothes hanger and drying control method, server, system and storage medium thereof | |
| CN112855593A (en) | Fan control method, fan, intelligent temperature control system and storage medium | |
| CN103873755A (en) | System and method for shooting leaping people | |
| CN105549376A (en) | Terminal alarm clock control method and device | |
| CN112764349A (en) | Clothes hanger control method, clothes hanger, system and storage medium | |
| CN112696372A (en) | Fan adjusting method, fan and storage medium | |
| CN113761974A (en) | Method for monitoring scalp, intelligent hair dryer and storage medium | |
| CN113802324A (en) | Household appliance interconnection control method, device, server and storage medium | |
| CN112861571A (en) | Household appliance control method, control device and computer readable storage medium | |
| CN113126870A (en) | Parameter setting method, intelligent refrigerator and computer readable storage medium | |
| CN112983871A (en) | Fan control method, fan and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |