CN109753948B - Microwave radar-based air conditioner control method and device, storage medium and processor - Google Patents
Microwave radar-based air conditioner control method and device, storage medium and processor Download PDFInfo
- Publication number
- CN109753948B CN109753948B CN201910081551.8A CN201910081551A CN109753948B CN 109753948 B CN109753948 B CN 109753948B CN 201910081551 A CN201910081551 A CN 201910081551A CN 109753948 B CN109753948 B CN 109753948B
- Authority
- CN
- China
- Prior art keywords
- microwave radar
- user
- indoor environment
- microwave
- air conditioner
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Air Conditioning Control Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an air conditioner control method and device based on a microwave radar, a storage medium and a processor. The method comprises the following steps: sending out a microwave signal through a microwave radar device; collecting a return signal of the microwave signal, wherein the return signal is a signal returned after the microwave signal meets an obstacle in the indoor environment; determining the distance between the microwave radar device and the obstacle according to the time difference between the first time when the microwave radar device transmits the microwave signals and the second time when the microwave radar device receives the return signals; determining the outline of each obstacle according to the distance between the microwave radar device and each obstacle; constructing a three-dimensional image of the indoor environment according to the contour of the obstacle; acquiring a user gesture from a three-dimensional image of an indoor environment; and controlling the air conditioner to operate according to the posture of the user. According to the invention, the effect of controlling the operation of the air conditioner through the microwave radar is achieved.
Description
Technical Field
The invention relates to the technical field of microwave radars, in particular to an air conditioner control method and device based on a microwave radar, a storage medium and a processor.
Background
At present in intelligent house field, what carry out intelligent control to the air conditioner mainly adopts is the mode of shooting video recording surrounding environment condition in real time through the camera, but this kind of mode receives many factors to restrict the use mode not flexible enough, for example, camera quantity, restriction such as installation angle, has a lot of dead angles and can't look over for the data of gathering according to the camera is controlled the air conditioner still intelligent inadequately.
Aiming at the problem that the air conditioner is not intelligent enough to be controlled according to the data collected by the camera in the related art, an effective solution is not provided at present.
Disclosure of Invention
The invention mainly aims to provide an air conditioner control method and device based on a microwave radar, a storage medium and a processor, so as to solve the problem that the control of an air conditioner is not intelligent enough according to data acquired by a camera.
In order to achieve the above object, according to an aspect of the present invention, there is provided a microwave radar-based air conditioner control method, the method including: sending out a microwave signal through a microwave radar device; collecting a return signal of the microwave signal, wherein the return signal is a signal returned after the microwave signal meets an obstacle in an indoor environment; determining the distance between the microwave radar device and an obstacle according to the time difference between the first time when the microwave radar device transmits the microwave signals and the second time when the microwave radar device receives the return signals; determining the outline of each obstacle according to the distance between the microwave radar device and each obstacle; constructing a three-dimensional image of the indoor environment according to the contour of the obstacle; acquiring a user gesture from a three-dimensional image of an indoor environment; and controlling the air conditioner to operate according to the posture of the user.
Further, prior to obtaining the user's gesture from the three-dimensional image of the indoor environment, the method further comprises: acquiring sample data of a preset number, wherein each group of sample data comprises projection of a three-dimensional image of an indoor environment and a user posture label in the indoor environment; and performing model training on the convolutional neural network model according to the preset number of sample data to obtain a trained user gesture recognition model.
Further, acquiring the gesture of the user from the three-dimensional image of the indoor environment comprises: performing projection extraction on the three-dimensional image of the indoor environment to obtain a projection of the three-dimensional image of the indoor environment; and inputting the projection of the three-dimensional image of the indoor environment into the user gesture recognition model for model recognition to obtain the gesture of the user.
Further, controlling the operation of the air conditioner according to the posture of the user includes: acquiring a preset corresponding relation between a user posture and an air conditioner operation parameter; determining air conditioner operation parameters according to the user posture and the corresponding relation; and controlling the air conditioner to operate according to the determined air conditioner operation parameters.
Further, the microwave radar device is installed on an air conditioner, and before determining the profile of each obstacle according to the distance between the microwave radar device and each obstacle and constructing a three-dimensional image of the indoor environment where the microwave radar device is located, the method further comprises: the microwave radar device extracting depth data as a function of time for each return signal, wherein the extracted depth data is used to populate the three-dimensional image; judging whether the data volume of the depth data in the first depth threshold section exceeds a preset depth data threshold; if the preset depth data threshold is exceeded, extracting the maximum value of the depth data in the first depth threshold section as the depth data in the first depth threshold section.
Further, the user's posture includes standing, lying down, sitting still.
In order to achieve the above object, according to another aspect of the present invention, there is also provided a microwave radar-based air conditioning control apparatus, including: a transmitting unit for transmitting a microwave signal by a microwave radar device; the acquisition unit is used for acquiring a return signal of the microwave signal, wherein the return signal is a signal returned after the microwave signal meets an obstacle in an indoor environment; the first determining unit is used for determining the distance between the microwave radar device and an obstacle according to the time difference between the first time when the microwave radar device transmits the microwave signals and the second time when the microwave radar device receives the return signals; a second determining unit, configured to determine a profile of each obstacle according to a distance between the microwave radar apparatus and the obstacle; a construction unit that constructs a three-dimensional image of the indoor environment according to the contour of the obstacle; a first acquisition unit configured to acquire a posture of a user from a three-dimensional image of the indoor environment; and the control unit is used for controlling the operation of the air conditioner according to the posture of the user.
Further, the apparatus further comprises: the second acquisition unit is used for acquiring a preset number of sample data before acquiring the gesture of the user from the three-dimensional image of the indoor environment, wherein each group of sample data comprises the projection of the three-dimensional image of the indoor environment and the gesture label of the user in the indoor environment; and the training unit is used for carrying out model training on the convolutional neural network model according to the sample data of the preset number to obtain a trained user gesture recognition model.
In order to achieve the above object, according to another aspect of the present invention, there is also provided a storage medium including a stored program, wherein when the program runs, an apparatus in which the storage medium is located is controlled to execute the microwave radar-based air conditioning control method according to the present invention.
In order to achieve the above object, according to another aspect of the present invention, there is also provided a processor for executing a program, wherein the program executes the microwave radar-based air conditioning control method according to the present invention.
The invention sends out microwave signals through a microwave radar device; collecting a return signal of the microwave signal, wherein the return signal is a signal returned after the microwave signal meets an obstacle in the indoor environment; determining the distance between the microwave radar device and the obstacle according to the time difference between the first time when the microwave radar device transmits the microwave signals and the second time when the microwave radar device receives the return signals; determining the outline of each obstacle according to the distance between the microwave radar device and each obstacle; constructing a three-dimensional image of the indoor environment according to the contour of the obstacle; acquiring a user gesture from a three-dimensional image of an indoor environment; the air conditioner is controlled to operate according to the posture of the user, the problem that the air conditioner is not intelligent enough to control according to data collected by the camera is solved, and the effect of controlling the air conditioner to operate through the microwave radar is achieved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a flowchart of a microwave radar-based air conditioning control method according to a first embodiment of the present invention;
fig. 2 is a schematic view of a microwave radar-based air conditioning control method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a convolutional neural network CNN according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a three-dimensional reconstruction process of a microwave radar image according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a microwave radar-based air conditioning control apparatus according to an embodiment of the present invention.
Detailed Description
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the application described herein may be used. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention provides an air conditioner control method based on a microwave radar.
Fig. 1 is a flowchart of a microwave radar-based air conditioning control method according to a first embodiment of the present invention, as shown in fig. 1, the method including the steps of:
step S102: sending out a microwave signal through a microwave radar device;
step S104: collecting a return signal of the microwave signal, wherein the return signal is a signal returned after the microwave signal meets an obstacle in the indoor environment;
step S106: determining the distance between the microwave radar device and the obstacle according to the time difference between the first time when the microwave radar device transmits the microwave signals and the second time when the microwave radar device receives the return signals;
step S108: determining the outline of each obstacle according to the distance between the microwave radar device and each obstacle;
step S110: constructing a three-dimensional image of the indoor environment according to the contour of the obstacle;
step S112: acquiring a user gesture from a three-dimensional image of an indoor environment;
step S114: and controlling the air conditioner to operate according to the posture of the user.
The embodiment sends out microwave signals through a microwave radar device; collecting a return signal of the microwave signal, wherein the return signal is a signal returned after the microwave signal meets an obstacle in the indoor environment; determining the distance between the microwave radar device and the obstacle according to the time difference between the first time when the microwave radar device transmits the microwave signals and the second time when the microwave radar device receives the return signals; determining the outline of each obstacle according to the distance between the microwave radar device and each obstacle; constructing a three-dimensional image of the indoor environment according to the contour of the obstacle; acquiring a user gesture from a three-dimensional image of an indoor environment; the air conditioner is controlled to operate according to the posture of the user, the problem that the air conditioner is not intelligent enough to control according to data collected by the camera is solved, and the effect of controlling the air conditioner to operate through the microwave radar is achieved.
The technical scheme of the embodiment of the invention can be used as an intelligent air conditioner control method based on microwave radar monitoring, the microwave radar is combined with an air conditioner, the environment is monitored by the microwave radar, the behavior state of a user is obtained, the air conditioner mode is adjusted accordingly, a microwave signal is sent out by a microwave radar device arranged at a set position, wherein the microwave signal is reflected when meeting an indoor obstacle to generate a return signal, the distance between the microwave radar and the obstacle can be determined according to the time difference of the two signals, and then a three-dimensional image in the current indoor environment can be determined, the position of the user and the posture of the user can be determined from the three-dimensional image under the indoor condition of the user, the air conditioner can be controlled to run according to the posture of the user, for example, the user posture can be standing, lying and sitting, and the user can be considered to sleep if lying, can adjust the mode and the parameter that are fit for the sleep with the air conditioner this moment, control the air conditioner operation through such mode and can make the air conditioner operation more intelligent, compare in camera data collection and control the air conditioner operation, the technical scheme of this application is more intelligent, and the restriction is less. At present, the user gestures are only recognized in simple and large-difference gestures such as standing, lying, sitting and the like, more and more precise user gestures can be recognized along with the technical progress, and the air conditioner is controlled to operate according to the user gestures.
Optionally, before the gesture of the user is acquired from the three-dimensional image of the indoor environment, acquiring a preset number of sample data, wherein each set of sample data includes a projection of the three-dimensional image of the indoor environment and a user gesture tag in the indoor environment; performing model training on the convolutional neural network model according to a preset number of sample data to obtain a trained user gesture recognition model, wherein the step of acquiring the gesture of the user from the three-dimensional image of the indoor environment comprises the following steps: performing projection extraction on the three-dimensional image of the indoor environment to obtain a projection of the three-dimensional image of the indoor environment; and inputting the projection of the three-dimensional image of the indoor environment into the user gesture recognition model for model recognition to obtain the gesture of the user.
The gesture of the user can be recognized by image recognition through a trained convolutional neural network model, the model needs to be trained before recognition, a trained sample is the projection of a certain number of indoor three-dimensional images and user gesture labels therein, and after the model is trained, the projection of the current indoor three-dimensional image can be input to obtain user gesture classification therein.
Optionally, the controlling of the air conditioner operation according to the user's gesture includes: acquiring a preset corresponding relation between a user posture and an air conditioner operation parameter; determining air conditioner operation parameters according to the posture and the corresponding relation of the user; and controlling the air conditioner to operate according to the determined air conditioner operation parameters.
The preset corresponding relation between the user posture and the air conditioner operation parameters can be stored in the air conditioner or in a separate storage database for calling, and the corresponding air conditioner operation parameters including the operation mode, the temperature, the humidity and the wind speed and other parameters can be obtained through the user posture table lookup.
Optionally, the microwave radar device is installed on the air conditioner, before the profile of the obstacle is determined according to the distance between the microwave radar device and each obstacle to construct a three-dimensional image of the indoor environment where the microwave radar device is located, the microwave radar device extracts depth data according to the time of each return signal, wherein the extracted depth data is used for filling the three-dimensional image; judging whether the data volume of the depth data in the first depth threshold section exceeds a preset depth data threshold; if the preset depth data threshold is exceeded, extracting the maximum value of the depth data in the first depth threshold segment as the depth data in the first depth threshold segment.
The position of the microwave radar device may be set on an air conditioner, the microwave radar device may extract depth data of each return signal before constructing a three-dimensional image of an indoor environment, information on a depth (i.e., a height direction) in the environment may be extracted according to a time node at which the data is received each time, a certain depth threshold is set at this time because the data amount may be too large, and if the number of data nodes in the threshold section reaches k or more, merging is performed. When merging, the maximum value of the segment of data is extracted as a representative value and is regarded as the data value of the depth. And after the data processing is finished, carrying out three-dimensional imaging according to the coordinates of each node, and outputting a three-dimensional image.
The embodiment of the present invention also provides a preferred implementation manner, and the following describes the technical solution of the embodiment of the present invention with reference to the preferred implementation manner.
The technical scheme of the embodiment of the invention can be used as an indoor air-conditioning mode control method based on microwave radar monitoring, and an intelligent air-conditioning mode control method based on microwave radar monitoring is designed.
Fig. 2 is a flowchart of a microwave radar-based air conditioner control method according to a second embodiment of the present invention, as shown in fig. 2, when a process starts, a microwave radar device installed on an air conditioner collects data in an environment, sends the data to a three-dimensional reconstruction imaging module, performs projection extraction on a three-dimensional image after imaging is completed, and sends the three-dimensional image to a CNN convolutional neural network, and the convolutional neural network discriminates the image and outputs a posture judgment of a user.
Fig. 3 is a structural diagram of a convolutional neural network CNN according to an embodiment of the present invention, as shown in fig. 3, the convolutional network is mainly composed of five parts, an input layer, a convolutional layer, a pooling layer, a full-link layer, and a softmax layer. The input was images, which were then concatenated by the convolutional layer. The convolution layer is mainly composed of convolution kernels, each convolution kernel is equivalent to a fully connected layer with a slightly small size, the size of a small square in images is consistent with that of the convolution kernel, the convolution kernels are scanned from left to right and from top to bottom from the top left of the images, when a unit area (convolution kernel area) is scanned, pixel points in iamge and the convolution kernels are subjected to matrix calculation to obtain a mapping area which is called a feature map, a plurality of feature maps form a convolution map layer, and if a left cube in a module becomes the convolution map. The effect of Images on the convolution kernel processing is to extract features from Iamges. The left convolution feature map in the Module also needs to be subjected to further feature extraction through a pooling layer, so that redundancy of features is reduced, pooling processing is similar to processing of convolution kernels, namely a unit area with a fixed size is scanned on the convolution feature map layer, and the difference is that the inside of a matrix is subjected to blocking processing instead of matrix calculation, for example, maximum pooling processing is carried out, namely, a maximum pixel point is obtained in the matrix; and (4) carrying out average pooling treatment, and averaging values of pixel points in the matrix. And obtaining a pooling feature map layer after pooling, such as a right cube in the module. Modules are formed by the convolutional layers and the pooling layers, after n-1 modules are connected subsequently, three full connection layers, FC1, FC2 and FC3 are connected, the three-dimensional feature map is converted into a one-dimensional full connection layer, and finally the result is judged through softmax.
Fig. 4 is a schematic diagram of a three-dimensional reconstruction process of a microwave radar image according to an embodiment of the present invention, and as shown in fig. 4, after a microwave radar module installed on an air conditioner collects environmental data, information on a depth (i.e., a height direction) in an environment is extracted according to a time node at which the data is received each time. Since the data amount may be too large, a certain depth threshold is set at this time, and if the number of data nodes in the threshold segment is k or more, the data nodes are merged, and when merging is performed, the maximum value of the segment of data is extracted as a representative value and regarded as a data value of the depth, and after data processing is completed, three-dimensional imaging is performed according to the coordinates of each node, and a three-dimensional image is output.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
The embodiment of the invention provides an air conditioner control device based on a microwave radar, which can be used for executing the air conditioner control method based on the microwave radar.
Fig. 5 is a schematic view of an air conditioning control apparatus based on a microwave radar according to an embodiment of the present invention, as shown in fig. 5, the apparatus including:
a transmitting unit 10 for transmitting a microwave signal by a microwave radar device;
the acquisition unit 20 is configured to acquire a return signal of the microwave signal, where the return signal is a signal returned after the microwave signal encounters an obstacle in the indoor environment;
a first determining unit 30 for determining a distance between the microwave radar apparatus and the obstacle according to a time difference between a first time when the microwave radar apparatus transmits the microwave signal and a second time when the microwave radar apparatus receives the return signal;
a second determining unit 40 for determining a profile of the obstacle according to a distance between the microwave radar apparatus and each obstacle;
a construction unit 50 that constructs a three-dimensional image of an indoor environment according to the contour of the obstacle;
a first acquisition unit 60 for acquiring a posture of a user from a three-dimensional image of an indoor environment;
and a control unit 70 for controlling the air conditioner to be operated according to the posture of the user.
This embodiment employs a transmitting unit 10 for emitting a microwave signal by means of a microwave radar device; the acquisition unit 20 is configured to acquire a return signal of the microwave signal, where the return signal is a signal returned after the microwave signal encounters an obstacle in the indoor environment; a first determining unit 30 for determining a distance between the microwave radar apparatus and the obstacle according to a time difference between a first time when the microwave radar apparatus transmits the microwave signal and a second time when the microwave radar apparatus receives the return signal; a second determining unit 40 for determining a profile of the obstacle according to a distance between the microwave radar apparatus and each obstacle; a construction unit 50 that constructs a three-dimensional image of an indoor environment according to the contour of the obstacle; a first acquisition unit 60 for acquiring a posture of a user from a three-dimensional image of an indoor environment; and the control unit 70 is used for controlling the air conditioner to operate according to the posture of the user, so that the problem that the air conditioner is not intelligently controlled according to the data collected by the camera is solved, and the effect of controlling the air conditioner to operate through the microwave radar is achieved.
Optionally, the apparatus further comprises: the second acquisition unit is used for acquiring a preset number of sample data before acquiring the gesture of the user from the three-dimensional image of the indoor environment, wherein each group of sample data comprises the projection of the three-dimensional image of the indoor environment and the gesture label of the user in the indoor environment; and the training unit is used for carrying out model training on the convolutional neural network model according to the preset number of sample data to obtain a trained user gesture recognition model.
Optionally, the first obtaining unit 60 includes: the extraction module is used for performing projection extraction on the three-dimensional image of the indoor environment to obtain the projection of the three-dimensional image of the indoor environment; and the input module is used for inputting the projection of the three-dimensional image of the indoor environment into the user gesture recognition model for model recognition to obtain the gesture of the user.
Alternatively, the control unit 70 includes: the acquisition module is used for acquiring the corresponding relation between the preset user posture and the air conditioner operation parameters; the determining module is used for determining the air conditioner operation parameters according to the posture and the corresponding relation of the user; and the control module is used for controlling the air conditioner to operate according to the determined air conditioner operation parameters.
The microwave radar-based air conditioner control device comprises a processor and a memory, wherein the transmitting unit 10, the collecting unit 20, the first determining unit 30 and the like are stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions.
The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. The inner core can be set to be one or more, and the operation of the air conditioner is controlled through the microwave radar by adjusting the parameters of the inner core.
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
An embodiment of the present invention provides a storage medium having a program stored thereon, the program implementing a microwave radar-based air conditioner control method when being executed by a processor.
The embodiment of the invention provides a processor, which is used for running a program, wherein the microwave radar-based air conditioner control method is executed when the program runs.
The embodiment of the invention provides equipment, which comprises a processor, a memory and a program which is stored on the memory and can run on the processor, wherein the processor executes the program and realizes the following steps: sending out a microwave signal through a microwave radar device; collecting a return signal of the microwave signal, wherein the return signal is a signal returned after the microwave signal meets an obstacle in the indoor environment; determining the distance between the microwave radar device and the obstacle according to the time difference between the first time when the microwave radar device transmits the microwave signals and the second time when the microwave radar device receives the return signals; determining the outline of each obstacle according to the distance between the microwave radar device and each obstacle; constructing a three-dimensional image of the indoor environment according to the contour of the obstacle; acquiring a user gesture from a three-dimensional image of an indoor environment; and controlling the air conditioner to operate according to the posture of the user. The device herein may be a server, a PC, a PAD, a mobile phone, etc.
The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a data processing device: sending out a microwave signal through a microwave radar device; collecting a return signal of the microwave signal, wherein the return signal is a signal returned after the microwave signal meets an obstacle in the indoor environment; determining the distance between the microwave radar device and the obstacle according to the time difference between the first time when the microwave radar device transmits the microwave signals and the second time when the microwave radar device receives the return signals; determining the outline of each obstacle according to the distance between the microwave radar device and each obstacle; constructing a three-dimensional image of the indoor environment according to the contour of the obstacle; acquiring a user gesture from a three-dimensional image of an indoor environment; and controlling the air conditioner to operate according to the posture of the user.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (9)
1. A microwave radar-based air conditioner control method is characterized by comprising the following steps:
sending out a microwave signal through a microwave radar device;
collecting a return signal of the microwave signal, wherein the return signal is a signal returned after the microwave signal meets an obstacle in an indoor environment;
determining the distance between the microwave radar device and an obstacle according to the time difference between the first time when the microwave radar device transmits the microwave signals and the second time when the microwave radar device receives the return signals;
determining the outline of each obstacle according to the distance between the microwave radar device and each obstacle;
constructing a three-dimensional image of the indoor environment according to the contour of the obstacle;
acquiring a gesture of a user from a three-dimensional image of the indoor environment;
controlling the air conditioner to operate according to the posture of the user;
wherein controlling the operation of the air conditioner according to the user's posture comprises:
acquiring a preset corresponding relation between a user posture and an air conditioner operation parameter;
determining air conditioner operation parameters according to the user posture and the corresponding relation;
and controlling the air conditioner to operate according to the determined air conditioner operation parameters.
2. The method of claim 1, wherein prior to obtaining the user's gesture from the three-dimensional image of the indoor environment, the method further comprises:
acquiring sample data of a preset number, wherein each group of sample data comprises projection of a three-dimensional image of an indoor environment and a user posture label in the indoor environment;
and performing model training on the convolutional neural network model according to the preset number of sample data to obtain a trained user gesture recognition model.
3. The method of claim 1, wherein obtaining the user's gesture from the three-dimensional image of the indoor environment comprises: performing projection extraction on the three-dimensional image of the indoor environment to obtain a projection of the three-dimensional image of the indoor environment; and inputting the projection of the three-dimensional image of the indoor environment into the user gesture recognition model for model recognition to obtain the gesture of the user.
4. The method of claim 1, wherein before determining the profile of each obstacle according to the distance between the microwave radar device and the obstacle to construct a three-dimensional image of the indoor environment in which the microwave radar device is located, the method further comprises:
the microwave radar device extracting depth data as a function of time for each return signal, wherein the extracted depth data is used to populate the three-dimensional image;
judging whether the data volume of the depth data in the first depth threshold section exceeds a preset depth data threshold;
if the preset depth data threshold is exceeded, extracting the maximum value of the depth data in the first depth threshold section as the depth data in the first depth threshold section.
5. The method of claim 1, wherein the user's posture comprises standing, lying, sitting still.
6. An air conditioner control device based on microwave radar is characterized by comprising:
a transmitting unit for transmitting a microwave signal by a microwave radar device;
the acquisition unit is used for acquiring a return signal of the microwave signal, wherein the return signal is a signal returned after the microwave signal meets an obstacle in an indoor environment;
the first determining unit is used for determining the distance between the microwave radar device and an obstacle according to the time difference between the first time when the microwave radar device transmits the microwave signals and the second time when the microwave radar device receives the return signals;
a second determining unit, configured to determine a profile of each obstacle according to a distance between the microwave radar apparatus and the obstacle;
a construction unit that constructs a three-dimensional image of the indoor environment according to the contour of the obstacle;
a first acquisition unit configured to acquire a posture of a user from a three-dimensional image of the indoor environment;
the control unit is used for controlling the operation of the air conditioner according to the posture of the user;
wherein the control unit includes: the acquisition module is used for acquiring the corresponding relation between the preset user posture and the air conditioner operation parameters; the determining module is used for determining the air conditioner operation parameters according to the posture and the corresponding relation of the user; and the control module is used for controlling the air conditioner to operate according to the determined air conditioner operation parameters.
7. The apparatus of claim 6, further comprising:
the second acquisition unit is used for acquiring a preset number of sample data before acquiring the gesture of the user from the three-dimensional image of the indoor environment, wherein each group of sample data comprises the projection of the three-dimensional image of the indoor environment and the gesture label of the user in the indoor environment;
and the training unit is used for carrying out model training on the convolutional neural network model according to the sample data of the preset number to obtain a trained user gesture recognition model.
8. A storage medium, characterized in that the storage medium comprises a stored program, wherein when the program runs, the storage medium is controlled to execute the microwave radar-based air conditioning control method according to any one of claims 1 to 5.
9. A processor, characterized in that the processor is configured to run a program, wherein the program is executed to execute the microwave radar-based air conditioning control method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910081551.8A CN109753948B (en) | 2019-01-28 | 2019-01-28 | Microwave radar-based air conditioner control method and device, storage medium and processor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910081551.8A CN109753948B (en) | 2019-01-28 | 2019-01-28 | Microwave radar-based air conditioner control method and device, storage medium and processor |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109753948A CN109753948A (en) | 2019-05-14 |
| CN109753948B true CN109753948B (en) | 2021-06-04 |
Family
ID=66406419
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910081551.8A Active CN109753948B (en) | 2019-01-28 | 2019-01-28 | Microwave radar-based air conditioner control method and device, storage medium and processor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109753948B (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110246259A (en) * | 2019-07-08 | 2019-09-17 | 广东科徕尼智能科技有限公司 | Based on microwave induced intelligent door lock system and microwave induced control method |
| CN110781764B (en) * | 2019-09-30 | 2021-08-03 | 北京大学 | Intelligent microwave sign language identification method |
| CN111067537A (en) * | 2019-11-11 | 2020-04-28 | 珠海格力电器股份有限公司 | Sleeping posture monitoring method, monitoring terminal and storage medium |
| CN110779150B (en) * | 2019-11-14 | 2021-05-14 | 宁波奥克斯电气股份有限公司 | Millimeter wave-based air conditioner control method and device and air conditioner |
| CN113140030A (en) * | 2020-01-17 | 2021-07-20 | 北京小米移动软件有限公司 | Three-dimensional model generation method and device and storage medium |
| CN113138384B (en) * | 2020-01-17 | 2023-08-15 | 北京小米移动软件有限公司 | Image acquisition method and device and storage medium |
| CN113516826A (en) * | 2020-04-10 | 2021-10-19 | 郑州任道智能科技有限公司 | Multidirectional intelligent abandon-prevention alarm device |
| CN111720980B (en) * | 2020-06-11 | 2022-09-06 | 青岛海尔空调器有限总公司 | Air conditioner indoor unit and control method thereof |
| CN112489372A (en) * | 2020-12-28 | 2021-03-12 | 南京大学 | Swimming pool monitoring and alarming system |
| CN113608224A (en) * | 2021-07-14 | 2021-11-05 | Oppo广东移动通信有限公司 | Human body recognition method, device, system, electronic equipment and storage medium |
| CN113655470B (en) * | 2021-08-09 | 2023-10-10 | 珠海格力电器股份有限公司 | Object detection method, device, equipment and storage medium |
| CN115866852B (en) * | 2023-02-22 | 2023-05-09 | 广州易而达科技股份有限公司 | Lighting lamp light adjusting method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103090503A (en) * | 2011-10-27 | 2013-05-08 | 海尔集团公司 | Air-conditioning device and control method thereof |
| CN104819549A (en) * | 2015-05-18 | 2015-08-05 | 广东美的暖通设备有限公司 | Air conditioner and control method thereof |
| WO2016046139A1 (en) * | 2014-09-25 | 2016-03-31 | Philips Lighting Holding B.V. | Control of lighting |
| CN108038420A (en) * | 2017-11-21 | 2018-05-15 | 华中科技大学 | A kind of Human bodys' response method based on deep video |
| CN109086700A (en) * | 2018-07-20 | 2018-12-25 | 杭州电子科技大学 | Radar range profile's target identification method based on depth convolutional neural networks |
| CN109114746A (en) * | 2018-09-30 | 2019-01-01 | 珠海格力电器股份有限公司 | Object detection system, method, air-conditioning system and computer readable storage medium |
-
2019
- 2019-01-28 CN CN201910081551.8A patent/CN109753948B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103090503A (en) * | 2011-10-27 | 2013-05-08 | 海尔集团公司 | Air-conditioning device and control method thereof |
| WO2016046139A1 (en) * | 2014-09-25 | 2016-03-31 | Philips Lighting Holding B.V. | Control of lighting |
| CN104819549A (en) * | 2015-05-18 | 2015-08-05 | 广东美的暖通设备有限公司 | Air conditioner and control method thereof |
| CN108038420A (en) * | 2017-11-21 | 2018-05-15 | 华中科技大学 | A kind of Human bodys' response method based on deep video |
| CN109086700A (en) * | 2018-07-20 | 2018-12-25 | 杭州电子科技大学 | Radar range profile's target identification method based on depth convolutional neural networks |
| CN109114746A (en) * | 2018-09-30 | 2019-01-01 | 珠海格力电器股份有限公司 | Object detection system, method, air-conditioning system and computer readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| LonchaNet: A Sliced-based CNN Architecture for Real-time 3D Object Recognition;F. Gomez-Donoso 等;《IJCNN 2017》;20170703;第412-418页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109753948A (en) | 2019-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109753948B (en) | Microwave radar-based air conditioner control method and device, storage medium and processor | |
| US10949995B2 (en) | Image capture direction recognition method and server, surveillance method and system and image capture device | |
| CN111666921B (en) | Vehicle control method, apparatus, computer device, and computer-readable storage medium | |
| US20170213080A1 (en) | Methods and systems for automatically and accurately detecting human bodies in videos and/or images | |
| CN104657936B (en) | Method and electronic installation for percentage regulation value | |
| CN113420729B (en) | Multi-scale target detection method, model, electronic equipment and application thereof | |
| CN104303193B (en) | Target classification based on cluster | |
| CN108256404B (en) | Pedestrian detection method and device | |
| CN107808116B (en) | Wheat and wheat spider detection method based on deep multilayer feature fusion learning | |
| CN107590456A (en) | Small micro- mesh object detection method in a kind of high-altitude video monitoring | |
| CN106971178A (en) | Pedestrian detection and the method and device recognized again | |
| CN108710367B (en) | Laser data identification method and device, robot and storage medium | |
| US20220138977A1 (en) | Two-stage depth estimation machine learning algorithm and spherical warping layer for equi-rectangular projection stereo matching | |
| WO2021104124A1 (en) | Method, apparatus and system for determining confinement pen information, and storage medium | |
| CN111985385A (en) | Behavior detection method, device and equipment | |
| CN111639668A (en) | Crowd density detection method based on deep learning | |
| CN115546901B (en) | Target detection model and method for pet normative behavior detection | |
| CN113723178A (en) | Method and device for detecting video monitoring fire | |
| CN114220076A (en) | Multi-target detection method, device and application thereof | |
| CN115376125A (en) | Target detection method based on multi-modal data fusion and in-vivo fruit picking method based on target detection model | |
| CN111382638B (en) | Image detection method, device, equipment and storage medium | |
| CN109740527B (en) | Image processing method in video frame | |
| US20190156141A1 (en) | Methods, systems and apparatus to improve image classification with boundary-bitmaps | |
| CN112699711A (en) | Lane line detection method, lane line detection device, storage medium, and electronic apparatus | |
| TW202247108A (en) | Visual positioning method, equipment, and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |