CN112329509A - Food material expiration reminding method and device, intelligent refrigerator and storage medium - Google Patents
Food material expiration reminding method and device, intelligent refrigerator and storage medium Download PDFInfo
- Publication number
- CN112329509A CN112329509A CN202010765943.9A CN202010765943A CN112329509A CN 112329509 A CN112329509 A CN 112329509A CN 202010765943 A CN202010765943 A CN 202010765943A CN 112329509 A CN112329509 A CN 112329509A
- Authority
- CN
- China
- Prior art keywords
- food material
- food
- storage temperature
- food materials
- materials
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/68—Food, e.g. fruit or vegetables
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
The invention discloses a food material expiration reminding method, which comprises the following steps: when the state change of a refrigerator door is detected, acquiring food material images through a preset image acquisition device; identifying the food material images to obtain food material categories of food materials in the food material images; determining the storage temperature of the food materials according to the food material categories, and adjusting the bin positions of the food materials to the storage temperature; and acquiring the shelf life of the food materials at the storage temperature, and sending a prompt to guide a user to process the food materials when detecting that the storage time of the food materials reaches the shelf life of the food materials. The invention also discloses a food material expiration reminding device, an intelligent refrigerator and a storage medium, and the user reminding for the state of food materials in the refrigerator is realized.
Description
Technical Field
The invention relates to the technical field of intelligent equipment, in particular to a food material expiration reminding method and device, an intelligent refrigerator and a storage medium.
Background
The refrigerator can be used as a refrigeration device capable of keeping constant low temperature, can be used for keeping constant low temperature state of food materials, can keep the food materials fresh by setting different temperatures in the refrigerator body, and can bring great convenience to users due to the fact that the quality guarantee period is sung.
Users usually put various food materials into the refrigerator, and due to the difference of food material types, the shelf lives of the various food materials are different, so that the users cannot know and perceive the food materials in time when the food materials deteriorate, the food materials are wasted, and peculiar smell generated by the refrigerator even threatens the health of the users.
Disclosure of Invention
The invention mainly aims to provide a food material expiration reminding method and device, an intelligent refrigerator and a storage medium, and aims to solve the technical problem that a user cannot timely and accurately acquire the state of food materials in the refrigerator.
In order to achieve the above object, the present invention provides a food material expiration reminding method, including the following steps:
when the state change of a refrigerator door is detected, acquiring food material images through a preset image acquisition device;
identifying the food material images to obtain food material categories of food materials in the food material images;
determining the storage temperature of the food materials according to the food material categories, and adjusting the bin positions of the food materials to the storage temperature;
and acquiring the shelf life of the food materials at the storage temperature, and sending a prompt to guide a user to process the food materials when detecting that the storage time of the food materials reaches the shelf life of the food materials.
In an embodiment, the identifying the food material image to obtain the food material categories of the food materials in the food material image includes:
globally scanning the food material image, and judging whether the food material image contains label information or not;
if the food material image contains the tag information, inquiring a cloud database, and acquiring the food material categories of the food materials corresponding to the tag information in the food material image;
and if the food material image does not contain label information, determining the food material category of each food material in the food material image according to the pixel color value of each pixel point in the food material image.
In an embodiment, if the food material image does not include tag information, the step of determining the food material category of each food material in the food material image according to the pixel color value of each pixel point in the food material image includes:
if the food material image does not contain label information, extracting pixel color values of all pixel points in the food material image;
acquiring a target pixel point of the pixel color value within a preset color value range, and calculating the proportion of the target pixel point to the total pixel point;
if the ratio is larger than or equal to a preset threshold value, judging that the food materials are fruits and vegetables;
if the ratio is smaller than a preset threshold value, comparing at least two food material images with shooting time intervals, and judging that the food material class is meat when pixel positions in the at least two food material images with the shooting time intervals are changed.
In an embodiment, the step of determining the storage temperature of the food material according to the food material categories and adjusting the bin where the food material is located to the storage temperature includes:
when the food material category is a label category, acquiring a first storage temperature corresponding to the label category, and adjusting the bin position of the food material to the first storage temperature;
when the food materials are fruits and vegetables, obtaining a second storage temperature corresponding to the fruits and vegetables, and adjusting the bin position of the food materials to the second storage temperature;
and when the food materials are meat, acquiring a third storage temperature corresponding to the meat, and adjusting the bin position where the food materials are located to the third storage temperature.
In an embodiment, after the step of identifying the food material image and obtaining the food material categories of the food materials in the food material image, the method includes:
generating a recommended menu and food material collocation taboo according to the food material categories;
and outputting and/or sending the recommended menu and the food material collocation taboo to a preset terminal so as to guide a user to process food materials.
In an embodiment, after the step of determining the storage temperature of the food material according to the food material categories and adjusting the bin where the food material is located to the storage temperature, the method includes:
when the food materials are fruits and vegetables, reducing the flow of the refrigerant to a first flow and/or reducing the rotating speed of the motor to a first rotating speed;
when the food material category is label category, the flow rate of the refrigerant is increased to a second flow rate and/or the rotating speed of the motor is increased to a second rotating speed;
and when the food materials are meat, increasing the flow of the refrigerant to a third flow and/or increasing the rotating speed of the motor to a third rotating speed, wherein the third flow is greater than the second flow, and the third rotating speed is greater than the second rotating speed.
In an embodiment, the step of obtaining the shelf life of the food material category at the storage temperature, and sending a prompt to guide a user to process the food material when it is detected that the storage time of the food material reaches the shelf life of the food material includes:
inquiring a preset database, and acquiring the shelf life of the food materials categories in the preset database at the storage temperature;
if the food material shelf life of the food material category at the storage temperature does not exist in the preset database, outputting prompt information, receiving a user-defined food material shelf life input by a user, and taking the user-defined food material shelf life as the food material shelf life of the food material category at the storage temperature;
and sending out a prompt to guide a user to process the food materials when the storage time of the food materials is detected to reach the shelf life of the food materials.
In addition, to achieve the above object, the present invention further provides a food material expiration reminding device, including:
a detection module: the food material image acquisition device is used for acquiring food material images through the preset image acquisition device when the state change of the refrigerator door is detected;
an identification module: the food material image is identified to obtain food material categories of food materials in the food material image;
a temperature adjusting module: the food storage temperature is determined according to the food categories, and the bin positions of the food are adjusted to the storage temperature;
an expiration prompting module: the food material quality guarantee period acquiring device is used for acquiring the food material quality guarantee period of the food material categories at the storage temperature, and sending out a prompt to guide a user to process food materials when the storage time of the food materials is detected to reach the food material quality guarantee period.
In addition, in order to realize the purpose, the invention also provides an intelligent refrigerator;
the intelligent refrigerator comprises: a camera, a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein:
the camera is used for shooting and acquiring picture data;
the computer program, when executed by the processor, implements the steps of the food material expiration reminding method as described above.
In addition, to achieve the above object, the present invention also provides a computer storage medium;
the computer storage medium stores a computer program, and the computer program when executed by a processor implements the steps of the food material expiration reminding method.
According to the food material expiration reminding method and device, the intelligent refrigerator and the storage medium provided by the embodiment of the invention, when the state change of the refrigerator door is detected, the food material image is acquired through the preset image acquisition device, the image information of the newly added food material is captured, the food material image is identified, the food material categories of the food materials in the food material image are obtained, the temperature of the refrigerator can be further adjusted to the appropriate storage temperature of the food materials after the food material categories are determined, namely the storage temperature of the food materials is determined according to the food material categories, the bin positions of the food materials are adjusted to the storage temperature so as to prolong the storage temperature of the food materials, the food material shelf lives of the food material categories at the storage temperature are obtained, the food material shelf lives of the food material categories at the storage temperature are accurately determined, and when the storage time of the food materials is detected to reach the food material shelf lives, the prompt is sent to guide the user to process the food materials, so that the user reminding of the state of the food materials in the refrigerator is realized, and the food material waste, the peculiar smell of the refrigerator and even the influence on the health of the user caused by the fact that the user cannot visually know the overdue deterioration condition of the food materials in the refrigerator are avoided.
Drawings
FIG. 1 is a schematic diagram of an apparatus in a hardware operating environment according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a food material expiration reminding method according to a first embodiment of the present invention;
fig. 3 is a flowchart illustrating a food material expiration reminding method according to a third embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
When the state change of a refrigerator door is detected, acquiring an image of food materials by a preset image acquisition device, capturing image information of newly added food materials, identifying the image of the food materials to obtain food material categories of the food materials in the image of the food materials, determining the food material categories, further adjusting the temperature of the refrigerator to the appropriate storage temperature of the food materials, namely determining the storage temperature of the food materials according to the food material categories, adjusting the bin positions of the food materials to the storage temperature to prolong the storage temperature of the food materials, acquiring the quality guarantee period of the food materials at the storage temperature to accurately determine the quality guarantee period of the food materials at the storage temperature, and when the storage time of the food materials is detected to reach the quality guarantee period, the prompt is sent to guide the user to process the food materials, so that the user reminding of the state of the food materials in the refrigerator is realized, and the food material waste, the peculiar smell of the refrigerator and even the influence on the health of the user caused by the fact that the user cannot visually know the overdue deterioration condition of the food materials in the refrigerator are avoided.
As shown in fig. 1, fig. 1 is a schematic structural diagram of a terminal in a hardware operating environment according to an embodiment of the present invention (also called an intelligent refrigerator, where the intelligent refrigerator may be formed by a separate food expiration reminding device, or may be formed by combining other devices with a food expiration reminding device).
The terminal of the embodiment of the invention can be a fixed terminal or a mobile terminal, such as an intelligent air conditioner with a networking function, an intelligent electric lamp, an intelligent power supply, an intelligent sound box, an automatic driving automobile, a Personal Computer (PC), a smart phone, a tablet computer, an electronic book reader, a portable computer and the like.
As shown in fig. 1, the terminal may include: a processor 1001, such as a Central Processing Unit (CPU), a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a WIreless interface (e.g., WIFI interface, WIreless FIdelity, WIFI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Optionally, the terminal may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, and a WiFi module; the input unit is compared with a display screen and a touch screen; the network interface may optionally be other than WiFi, bluetooth, probe, etc. in the wireless interface. Such as light sensors, motion sensors, and other sensors. In particular, the light sensor may include an ambient light sensor and a proximity sensor; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, the computer software product is stored in a storage medium (storage medium: also called computer storage medium, computer medium, readable storage medium, computer readable storage medium, or direct storage medium, etc., and the storage medium may be a non-volatile readable storage medium, such as RAM, magnetic disk, optical disk), and includes several instructions for enabling a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the method according to the embodiments of the present invention, and a memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a computer program.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; the processor 1001 may be configured to call the computer program stored in the memory 1005 and execute the steps of the food material expiration reminding method provided by the following embodiments of the present invention.
Referring to fig. 2, in a first embodiment of a food material expiration reminding method according to the present invention, the food material expiration reminding method includes:
and step S10, when the state change of the refrigerator door is detected, acquiring the food material image through a preset image acquisition device.
When detecting the change of refrigerator door state, the intelligence refrigerator gathers through predetermineeing image acquisition device and eats the material image, can understand, can judge to be that the user eats the material from the access in the intelligence refrigerator when opening or closing of refrigerator door, consequently the change of refrigerator door state contains opening and closing of refrigerator door, and the material image is eaten through predetermineeing image acquisition device collection to the back, predetermine the image acquisition device for predetermineeing the inside camera that is used for gathering in the intelligence refrigerator of arranging in and eat the material image, predetermine image acquisition device and can contain a plurality of cameras, if, the intelligence refrigerator divide into a plurality of functional areas, then set up a plurality of cameras respectively in each functional area and carry out image acquisition for the position that corresponds, if the intelligence refrigerator contains a plurality of positions again, then set up a plurality of cameras respectively and carry out image acquisition for the position that corresponds.
Step S20, recognizing the food material images to obtain the food material categories of the food materials in the food material images.
And the intelligent refrigerator identifies the food material images to obtain the food material categories of the food materials in the food material images. The food material image identification method includes various processing methods, such as directly connecting an existing image identification interface of an image identification service provider, and establishing an image identification model by using a machine learning method.
Specifically, the step S20 may include:
step a1, performing global scanning on the food material image, and judging whether the food material image contains label information.
And the intelligent refrigerator performs global scanning on the food material image and judges whether the food material image contains label information. It is understood that tag information may exist in food materials purchased by a user, and the tag information may carry information of corresponding food materials, such as food material types, production dates, shelf lives, and the like, for example, taking the tag information as an example and a two-dimensional code, an intelligent refrigerator performs global scanning on a food material image, the global scanning may further include steps of performing gray processing on the food material image, and the like, and then positions whether the food material image includes three feature regions of the two-dimensional code, and if the food material image includes three feature regions of the two-dimensional code, the food material image includes the tag information.
Step a2, if the food material image contains label information, querying a cloud database to obtain the food material categories of the food materials corresponding to the label information in the food material image.
If the food material image contains the tag information, the intelligent refrigerator queries a cloud database to obtain the food material categories of the food materials corresponding to the tag information in the food material image. The cloud database is a database containing the relation between the tag information and the food material information, such as a source database established by a manufacturer, associates the tag information with various information such as food material categories, and can acquire the corresponding food material categories by scanning the tag information.
Step a3, if the food material image does not contain label information, determining the food material category of each food material in the food material image according to the pixel color value of each pixel point in the food material image.
If the food material image does not contain label information, the intelligent refrigerator determines the food material categories of the food materials in the food material image according to the pixel color values of the pixel points in the food material image. When the food material image does not contain the tag information, the food material categories are determined in other manners, it can be understood that the fruit and vegetable food materials have obvious color features and the meat food materials such as living animals also have unique color features or dynamic features, the pixel values of the pixel points of the food material image are analyzed by using the features of the food materials, and the food material categories of the food materials in the food material image can be determined.
Specifically, the step a3 may include:
step a31, if the food material image does not contain label information, extracting pixel color values of each pixel point in the food material image.
Step a32, obtaining a target pixel point of the pixel color value in a preset color value range, and calculating the proportion of the target pixel point to the total pixel point.
Step a33, if the ratio is larger than or equal to a preset threshold value, determining that the food materials are fruits and vegetables.
Step a34, if the ratio is smaller than a preset threshold value, comparing at least two food material images with shooting time intervals, and when the pixel positions in the at least two food material images with shooting intervals are changed, judging that the food material class is meat.
And if the food material image does not contain label information, the intelligent refrigerator extracts the pixel color values of all pixel points in the food material image. The method comprises the steps of converting an image into a set of pixel points, wherein the set of pixel values is not repeated in the prior art, the pixel color values refer to RGB values forming pixel colors, an 8-bit map is taken as an example, the pixel color values are (0-255 ), an intelligent refrigerator obtains a target pixel point of the pixel color values in a preset range, the ratio of the target pixel point to total pixel points is calculated, the preset range refers to the pixel color value range (R-R, G-G, B-B) of a fruit and vegetable image, the preset range is a range established by analyzing the pixel color values of a large number of fruit and vegetable images, if the pixel color values of the pixel points of the food material image are in the preset range, the pixel points are taken as the target pixel points, then the ratio of the target pixel points to the total pixel points of the food material image is calculated, and if the ratio is greater than or equal to a, the intelligent refrigerator judges the food material categories as fruits and vegetables, the preset threshold is a threshold for judging whether the food material images are fruit and vegetable images, namely the proportion of the number of pixel band points in the pixel color value range of the fruit and vegetable images to the total pixel points exceeds the threshold, the food material images are considered to be fruit and vegetable images, the corresponding food materials also belong to the fruits and vegetables, particularly, the meat food materials can be determined by referring to a fruit and vegetable determination method, if the proportion is smaller than the preset threshold, the intelligent refrigerator compares at least two food material images with shooting time intervals, the pixel position change value in the food material images judges that the food material categories are meat, if the proportion is smaller than the preset threshold, the possibility that the food material images can directly determine the food material categories through label information and determine the food material categories as the fruits and vegetables is eliminated, and it can be understood that the image acquisition positions are preset in the intelligent refrigerator to be fixed, under the premise that the light source is fixed, the food material images acquired by the preset image acquisition device should be the same within a certain time interval, when the food material images acquired within the certain time interval are different, living animals such as fresh seafood and the like can be determined to exist in the intelligent refrigerator, in the pixel-based food material image analysis, the same-position pixels in at least two food material images with shooting time intervals change, and the food materials can be determined as living food materials, and in the embodiment, the living food materials and the rest of the animal meat are collectively referred to as meat.
In addition, the method for determining the food material categories can also adopt the existing image recognition method to perform specific image recognition, under the method, the recognition result of the food material categories is specific categories, such as spinach, lettuce, live crab, pork and the like, and on the premise of realizing the specific category determination, the humanized function of the intelligent refrigerator can be further widened, and the content of the part will be described in the following embodiments.
Step S30, determining the storage temperature of the food materials according to the food material categories, and adjusting the bin positions of the food materials to the storage temperature.
The intelligent refrigerator determines the storage temperature of the food materials according to the food material categories, and adjusts the bin positions of the food materials to the storage temperature. Specifically, modes for various food materials and categories can be preset in the intelligent refrigerator, if the vegetable mode, the meat mode and the like respectively have modes with different temperatures, the corresponding storage temperature in the corresponding mode can be determined after the food materials and categories are determined by the intelligent refrigerator, and then the bin position where the food materials are located is adjusted to the storage temperature.
Further, the step S30 may be followed by:
and b1, when the food materials are fruits and vegetables, reducing the flow of the refrigerant to a first flow and/or reducing the rotating speed of the motor to a first rotating speed.
And b2, when the food material category is label category, increasing the flow rate of the refrigerant to a second flow rate and/or increasing the rotating speed of the motor to a second rotating speed.
And b3, when the food materials are meat, increasing the flow of the refrigerant to a third flow and/or increasing the rotating speed of the motor to a third rotating speed, wherein the third flow is greater than the second flow, and the third rotating speed is greater than the second rotating speed.
When the food materials are fruits and vegetables, the intelligent refrigerator reduces the flow of the refrigerant to a first flow and/or reduces the rotating speed of the motor to a first rotating speed, when the food materials are labels, the intelligent refrigerator promotes the flow of the refrigerant to a second flow and/or promotes the rotating speed of the motor to a second rotating speed, when the food materials are meat, the intelligent refrigerator promotes the flow of the refrigerant to a third flow and/or promotes the rotating speed of the motor to a third rotating speed, wherein the third flow is greater than the second flow and greater than the first flow, the third rotating speed is greater than the second rotating speed and greater than the first rotating speed, and the adjustment is based on the default refrigeration mode of the intelligent refrigerator, such as the default fresh-keeping mode of the cold storage bin and the default refrigeration mode of the freezing bin.
Step S40, obtaining the shelf life of the food materials at the storage temperature, and sending out a prompt to guide a user to process the food materials when detecting that the storage time of the food materials reaches the shelf life of the food materials.
The intelligent refrigerator obtains the food material quality guarantee period of the food material categories at the storage temperature, and sends out a prompt to guide a user to process the food materials when detecting that the storage time of the food material amount reaches the food material quality guarantee period. Specifically, step S40 may include:
step c1, querying a preset database, and obtaining the shelf life of the food materials in the preset database at the storage temperature.
Step c2, if the food material shelf life of the food material class at the storage temperature does not exist in the preset database, outputting prompt information, receiving the self-defined food material shelf life input by a user, and taking the self-defined food material shelf life as the food material shelf life of the food material class at the storage temperature.
And c3, sending out a prompt to guide a user to process the food materials when the storage time of the food materials is detected to reach the shelf life of the food materials.
The intelligent refrigerator inquires a preset database to obtain the shelf life of the food materials at the storage temperature in the preset database, and it can be understood that the shelf life of the food materials stored in the intelligent refrigerator depends on the food material types and the storage temperature, the intelligent refrigerator inquires the preset database according to the food material types and the storage temperature to obtain the shelf life of the food materials, the preset database can be a pre-established local database or a cloud database, the preset data stores the data related to the food material types, the storage temperature and the food material shelf life, and is special, if the food material shelf life of the food material types at the storage temperature does not exist in the preset database, a user is prompted, the prompting method can be output by devices such as an audio output device and a display device of the intelligent refrigerator, and if the food material shelf life of the food material types at the storage temperature does not exist in the preset database, the intelligent refrigerator outputs prompt information, receives the shelf life of the user-defined food material input by the user, takes the shelf life of the user-defined food material as the shelf life of the food material class at the storage temperature, and sends a prompt to guide the user to process the food material when detecting that the storage time of the food material reaches the shelf life of the food material, the shelf life of the food material can be directly input by a user to set the shelf life of the food material, the input mode can be that touch input or voice input is carried out through a preset input device of the intelligent refrigerator, such as a touch screen and a microphone, and then the set shelf life of the food material is directly recorded as the shelf life of the food material class, the scene input by the user can also be used for modifying the quality guarantee period of the food materials acquired from the preset database by the intelligent refrigerator so as to deal with the situation that the identification of the identification types is wrong or cannot be identified.
In this embodiment, when a change in the state of a refrigerator door is detected, an image of food materials is acquired by a preset image acquisition device, image information of newly added food materials is captured, the food material image is identified, food material categories of each food material in the food material image are obtained, the temperature of the refrigerator can be further adjusted to the appropriate storage temperature of the food materials after the food material categories are determined, that is, the storage temperature of the food materials is determined according to the food material categories, the bin positions where the food materials are located are adjusted to the storage temperature, so as to prolong the storage temperature of the food materials, the food material shelf life of the food material categories at the storage temperature is obtained, so as to accurately determine the food material shelf life of the food material categories at the storage temperature, and when the storage time of the food materials is detected to reach the food material shelf life, a prompt is sent to guide a user to process the food materials, the reminding of the user of the food material state in the refrigerator is realized.
Further, on the basis of the above embodiment of the present invention, a second embodiment of the food material expiration reminding method of the present invention is further provided, where the present embodiment is a refinement step of step S30 in the first embodiment, and the food material expiration reminding method includes:
and d1, when the food material types are label types, acquiring a first storage temperature corresponding to the label types, and adjusting the bin positions of the food materials to the first storage temperature.
And d2, when the food materials are fruits and vegetables, obtaining a second storage temperature corresponding to the fruits and vegetables, and adjusting the bin position of the food materials to the second storage temperature.
And d3, when the food materials are meat, obtaining a third storage temperature corresponding to the meat, and adjusting the bin position where the food materials are located to the third storage temperature.
When the food material types are label types, acquiring a first storage temperature corresponding to the label types, adjusting the bin where the food materials are located to the first storage temperature, wherein the first storage temperature can be the storage temperature acquired by scanning the label information, at the moment, the first storage temperature is calibrated by a food material producer and written into the label information, and the bin where the food materials are located is adjusted to the first storage temperature by the intelligent refrigerator so as to prolong the storage time of the label type food materials. When eating the material class for the vegetables, acquire the second save temperature that the vegetables correspond will eat the position adjustment of material place extremely the second save temperature, the second save temperature is the save temperature of restriction vegetables respiration, generally is between 1 ~ 7 degrees eat the material class for the meat, acquire the third save temperature that the vegetables correspond, will eat the position adjustment of material place to third save temperature, third save temperature is generally less than 0 ℃.
In this embodiment, the intelligent refrigerator sets up different preservation temperatures respectively to the food material categories that food material image recognition confirms, and to the condition of many positions, the setting of preservation temperature can specifically arrive the position, has realized the management of differentiated food material temperature, has prolonged the save time of edible material.
Further, referring to fig. 3, on the basis of the above embodiment of the present invention, a third embodiment of the food material expiration reminding method of the present invention is further provided, where the present embodiment is a post-step of step S20 in the first embodiment, and the food material expiration reminding method includes:
and step S21, generating a recommended menu and food material collocation taboo according to the food material categories.
And step S22, outputting and/or sending the recommended menu and the food material collocation taboo to a preset terminal so as to guide a user to process food materials.
The intelligent refrigerator generates a recommended menu and food material collocation taboos according to the food material categories, and the recommended menu and the food material collocation taboos are output and/or sent to a preset terminal by the intelligent refrigerator so as to guide a user to process food materials. As described in the foregoing embodiment, the food material categories may be fruits and vegetables, meat and other major categories, and may also be specific food material categories such as spinach, lettuce, live crabs and pork, after the specific food material categories of the food materials are identified, a recommended recipe and food material collocation taboo may be generated according to the food material categories, the recommended recipe and the food material collocation taboo may be output and/or sent to a preset terminal by the smart refrigerator to guide a user to perform food material processing, when the smart refrigerator has a display device, the recipe and the food material collocation taboo are displayed on the display device or sent to the preset terminal, when the smart refrigerator does not have the display device, the information is directly sent to the preset terminal, and the preset terminal may be a smart phone, a smart television and other devices connected to the smart refrigerator.
In this embodiment, the intelligent refrigerator recommends the recipe according to the food material type after discerning the food material type, and the guide user consumes the food material gradually when giving the user culinary art inspiration to avoid eating the extravagant overdue, provide simultaneously and eat material collocation taboo, compromise user diet safety, make intelligent refrigerator more humanized.
In addition, an embodiment of the present invention further provides a food material expiration reminding device, where the food material expiration reminding device includes:
a detection module: the food material image acquisition device is used for acquiring food material images through the preset image acquisition device when the state change of the refrigerator door is detected;
an identification module: the food material image is identified to obtain food material categories of food materials in the food material image;
a temperature adjusting module: the food storage temperature is determined according to the food categories, and the bin positions of the food are adjusted to the storage temperature;
an expiration prompting module: the food material quality guarantee period acquiring device is used for acquiring the food material quality guarantee period of the food material categories at the storage temperature, and sending out a prompt to guide a user to process food materials when the storage time of the food materials is detected to reach the food material quality guarantee period.
The steps implemented by each functional module of the food material expiration reminding device can refer to each embodiment of the food material expiration reminding method of the present invention, and are not described herein again.
In addition, an embodiment of the present invention further provides an intelligent refrigerator, which is characterized in that the intelligent refrigerator includes: a camera, a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein:
the camera is used for shooting and acquiring picture data;
when being executed by the processor, the computer program realizes the operation in the food material expiration reminding method provided by the embodiment.
In addition, the embodiment of the invention also provides a computer storage medium.
The computer storage medium stores a computer program, and when the computer program is executed by a processor, the computer program realizes the operation of the food material expiration reminding method provided by the above embodiment.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity/action/object from another entity/action/object without necessarily requiring or implying any actual such relationship or order between such entities/actions/objects; the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
For the apparatus embodiment, since it is substantially similar to the method embodiment, it is described relatively simply, and reference may be made to some descriptions of the method embodiment for relevant points. The above-described apparatus embodiments are merely illustrative, in that elements described as separate components may or may not be physically separate. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the invention. One of ordinary skill in the art can understand and implement it without inventive effort.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A food material expiration reminding method is characterized by comprising the following steps:
when the state change of a refrigerator door is detected, acquiring food material images through a preset image acquisition device;
identifying the food material images to obtain food material categories of food materials in the food material images;
determining the storage temperature of the food materials according to the food material categories, and adjusting the bin positions of the food materials to the storage temperature;
and acquiring the shelf life of the food materials at the storage temperature, and sending a prompt to guide a user to process the food materials when detecting that the storage time of the food materials reaches the shelf life of the food materials.
2. The food material expiration reminding method of claim 1, wherein the step of identifying the food material image to obtain the food material categories of the food materials in the food material image comprises:
globally scanning the food material image, and judging whether the food material image contains label information or not;
if the food material image contains the tag information, inquiring a cloud database, and acquiring the food material categories of the food materials corresponding to the tag information in the food material image;
and if the food material image does not contain label information, determining the food material category of each food material in the food material image according to the pixel color value of each pixel point in the food material image.
3. The food material expiration reminding method of claim 2, wherein the step of determining the food material category of each food material in the food material image according to the pixel color value of each pixel point in the food material image if the food material image does not contain tag information comprises:
if the food material image does not contain label information, extracting pixel color values of all pixel points in the food material image;
acquiring a target pixel point of the pixel color value within a preset color value range, and calculating the proportion of the target pixel point to the total pixel point;
if the ratio is larger than or equal to a preset threshold value, judging that the food materials are fruits and vegetables;
if the ratio is smaller than a preset threshold value, comparing at least two food material images with shooting time intervals, and judging that the food material class is meat when pixel positions in the at least two food material images with the shooting time intervals are changed.
4. The food material expiration reminding method of claim 1, wherein the step of determining the storage temperature of the food material according to the food material category and adjusting the bin position of the food material to the storage temperature comprises:
when the food material category is a label category, acquiring a first storage temperature corresponding to the label category, and adjusting the bin position of the food material to the first storage temperature;
when the food materials are fruits and vegetables, obtaining a second storage temperature corresponding to the fruits and vegetables, and adjusting the bin position of the food materials to the second storage temperature;
and when the food materials are meat, acquiring a third storage temperature corresponding to the meat, and adjusting the bin position where the food materials are located to the third storage temperature.
5. The food material expiration reminding method of claim 1, wherein the step of identifying the food material image and obtaining the food material categories of the food materials in the food material image comprises:
generating a recommended menu and food material collocation taboo according to the food material categories;
and outputting and/or sending the recommended menu and the food material collocation taboo to a preset terminal so as to guide a user to process food materials.
6. The food material expiration reminding method according to claim 1, wherein the step of determining the storage temperature of the food material according to the food material category and adjusting the bin position of the food material to the storage temperature comprises:
when the food materials are fruits and vegetables, reducing the flow of the refrigerant to a first flow and/or reducing the rotating speed of the motor to a first rotating speed;
when the food material category is label category, the flow rate of the refrigerant is increased to a second flow rate and/or the rotating speed of the motor is increased to a second rotating speed;
and when the food materials are meat, increasing the flow of the refrigerant to a third flow and/or increasing the rotating speed of the motor to a third rotating speed, wherein the third flow is greater than the second flow, and the third rotating speed is greater than the second rotating speed.
7. The food material expiration reminding method of claim 1, wherein the step of obtaining the food material shelf life of the food material category at the storage temperature and sending a prompt to guide a user to process the food material when the storage time of the food material is detected to reach the food material shelf life comprises:
inquiring a preset database, and acquiring the shelf life of the food materials categories in the preset database at the storage temperature;
if the food material shelf life of the food material category at the storage temperature does not exist in the preset database, outputting prompt information, receiving a user-defined food material shelf life input by a user, and taking the user-defined food material shelf life as the food material shelf life of the food material category at the storage temperature;
and sending out a prompt to guide a user to process the food materials when the storage time of the food materials is detected to reach the shelf life of the food materials.
8. An expiration reminding device for food materials, the expiration reminding device for food materials comprising:
a detection module: the food material image acquisition device is used for acquiring food material images through the preset image acquisition device when the state change of the refrigerator door is detected;
an identification module: the food material image is identified to obtain food material categories of food materials in the food material image;
a temperature adjusting module: the food storage temperature is determined according to the food categories, and the bin positions of the food are adjusted to the storage temperature;
an expiration prompting module: the food material quality guarantee period acquiring device is used for acquiring the food material quality guarantee period of the food material categories at the storage temperature, and sending out a prompt to guide a user to process food materials when the storage time of the food materials is detected to reach the food material quality guarantee period.
9. An intelligent refrigerator, characterized in that the intelligent refrigerator comprises: a camera, a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein:
the camera is used for shooting and acquiring picture data;
the computer program when executed by the processor implements the steps of the food material expiration reminding method as claimed in any one of claims 1 to 7.
10. A computer storage medium, characterized in that the computer storage medium has a computer program stored thereon, and the computer program, when executed by a processor, implements the steps of the food material expiration reminding method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010765943.9A CN112329509A (en) | 2020-07-31 | 2020-07-31 | Food material expiration reminding method and device, intelligent refrigerator and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010765943.9A CN112329509A (en) | 2020-07-31 | 2020-07-31 | Food material expiration reminding method and device, intelligent refrigerator and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112329509A true CN112329509A (en) | 2021-02-05 |
Family
ID=74303118
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010765943.9A Pending CN112329509A (en) | 2020-07-31 | 2020-07-31 | Food material expiration reminding method and device, intelligent refrigerator and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112329509A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113551478A (en) * | 2021-07-30 | 2021-10-26 | 珠海格力电器股份有限公司 | Method and device for updating residual shelf life of food and refrigerator |
| CN113569646A (en) * | 2021-06-28 | 2021-10-29 | 青岛海尔科技有限公司 | Abnormal article prompting method and device for refrigerator, storage medium and electronic device |
| CN113915869A (en) * | 2021-03-02 | 2022-01-11 | 海信（山东）冰箱有限公司 | Refrigerator and control method thereof |
| CN114143578A (en) * | 2021-11-30 | 2022-03-04 | 海信视像科技股份有限公司 | Food material reminding method, display device and server |
| CN114971933A (en) * | 2022-05-25 | 2022-08-30 | 连云港银丰食用菌科技有限公司 | Edible mushroom preservation method and system |
| CN115111829A (en) * | 2021-03-19 | 2022-09-27 | 海信集团控股股份有限公司 | Intelligent refrigerator, quality guarantee period determination method, equipment and medium |
-
2020
- 2020-07-31 CN CN202010765943.9A patent/CN112329509A/en active Pending
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113915869A (en) * | 2021-03-02 | 2022-01-11 | 海信（山东）冰箱有限公司 | Refrigerator and control method thereof |
| CN115111829A (en) * | 2021-03-19 | 2022-09-27 | 海信集团控股股份有限公司 | Intelligent refrigerator, quality guarantee period determination method, equipment and medium |
| CN115111829B (en) * | 2021-03-19 | 2023-11-03 | 海信集团控股股份有限公司 | Intelligent refrigerator, quality guarantee period determining method, equipment and medium |
| CN113569646A (en) * | 2021-06-28 | 2021-10-29 | 青岛海尔科技有限公司 | Abnormal article prompting method and device for refrigerator, storage medium and electronic device |
| CN113551478A (en) * | 2021-07-30 | 2021-10-26 | 珠海格力电器股份有限公司 | Method and device for updating residual shelf life of food and refrigerator |
| CN114143578A (en) * | 2021-11-30 | 2022-03-04 | 海信视像科技股份有限公司 | Food material reminding method, display device and server |
| CN114971933A (en) * | 2022-05-25 | 2022-08-30 | 连云港银丰食用菌科技有限公司 | Edible mushroom preservation method and system |
| CN114971933B (en) * | 2022-05-25 | 2024-01-16 | 连云港银丰食用菌科技有限公司 | Preservation method and system for edible fungi |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112329509A (en) | Food material expiration reminding method and device, intelligent refrigerator and storage medium | |
| CN111271936B (en) | Intelligent refrigerator control method and related device | |
| CN113329545B (en) | Intelligent lighting method and device, intelligent control device and storage medium | |
| CN107862018B (en) | Recommendation method and device for food cooking method | |
| CN111416950A (en) | Video processing method and device, storage medium and electronic equipment | |
| CN105184719A (en) | Foodstuff monitoring method and device | |
| CN106524664A (en) | Method and system for reminding user of optimal article storage position and intelligent refrigerator | |
| CN103810284A (en) | Kitchen management method and device | |
| CN108766529A (en) | A kind of intelligence recipe recommendation method and system | |
| CN109668852B (en) | Electronic equipment, information pushing method and related product | |
| TWI540518B (en) | Remote food management system | |
| US20170284733A1 (en) | Remote food management system | |
| CN110674736A (en) | Method, device, server and storage medium for identifying freshness of food materials | |
| CN110969047A (en) | Method and device for identifying food materials and refrigerator | |
| CN112084225A (en) | Intelligent processing method and system of big data based sharing platform and readable storage medium | |
| CN110675400A (en) | Rapid and intelligent mutton quality index detection method based on mobile phone APP | |
| Behera et al. | On-tree fruit monitoring system using IoT and image analysis | |
| Shweta | Intelligent refrigerator using artificial intelligence | |
| CN109658198B (en) | Commodity recommendation method and mobile terminal | |
| KR102481445B1 (en) | Display apparatus and control method thereof | |
| CN112419432A (en) | Method and device for controlling food in refrigerator, electronic equipment and storage medium | |
| Jayalakshmi et al. | Monitoring Ripeness in Fruits and Vegetables Using the Raspberry Pi | |
| Saha et al. | Using machine learning in refrigerator to keep inventory | |
| CN114294899B (en) | Refrigerator parameter control method and device, electronic equipment and storage medium | |
| WO2018196171A1 (en) | Remote viewing method, remote viewing system, and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |