CN118009615A - Intelligent refrigerator based on voice recognition and Internet of things technology - Google Patents

Intelligent refrigerator based on voice recognition and Internet of things technology Download PDF

Info

Publication number
CN118009615A
CN118009615A CN202410167988.4A CN202410167988A CN118009615A CN 118009615 A CN118009615 A CN 118009615A CN 202410167988 A CN202410167988 A CN 202410167988A CN 118009615 A CN118009615 A CN 118009615A
Authority
CN
China
Prior art keywords
food
information
refrigerator
module
voice
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202410167988.4A
Other languages
Chinese (zh)
Inventor
刘岩可
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202410167988.4A priority Critical patent/CN118009615A/en
Publication of CN118009615A publication Critical patent/CN118009615A/en
Pending legal-status Critical Current

Links

Landscapes

  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

The invention discloses an intelligent refrigerator based on voice recognition and the internet of things technology, which comprises an embedded Wi-Fi module, an inductive switch, a voice recognition module, a touch display screen, a server and a mobile phone APP. The refrigerator obtains information such as food access, names, quantity, validity period and the like through the voice recognition module, obtains food storage position information through the induction switch, stores the food information in a storage medium, and simultaneously displays the food information on a display screen and synchronizes the food information in a server. The user can control and manage the refrigerator through the mobile phone APP. For food which is about to expire or has expired, a reminding alarm can be sent out on a display screen and a mobile phone APP. Meanwhile, reminding can be given on the mobile phone APP for foods which are often purchased but are not in sufficient inventory by the user. In addition, the refrigerator can intelligently recommend related foods and recipes according to long-term food consumption conditions of users, reasonable collocation suggestions are provided for the users, and life quality and health level of the users are improved.

Description

Intelligent refrigerator based on voice recognition and Internet of things technology
Technical Field
The application relates to the technical field of intelligent household appliances, in particular to an intelligent refrigerator based on voice recognition and the internet of things technology.
Background
Fast paced lifestyles have made people face many challenges in food storage and management. Refrigerators are used as main places for storing foods, and often cause expiration problems due to the large number and variety of foods. The expired food may cause health hidden trouble, increase garbage disposal burden, and cause resource waste. Meanwhile, poor eating habits also bring potential threats to the physical health of people. Therefore, it is an urgent need to achieve effective management of refrigerator foods and promote good eating habits.
The rapid development of the internet of things technology provides a possibility for solving the problem. Through the internet of things technology, interconnection and intercommunication can be realized between the refrigerator and the mobile phone, and intelligent control and management functions are provided for users. The voice recognition technology is also continuously advanced, high accuracy can be achieved in various scenes, and guarantee is provided for voice acquisition of food information.
Disclosure of Invention
The invention aims to provide an intelligent refrigerator based on voice recognition and the internet of things technology, which can realize intelligent control and management of the refrigerator so as to solve the problems of food storage and management in the prior art, and simultaneously promote good eating habits of users, thereby bringing convenience and high-efficiency use experience to the users.
The invention provides an intelligent refrigerator based on voice recognition and the technology of the Internet of things, which comprises:
The refrigerator body is divided into an upper sealed storage space, a middle sealed storage space and a lower sealed storage space, the temperatures of the three independent sealed storage spaces can be set, the refrigerator body is used for storing foods, such as beverages, and the like under different temperature requirements, in the upper sealed storage space, fruits, vegetables and the like in the middle sealed storage space and meats and the like in the lower sealed storage space;
the upper, middle and lower independent sealed storage spaces are correspondingly provided with an upper refrigerator door, a middle refrigerator door and a lower refrigerator door;
An upper door induction switch, a middle door induction switch and a lower door induction switch which are used for detecting the opening and closing states of an upper door, a middle door and a lower door of the corresponding refrigerator are arranged at the edge positions of the upper, middle and lower independent sealed storage spaces;
The voice recognition module is used for collecting food information such as food storage, food taking-out operation, food names, food number, food validity period duration and the like;
The touch display screen is used for displaying food information stored in the current refrigerator, and is arranged outside the upper door of the refrigerator, so that man-machine interaction is facilitated;
the voice module is connected with a loudspeaker and a microphone and is arranged near the touch display screen, so that man-machine interaction is facilitated;
The embedded Wi-Fi module is used for interacting with a network and processing digital information;
An electronic storage medium for storing the stored-food information locally;
The server is used for storing refrigerator food information and analyzing food consumption information of users;
The mobile phone APP is used for interacting with the mobile phone;
The intelligent refrigerator control and management method combines the voice recognition and the internet of things technology, and can realize intelligent control and management of the refrigerator. When the food is about to or has expired, the refrigerator can send out a prompt on the mobile phone APP, so that the user is prevented from eating the expired food by mistake. For foods which are often purchased but are not enough in inventory, a prompt can be given on the mobile phone APP, so that a user can conveniently and timely replenish the foods. In addition, the refrigerator can intelligently recommend related foods and recipes according to the food consumption condition of the user, reasonable collocation suggestions are provided for the user, and the life quality and the health level are improved.
Drawings
Fig. 1 is a schematic perspective view of a refrigerator according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an installation position of an induction switch of an embodiment of the refrigerator according to the present invention;
FIG. 3 is a block diagram showing a hardware configuration of an embodiment of the refrigerator according to the present invention;
FIG. 4 is an interface diagram of a touch display screen of an embodiment of a refrigerator according to the present invention;
FIG. 5 is a diagram of a mobile phone APP Main interface in an embodiment of the refrigerator of the present invention;
FIG. 6 is a diagram of a mobile phone APP food information interface in an embodiment of the refrigerator of the present invention;
fig. 7 is a flowchart of a refrigerator according to an embodiment of the present invention.
Detailed Description
In order that the invention may be more clearly understood, a more particular description of the invention will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. The invention may be practiced otherwise than as specifically described and thus the scope of the invention is not limited to the specific embodiments disclosed herein.
Referring to fig. 1, in an embodiment of the present invention, an intelligent refrigerator based on voice recognition and internet of things includes a refrigerator body 10, wherein the refrigerator body 10 has three independent sealed storage spaces, namely an upper sealed storage space, a middle sealed storage space and a lower sealed storage space, which can be set with different temperatures for storing foods with different storage temperatures, and the three independent sealed storage spaces are respectively provided with an upper refrigerator door 20, a middle refrigerator door 30 and a lower refrigerator door 40. The upper door of the refrigerator is provided with a touch display screen 21, a microphone 22 of a voice recognition module and a loudspeaker 23.
Referring to fig. 2, in order to detect the open/close states of the upper door 20, the middle door 30, and the lower door 40 of the refrigerator, upper door sensing switches 11, middle door sensing switches 12, and lower door sensing switches 13 are installed in the upper, middle, and lower sealed storage spaces, respectively.
Referring to fig. 3, as a hardware structure diagram of the refrigerator according to the embodiment, the core control component is an embedded Wi-Fi module 130, the embedded Wi-Fi module 130 continuously detects the electric signals of the upper door sensing switch 11, the middle door sensing switch 12 and the lower door sensing switch 13 to identify the open/close states of the corresponding upper, middle and lower refrigerator doors, thereby identifying the position of the refrigerator where food is taken out or stored, the touch display screen 150 is used for displaying food information, and the mobile phone APP160 can manage and control the refrigerator through the server 170.
The functions and the working methods of the modules are as follows:
After the embedded Wi-Fi module 130 detects the on signal of the induction switch, the on signal position is saved, namely the position of the refrigerator where food is taken out or stored, and the connected voice module 180 is awakened, the voice recognition module 180 sends out voice instructions through the loudspeaker 23 to guide the user to speak related voice information step by step, the voice information is input into the voice recognition module 180 through the microphone 22 and converted into text information to be input into the embedded Wi-Fi module 130, after the text information is received by the embedded Wi-Fi module 130, keywords of 'taken out' and 'stored' are extracted from the text information, the food names, the number of the food and the duration information of the food validity period are extracted, the expiration time of the newly added food is calculated, the corresponding number of the food names stored in the storage medium 140 is subjected to addition and subtraction operation, the food information is updated and stored in the storage medium 140 and displayed on the touch display screen 150 in real time, the food information in the storage medium 140 together with the food taking out and the storage operation record can be uploaded and stored in the server 170, and the food taking out and storage record in the server 170 can be searched through the mobile phone APP 160;
Further, the embedded Wi-Fi module 130 also updates the food validity period in the storage medium 140 at regular time, updates to the server 170 and displays to the touch display screen 150;
Further, the embedded Wi-Fi module 130 monitors whether a refresh command from the mobile phone APP160 is received through the server 170, and if the refresh command is received, the embedded Wi-Fi module 130 immediately updates the duration of the food validity period in the storage medium 140, updates the duration to the server 170 and displays the updated duration on the touch display screen 150;
Preferably, the voice command issued by the speaker 23 includes: "please ask you to store or retrieve food", "please speak the name of the stored food", "please speak the number of the stored food", "please speak the duration of the validity of the stored food", "please speak the name of the retrieved food", "please speak the number of the retrieved food", "please speak the name of the next stored food", "please speak the name of the next retrieved food", etc., provide guidance for the user to store and retrieve food operations;
preferably, the expiration time calculation of the food product comprises: the embedded Wi-Fi module 130 is connected with WIFI through a built-in network module, obtains the current time from the network, adds the food effective period duration and the obtained current time, and calculates the expiration time of the food;
Preferably, the food storage calculation comprises: comparing the food names obtained by the voice module 180 with the corresponding food names in the storage medium 140, and if the extracted food names are found in the storage medium 140, adding food information such as the food names, the number of the foods, the duration of the food validity period, the expiration time of the foods, the storage position of the foods and the like in the storage medium 140, and storing the food information in the storage medium 140; if the food name is found in the storage medium 140, adding the number of the food obtained by the voice module 180 to the number of the food corresponding to the food name in the storage medium 140, and storing the added number of the food as a new number of the food in the storage medium 140;
Preferably, the food extraction calculation comprises: comparing the food names with the food names in the storage medium 140, if the extracted food names are found in the storage medium 140, subtracting the number of the foods obtained by the voice module 180 from the number of the foods corresponding to the food names in the storage medium 140 to obtain a new number of the foods, and if the new number is less than or equal to 0, deleting all the food information corresponding to the food names in the storage medium 140; if the new quantity is greater than 0, the new quantity is stored in the storage medium 140 in place of the quantity of food in the storage medium 140;
As shown in fig. 4, an interface diagram of a touch display screen of an embodiment of a refrigerator according to the present invention includes: food information display area 211, page turning control area 212. The food information is displayed in a sequence from short to long according to the food effective period duration by default, and the food information with the food effective period duration < = 24 hours is highlighted; the user can click any keyword such as the name of the food, the number of the food, the expiration time of the food, the storage position of the food and the like on the touch display screen 150, the food information is ordered in ascending or descending order according to the clicked keywords, an equilateral triangle and an inverted triangle icon are arranged beside any keyword, the solid equilateral triangle indicates that the food information is arranged in ascending order of the current keyword, and the solid inverted triangle indicates that the food information is arranged in descending order of the current keyword; if one screen can not display all the food information, the user can also perform page turning operation on the page turning control area 212 of the touch display screen 150 to view more food information, wherein six keys from left to right in the page turning control area 212 show page down to the next page, page down, page up to the first page;
Further, the embedded Wi-Fi module 130 transmits and displays the food information stored in the medium 140 to the mobile phone APP160 through Wi-Fi, the food information is displayed by default in order of short to long effective period duration, and the food information with effective period duration < = 24 hours is highlighted.
In one embodiment, as shown in fig. 5, a main interface diagram of a mobile phone APP according to an embodiment of the refrigerator of the present invention, the interface specifically includes: food information button 300, warehouse-in query button 400, warehouse-out query button 500, healthy diet 600, refrigerator switch button 700, exit 800. Click food information button 300, jump to the mobile phone APP interface displaying food information; clicking the warehouse-in query button 400 can view the most recently stored food information; clicking the warehouse-out inquiry button 500 can check the recently taken food information; clicking on the healthy diet 600 will enter a healthy diet interface with food recommendations and recipes, where the food recommendations are that the server 170 analyzes the nutritional intake of the user based on the user's refrigerator food consumption history data, thereby analyzing the deficiency of the nutritional intake of the user and recommending relevant foods.
In one embodiment, as shown in fig. 6, an APP interface diagram of a mobile phone for displaying food information in a preferred embodiment of the present invention, the interface specifically includes: food information display area 301, page flip control area 302, home button 303, refresh button 304. The user may click any keyword such as the top food name, the number of foods, the duration of the food validity period, the expiration time of the foods, the storage position of the foods, etc. of the table in the food information display area 301, the food information will be sorted in ascending order or descending order according to the clicked keywords, the any keyword is provided with an equilateral triangle and an inverted triangle icon, the solid equilateral triangle indicates that the food information is arranged in ascending order according to the current keyword, and the solid inverted triangle indicates that the food information is arranged in descending order according to the current keyword; the user can click on the control of the page turning control area 302, and can view more food information; after the user clicks the refresh button 304 and the embedded Wi-Fi module 130 monitors that the refresh command of the mobile phone APP160 is received through the server 170, the validity period of all the food information stored in the storage medium 140 is automatically updated according to the current time, and the data is updated to the food information display area 301; clicking the home button 303 returns to the mobile APP home interface shown in fig. 5.
Referring to fig. 7, a flowchart of a refrigerator according to an embodiment of the present invention includes:
Step S1, initializing each module and starting a cycle.
In step S2, the embedded Wi-Fi module 130 monitors the open/close states of the upper door 20, the middle door 30, and the lower door 40 of the refrigerator in real time. Once the refrigerator door is opened, the system records the position information of the opened refrigerator door, namely the specific position of food storage; meanwhile, the system activates the voice recognition module 180 to collect food related data in a man-machine interaction mode; next, the system processes the food information transmitted by the voice recognition module 180, and updates the data to the local storage medium 140 in combination with the time information acquired from the network, and displays the data on the refrigerator touch display screen 150; in addition, the food information and the records stored and retrieved are uploaded to the web server 170; the server 170 intelligently recommends relevant foods and recipes according to the food consumption condition of the user and pushes the relevant foods and recipes through the mobile phone APP 160; for foods that are frequently purchased by users but are not in sufficient inventory, the system will also send a reminder through the cell phone APP 160.
In step S3, the embedded Wi-Fi module 130 monitors the food information update time, and if the update time is up, updates the duration of the food validity period in the storage medium 140, and updates to the server 170 and displays to the touch display 150.
In step S4, the embedded Wi-Fi module 130 monitors whether a refresh command of the mobile phone APP160 is received through the server 170, and if the refresh command is received, updates the duration of the valid period of the food in the storage medium 140, and updates the valid period to the server 170 and displays the updated valid period on the touch display screen 150.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the invention, and all equivalent structural changes made by the description of the present invention and the accompanying drawings or direct/indirect application in other related technical fields are included in the scope of the invention.

Claims (10)

1. Intelligent refrigerator based on speech recognition and internet of things, characterized by comprising:
An embedded Wi-Fi module; an inductive switch; a voice recognition module; a storage medium; touching the display screen; a server; cell phone APP.
2. The intelligent refrigerator based on the technology of voice recognition and internet of things of claim 1, further comprising:
The voice recognition module is configured with a semantic analysis functional module;
the voice receiving module is provided with a microphone and a loudspeaker, the microphone is used for receiving voice information, and the loudspeaker is used for broadcasting voice instructions;
The voice recognition module transmits the voice information to the semantic analysis functional module, and the semantic analysis functional module generates text information and voice instructions according to the received voice information;
and the text information is transmitted to the embedded Wi-Fi module for extraction and analysis.
3. The intelligent refrigerator based on the technology of voice recognition and the internet of things according to claims 1-2, further comprising:
The refrigerator comprises a refrigerator body, a refrigerator upper door, a refrigerator middle door and a refrigerator lower door;
the induction switches comprise an upper door induction switch, a middle door induction switch and a lower door induction switch, are respectively arranged in the refrigerator body and correspond to the positions of the upper door, the middle door and the lower door of the refrigerator, and are respectively used for sensing the opening and closing states of the upper door, the middle door and the lower door of the refrigerator;
the touch display screen is arranged outside the upper door of the refrigerator;
The microphone and the speaker are mounted near the display screen.
4. The intelligent refrigerator based on the technology of voice recognition and internet of things as set forth in claim 2, wherein the text information comprises:
"fetch", "store" keywords;
information such as food name, number of foods, duration of food validity period, etc.
5. The intelligent refrigerator based on voice recognition and internet of things technology as set forth in claim 2, wherein the voice command comprises:
"please ask you to store or retrieve food", "please speak the name of the stored food", "please speak the number of the stored food", "please speak the duration of the validity of the stored food", "please speak the name of the retrieved food", "please speak the number of the retrieved food", "please speak the name of the next stored food", "please speak the name of the next retrieved food", etc., provide guidance for the user to store and retrieve food operations.
6. The intelligent refrigerator based on the technology of voice recognition and internet of things as set forth in claim 1, wherein the embedded Wi-Fi module configuration function has:
Acquiring the opening and closing states of the upper door induction switch, the middle door induction switch and the lower door induction switch corresponding to the upper door, the middle door and the lower door of the refrigerator, thereby acquiring the upper, middle and lower positions of food taken out or stored in the intelligent refrigerator;
Waking up the voice module to perform voice interaction according to the states of the upper door induction switch, the middle door induction switch and the lower door induction switch;
calculating the text information input by the voice module to obtain complete food information;
storing the complete food information in the storage medium;
The food information stored in the storage medium is displayed on the touch display screen;
Updating the food information stored in the storage medium at regular time, displaying the food information on a touchable screen of the refrigerator and uploading the food information to a server;
Continuously monitoring whether the mobile phone APP sends refreshing information from a network, after receiving the refreshing information, updating the duration information of the valid period of all foods in the storage medium, displaying the food information on a touchable screen of the refrigerator and uploading the food information to a server.
7. The intelligent refrigerator based on the technology of voice recognition and internet of things of claim 6, wherein the embedded Wi-Fi module performs calculation processing on the text information input by the voice module to obtain complete food information, and the intelligent refrigerator comprises:
Calculating the expiration time of food, obtaining the current time from a network through a Wi-Fi connection network, adding the food effective period time obtained by the voice module and the obtained current time, and calculating the expiration time of the food;
Food storage calculation, namely comparing the food name obtained by the voice module with the food names in the storage medium, and if the food obtained by the voice module is not found in the storage medium, newly adding the food names obtained by the voice module, the number of the foods, the food validity period, the calculated food expiration time, the food storage position and other food information into the storage medium; if the food obtained by the voice module is found in the storage medium, adding the number of the food obtained by the voice module to the number of the food corresponding to the name of the food in the storage medium, and storing the number of the food as a new number of the food in the storage medium;
The food name obtained by the voice module is compared with the food name in the storage medium, if the food obtained by the voice module is found in the storage medium, the number of the food corresponding to the food name in the storage medium is subtracted by the voice module to obtain the number of the food, and if the new number is less than or equal to 0, all the food information corresponding to the food name is deleted in the storage medium; and if the new quantity is larger than 0, replacing the quantity of the food in the storage medium with the new quantity, and storing the quantity of the food in the storage medium.
8. The intelligent refrigerator based on the technology of voice recognition and internet of things as claimed in claims 1-7, wherein the touch display screen function comprises:
Displaying the food information in a sequence from short to long according to the food effective period duration by default, and highlighting the food information with the food effective period duration < = 24 hours;
the user can select any keyword such as the name of the food, the number of the food, the effective period of the food, the expiration time of the food, the storage position of the food and the like on the touch display screen to sort the food information in an ascending order or a descending order.
The user can turn pages of the touch screen display to view more food information.
9. The intelligent refrigerator based on the technology of voice recognition and internet of things as claimed in claims 1-7, wherein the mobile phone APP function comprises:
Displaying the food information stored in the refrigerator, displaying the food information on a mobile phone APP according to the short-to-long ordering of the food validity period by default, and highlighting the food information with the food validity period < = 24 hours;
Displaying food recommended by analyzing the type consumption of the food of the refrigerator by the user from the intelligent refrigerator, and helping the user to reasonably match the food and nutrition;
displaying food which is from the refrigerator and is lack of the user and is often purchased by the user, and reminding the user of purchasing;
The mobile phone APP is provided with a refreshing button, the refreshing button is clicked, the intelligent refrigerator updates the food information stored in the storage medium, and the updated food information is sent to the mobile phone APP;
And analyzing the consumption condition of the refrigerator food types of the user, recommending related foods and foods to the mobile phone APP, and helping the user to reasonably match the foods and nutrition.
10. The intelligent refrigerator based on voice recognition and internet of things as claimed in claims 1-7, wherein the server function comprises:
Establishing connection with the refrigerator and the mobile phone APP by using a standard network communication protocol to realize data transmission and exchange;
Storing food information transmitted by the embedded Wi-Fi module and records stored and taken out of the food information, wherein the data can be queried through the mobile phone APP;
analyzing food consumption data of a user, and intelligently recommending related foods and recipes to the mobile phone APP;
the user often purchases but inventory-deficient food to the mobile phone APP.
CN202410167988.4A 2024-02-06 2024-02-06 Intelligent refrigerator based on voice recognition and Internet of things technology Pending CN118009615A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410167988.4A CN118009615A (en) 2024-02-06 2024-02-06 Intelligent refrigerator based on voice recognition and Internet of things technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202410167988.4A CN118009615A (en) 2024-02-06 2024-02-06 Intelligent refrigerator based on voice recognition and Internet of things technology

Publications (1)

Publication Number Publication Date
CN118009615A true CN118009615A (en) 2024-05-10

Family

ID=90942523

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410167988.4A Pending CN118009615A (en) 2024-02-06 2024-02-06 Intelligent refrigerator based on voice recognition and Internet of things technology

Country Status (1)

Country Link
CN (1) CN118009615A (en)

Similar Documents

Publication Publication Date Title
US10353939B2 (en) Interoperability mechanisms for internet of things integration platform
US11972327B2 (en) Method for automating actions for an electronic device
US10171586B2 (en) Physical environment profiling through Internet of Things integration platform
US10181960B2 (en) Method and apparatus for configuring and recommending device action using user context
CN106383450A (en) Smart home user behavior analyzing system and smart home user behavior analyzing method based on big data
US20080034081A1 (en) Remotely controlling one or more client devices detected over a wireless network using a mobile device
CN105872213A (en) Information displaying method and electronic device
WO2012000423A1 (en) Method and system for pushing network information
CN105431820A (en) Method and apparatus for configuring and recommending device action using user context
CN104181886A (en) Intelligent home system and intelligent home control method
CN104361039A (en) Qt-development-based auxiliary method and system for embedded intelligent refrigerator
WO2017218437A1 (en) Situation forecast mechanisms for internet of things integration platform
CN109450745A (en) Information processing method, device, intelligence control system and intelligent gateway
CN101178280A (en) Refrigerator having cartoon display operations
CN106161811A (en) A kind of reminding method and mobile terminal
CN108205408A (en) Message display method and device
CN109856980B (en) Intelligent household equipment recommendation method and device, Internet of things system and cloud server
CN105513298A (en) Prompt method and prompt device
CN101949626A (en) Refrigerator utilizing multimedia technology
US20200104861A1 (en) Web-based system for customer relationship management and method for operating the same
CN118009615A (en) Intelligent refrigerator based on voice recognition and Internet of things technology
CN109451752A (en) Mode control method, device, readable storage medium storing program for executing and electronic equipment
CN109873994A (en) A kind of smart machine and its information processing method, computer storage medium
CN115563189A (en) Mass data query method based on data mining technology
CN113296648A (en) Display method, display device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication