CN115077155A - Refrigerator and intelligent refrigerator system - Google Patents
Refrigerator and intelligent refrigerator system Download PDFInfo
- Publication number
- CN115077155A CN115077155A CN202110260777.1A CN202110260777A CN115077155A CN 115077155 A CN115077155 A CN 115077155A CN 202110260777 A CN202110260777 A CN 202110260777A CN 115077155 A CN115077155 A CN 115077155A
- Authority
- CN
- China
- Prior art keywords
- voice
- refrigerator
- food material
- module
- main body
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 235000013305 food Nutrition 0.000 claims abstract description 203
- 239000000463 material Substances 0.000 claims abstract description 200
- 238000012545 processing Methods 0.000 claims abstract description 57
- 238000003860 storage Methods 0.000 claims description 49
- 238000004891 communication Methods 0.000 claims description 6
- 238000007726 management method Methods 0.000 abstract description 59
- 238000013523 data management Methods 0.000 abstract description 6
- 241000220225 Malus Species 0.000 description 28
- 235000021016 apples Nutrition 0.000 description 13
- 238000000034 method Methods 0.000 description 12
- 238000012986 modification Methods 0.000 description 11
- 230000004048 modification Effects 0.000 description 11
- 230000003993 interaction Effects 0.000 description 9
- 238000003672 processing method Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000004519 manufacturing process Methods 0.000 description 5
- 238000012217 deletion Methods 0.000 description 4
- 230000037430 deletion Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000012423 maintenance Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000013479 data entry Methods 0.000 description 2
- 230000008014 freezing Effects 0.000 description 2
- 238000007710 freezing Methods 0.000 description 2
- 235000012055 fruits and vegetables Nutrition 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 238000002372 labelling Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000013589 supplement Substances 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 235000014443 Pyrus communis Nutrition 0.000 description 1
- 235000009754 Vitis X bourquina Nutrition 0.000 description 1
- 235000012333 Vitis X labruscana Nutrition 0.000 description 1
- 240000006365 Vitis vinifera Species 0.000 description 1
- 235000014787 Vitis vinifera Nutrition 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 235000013527 bean curd Nutrition 0.000 description 1
- 235000013361 beverage Nutrition 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000005672 electromagnetic field Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 235000013622 meat product Nutrition 0.000 description 1
- 239000008267 milk Substances 0.000 description 1
- 210000004080 milk Anatomy 0.000 description 1
- 235000013336 milk Nutrition 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 235000013311 vegetables Nutrition 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D11/00—Self-contained movable devices, e.g. domestic refrigerators
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/08—Mouthpieces; Microphones; Attachments therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
The invention relates to the technical field of intelligent household appliances, and provides a refrigerator and an intelligent refrigerator system, which can realize accurate data management on various food materials without additionally installing too many hardware devices. A refrigerator, comprising: a refrigerator main body; a microphone and a speaker arranged on the refrigerator main body; the voice processing circuit is arranged in the refrigerator main body and is electrically connected with the microphone and the loudspeaker, wherein the voice processing circuit comprises an in-store management module for recording and storing food material data information of food materials stored in the refrigerator main body; the voice processing module is used for coding and generating voice data according to the voice information collected by the microphone; and the voice recognition module is used for generating a voice instruction after matching the voice data generated by the voice processing module with the pre-embedded voice command vocabulary, wherein the in-store management module is used for modifying and updating the food material data information of the food material stored in the refrigerator main body according to the voice instruction generated by the voice recognition module.
Description
Technical Field
The invention relates to the technical field of intelligent household appliances, in particular to a refrigerator with a voice interaction function and an intelligent refrigerator system.
Background
Refrigerators, which are main storage appliances for fresh food materials, are closely related to daily life from the purchase, storage, and use of food materials, the distribution of food materials to daily in-store management, and maintenance of breakdown. With the development of the intelligent technology trend, an intelligent refrigerator for performing data management on food materials is attracting more and more attention.
In the prior art, for example, an intelligent refrigerator disclosed in chinese patent document CN109059410A uses a radio frequency tag identification scheme or an image identification scheme to implement data management of food materials in a warehouse.
Regarding the method for identifying the radio frequency tag, in order to cooperate with the use of the intelligent refrigerator, a supplier of food materials needs to attach the corresponding radio frequency tag to the surface of the food material outer package for the intelligent refrigerator to read. The radio frequency tags can increase the cost of food material suppliers, and once the radio frequency tags are not attached to part of food materials provided by the suppliers or the radio frequency tags are not easily attached to part of fresh foods, the food materials are difficult to read by an in-warehouse management system, so that the food materials from various sources cannot be comprehensively subjected to data management. On the other hand, the refrigerator body needs to be additionally provided with a radio frequency reading device which emits electromagnetic field towards the inside of the refrigerator, and the manufacturing cost and the design difficulty of the refrigerator body are increased.
The image recognition method depends on image recognition of food materials or food material outer packages, an image database with large data volume needs to be established in advance or a complex matching model needs to be trained, the error rate of the image recognition is high, and the image recognition is difficult to popularize and use in the field of intelligent refrigerators at present for diversified food materials. On the other hand, the refrigerator body also needs to be provided with a special camera for reading food materials, a relevant processor and a relevant memory, and the manufacturing cost and the design difficulty of the refrigerator body are also increased.
In addition, in any of the prior art, a display screen for displaying the stock information or the fault information of the refrigerator is required to be provided for the user to confirm the refrigerator, establish a purchase or use plan, or know the fault information. And the refrigerator inventory information is usually shown in a complex list form, and the operation of a display screen by a user is required from the purchase, storage, taking and matching of food materials to the daily in-store management, fault maintenance and the like, and the operation and the user lack interaction and the friendly interaction of a human-computer interface.
Therefore, it is a problem in the prior art to provide a low-cost intelligent refrigerator that does not require additional hardware devices, can perform accurate data management on a wide variety of food materials, and is user-friendly.
Disclosure of Invention
In order to solve the problems, the invention provides a refrigerator and an intelligent refrigerator system, which can realize accurate data management on various food materials without additionally installing too many hardware devices, and have friendly human-computer interfaces.
The refrigerator provided by the invention comprises: a refrigerator main body; a microphone and a speaker arranged on the refrigerator main body; set up at the inside voice processing circuit who is connected with microphone and speaker electricity of refrigerator main part, wherein, voice processing circuit includes:
the warehouse management module records and stores food material data information of food materials stored in the main body of the refrigerator;
the voice processing module is used for coding and generating voice data according to the voice information collected by the microphone;
the voice recognition module generates a voice instruction after matching with a pre-embedded voice command vocabulary according to the voice data generated by the voice processing module,
the in-store management module modifies and updates the food material data information of the food materials stored in the refrigerator main body according to the voice instruction generated by the voice recognition module.
According to the refrigerator provided by the invention, firstly, the speed of voice recognition on information processing is high, the efficiency is high, a user can put in or take out food materials and send out voice for the microphone to collect voice information, and can send out the voice information for the microphone to collect through reading documents or counting the food materials after all the food materials are put in or taken out, so that the intelligent management on the food materials in the refrigerator can be realized at low cost only by a common microphone, a loudspeaker and a voice processing circuit without additionally arranging too many hardware devices including a display screen, and the usable data entry, update or deletion mode of the refrigerator is more flexible.
Secondly, the recognition accuracy of voice recognition is high, compared with image data, the number of voice command vocabularies such as food material names, quantity, weight and the like is limited, exhaustion can be conveniently carried out, the data volume of a database which needs to be established in advance is small, and the cost of data and software which need to be recorded can be effectively reduced.
Moreover, compared with a radio frequency tag identification method, the method of voice identification does not need to increase the cost of consumables of the radio frequency tag, and equipment such as a loudspeaker and a microphone collects sound or broadcasts sound towards the outside of the refrigerator and is installed on the outer side surface of the refrigerator main body or nearby, so that the refrigerator is not easily affected by the cold environment inside the refrigerator, and the cost and the design difficulty of the refrigerator body are lower than those of an additionally-installed radio frequency reading device.
Finally, the in-store management module can modify and update the food material data information of the food materials stored in the refrigerator main body based on the voice instruction generated by the voice recognition module, namely, the food material data information is modified through the voice instruction of the user, and the user does not need to actively input the inventory information of the modified food materials. Moreover, the generation and the output of the voice command can be triggered by the voice information input from the outside, namely when the user sends out voice to store or take out food materials in the refrigerator, the voice command is output to change the food material data information stored in the warehouse management module, no equipment is required to be operated, no label pasting is required to be carried out on the food materials, the food material data information of the food materials in the warehouse management module can be updated and deleted, the convenience degree of the refrigerator is improved while the production cost is saved, the human-computer interface is friendly, and the user experience is improved.
It should be noted that, in the voice processing circuit of the refrigerator provided in the present invention, the food material data information of the food material stored in the library management module can be updated by voice, but the method for inputting the original food material data information of the food material in the library management module is not limited in the present invention, and those skilled in the art can understand that, after the original food material data information is input by any method, the food material data information is updated by combining with the voice processing circuit of the present invention, which does not exceed the protection scope of the present invention.
In a preferred embodiment of the present invention, the refrigerator further includes:
the voice feedback module generates a voice feedback instruction according to the voice data generated by the voice processing module;
and the voice output module is used for converting the voice feedback instruction generated by the voice feedback module into voice data and outputting the voice data to the loudspeaker.
According to the preferred technical scheme, the voice data generated by the voice processing module codes are respectively generated into the voice command and the voice feedback command, the voice command is output to the food material data information modification of the food material in the storage management module, the voice feedback command is output to the voice output module and is output to the loudspeaker after being converted into the voice data, the modification of the food material data information is fed back to a user in a voice broadcasting mode, and therefore the user can know the relevant conditions of the modified food material data information in the refrigerator through voice without looking up a display screen and the like, and the use convenience degree of the food material storage management function is improved.
In a preferred embodiment of the present invention, the food material data information includes at least any one of a kind, a quantity, a consumption term, and a storage location in the refrigerator main body.
In a preferred technical solution of the present invention, the voice information collected by the microphone at least includes a type of food material, a quantity of the food material, and a storage location of the food material in the refrigerator main body.
According to the preferred technical scheme, the voice information content collected by the microphone corresponds to the food material data information one to one, so that the voice recognition module can match the information collected by the microphone with the voice command vocabulary embedded in advance, and generate the voice command which can be updated and stored for the food material data information in the library management module, so that each item in the food material data information of the food material is correspondingly modified and updated, and incomplete food material data information is avoided.
In the preferred technical scheme of the invention, when the voice information collected by the microphone does not include the storage position information of the food material,
the voice feedback instruction generated by the voice feedback module contains storage position information associated with the food material.
According to the preferred technical scheme, when the voice information sent by the user does not include the storage position information in the food material data information, the refrigerator sends a voice prompt for confirming the storage position after calling the food material data information stored in the library management module, so that the information of the storage position of the food material is further ensured to be effectively updated and input in the library management module.
In the preferred technical scheme of the invention, when the voice information collected by the microphone does not include the quantity information of the food materials,
the voice feedback instruction generated by the voice feedback module contains quantity information associated with food materials.
According to the better technical scheme, when the number information of the food materials is not included in the voice sent by the user, the refrigerator sends out the voice prompt for confirming the number of the food materials after calling the food material data information stored in the warehouse management module, so that the effective updating and inputting of the number of the food materials in the warehouse management module are ensured.
The invention also provides an intelligent refrigerator system which comprises any refrigerator provided by the invention and an intelligent terminal in communication connection with the voice processing circuit of the refrigerator.
According to the intelligent refrigerator system, the in-store management module modifies and stores the food material data information of food materials stored in the refrigerator main body according to the input of the intelligent terminal. Therefore, besides the voice instruction, the modification instruction can be input through the intelligent terminal to modify the food material data information stored in the refrigerator main body, and an input mode is added, so that the condition that human-computer interaction operation cannot be performed when voice output fails is avoided, meanwhile, the modification instruction input by the intelligent terminal can be further processed by data, such as sharing with other servers and the like, and synchronously updated and modified food material data instructions, or a food material use report and the like in the refrigerator are generated, and efficient and convenient food material supplement is further realized.
In a preferred technical scheme of the invention, the in-store management module can modify the food material data information of all food materials stored in the refrigerator main body at one time according to the input of the intelligent terminal. According to the optimal intelligent refrigerator system disclosed by the invention, a user can rapidly modify all food material information stored in the refrigerator at one time through the intelligent terminal, such as one-key storage and one-key deletion, so that the food material data information in the refrigerator can be rapidly and conveniently modified under the conditions of cleaning, maintenance and the like of the refrigerator.
Drawings
FIG. 1 is a schematic diagram of an application scenario of an embodiment of the present invention;
fig. 2 is a schematic view of an external structure of a refrigerator according to an embodiment of the present invention;
fig. 3 is a structural diagram of a voice processing circuit of a refrigerator according to a first embodiment of the present invention;
FIG. 4 is a flow chart of a speech processing method provided by a first embodiment of the present invention;
fig. 5 is a structural diagram of a voice processing circuit of a refrigerator according to a second embodiment of the present invention;
fig. 6 is a flowchart of a speech processing method according to a second embodiment of the present invention.
Reference numerals:
1-a user; 2-a refrigerator; 20-a refrigerator main body; 21-a microphone; 22-a loudspeaker; 23-a speech processing circuit; 231-a speech processing module; 232-a speech recognition module; 233-library-in management module; 235-a voice output module; 238-voice feedback module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
[ terms and explanations ]
In some embodiments, the term "consumption period" is generated by overlapping preset storage days of the food material with the date of the voice command generated by the voice recognition module as the starting date, for example, for fresh food materials such as vegetables and meat products, the food material may be assumed to be fresh when being put into the date, so that the consumption period of the food material is obtained by overlapping the storage days corresponding to the pre-stored food materials. In other embodiments, the "consumption period" may be other time periods related to the number of days of storage of the food material, for example, the expiration date is well described for the deep processing of milk, tofu, and the like, and the "consumption period" may be the expiration date of the food material outer package printing. In this case, the "consumption term" is input by the user through voice.
[ application scenarios ]
Fig. 1 is a schematic diagram of an application scenario of an embodiment of the present invention.
Referring to fig. 1, an application scenario of the present invention involves communication and interaction between a user 1 and a refrigerator 2. In other embodiments of the present invention, some or all of the modules of the voice processing circuit 23 in the refrigerator 2 may also be disposed in a cloud server, and these embodiments should be regarded as simple changes of the technical solution of the present invention and are included in the protection scope of the present invention without departing from the spirit of the present invention.
Fig. 2 is a schematic external structural diagram of a refrigerator 2 according to an embodiment of the present invention, and as can be seen from fig. 2, a microphone 21 and a speaker 22 are disposed on a front side surface of a refrigerator main body 20, and the microphone 21 is used for picking up sound, especially picking up voice information uttered by a user, and sending the sound information to a voice processing circuit 23; the loudspeaker 22 is used for broadcasting, in particular for playing voice data returned by the voice processing circuit 23. The voice processing circuit 23 is disposed inside the refrigerator main body 20, is electrically connected to the microphone 21 and the speaker 22, processes the voice information picked up by the microphone 21, obtains voice data to be played by the speaker 22, and forms voice interaction with the user 1.
The refrigerator 2 according to the embodiment of the present invention does not need to have any other technical means capable of interacting with the user 1, other than the voice interaction. However, the present invention is not limited thereto, and in some other embodiments of the present invention, the refrigerator 2 may have other technical means capable of interacting with the user 1 besides voice interaction. For example, the refrigerator 2 may include a touch screen for receiving a touch input of the user 1. As another example, the refrigerator 2 may include a camera for acquiring images or videos of the user 1. As another example, the refrigerator 2 may include a biometric sensor for acquiring biometric information of the user 1, such as fingerprint or iris information. Further, the refrigerator 2 may be provided with technical means capable of communicating with the terminal and/or the cloud server, including, for example, a wired or wireless communication module, so as to be capable of transmitting and receiving information or data to and from the terminal and/or the cloud server based on various wired or wireless communication protocols.
The refrigerator 2 of the present invention may further include or be replaced with various intelligent appliances, such as food or beverage storage devices, for example, a food cabinet, a refrigerator, a wine cabinet, etc., according to practical application scenarios.
In the embodiment of the invention, an intelligent refrigerator system comprising the refrigerator 2 is further provided, and the intelligent refrigerator system further comprises an intelligent terminal in communication connection with the refrigerator 2, wherein the intelligent terminal is provided with a display screen and used for displaying instructions or data sent by the refrigerator 2.
[ first embodiment ]
Fig. 3 is a configuration diagram of the voice processing circuit 23 of the refrigerator 2 according to the first embodiment of the present invention.
Referring to fig. 3, in the present embodiment, the voice processing circuit 23 includes: a library management module 233, a speech processing module 231, and a speech recognition module 232.
The in-store management module 233 is configured to record, store, modify and update food material data information of food materials stored in the refrigerator main body 20;
the voice processing module 231 is configured to generate voice data by encoding according to the voice information collected by the microphone 21. In this embodiment, the voice processing module 231 may be an analog-to-digital converter for converting the analog signal sampled by the microphone 21 into a digital signal for subsequent analysis and processing. The voice processing module 231 may be located outside the microphone 21 and communicatively connected to the microphone 21, or may be integrated in a chip of the microphone 21.
The voice recognition module 232 is configured to generate a voice instruction after matching the voice data generated by the voice processing module 231 with the pre-embedded voice command vocabulary. The speech recognition module 232 may use an existing speech recognition module 232, such as an HBR-series speech recognition module 232, and an input port of the speech recognition module 232 may be communicatively connected to the speech processing module 231 using a standard RS232 serial port to receive speech data from the speech processing module 231. The voice recognition module 232 stores a voice command vocabulary in advance, and generates a voice instruction by matching voice data with the voice command vocabulary.
The inventory management module 233 modifies and updates the food material data information of the food material stored in the refrigerator main body 20 according to the voice command generated by the voice recognition module 232. Specifically, the library management module 233 includes a memory (not shown) in which the current food material data information is stored, and the library management module 233 also includes a processor (not shown) which can modify and delete the food material data information in the memory, so that the food material data information stored in the library management module 233 can be matched with the food material condition of the content of the refrigerator 2, and the refrigerator 2 can conveniently store and manage the food material in the future.
For example, the voice recognition module 232 stores in advance voice command words such as "put in", "take out", "apple", "pear", "grape", "person", "jin", "kg", and "g". When the number of the original apples is 7 and the user 1 sends voice information of taking 3 apples out of the refrigerating chamber, the microphone 21 samples the voice information to obtain an analog signal, and the voice processing module 231 converts the code of the analog signal into digital voice data and sends the digital voice data to the voice recognition module 232; the voice recognition module 232 matches the voice data with the voice command vocabularies to obtain matching results that the matching degrees of the voice data with the five voice command vocabularies of 'take out', 'apple', '3', 'individual', 'cold room' in sequence according to the time sequence are all above a threshold value, generates voice instructions reflecting 'cold room apple-3' and sends the voice instructions to the in-store management module 233, and the in-store management module 233 modifies food material data information of 'cold room apple 7' stored in the in-store management module 233 into 'cold room apple 4' in response to the voice instructions of 'cold room apple-3' generated by the voice recognition module.
The food material data information may be one or more of the kind, quantity, consumption term, storage location in the refrigerator main body 2020. The storage management module 233 records and stores the types, the number and the storage positions of the food materials, so that more complete and reliable storage management data can be obtained, and the storage positions of the food materials in the refrigerator main body 20 are recorded and stored, so that the user 1 can find the target food material more quickly, the heat loss caused by opening and closing the 2 doors of the refrigerator is reduced, and the energy consumption is reduced. The storage location in the refrigerator main body 20 may be, for example, a storage location of a refrigerating compartment, a freezing compartment, a garden stuff compartment, a temperature changing compartment, a fresh freezing compartment, or the like. The food material data information of the food materials stored in the refrigerator main body is modified and updated by the warehouse management module 233, and the food material data information of the food materials in the warehouse management module can be updated and deleted without operating any equipment or labeling the food materials, so that the convenience of the refrigerator is improved while the production cost is saved.
In addition, the consumption time limit of the food material is generally related to the temperature of the storage position of the food material, and the consumption time limit of the food material is different because the temperature and the humidity of different storage positions are different. By associating the consumption term with the storage location in the refrigerator main body 20, it is possible to more precisely manage the consumption term of the food material and reduce waste of the food material. In other embodiments, the food material data information may also be any other suitable data information related to food materials, and the selection of the type of the food material data information does not limit the present invention, and is not described herein again.
In the food material data information, the current food material data information is a state quantity, which reflects the current storage state of each food material in the refrigerator main body 20, for example, information that there are a number (quantity) of apples (type) in the refrigerator main body 20. The stored or retrieved food material data information is a variation, which is a variation of the inventory of food materials in the refrigerator main body 20 reflected by the voice command sent by the voice recognition module 232, for example, a variation of the inventory of apples reduced by 3 reflected by the voice command "cold storage apples-3".
It should be noted that, in the voice processing circuit 23 of the refrigerator 2 provided in the present invention, the food material data information of the food material stored in the library management module 233 can be updated by voice, that is, the food material data information can be modified or updated based on a voice instruction, but the present invention does not limit the method for inputting the original food material data information of the food material in the library management module 233, and a person skilled in the art can understand that after the original food material data information is input by any method, the food material data information is updated by combining the voice processing circuit 23 of the present invention, for example, the user 1 actively inputs the food material information through a display screen on the refrigerator main body 20, or identifies and records the food material inside the refrigerator main body 20 through radio frequency, which does not exceed the protection scope of the present invention.
Fig. 4 is a flowchart of a speech processing method according to a first embodiment of the present invention, and referring to fig. 4, the speech processing method according to the first embodiment includes:
a storage management step of recording and storing food material data information of food materials stored in the main body 20;
a voice processing step of encoding the voice information collected by the microphone 21 to generate voice data;
a voice recognition step of generating a voice command after matching the voice data generated by the voice processing module 231 with the pre-embedded voice command vocabulary,
an inventory modification step, in which the inventory management step module modifies and updates the food material data information of the food material stored in the refrigerator main body 20 according to the voice command generated in the voice recognition module 232.
In the present embodiment, the voice processing step is performed by the voice processing module 231, the voice recognition step is performed by the voice recognition module 232, and the inventory modification step is performed by the inventory management module 233, and more specifically, the inventory modification step is performed in the inventory management module 233 based on a voice instruction generated by the voice recognition module 232. In other embodiments of the present invention, a part of the independent modules in the speech processing circuit 23 may also perform two or more steps of the speech processing method. In other embodiments, the voice processing circuit 23 may also include one or more processors (not shown), and a memory (not shown) communicatively connected to the processors, where processor-readable instructions are stored in the memory, and the processor performs all the steps of the voice processing method provided in the first embodiment by executing the processor-readable instructions. In addition, the processor and the memory may be disposed in a cloud server or other terminal devices communicatively connected to the refrigerator 2.
According to the refrigerator 2 and the voice processing method provided by the embodiment, since the speed of the voice recognition on the information processing is high and the efficiency is high, the user 1 can put in or take out the food material and send out the voice information collected by the microphone 21 at the same time, and can send out the voice information collected by the microphone 21 in a mode of reading documents or counting the food material after all the food material is put in or taken out, so that the intelligent management on the food material in the refrigerator 2 can be realized at low cost only by the common microphone 21, the common loudspeaker 22 and the voice processing circuit 23 without depending on other hardware equipment including a display screen, and the usable data entry, update or deletion mode of the refrigerator 2 is more flexible.
Secondly, the recognition accuracy of voice recognition is high, compared with image data, the number of voice command vocabularies such as food material names, quantity, weight and the like is limited, exhaustion can be conveniently carried out, the data volume of a database which needs to be established in advance is small, and the cost of data and software which need to be recorded can be effectively reduced.
Moreover, compared with the method of radio frequency tag identification, the voice identification method does not need to increase the cost of consumables of the radio frequency tag, and the devices such as the speaker 22 and the microphone 21 are arranged on the outer side surface of the refrigerator main body 20 or nearby, so that the refrigerator is not easily affected by the cold environment inside the refrigerator 2, and the cost and the design difficulty of the refrigerator 2 body are lower than those of the radio frequency reading device.
Finally, the inventory management module 233 can modify and update the food material data information of the food material stored in the refrigerator main body 20 based on the voice command generated by the voice recognition module 232, that is, the food material data information is modified through the voice command of the user 1, and the user 1 does not need to actively input the inventory information of the modified food material. Moreover, the generation and output of the voice instruction can be triggered by the voice information input from the outside, that is, when the user 1 sends out voice to store or take out the food material in the refrigerator 2, the voice instruction is output to change the food material data information stored in the library management module 233, and the food material data information of the food material in the library management module 233 can be updated and deleted without operating any equipment or labeling the food material, so that the convenience of the refrigerator 2 in use is improved while the production cost is saved, the man-machine interface is friendly, and the experience of the user 1 is improved.
[ second embodiment ]
The present embodiment provides a refrigerator 2, and fig. 5 is a schematic diagram of a partial circuit configuration of the refrigerator 2 according to the present embodiment, which is associated with sound collection, broadcast, and voice processing. Referring to fig. 5, the voice processing circuit 23 provided in this embodiment includes a voice processing module 231, a voice recognition module 232, an on-library management module 233, a voice feedback module 238, and a voice output module 235. The functions and connection relationships of the voice processing module 231, the voice recognition module 232, and the library management module 233 may refer to the first embodiment, and are not described herein again.
Fig. 6 is a flowchart of a speech processing method according to the present embodiment. As shown in fig. 5 and fig. 6, in the present embodiment, the voice feedback module 238 of the voice processing circuit 23 is capable of generating a voice feedback instruction according to the voice data generated by the voice processing module 231; the voice output module 235 converts the voice feedback instruction generated by the voice feedback module 238 into voice data, and outputs the voice data to the speaker 22.
For example, when the user 1 sends out the voice message of "3 apples are put in the cold storage room", the voice processing module 231 converts the code thereof into the voice data in the digital form, the voice data is sent to the voice recognition module 232 and the voice feedback module 238, the voice recognition module 232 generates the voice command reflecting "apple in cold storage room + 3" and sends the voice command to the in-store management module 233, the in-store management module 233 modifies the food material data information of "apple in cold storage room 2" stored in the in-store management module 233 into "apple in cold storage room 5" in response to the voice command of "apple in cold storage room + 3" generated by the voice recognition module; the voice feedback module 238 generates a "good, put for you" voice feedback instruction based on the voice data, and outputs the instruction to the voice output module 235, the voice output module 235 includes a signal converter, converts the voice feedback instruction into a voice signal and outputs the voice signal to the speaker 22, and the speaker 22 performs voice broadcast "good, put for you". Similarly, when taking out apples from the refrigerating room, the above-mentioned flow may be referred to, and when taking out three apples with 8 apples in stock, the speaker 22 finally performs a voice broadcast "5 apples remain in the refrigerating room".
It should be noted that fig. 6 illustrates a case where the voice feedback step and the voice recognition step are performed in parallel, but the present invention is not limited thereto, and the case where the voice feedback step is performed first or the voice recognition step is performed first is also applicable to the present invention.
Through the mode, the modification result of the food material data information is fed back to the user 1 in the form of voice broadcast, so that the user 1 can know the relevant conditions of the modified food material data information in the refrigerator 2 through voice without looking up a display screen or actively inquiring, the user 1 can timely adjust the voice content when storing food materials according to the feedback of the refrigerator 2, the food material input and output efficiency is increased, and the use convenience degree of the food material inventory management function is improved.
The voice information collected by the microphone 21 at least includes the type of food material, the number of food materials and the storage location of the food materials in the refrigerator main body 20. Through the above manner, the voice information content collected by the microphone 21 corresponds to the food material data information one to one, so that the voice recognition module 232 can match the information collected by the microphone 21 with the pre-embedded voice command vocabulary, and generate the voice instruction which can be updated and stored for the food material data information in the library management module 233, so that each item in the food material data information of the food material is correspondingly modified and updated, and incomplete food material data information is avoided.
And, based on the content of the voice information collected by the microphone 21, the voice feedback module 238 can further generate a voice feedback instruction for inquiring and feeding back the missing necessary information.
For example, when the voice information collected by the microphone 21 does not include the storage location information of the food material, the voice feedback instruction generated by the voice feedback module 238 includes the storage location information associated with the food material.
Specifically, when the user 1 utters the voice message "put an apple", the voice processing module 231 converts its code into voice data in digital form, the voice data is sent to the voice feedback module 238, and after the voice feedback module 238 obtains the information of the storage position of the missing food material of the data based on the voice data analysis, a voice feedback instruction of "apple is suitable for being put into the cold storage room, and you are not put into the cold storage room" is generated, and outputs the instruction to the voice output module 235, the voice output module 235 includes a signal converter, converts the voice feedback instruction into a voice signal and outputs the voice signal to the loudspeaker 22, the loudspeaker 22 performs voice broadcast, "apple is suitable for being put into the fruit and vegetable room, you are put in, after the user 1 obtains the voice feedback broadcast, the user can make a positive or negative answer, for example, if the user 1 answers "good", the voice command sent by the voice recognition module 232 is "fruit and vegetable room apple + 1"; when the user 1 answers negatively, the information of the storage position of the food material, such as "store into the freezer", needs to be supplemented, after the microphone 21 collects all necessary voice information, the voice recognition module 232 generates a voice instruction "apple in freezer + 1", the database management module 233 modifies the stored food material data information, and the voice feedback module 238 generates a "good and put in for you" voice feedback instruction again.
As another example, when the voice information collected by the microphone 21 does not include the quantity information of the food materials, the voice feedback instruction generated by the voice feedback module 238 includes the quantity information associated with the food materials.
Specifically, when the user 1 sends out the voice information of "putting an apple into a refrigerating chamber", the voice processing module 231 converts the code of the voice information into the voice data in a digital form, the voice data is sent to the voice feedback module 238, the voice feedback module 238 generates a voice feedback instruction of "adding several apples" after obtaining the quantity information of the missing food materials based on the voice data analysis, and outputs the instruction to the voice output module 235, the voice output module 235 includes a signal converter, converts the voice feedback instruction into a voice signal and outputs the voice signal to the speaker 22, the speaker 22 performs voice broadcast of "adding several apples", the user 1 can confirm and answer the quantity of the food materials after obtaining the voice feedback broadcast, for example, the user 1 answers "1", then the voice recognition module 232 sends out the voice instruction of "refrigerating chamber apple + 1", the food material data information in the library management module 233 is modified from "2 cold-storage apples" to "3 cold-storage apples", and after all necessary voice information is collected by the microphone 21, the voice feedback module 238 generates a voice feedback instruction of "good, put for you" again.
Through the above manner, the food material data information is further ensured to be effectively updated and input in the inventory management module 233, and the inventory management of the content food materials by the refrigerator 2 is enhanced.
In the above embodiment of the present invention, the inventory management module 233 in the refrigerator 2 can also modify and store the food material data information of the food material stored in the refrigerator main body 20 according to the input of the intelligent terminal. In addition to the voice instruction, the embodiment adds a method of modifying the food material data information stored in the refrigerator main body 20 by inputting a modification instruction through the intelligent terminal, so that the problem that human-computer interaction operation cannot be performed when a voice output fault occurs is avoided, and meanwhile, the modification instruction input by the intelligent terminal can be further processed by data, such as sharing with other servers and the like, and synchronously updating and modifying the food material data instruction, or generating a food material use report and the like in the refrigerator 2 according to the above, so that efficient and convenient food material supplement is further realized.
Preferably, the in-store management module 233 may modify the food material data information of all food materials stored in the refrigerator main body 20 at one time according to the input of the intelligent terminal. Through the mode, the user 1 can rapidly modify all food material information stored in the refrigerator 2 through the intelligent terminal at one time, for example, one-key storage and one-key deletion are performed, so that the food material data information in the refrigerator 2 can be rapidly and conveniently modified when the refrigerator 2 is cleaned and maintained.
The present invention is not limited to the above preferred embodiments, and any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. A refrigerator, characterized by comprising:
a refrigerator main body;
a microphone and a speaker provided in the refrigerator main body;
a voice processing circuit arranged in the refrigerator main body and electrically connected with the microphone and the loudspeaker, wherein the voice processing circuit comprises,
the in-store management module is used for recording and storing food material data information of food materials stored in the refrigerator main body;
the voice processing module is used for coding and generating voice data according to the voice information collected by the microphone;
a voice recognition module for matching the voice data generated by the voice processing module with the pre-embedded voice command vocabulary and then generating a voice instruction,
and the in-store management module modifies and updates the food material data information of the food materials stored in the refrigerator main body according to the voice instruction generated by the voice recognition module.
2. The refrigerator according to claim 1, further comprising:
the voice feedback module generates a voice feedback instruction according to the voice data generated by the voice processing module;
and the voice output module is used for converting the voice feedback instruction generated by the voice feedback module into voice data and outputting the voice data to the loudspeaker.
3. The refrigerator according to claim 1 or 2,
the food material data information includes at least any one of a kind, a quantity, a consumption term, and a storage location in the refrigerator main body.
4. The refrigerator according to claim 3,
the voice information collected by the microphone at least comprises the types of food materials, the amount of the food materials and the storage positions of the food materials in the refrigerator main body.
5. The refrigerator according to claim 3,
when the voice information collected by the microphone does not include the storage position information of the food material,
the voice feedback instruction generated by the voice feedback module comprises storage position information associated with the food material.
6. The refrigerator according to claim 3,
when the voice information collected by the microphone does not include the quantity information of the food materials,
the voice feedback instruction generated by the voice feedback module comprises quantity information associated with the food materials.
7. An intelligent refrigerator system is characterized by comprising
The refrigerator of any one of claims 1-6;
an intelligent terminal in communication connection with the refrigerator,
and the in-store management module modifies and stores food material data information of food materials stored in the refrigerator main body according to the input of the intelligent terminal.
8. The intelligent refrigerator system of claim 7,
the in-store management module can modify the food material data information of all food materials stored in the refrigerator main body at one time according to the input of the intelligent terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110260777.1A CN115077155B (en) | 2021-03-10 | 2021-03-10 | Refrigerator and intelligent refrigerator system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110260777.1A CN115077155B (en) | 2021-03-10 | 2021-03-10 | Refrigerator and intelligent refrigerator system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115077155A true CN115077155A (en) | 2022-09-20 |
| CN115077155B CN115077155B (en) | 2023-12-22 |
Family
ID=83241425
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110260777.1A Active CN115077155B (en) | 2021-03-10 | 2021-03-10 | Refrigerator and intelligent refrigerator system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115077155B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202562207U (en) * | 2012-05-03 | 2012-11-28 | 合肥美菱股份有限公司 | Refrigerator system with voice function |
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
| CN106679321A (en) * | 2016-12-19 | 2017-05-17 | Tcl集团股份有限公司 | Intelligent refrigerator food management method and intelligent refrigerator |
| CN107525341A (en) * | 2016-06-20 | 2017-12-29 | 广州零号软件科技有限公司 | The food storage voice record and based reminding method that a kind of suitable refrigerator uses |
| CN107623724A (en) * | 2017-08-28 | 2018-01-23 | 合肥美的智能科技有限公司 | The shared method and system in food materials and space, refrigerator in refrigerator |
| CN107636410A (en) * | 2015-07-14 | 2018-01-26 | 利勃海尔-家用电器奥克森豪森有限责任公司 | Refrigeration and/or freezing equipment |
| KR20180111310A (en) * | 2017-03-31 | 2018-10-11 | 엘지전자 주식회사 | Home appliance, voice recognition module and home appliance system |
| US20190348044A1 (en) * | 2017-01-03 | 2019-11-14 | Samsung Electronics Co., Ltd. | Refrigerator and information display method thereof |
| CN111426115A (en) * | 2020-03-31 | 2020-07-17 | 北京喧歌科技有限公司 | Refrigerator food material management device and method |
| CN111696541A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Voice data interaction method and system for adding food materials into refrigerator |
| CN111692829A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Data interaction method and interaction system for refrigerator |
| CN111883129A (en) * | 2020-08-03 | 2020-11-03 | 海信视像科技股份有限公司 | Terminal device control method and device and terminal device |
-
2021
- 2021-03-10 CN CN202110260777.1A patent/CN115077155B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202562207U (en) * | 2012-05-03 | 2012-11-28 | 合肥美菱股份有限公司 | Refrigerator system with voice function |
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
| CN107636410A (en) * | 2015-07-14 | 2018-01-26 | 利勃海尔-家用电器奥克森豪森有限责任公司 | Refrigeration and/or freezing equipment |
| CN107525341A (en) * | 2016-06-20 | 2017-12-29 | 广州零号软件科技有限公司 | The food storage voice record and based reminding method that a kind of suitable refrigerator uses |
| CN106679321A (en) * | 2016-12-19 | 2017-05-17 | Tcl集团股份有限公司 | Intelligent refrigerator food management method and intelligent refrigerator |
| US20190348044A1 (en) * | 2017-01-03 | 2019-11-14 | Samsung Electronics Co., Ltd. | Refrigerator and information display method thereof |
| KR20180111310A (en) * | 2017-03-31 | 2018-10-11 | 엘지전자 주식회사 | Home appliance, voice recognition module and home appliance system |
| CN107623724A (en) * | 2017-08-28 | 2018-01-23 | 合肥美的智能科技有限公司 | The shared method and system in food materials and space, refrigerator in refrigerator |
| CN111696541A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Voice data interaction method and system for adding food materials into refrigerator |
| CN111692829A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Data interaction method and interaction system for refrigerator |
| CN111426115A (en) * | 2020-03-31 | 2020-07-17 | 北京喧歌科技有限公司 | Refrigerator food material management device and method |
| CN111883129A (en) * | 2020-08-03 | 2020-11-03 | 海信视像科技股份有限公司 | Terminal device control method and device and terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115077155B (en) | 2023-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114485031B (en) | Data interaction method and interaction system for refrigerator | |
| CN102708864A (en) | Conversation-based household electronic equipment and control method thereof | |
| CN107525341A (en) | The food storage voice record and based reminding method that a kind of suitable refrigerator uses | |
| CN111696541B (en) | Voice data interaction method and system for adding food materials into refrigerator | |
| CN108759294A (en) | A kind of refrigerator intelligent recognition and management system | |
| CN105841436B (en) | The food control method and food management system of intelligent refrigerator | |
| CN106524664A (en) | Method and system for reminding user of optimal article storage position and intelligent refrigerator | |
| CN108224896A (en) | Refrigerator management equipment, system, refrigerator and mobile terminal | |
| WO2003073225A3 (en) | Real-time data reporting using radio frequency identification | |
| US20140111333A1 (en) | dB | |
| CN115077155A (en) | Refrigerator and intelligent refrigerator system | |
| CN112417282B (en) | Information recommendation method, food storage equipment and server | |
| CN112199406A (en) | Information recommendation method, food material storage device and server | |
| CN115077161B (en) | Refrigerator and intelligent refrigerator system | |
| CN115077158A (en) | Refrigerator, intelligent refrigerator system | |
| CN115077159A (en) | Refrigerator and intelligent refrigerator system | |
| CN115077157B (en) | Refrigerator and intelligent refrigerator system | |
| JP6943192B2 (en) | Home appliances and location search system | |
| CN113483525A (en) | Preservation equipment and food material management method | |
| WO2018023514A1 (en) | Home background music control system | |
| US20220383237A1 (en) | System for staggered partial order induction into automated storage | |
| CN201689423U (en) | System used for managing refrigerator | |
| CN115077160A (en) | Refrigerator, intelligent refrigerator system | |
| CN115077162A (en) | Refrigerator and intelligent refrigerator system | |
| CN113915843B (en) | Refrigerator and management method of food material information of refrigerator |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240620 Address after: 214028 No.1, Xixin 1st Road, Wuxi City, Jiangsu Province Patentee after: Panasonic Home Appliances Refrigerator(Wuxi) Co.,Ltd. Country or region after: China Address before: 215123 No. 300, Zhongnan street, Suzhou Industrial Park, Suzhou City, Jiangsu Province Patentee before: PANASONIC R&D CENTER SUZHOU Co.,Ltd. Country or region before: China |