WO2022041992A1 - Refrigerator, display device, server, recommendation method, and message reminding method - Google Patents
Refrigerator, display device, server, recommendation method, and message reminding method Download PDFInfo
- Publication number
- WO2022041992A1 WO2022041992A1 PCT/CN2021/102312 CN2021102312W WO2022041992A1 WO 2022041992 A1 WO2022041992 A1 WO 2022041992A1 CN 2021102312 W CN2021102312 W CN 2021102312W WO 2022041992 A1 WO2022041992 A1 WO 2022041992A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- ingredient
- recipe
- ingredients
- existing
- refrigerator
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9032—Query formulation
Definitions
- the smart refrigerator usually first recognizes all the ingredients it stores, then generates various popular recipes containing the identified ingredients, and finally displays the popular recipes on the display screen of the refrigerator, or recommends the recipes in other related recipes. on an associated display device, such as a smart TV.
- a box door located at the opening of the storage room
- a display screen arranged on the box door, for displaying a user interface
- a part or all of the recipes are displayed in the user interface by taking the descending order of the recommended priority of each recipe as the display order of each recipe.
- the present application further provides a method for pushing information, which is applied to a refrigerator, where the refrigerator includes a display screen, and the method includes:
- a part or all of the recipes are displayed in the user interface by taking the descending order of the recommended priority of each recipe as the display order of each recipe.
- the application provides a refrigerator, comprising:
- the box body has a storage room inside for storing ingredients
- a box door located at the opening of the storage room
- a display arranged on the box door, for displaying a user interface
- the target ingredient at least includes an ingredient whose freshness satisfies a preset reminder condition determined according to time-related information corresponding to the existing ingredient in the storage room;
- the reminder message including the ingredient name of the target ingredient
- the target ingredients at least include ingredients whose freshness satisfies the preset reminder condition determined according to the time-related information corresponding to the existing ingredients in the refrigerator;
- the reminder message including the ingredient name of the target ingredient
- a server comprising: a media repository for storing recipe data corresponding to ingredients; a second controller configured to: receive a recommendation request sent from a display device, and store in the media repository according to the The recommended recipe data that can be provided by querying the main ingredients of the ingredients stored in the user's refrigerator, the ingredients stored in the user's refrigerator are identified by the server as main ingredients or auxiliary ingredients; and the recommended recipe data is sent to the display device.
- a method for recommending recipes comprising: receiving a recommendation request sent from a display device, and querying available recommended recipe data according to main ingredients in the ingredients stored in the user's refrigerator, and the user's refrigerator stores ingredients Recognized by the server as a main ingredient or an auxiliary ingredient; and sending the recommended recipe data to the display device.
- FIG. 1a is a perspective view of a refrigerator according to an exemplary embodiment of the present application.
- FIG. 2 is a schematic diagram of the hardware configuration of a refrigerator according to an exemplary embodiment of the present application
- FIG. 8 is another food material management interface shown in the present application according to an exemplary embodiment
- FIG. 9 is a recipe detail interface shown in the present application according to an exemplary embodiment.
- FIG. 11 is another recipe display interface shown in this application according to an exemplary embodiment
- FIG. 12 is a flowchart of a method for pushing information according to an exemplary embodiment of the present application.
- Fig. 13 is a flowchart showing the steps of configuring a refrigerator controller according to an exemplary embodiment of the present application
- FIG. 14 is an application scenario shown in the present application according to an exemplary embodiment
- FIG. 15 is a user interface of a display device shown in the present application according to an exemplary embodiment
- FIG. 16 is a user interface of a refrigerator display according to an exemplary embodiment of the present application.
- FIG. 17B shows a UI schematic diagram of displaying device recommended recipe data according to an embodiment of the present application
- FIG. 17C shows a UI schematic diagram of a display device recommending recipe data according to another embodiment of the present application.
- 17D shows a schematic diagram of an operation interface of recommended recipe data according to an embodiment of the present application.
- FIG. 19 shows a schematic flowchart of a method for recommending recipes according to another embodiment of the present application.
- FIG. 20B shows a schematic front view of a refrigerator according to an embodiment of the present application.
- module refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code capable of performing the functions associated with that element.
- Fig. 1a is a perspective view of a refrigerator according to an exemplary embodiment of the present application.
- the shape of the refrigerator provided by the embodiment of the present invention is approximately a rectangular parallelepiped.
- the appearance of the refrigerator is defined by the storage compartment 101 providing a limited storage space and a plurality of box doors 200 provided at the opening of the storage compartment 101 .
- the storage compartment 101 is a box body 100 with an opening.
- the storage compartment 101 includes a freezing compartment 101A located below and a refrigerating compartment 101B located above, and the freezing compartment 101A and the refrigerating compartment 101B respectively have one or more an independent storage space.
- freezer compartment 101A may be selectively covered by freezer drawer door 200A.
- the refrigerator compartment 101B is partitioned into left and right sides.
- the refrigerating compartment 101B is selectively opened or closed by a refrigerating compartment door 200B pivotally mounted on the refrigerating compartment 101B.
- Fig. 1b is a schematic view of the appearance of a refrigerator according to an exemplary embodiment of the present application.
- a display screen is provided on the refrigerator compartment door 200B, and the display screen is embedded in the door body.
- a tag reading area is provided at a position below the display screen on the refrigerator compartment door 200B, and the tag reading area has a built-in antenna for reading RFID tags, so as to identify RFID tags at a short distance.
- the plane on which the screen of the display screen is located is flush with the outer surface of the box door.
- the refrigerator 200 may include a display screen 210, a controller 220, a detector 240, a memory 250, a communicator 260, and several user input interfaces.
- the display screen 210, the antenna 230, the detector 240, and the memory 250 are coupled with the controller 220 through a communication interface.
- the display 210 is used for receiving the image signal output by the controller 220 , performing components for displaying video content and images and a menu manipulation interface, and displaying a user manipulation UI interface for controlling the refrigerator 200 .
- the controller 220 may include one or more processing units, such as a system on a chip (SoC), a central processing unit (CPU), a microcontroller (MCU), a memory controller, and the like. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
- SoC system on a chip
- CPU central processing unit
- MCU microcontroller
- memory controller and the like.
- different processing units may be independent devices, or may be integrated in one or more processors.
- the refrigerator further includes a plurality of antennas 230 for detecting RFID tags, and the controller 220 communicates with the antennas 230 through a serial port.
- the controller 220 includes an RFID module, the RFID module, the antenna 230 and the RFID tag constitute an RFID reading and writing system, the antenna 230 is used to transmit radio frequency signals between the RFID module and the RFID tag, and the RFID module completes the pairing process through the antenna 230. Read and write operations of RFID tags.
- the RFID module communicates with the antenna through a serial port.
- the memory 250 may include one or more storage units, for example, may include volatile memory (volatile memory), such as: dynamic random access memory (dynamic random access memory, DRAM), static random access memory (static random access memory) , SRAM), etc.; can also include non-volatile memory (non-volatile memory, NVM), such as: read-only memory (read-only memory, ROM), flash memory (flash memory), etc.
- volatile memory dynamic random access memory
- SRAM static random access memory
- NVM non-volatile memory
- different storage units may be independent devices, or may be integrated or packaged in one or more processors or communication interfaces, and become part of the processors or communication interfaces.
- Program instructions and applications are stored in the memory 250 .
- the controller 220 can call program instructions in the memory 250 or run an application program, so that the refrigerator executes a related method, such as the method for scanning food labels provided in the embodiments of the present application.
- the detector 240 including at least a sound collector, such as a microphone, may be used to receive the user's voice.
- the voice signal includes a control instruction of the user to control the refrigerator 200 .
- the detector 240 may also include a box door switch state sensor, such as a magnetic sensitive switch, a mechanical switch, for detecting the switch signal of each box door, and when the switch state of the box door is recorded according to the detected switch signal, the switch is sent. Status information to the controller 220 .
- the detector detects an opening signal or a closing signal of any box door, it sends the latest switch state information to the controller 220 .
- the detector may further include an image collector, such as a camera, and the camera is used to record the putting-in/out-out time and storage location of the food ingredients.
- the user input interface includes at least one of other input interfaces such as a microphone, a touch panel, a sensor, and a button.
- the user can implement the user command input function through actions such as voice, touch, gesture, pressing, etc.
- the input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the controller 220.
- the communicator 260 is used to communicate with the server or the terminal device in the local area network.
- the antenna 230 may include an antenna disposed in each storage chamber and an antenna disposed in a tag reading area, wherein the antenna disposed in each storage chamber is mainly used for scanning RFID tags in each storage chamber to read the RFID tags
- the antenna set inside the tag reading area is mainly used to scan the RFID tag on the tag reading area to read the tag information of the RFID tag.
- the power of the antennas disposed in different storage compartments may be different.
- the power of the antenna of each storage room can ensure that the antenna can recognize the ingredients included in its own compartment, so as to avoid that the false recognition rate will increase when the power is too high, and the ingredients in its own compartment will not be recognized when the power is too small.
- the power of the antenna can be determined in advance according to the space size of each storage room, and the power of each antenna can be set in the refrigerator. The larger the space, the higher the power.
- RFID tags can be used to identify the ingredients in the storage room.
- the virtual association between the RFID tag and the ingredient information is realized.
- the same RFID tag is associated with different food information successively, and the flexibility of using the RFID tag is improved.
- the ingredients with the RFID tags are stored in the refrigerator, the RFID tags in the storage room are detected by the second antenna to obtain the tag information, and the ingredients identified by the tags are determined according to the association relationship between the tag information and the ingredient information.
- the ingredient library interface includes a tab switch bar and a content area
- the tab switch bar includes multiple tab controls
- the content area will display ingredient icons in different ranges. For example, when the different tab controls are selected, ingredient icons for different categories of ingredients are displayed in the content area.
- the user can first select the label control of the corresponding category according to the category of the ingredient to be added to trigger the display of the icon of the ingredient of the corresponding category in the content area, and then select the ingredient icon to be added from the ingredient icons displayed in the content area. ingredients icon.
- the ingredient management application may also draw a corresponding ingredient icon containing an explicit freshness identifier according to the freshness identifier corresponding to the existing ingredient.
- the dominant freshness indicator is a display representation of the freshness of the ingredients
- the freshness of the ingredients is the freshness of the ingredients.
- this application does not limit the style of the freshness explicit mark, which can be a text mark, a color mark that directly indicates the freshness level, or a graphic mark that represents the relationship between the remaining days and the shelf life, such as progress. Bars can also be various combinations of text, colors, and graphics.
- the ingredients in the refrigerator can be recorded by taking pictures of the ingredients in the refrigerator, and the corresponding ingredients in the collected images can be parsed and identified by the controller, or sent to the The server does the parsing and identification.
- the camera when the refrigerator door is closed, the camera is not enabled to detect images; when the refrigerator door is opened, the camera is triggered to turn on and take pictures of the inside of the refrigerator.
- the controller sends the data collected by the camera to the server, and the server analyzes and recognizes the captured pictures, and feeds back the specific ingredients in the refrigerator.
- the controller is also used to record when the ingredients are first put in, and the shelf life of the stored ingredients.
- both the RFID module and the camera are used to record food data, one can be applied to the refrigerator.
- FIG. 3 is a user interface shown in the present application according to an exemplary embodiment, which is specifically an exemplary ingredient management interface.
- the ingredient management interface includes an RFID tag editing control 301, a recommended recipe control 302, an ingredient adding control 306, and also includes an ingredient display area corresponding to each storage room, such as an ingredient display area 303 corresponding to a refrigerator room, and a corresponding change room.
- the food material display area 304 and the food material display area 305 corresponding to the cold greenhouse.
- Each ingredient display area displays an ingredient icon corresponding to each ingredient in the storage room, such as ingredient 1, ingredient 2, and ingredient 3 in ingredient display area 303, ingredient 4 and ingredient 5 in ingredient display area 304, and ingredient display area.
- Each ingredient icon includes an ingredient image and ingredient name.
- the ingredient management application determines the freshness of the existing ingredients at preset time intervals according to the current time, the shelf life and the starting time of the existing ingredients. After determining the freshness of the existing ingredients, use the corresponding freshness identifier to mark the corresponding ingredient information in the local ingredient information set, or update the previously marked freshness identifier.
- the shelf life of "apple” in the local ingredient information set is 30 days
- the starting time is May 1.
- the freshness indicator corresponding to the ingredient information corresponding to "apple” is "fresh”.
- the ingredient icon may include, in addition to the image of the ingredient and the name of the ingredient, an explicit identifier of the freshness of the ingredient.
- the dominant freshness indicator is a display representation of the freshness of the ingredients
- the freshness of the ingredients is the freshness of the ingredients.
- the ingredient management application draws a corresponding ingredient icon containing an explicit freshness identifier according to the freshness identifier corresponding to the existing ingredient during the process of displaying the ingredient management interface.
- this application does not limit the style of the freshness explicit mark, which can be a text mark, a color mark that directly indicates the freshness level, or a graphic mark that represents the relationship between the remaining days and the shelf life, such as progress. Bars can also be various combinations of text, colors, and graphics.
- FIG. 4 is another food material management interface shown in this application according to an exemplary embodiment.
- each ingredient icon also includes an explicit freshness indicator.
- the freshness of Ingredient 1 and Ingredient 12 is explicitly marked as the word "Expired” displayed on the picture of the ingredient, indicating that the freshness level of Ingredient 1 and Ingredient 12 is "Expired”; the freshness of Ingredient 4 and Ingredient 6
- the dominant mark is a text mark and a progress bar with the content "2 days remaining” displayed below the image of the ingredients.
- the progress of the progress bar represents the remaining time or the ratio of the remaining time to the shelf life, indicating that the remaining two days of the ingredients 4 and 6 expire. That is, it is about to expire; the freshness of the remaining ingredients is explicitly marked as a progress bar, and the progress of the progress bar represents the remaining time or the ratio of the remaining time to the shelf life.
- the ingredient management application displays the ingredient management interface according to the ingredient information of the existing ingredients in the local ingredient information set, according to the freshness identifiers and storage location identifiers corresponding to the existing ingredients, the existing ingredients in each storage room are sorted.
- the icon of the ingredients is displayed in the corresponding ingredient display area, wherein the ingredient icons of the existing ingredients in each storage room are arranged in the order of decreasing freshness in the corresponding ingredient display area.
- the controller 220 detects the switch signal of each of the cabinet doors separately through the detector 240, records the switch state of the cabinet door according to the detected switch signal, and analyzes the user's operation of the cabinet door according to the switch state information behavior.
- the RFID tag in the storage room is detected to obtain the identification information of the RFID tag; according to the identification information of the RFID tag in the storage room, the storage status of the ingredient information in the local ingredient information collection is updated .
- the user may input an ingredient adding instruction by operating the ingredient adding control in the ingredient management interface.
- the ingredient management application displays an ingredient library interface in response to an ingredient addition instruction input by the user, and the ingredient library interface displays a large number of optional ingredient icons, each ingredient icon corresponding to an ingredient information.
- the user can select the ingredient to be added by inputting the selection operation of an ingredient icon.
- the selected ingredient icon can be added to the ingredient management interface, and on the other hand, the ingredient information corresponding to the selected ingredient icon can be added to the local. A collection of ingredient information and mark it as put.
- the ingredient library interface includes a tab switch bar and a content area
- the tab switch bar includes multiple tab controls
- the content area will display ingredient icons in different ranges. For example, when the different tab controls are selected, ingredient icons for different categories of ingredients are displayed in the content area.
- the user can first select the label control of the corresponding category according to the category of the ingredient to be added to trigger the display of the icon of the ingredient of the corresponding category in the content area, and then select the ingredient icon to be added from the ingredient icons displayed in the content area. ingredients icon.
- FIG. 5 is an ingredient management interface shown in some exemplary embodiments of the present application.
- the ingredient management interface further includes a recipe display area 510.
- the recipe display area 510 displays recipe controls 511-515 generated according to the recipe AE returned by the server.
- the corresponding recipe name and cover image are displayed.
- the user can click any recipe control to view the detailed content of the recipe, and the user can click the page turning button ">" to view more recipes.
- the ingredient management application After receiving the recipe information returned by the server, the ingredient management application enters the recipe display interface from the ingredient management interface, and displays the recipe returned by the server in the recipe display interface.
- the ingredient management application provides an independent recipe display interface, and the recipe returned by the server is displayed in the recipe display interface.
- FIG. 7 is a recipe display interface shown in some exemplary embodiments of the present application, which may specifically be an interface displayed after the user clicks on the recommended recipe interface when the ingredient management interface shown in FIG. 3 is displayed.
- the recipe display interface displays a return button and recipe controls 701-710 generated according to recipes A-J returned by the server, and the recipe controls display the corresponding recipe name and cover image.
- the user can click any recipe control to view the detailed content of the recipe, and can click the back button to return to the ingredient management interface.
- the ingredient management application determines the weight value corresponding to each existing ingredient according to the freshness level of each existing ingredient in each recipe, wherein the weight values corresponding to different freshness levels are different; and then calculates the corresponding weight value of all existing ingredients in each recipe.
- the sum of the weight values is used to reflect the overall freshness of all the existing ingredients in the recipe; finally, the recipes are sorted based on the corresponding addition results of each recipe to determine the recommended priority of each recipe.
- the recipe information returned by the server includes recipe A-recipe E, and the existing ingredients included in recipe A-recipe E respectively are shown in the following table:
- ingredient names of ingredients 1-5 included in recipe A-recipe E look up the freshness labels of ingredients 1-5 from the local information collection, and determine the freshness levels of ingredients 1-5 as shown in the following table:
- the lower the freshness level, the higher the corresponding weight value, and the summation result corresponding to the recipe can reflect the overall freshness of the existing ingredients in the recipe, so the overall freshness based on the existing ingredients in the recipe is lower.
- the corresponding recommendation priority is higher, and the recipes AE are arranged according to the descending order of the summation results corresponding to the recipes AE, and the recommended priority order of the recipes AE can be determined as follows:
- the priority of the recommended recipes is determined according to the freshness of the existing ingredients, and the recipes AE are displayed in the order of the recommended priorities shown in the table above, which can remind users to eat ingredients with low freshness in time , and give priority to displaying corresponding recipes for users to avoid spoilage and waste of ingredients and improve user experience.
- FIG. 8 is an ingredient management interface shown in some exemplary embodiments of the present application. Different from the ingredient management interface shown in FIG. 6 , in the ingredient management interface, the display order of recipes A-E in the pop-up window 810 is recipe C, recipe E, recipe B, recipe A, recipe D.
- the ingredient management application displays a recipe detail interface in response to a user's selection operation (eg, a click operation) on the displayed recipe control. Among them, the detailed content of the corresponding recipe is displayed in the recipe details interface.
- FIG. 9 is a recipe details interface shown in some exemplary embodiments of the present application. As shown in FIG. 9 , the interface displays a cover image 901 of a recipe, a recipe name 902 , an ingredient list area 903 and a recipe introduction area 904 , among them, the ingredients and amounts involved in the recipe are listed in the ingredient list area, and the method steps are displayed in the method introduction area.
- the ingredient management application in response to the user's selection operation on the displayed recipe control, jumps to the recipe video playback page according to the recipe video playback address in the recipe information, and further, the user can click the recipe in the recipe. Watch how-to videos on the video playback page.
- the pop-up window on the ingredient management interface or the independent recipe display interface further includes an expired ingredient reminder area corresponding to each storage room, and the expired ingredient reminder area displays the expired ingredients in the corresponding storage room. ingredients icon.
- FIG. 10 is an ingredient management interface shown in some exemplary embodiments of the present application.
- the pop-up window further includes a plurality of expired ingredient reminder areas , which are respectively an expired food reminder area 101 corresponding to the refrigerating room, an expired food reminder area 102 corresponding to the changing room, and an expired food reminder area 103 corresponding to the cooling room.
- Each expired ingredient reminder area displays the expired existing ingredients in the corresponding storage room.
- the expired ingredient reminder area 101 displays the expired existing ingredients 11-13 in the refrigerator compartment
- the expired ingredient reminder area 102 displays Expired existing ingredients 14-15 in the freezing chamber
- expired ingredients 16-17 in the changing chamber are displayed in the expired ingredient reminder area 103.
- the recipe includes a main ingredient and an auxiliary ingredient
- the main ingredient is generally an ingredient in a larger amount
- the auxiliary ingredient generally refers to an ingredient or a condiment in a smaller amount.
- the embodiment of the present application further provides a method for pushing information, specifically a method for pushing recipe information for a user on the display screen of the refrigerator, as shown in FIG. 12 , the method may include:
- S101 Receive at least one recipe issued by the server according to the existing ingredients in the storage room, where each recipe includes at least one of the existing ingredients.
- the method before the receiving the at least one recipe delivered by the server according to the existing ingredients in the storage room, the method further includes: reading the existing ingredients in the storage room from the local ingredient information set, the existing ingredients In the local ingredient information, the storage state is an ingredient in the state of being put in; send a recipe recommendation request to the server, the recipe recommendation request at least includes the ingredient name of the existing ingredient, and the recipe recommendation request is used to make the server according to the The ingredient name of the existing ingredient matches a recipe that includes at least one of the existing ingredient.
- S102 Determine the freshness of each existing ingredient in the recipe according to the current time and the pre-stored time-related information of the existing ingredient.
- S103 Determine a recommendation priority of the recipe according to the freshness of each existing ingredient in the recipe.
- the method of the present application further includes: in response to the user's selection operation on the displayed target recipe control, displaying the detailed content of the corresponding recipe.
- the method of the present application further includes: displaying on the user interface a plurality of food material display areas corresponding to each storage room, and according to the freshness identification and storage location identification corresponding to the existing food ingredients, each storage room is displayed.
- the ingredient icons of the existing ingredients in the room are displayed in the corresponding ingredient display area, wherein the ingredient icons of the existing ingredients in each storage room are arranged in the order of decreasing freshness in the corresponding ingredient display area.
- the user can select an ingredient icon in the ingredient library interface through a single-click or long-press operation.
- the ingredient management application directly adds ingredient information corresponding to the ingredient icon selected by the user to the local ingredient information set, and marks it as a storage state.
- the refrigerator controller periodically executes the following steps shown in FIG. 13 by running an ingredient management application, that is, every preset time interval, executes the following steps shown in FIG. 13 , the preset time interval The interval is the preset reminder period. As shown in Figure 13:
- S201 Determine a target ingredient, where the target ingredient at least includes an ingredient whose freshness satisfies a preset reminder condition determined according to time-related information corresponding to the existing ingredient in the storage room.
- the ingredient management application since the ingredient management application periodically executes S201-S203 to remind the user to consume the expired ingredients in the refrigerator in time, the expired ingredients whose expiration time is longer than the reminder period should be reminded ingredients, and the expiration time is less than or equal to the expiration of the reminder period The ingredients should be the ingredients that have not been reminded.
- S201 first determine the expired ingredients in the existing ingredients and the expiration time of each expired ingredient according to the time-related information or the freshness identifier of the existing ingredients in the storage room; Or the expired ingredient equal to the reminder period is determined as the first expired ingredient.
- expiration time current time - expiration time.
- the unread historical reminder messages before the preset time cut-off point in the notification application are obtained, and the preset time cut-off point refers to a time point earlier than the preset time interval of the current time point; according to The name of the ingredient contained in the historical reminder message determines the target ingredient indicated by the historical reminder message.
- all expired ingredients in the storage compartment are identified as target ingredients.
- S202 Generate a reminder message according to the target ingredient, where the reminder message includes an ingredient name of the target ingredient.
- the reminder message is generated for the first expired ingredient, it can be ensured that only one reminder is performed for each expired ingredient, and the repeated reminder strategy can be prevented from causing trouble to the user.
- the reminder state identifier corresponding to the first expired ingredient is modified from the first identifier to the second identifier.
- FIG. 14 is an application scenario exemplarily shown in this application.
- the scenario includes LAN I and refrigerators and terminal devices A-E in LAN I, where terminal device A, terminal device B, and terminal device C are active devices in LAN I.
- the ingredient management application on the refrigerator can send device discovery messages through the communicator, such as UDP (User Datagram Protocol, User Datagram Protocol) broadcast messages and/or multicast messages.
- the active devices A-C can receive the device discovery message sent by the refrigerator, and send a response message, such as a UDP unicast message, to the ingredient management application on the refrigerator according to the IP address of the refrigerator in the device discovery message.
- the ingredient management application sequentially receives the response messages sent by the active devices A-C within the preset waiting time period (5S), it can be determined that the active devices A-C exist in the local area network.
- 5S preset waiting time period
- the device discovery message includes a UDP broadcast message carrying a device discovery identifier
- the UDP broadcast message includes the local IP address, that is, the IP address of the refrigerator terminal.
- the active device in the local area network After receiving the UDP broadcast message sent by the refrigerator, the active device in the local area network confirms that the message is a device discovery message according to the device discovery identifier in the UDP broadcast message, and parses the refrigerator from the UDP broadcast message in response to confirming that the message is a device discovery message.
- the IP address of the UDP broadcast message is sent to the refrigerator according to the parsed IP address, and the response message includes the IP address of the active device.
- the device discovery message includes a multicast message sent to the terminal device in the target network, and the multicast message carries the device discovery identifier and the local IP address.
- the target network refers to the network where the refrigerator terminal is located.
- the active device in the target network After receiving the multicast message sent by the refrigerator, the active device in the target network confirms that the message is a device discovery message according to the device discovery identifier in the multicast message, and parses the message from the multicast message in response to confirming that the message is a device discovery message
- the IP address of the refrigerator is obtained, and a response message to the multicast message is sent to the refrigerator according to the resolved IP address, and the response message includes the IP address of the active device.
- the device discovery message includes both the above-mentioned UDP broadcast message and multicast message, that is, the ingredient management application simultaneously sends the UDP broadcast message to the terminal device in the local area network and the multicast message to the terminal device in the target network.
- the active device in the local area network or the active device in the target group network After receiving the UDP broadcast message or the multicast message, the active device in the local area network or the active device in the target group network sends a response message to the ingredient management application according to the IP address of the refrigerator in the UDP broadcast message or the multicast message.
- the terminal devices in the target network are all or part of the terminal devices in the local area network.
- the reminder message When there are active devices in the local area network, push a reminder message to at least one active device. When there is no active device in the local area network, the reminder message is displayed on the display through a notification application.
- the IP addresses of the respective active devices are parsed from the response messages sent by the respective active devices, and then according to the IP addresses of the respective active devices, the reminder messages generated in S202 are sent to the respective active devices in a UDP unicast manner.
- Each active device so that each active device displays the reminder message on its screen after receiving the reminder message sent by the refrigerator.
- the terminal devices in the local area network include display devices such as smart TVs or smart large screens.
- the terminal device After receiving the reminder message sent by the refrigerator end, the terminal device displays the received reminder message in the user interface according to the preset display logic and method. It should be noted that the present application does not limit the logic and manner in which the terminal device displays the reminder message.
- the display device may display the reminder message in the current user interface in the form of a modeless dialog box, so as to remind the user to consume the expired ingredients in time without affecting the user's viewing or operation of the current User Interface.
- FIG. 15 is a user interface of a display device exemplarily shown in the application. As shown in FIG. 15 , the user interface includes a video playback screen 701 and a pop-up window prompt 702 displayed at the upper right corner of the upper layer of the video playback screen 70.
- the pop-up window prompt 702 displays the text content of the reminder message, specifically "watermelon and yogurt have expired, please eat them in time".
- each terminal device in the local area network or target network corresponds to a priority
- different terminal devices correspond to different priorities.
- the ingredient management application determines the preset priority of each active device according to the device information of each active device, such as the IP address, and determines the active device with the highest priority as the target device. Then, according to the IP address of the target device, the reminder message generated in S202 is sent to the target device, so as to display the reminder message in the user interface of the target device, thereby realizing the purpose of reminding the user to consume expired ingredients in time.
- the priorities of terminal devices A-E in LAN I are terminal device A, terminal device B, terminal device C, terminal device D, and terminal device E in descending order.
- the food management application determines that the active device A is the target device according to the priority corresponding to the active device AC, and then sends a reminder message to the active device A according to the IP address of the active device A. .
- the notification application is further configured to receive a preset operation on the displayed reminder message input by the user, such as a viewing operation, a clearing operation, and the like.
- a preset operation on the displayed reminder message input by the user, such as a viewing operation, a clearing operation, and the like.
- the notification application receives the aforementioned preset operation, it will mark the reminder message as read or clear. After clearing the reminder message, delete the reminder message operated by the user. Otherwise (ie, in the case where the aforementioned preset operation is not received), the state of the reminder message is kept as the unread state or the reminder message is retained.
- Fig. 16 is a schematic diagram of a refrigerator display user interface exemplarily shown in this application.
- a notification message box 802 and a "clear" button are displayed on the upper layer of the ingredient management interface 801, and a reminder is displayed in the notification message box 802
- the text content of the message is specifically "watermelon and yogurt have expired, please eat in time”.
- the user can click the "Clear” button to cancel the display of the notification message box, and instruct the notification application to clear the reminder message.
- the user can also click on the notification message box to view the message details.
- the target ingredient can be determined according to the newly generated expired ingredient in the storage room and the ingredient indicated by the unread historical reminder message. Reminding the expired ingredients indicated by the unread historical reminder message and/or the newly generated expired ingredients in the refrigerator can avoid repeating multiple reminders for the same expired ingredient and affecting the user experience. Then, a reminder message is generated according to the target ingredients, and active devices in the local area network are actively discovered at the same time. When an active device is found in the local area network, a reminder message is pushed to at least one active device, and other active devices are used to remind users to consume expired ingredients in time, not limited to reminding on the refrigerator side, and no need to rely on cloud platforms and external networks, flexibility Powerful and resource-saving. When there is no active device in the local area network, push the reminder message to the notification application.
- the embodiment of the present application further provides a message reminding method, the execution subject of the method includes but is not limited to the controller of the above refrigerator.
- the recommended recipe can be completed by the interaction between the refrigerator and the server, and one or more other terminal devices (including but not limited to: smart TVs, set-top boxes, refrigerators, microwave ovens, ovens, and other household appliances including display screens) can also be into the interaction. No matter how several terminal devices interact with the server, they are finally displayed on their corresponding displays, so as to be more intuitively provided to the user, and to improve the correlation between the ingredients in the refrigerator and the user.
- terminal devices including but not limited to: smart TVs, set-top boxes, refrigerators, microwave ovens, ovens, and other household appliances including display screens
- FIG. 17A shows a UI schematic diagram of a TV application according to an embodiment of the present application.
- the TV display screen is configured to display other interactive controls while displaying the application UI interface
- the interactive controls may include, for example, TV homepage controls, search controls, message button controls, mailbox controls, browsing Controls, Favorites Controls, Signal Bar Controls, etc.
- FIG. 17B shows a UI schematic diagram of a display device recommending recipe data according to an embodiment of the present application.
- the display device provided by the present application includes a display screen, and the display screen is used to display a user interface, and the user interface can provide interactive functions for the user. different functions.
- the display screen of the display device may be implemented as the third display 280 of the drawings.
- the refrigerator can obtain the information of the stored food in real time through the following methods.
- the controller of the refrigerator acquires an image of the storage room, and processes the image of the storage room to obtain the grid position; then, the refrigerator acquires the user's hand trajectory, and selects the corresponding fitting trajectory based on the movement trend of the hand trajectory , the fitting trajectory is the hand trajectory at the time of item access; according to the fitting trajectory and grid position, the item access position is calculated and obtained, so that the storage or retrieval of ingredients in the refrigerator can be monitored in real time, and the user's refrigerator storage can be obtained.
- Detailed information of the ingredients such as the location of the ingredients in the refrigerator, the storage time, the remaining days of the shelf life, etc.; finally, the refrigerator uploads the ingredients stored in the user's refrigerator to the server provided in this application.
- the recommended recipe data includes attribute information of the recipe, wherein the attribute information of the recipe includes main ingredients required by the recipe, dish taste, cooking method, suitable crowd, suitable scene, cuisine, dish, efficacy, and Properties elements such as required kitchen tools.
- the recipes and the attribute information of the recipes are associated and stored in the media resource library of the server provided by this application, so that they can be accessed and used.
- the user's smart refrigerator reports the information of the ingredients stored in the user's refrigerator to the server in the cloud, and the second controller of the server or the recommended recipe business system will regularly query every day to determine the main ingredient information of the current refrigerator, and according to the The main ingredient information is queried to determine the recommended recipe data, and the recommended recipe data is saved.
- the recommended recipe application of the display device requests the recommended recipe data
- the saved recommended recipe data is sent to the display device to improve the response speed.
- the third controller controlling the user interface to display the recommended recipe operation interface including controls according to the recommended recipe data includes, the third controller includes the first recommended recipe data and the second recommended recipe data when the received recommended recipe data includes the first recommended recipe data and the second recommended recipe.
- a mapping relationship is constructed according to the preset matching characteristics of different users bound by the display device and the recipes in the recommended recipe data, a user list is generated based on the mapping relationship, and a focus position in the user list is generated according to the The user at the location controls the second recommendation window to display the recommended recipe data mapped by the user, wherein the user list and the second recommendation window are simultaneously displayed in the user interface.
- the user list in the figure includes 3 users: father, mother, Dabao Dabaoda, among which,
- the preset matching features of the user's father are: taste: spicy, fresh; others: reduce blood lipids;
- the present application also provides a method for recommending recipes on the server side.
- the refrigerator in the figure is a 4-door refrigerator, and its camera is arranged inside the refrigerator and is configured to capture the internal images of the refrigerator, for example, to obtain the images of the refrigerator compartment and the freezer compartment inside the refrigerator, and send them to the controller for identifying the ingredients As well as generating recommended recipe data.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
The present application discloses a refrigerator, a display device, a server, a recommendation method, and a message reminding method. The refrigerator comprises: a refrigerator body in which a storage chamber is provided, at least one food material being stored in the storage chamber; a refrigerator door disposed at an opening of the storage chamber; a display screen disposed on the refrigerator door and used for displaying a user interface; and a controller connected to the display screen and configured to: receive at least one recipe issued by a server according to existing food materials in the storage chamber, each recipe comprising at least one of the existing food materials; determine, according to current time and prestored time-related information of the existing food materials, the freshness of the existing food materials in the recipe; determine the recommendation priority of the recipe according to the freshness of the existing food materials in the recipe; and display, by taking the descending order of recommendation priorities of all recipes as the display order of the recipes, some or all of the recipes in the user interface.
Description
本申请要求在2020年8月24日提交中国专利局、申请号为202010855107.X、申请名称为“一种显示设备、服务器、冰箱及推荐方法”的中国专利申请的优先权,和在2021年5月25日提交中国专利局、申请号为202110606093.2、申请名称为“冰箱及信息推荐方法”的中国专利申请的优先权,和在2021年5月28日提交中国专利局、申请号为202110617466.6、申请名称为“冰箱及消息提醒方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed with the China Patent Office on August 24, 2020, the application number is 202010855107.X, and the application name is "a display device, server, refrigerator and recommended method", and in 2021 The priority of the Chinese patent application filed with the Chinese Patent Office on May 25 with application number 202110606093.2 and the application name "Refrigerator and Information Recommendation Method", and filed with the Chinese Patent Office on May 28, 2021 with application number 202110617466.6, The priority of the Chinese patent application entitled "Refrigerator and Message Reminder Method" is claimed, the entire contents of which are incorporated herein by reference.
本申请涉及图像显示技术领域,尤其涉及冰箱、显示设备、服务器、推荐方法及消息提醒方法。The present application relates to the technical field of image display, and in particular, to a refrigerator, a display device, a server, a recommendation method, and a message reminder method.
随着AIOT(人工智能物联网)的普及,传统家电也均具备智能设备的功能,根据冰箱中的食材进行食谱推荐越来越受用户的喜爱。With the popularization of AIOT (Artificial Intelligence Internet of Things), traditional home appliances also have the function of smart devices. Recipe recommendation based on the ingredients in the refrigerator is more and more popular among users.
在一些推荐食谱的实现中,通常智能冰箱首先识别其储存的所有食材,然后生成包含已识别食材的各种热门食谱,最后将热门食谱显示于冰箱的显示屏,或者将食谱推荐在其他与之相关联的显示设备,如智能电视上。In the implementation of some recommended recipes, the smart refrigerator usually first recognizes all the ingredients it stores, then generates various popular recipes containing the identified ingredients, and finally displays the popular recipes on the display screen of the refrigerator, or recommends the recipes in other related recipes. on an associated display device, such as a smart TV.
发明内容SUMMARY OF THE INVENTION
本申请提供一些冰箱、显示设备、服务器、推荐方法及消息提醒方法。This application provides some refrigerators, display devices, servers, recommendation methods and message reminder methods.
第一方面,本申请提供一种冰箱,包括:In a first aspect, the application provides a refrigerator, comprising:
箱体,内部设有储藏室,所述储藏室中储藏有至少一个食材;The box body is provided with a storage room inside, and at least one food material is stored in the storage room;
箱门,设于所述储藏室的开口处;a box door, located at the opening of the storage room;
显示屏,设于所述箱门,用于显示用户界面;a display screen, arranged on the box door, for displaying a user interface;
与所述显示屏连接的控制器,被配置为:A controller connected to the display screen is configured to:
接收服务器根据储藏室中的现有食材下发的至少一个菜谱,每个菜谱包括至少一种所述现有食材;receiving at least one recipe issued by the server according to the existing ingredients in the storage room, each recipe including at least one of the existing ingredients;
根据当前时间和预先存储的所述现有食材的时间相关信息,确定所述菜谱中各现有食材的新鲜度;determining the freshness of each existing ingredient in the recipe according to the current time and the pre-stored time-related information of the existing ingredient;
根据所述菜谱中各现有食材的新鲜度确定所述菜谱的推荐优先级;Determine the recommendation priority of the recipe according to the freshness of each existing ingredient in the recipe;
以各菜谱的推荐优先级的降序作为各菜谱的展示顺序,在所述用户界面中展示部分或者全部菜谱。A part or all of the recipes are displayed in the user interface by taking the descending order of the recommended priority of each recipe as the display order of each recipe.
第二方面,本申请还提供一种信息推送的方法,应用于冰箱,所述冰箱包括显示屏,所述方法包括:In a second aspect, the present application further provides a method for pushing information, which is applied to a refrigerator, where the refrigerator includes a display screen, and the method includes:
接收服务器根据储藏室中的现有食材下发的至少一个菜谱,每个菜谱包括至少一个所述现有食材;receiving at least one recipe issued by the server according to the existing ingredients in the storage room, each recipe including at least one of the existing ingredients;
根据当前时间和预先存储的所述现有食材的时间相关信息,确定所述菜谱中各现有食 材的新鲜度;determining the freshness of each existing ingredient in the recipe according to the current time and the pre-stored time-related information of the existing ingredient;
根据所述菜谱中各现有食材的新鲜度确定所述菜谱的推荐优先级;Determine the recommendation priority of the recipe according to the freshness of each existing ingredient in the recipe;
以各菜谱的推荐优先级的降序作为各菜谱的展示顺序,在所述用户界面中展示部分或者全部菜谱。A part or all of the recipes are displayed in the user interface by taking the descending order of the recommended priority of each recipe as the display order of each recipe.
第三方面,本申请提供一种冰箱,包括:In a third aspect, the application provides a refrigerator, comprising:
箱体,内部设有储藏室,用于储藏食材;The box body has a storage room inside for storing ingredients;
箱门,设于所述储藏室的开口处;a box door, located at the opening of the storage room;
显示器,设于所述箱门,用于显示用户界面;a display, arranged on the box door, for displaying a user interface;
通信器,用于与关联的终端设备进行通信;A communicator for communicating with the associated end device;
与所述显示器及所述通信器连接的控制器,被配置为:A controller connected to the display and the communicator is configured to:
确定目标食材,所述目标食材至少包括根据储藏室中现有食材对应的时间相关信息确定的新鲜度满足预设提醒条件的食材;Determining a target ingredient, the target ingredient at least includes an ingredient whose freshness satisfies a preset reminder condition determined according to time-related information corresponding to the existing ingredient in the storage room;
根据所述目标食材生成提醒消息,所述提醒消息包括所述目标食材的食材名称;generating a reminder message according to the target ingredient, the reminder message including the ingredient name of the target ingredient;
将所述提醒消息推送到至少一个所述终端设备,以在至少一个所述终端设备上展示所述提醒消息。Pushing the reminder message to at least one of the terminal devices to display the reminder message on at least one of the terminal devices.
第四方面,本申请还提供一种消息提醒方法,应用于冰箱,所述方法包括:In a fourth aspect, the present application further provides a message reminder method, which is applied to a refrigerator, and the method includes:
确定目标食材,所述目标食材至少包括根据冰箱中现有食材对应的时间相关信息确定的新鲜度满足预设提醒条件的食材;Determining target ingredients, the target ingredients at least include ingredients whose freshness satisfies the preset reminder condition determined according to the time-related information corresponding to the existing ingredients in the refrigerator;
根据所述目标食材生成提醒消息,所述提醒消息包括所述目标食材的食材名称;generating a reminder message according to the target ingredient, the reminder message including the ingredient name of the target ingredient;
将所述提醒消息推送到至少一个关联的终端设备,以在至少一个所述终端设备上展示所述提醒消息。Pushing the reminder message to at least one associated terminal device to display the reminder message on at least one of the terminal devices.
第五方面,提供一种显示设备,包括:显示屏,被配置为用于显示用户界面;第三控制器,被配置为:响应于用户对推荐食谱应用程序的操作,根据用户冰箱存储食材中的主食材确定服务器可以提供的推荐食谱数据,所述用户冰箱存储食材包括主食材和辅食材;控制所述用户界面根据所述推荐食谱数据显示包含控件的推荐食谱操作界面,所述控件用于在接收到用户的确认操作后,跳转至推荐食谱详情界面。In a fifth aspect, a display device is provided, comprising: a display screen configured to display a user interface; and a third controller configured to: in response to a user's operation on a recommended recipe application, store ingredients in a refrigerator according to the user's operation. The main ingredient determines the recommended recipe data that can be provided by the server, and the ingredients stored in the user's refrigerator include main ingredients and auxiliary ingredients; control the user interface to display a recommended recipe operation interface including controls according to the recommended recipe data, and the controls are used for After receiving the user's confirmation operation, jump to the recommended recipe details interface.
第六方面,提供一种服务器,包括:媒资库,用于保存食材对应的食谱数据;第二控制器,被配置为:接收来自显示设备发送的推荐请求,在所述媒资库中根据所述用户冰箱存储食材的主食材查询可以提供的推荐食谱数据,所述用户冰箱存储食材被所述服务器识别为主食材或辅食材;将所述推荐食谱数据发送至所述显示设备。In a sixth aspect, a server is provided, comprising: a media repository for storing recipe data corresponding to ingredients; a second controller configured to: receive a recommendation request sent from a display device, and store in the media repository according to the The recommended recipe data that can be provided by querying the main ingredients of the ingredients stored in the user's refrigerator, the ingredients stored in the user's refrigerator are identified by the server as main ingredients or auxiliary ingredients; and the recommended recipe data is sent to the display device.
第七方面,提供一种推荐食谱方法,所述方法包括:推荐食谱应用程序启动后,发送第一推荐请求至所述服务器,所述第一推荐请求用于使所述服务器反馈根据用户冰箱存储食材中的主食材确定的推荐食谱数据;在用户界面根据所述推荐食谱数据显示包含控件的推荐食谱操作界面,所述控件用于在接收到用户的确认操作后,跳转至推荐食谱详情界面。In a seventh aspect, a method for recommending recipes is provided, the method comprising: after a recipe recommendation application is started, sending a first recommendation request to the server, where the first recommendation request is used to make the server feed back the storage according to the user's refrigerator storage Recommended recipe data determined by the main ingredient in the ingredients; the user interface displays a recommended recipe operation interface including controls according to the recommended recipe data, and the controls are used to jump to the recommended recipe details interface after receiving the user's confirmation operation .
第八方面,提供一种推荐食谱方法,所述方法包括:接收来自显示设备发送的推荐请求,根据所述用户冰箱存储食材中的主食材查询可以提供的推荐食谱数据,所述用户冰箱存储食材被所述服务器识别为主食材或辅食材;将所述推荐食谱数据发送至所述显示设备。In an eighth aspect, a method for recommending recipes is provided, the method comprising: receiving a recommendation request sent from a display device, and querying available recommended recipe data according to main ingredients in the ingredients stored in the user's refrigerator, and the user's refrigerator stores ingredients Recognized by the server as a main ingredient or an auxiliary ingredient; and sending the recommended recipe data to the display device.
第九方面,提供一种冰箱,包括:摄像头,被配置为采集所述冰箱的内部图像;显示屏,被配置为用于显示用户界面;控制器,被配置为:将根据所述摄像头采集的冰箱内部图像获取的用户冰箱存储食材发送至服务器,所述用户冰箱存储食材被所述服务器识别为 主食材或辅食材;响应于用户对推荐食谱应用程序的操作,根据所述用户冰箱存储食材中的主食材确定服务器可以提供的推荐食谱数据;控制所述用户界面根据所述推荐食谱数据显示包含控件的推荐食谱操作界面,所述控件用于在接收到用户的确认操作后,跳转至推荐食谱详情界面。In a ninth aspect, a refrigerator is provided, comprising: a camera configured to capture an internal image of the refrigerator; a display screen configured to display a user interface; and a controller configured to: The ingredients stored in the user's refrigerator obtained from the image inside the refrigerator are sent to the server, and the ingredients stored in the user's refrigerator are identified by the server as main ingredients or auxiliary ingredients; in response to the user's operation on the recommended recipe application, according to the user's refrigerator storage ingredients determine the recommended recipe data that the server can provide; control the user interface to display a recommended recipe operation interface including controls according to the recommended recipe data, the controls are used to jump to the recommended recipe after receiving the user's confirmation operation Recipe details interface.
为了更清楚地说明本申请的实施方式,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the embodiments of the present application more clearly, the accompanying drawings required in the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, without creative efforts Additional drawings can be obtained from these drawings.
图1a为本申请根据一示例性实施例示出的冰箱立体图;1a is a perspective view of a refrigerator according to an exemplary embodiment of the present application;
图1b为本申请根据示例性实施例示出的冰箱外观示意图;Fig. 1b is a schematic diagram of the appearance of a refrigerator according to an exemplary embodiment of the present application;
图2为本申请根据示例性实施例示出的冰箱硬件配置示意图;FIG. 2 is a schematic diagram of the hardware configuration of a refrigerator according to an exemplary embodiment of the present application;
图3为本申请根据示例性实施例示出的一种食材管理界面;Fig. 3 is an ingredient management interface shown in the present application according to an exemplary embodiment;
图4为本申请根据示例性实施例示出的另一种食材管理界面;FIG. 4 is another food material management interface shown in the present application according to an exemplary embodiment;
图5为本申请根据示例性实施例示出的另一种食材管理界面;FIG. 5 is another food material management interface shown in this application according to an exemplary embodiment;
图6为本申请根据示例性实施例示出的另一种食材管理界面;FIG. 6 is another food material management interface shown in this application according to an exemplary embodiment;
图7为本申请根据示例性实施例示出的一种菜谱展示界面;FIG. 7 is a recipe display interface shown in the present application according to an exemplary embodiment;
图8为本申请根据示例性实施例示出的另一种食材管理界面;FIG. 8 is another food material management interface shown in the present application according to an exemplary embodiment;
图9为本申请根据示例性实施例示出的一种菜谱详情界面;FIG. 9 is a recipe detail interface shown in the present application according to an exemplary embodiment;
图10为本申请根据示例性实施例示出的另一种食材管理界面;FIG. 10 is another food material management interface shown in this application according to an exemplary embodiment;
图11为本申请根据示例性实施例示出的另一种菜谱展示界面;FIG. 11 is another recipe display interface shown in this application according to an exemplary embodiment;
图12为本申请根据示例性实施例示出的一种信息推送方法流程图;FIG. 12 is a flowchart of a method for pushing information according to an exemplary embodiment of the present application;
图13为本申请根据示例性实施例示出的冰箱控制器被配置的步骤流程图;Fig. 13 is a flowchart showing the steps of configuring a refrigerator controller according to an exemplary embodiment of the present application;
图14为本申请根据示例性实施例示出的一种应用场景;FIG. 14 is an application scenario shown in the present application according to an exemplary embodiment;
图15为本申请根据示例性实施例示出的一种显示设备用户界面;FIG. 15 is a user interface of a display device shown in the present application according to an exemplary embodiment;
图16为本申请根据示例性实施例示出的一种冰箱显示器用户界面;FIG. 16 is a user interface of a refrigerator display according to an exemplary embodiment of the present application;
图17A示出了本申请实施例电视应用UI示意图;FIG. 17A shows a UI schematic diagram of a TV application according to an embodiment of the present application;
图17B示出了本申请一实施例显示设备推荐食谱数据UI示意图;FIG. 17B shows a UI schematic diagram of displaying device recommended recipe data according to an embodiment of the present application;
图17C示出了本申请另一实施例显示设备推荐食谱数据UI示意图;FIG. 17C shows a UI schematic diagram of a display device recommending recipe data according to another embodiment of the present application;
图17D示出了本申请实施例推荐食谱数据操作界面示意图;17D shows a schematic diagram of an operation interface of recommended recipe data according to an embodiment of the present application;
图18示出了本申请一实施例一种推荐食谱方法的流程示意图;FIG. 18 shows a schematic flowchart of a method for recommending recipes according to an embodiment of the present application;
图19示出了本申请另一实施例一种推荐食谱方法的流程示意图;FIG. 19 shows a schematic flowchart of a method for recommending recipes according to another embodiment of the present application;
图20A示出了本申请实施例一种冰箱的侧视外观示意图;FIG. 20A shows a schematic side view of the appearance of a refrigerator according to an embodiment of the present application;
图20B示出了本申请实施例一种冰箱的正视外观示意图。FIG. 20B shows a schematic front view of a refrigerator according to an embodiment of the present application.
为使本申请的目的和实施方式更加清楚,下面将结合本申请示例性实施例中的附图,对本申请示例性实施方式进行清楚、完整地描述,显然,描述的示例性实施例仅是本申请一部分实施例,而不是全部的实施例。In order to make the purpose and implementation of the present application clearer, the exemplary embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only the Some embodiments are claimed, but not all embodiments.
需要说明的是,本申请中对于术语的简要说明,仅是为了方便理解接下来描述的 实施方式,而不是意图限定本申请的实施方式。除非另有说明,这些术语应当按照其普通和通常的含义理解。It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the embodiments described next, rather than intending to limit the embodiments of the present application. Unless otherwise specified, these terms are to be understood according to their ordinary and ordinary meanings.
本申请中说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”等是用于区别类似或同类的对象或实体,而不必然意味着限定特定的顺序或先后次序,除非另外注明。应该理解这样使用的用语在适当情况下可以互换。The terms "first", "second", "third", etc. in the description and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and are not necessarily meant to limit specific Sequential or sequential, unless otherwise noted. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
术语“包括”和“具有”以及他们的任何变形,意图在于覆盖但不排他的包含,例如,包含了一系列组件的产品或设备不必限于清楚地列出的所有组件,而是可包括没有清楚地列出的或对于这些产品或设备固有的其它组件。The terms "comprising" and "having", and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that incorporates a series of components is not necessarily limited to all components explicitly listed, but may include no explicit other components listed or inherent to these products or devices.
术语“模块”是指任何已知或后来开发的硬件、软件、固件、人工智能、模糊逻辑或硬件或/和软件代码的组合,能够执行与该元件相关的功能。The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code capable of performing the functions associated with that element.
图1a为本申请根据示例性实施例示出的冰箱立体图,本发明实施例提供的冰箱的形状近似长方体。冰箱的外观由提供有限储存空间的储藏室101和设置在储藏室101开口处的多个箱门200限定。储藏室101为具有开口的箱体100,在图1a所示示例中,储藏室101被包括位于下方的冷冻室101A以及位于上方的冷藏室101B,冷冻室101A和冷藏室101B分别具有一个或者多个独立的储存空间。Fig. 1a is a perspective view of a refrigerator according to an exemplary embodiment of the present application. The shape of the refrigerator provided by the embodiment of the present invention is approximately a rectangular parallelepiped. The appearance of the refrigerator is defined by the storage compartment 101 providing a limited storage space and a plurality of box doors 200 provided at the opening of the storage compartment 101 . The storage compartment 101 is a box body 100 with an opening. In the example shown in FIG. 1a, the storage compartment 101 includes a freezing compartment 101A located below and a refrigerating compartment 101B located above, and the freezing compartment 101A and the refrigerating compartment 101B respectively have one or more an independent storage space.
在一些实施例中,冷冻室101A可通过抽屉式冷冻室门200A选择性地覆盖。冷藏室101B被隔成左侧和右侧。冷藏室101B通过可枢转地安装在冷藏室101B上的冷藏室门200B选择性地打开或者关闭。In some embodiments, freezer compartment 101A may be selectively covered by freezer drawer door 200A. The refrigerator compartment 101B is partitioned into left and right sides. The refrigerating compartment 101B is selectively opened or closed by a refrigerating compartment door 200B pivotally mounted on the refrigerating compartment 101B.
图1b为本申请根据示例性实施例示出的冰箱外观示意图,如图1b所示,在冷藏室门200B上设有显示屏,显示屏嵌入到门体中。冷藏室门200B上显示屏下方的位置处设有标签读取区,标签读取区内置用于读取RFID标签的天线,以用于识别近距离的RFID标签。Fig. 1b is a schematic view of the appearance of a refrigerator according to an exemplary embodiment of the present application. As shown in Fig. 1b, a display screen is provided on the refrigerator compartment door 200B, and the display screen is embedded in the door body. A tag reading area is provided at a position below the display screen on the refrigerator compartment door 200B, and the tag reading area has a built-in antenna for reading RFID tags, so as to identify RFID tags at a short distance.
在一些实施例中,显示屏的屏幕所在平面与箱门外表面平齐。In some embodiments, the plane on which the screen of the display screen is located is flush with the outer surface of the box door.
如图1a和图1b所示,本申请实施例提供的冰箱,其箱体内部设有至少一个储藏室,如冷冻室、冷藏室、变温室和/或保鲜室等中的至少一个。每个储藏室中可以具有多个独立的存储空间,如抽屉式间室。As shown in FIG. 1a and FIG. 1b, the refrigerator provided by the embodiment of the present application is provided with at least one storage compartment inside the box, such as at least one of a freezing compartment, a refrigerating compartment, a changing room, and/or a fresh-keeping room. Each storage compartment can have multiple independent storage spaces, such as drawer-style compartments.
图2为本申请根据示例性实施例示出的冰箱硬件配置示意图,作为示例,冰箱200可以包括显示屏210、控制器220、检测器240、存储器250、通信器260、和若干用户输入接口。显示屏210、天线230、检测器240、存储器250通过通信接口与控制器220耦合。其中,显示器210,用于接收控制器220输出的图像信号,进行显示视频内容和图像以及菜单操控界面的组件,以及显示用于控制冰箱200的用户操控UI界面。2 is a schematic diagram of the hardware configuration of a refrigerator according to an exemplary embodiment of the present application. As an example, the refrigerator 200 may include a display screen 210, a controller 220, a detector 240, a memory 250, a communicator 260, and several user input interfaces. The display screen 210, the antenna 230, the detector 240, and the memory 250 are coupled with the controller 220 through a communication interface. The display 210 is used for receiving the image signal output by the controller 220 , performing components for displaying video content and images and a menu manipulation interface, and displaying a user manipulation UI interface for controlling the refrigerator 200 .
控制器220,可以包括一个或者多个处理单元,例如***芯片(system on a chip,SoC)、中央处理器(central processing unit,CPU)、微控制器(microcontroller,MCU)、存储控制器等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。The controller 220 may include one or more processing units, such as a system on a chip (SoC), a central processing unit (CPU), a microcontroller (MCU), a memory controller, and the like. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
在一些实施例中,所述冰箱还包括多根用于检测RFID标签的天线230,控制器220与天线230通过串口通信。In some embodiments, the refrigerator further includes a plurality of antennas 230 for detecting RFID tags, and the controller 220 communicates with the antennas 230 through a serial port.
在一些实施例中,控制器220包括RFID模块,RFID模块、天线230以及RFID标签构成RFID读写***,天线230用于在RFID模块和RFID标签之间传递射频信号,RFID模块通过天线230完成对RFID标签的读、写操作。In some embodiments, the controller 220 includes an RFID module, the RFID module, the antenna 230 and the RFID tag constitute an RFID reading and writing system, the antenna 230 is used to transmit radio frequency signals between the RFID module and the RFID tag, and the RFID module completes the pairing process through the antenna 230. Read and write operations of RFID tags.
在一些实施例中,RFID模块通过串口与天线通信。In some embodiments, the RFID module communicates with the antenna through a serial port.
存储器250,可以包括一个或者多个存储单元,例如可以包括易失性存储器(volatile memory),如:动态随机存取存储器(dynamic random access memory,DRAM)、静态随机存取存储器(static random access memory,SRAM)等;还可以包括非易失性存储器(non-volatile memory,NVM),如:只读存储器(read-only memory,ROM)、闪存(flash memory)等。其中,不同的存储单元可以是独立的器件,也可以集成或者封装在一个或者多个处理器或者通信接口中,成为处理器或者通信接口的一部分。The memory 250 may include one or more storage units, for example, may include volatile memory (volatile memory), such as: dynamic random access memory (dynamic random access memory, DRAM), static random access memory (static random access memory) , SRAM), etc.; can also include non-volatile memory (non-volatile memory, NVM), such as: read-only memory (read-only memory, ROM), flash memory (flash memory), etc. Wherein, different storage units may be independent devices, or may be integrated or packaged in one or more processors or communication interfaces, and become part of the processors or communication interfaces.
存储器250中存储有程序指令和应用程序,如语音应用。控制器220可调用存储器250中的程序指令或者运行应用程序,使冰箱执行相关的方法,例如本申请实施例所提供的食材标签的扫描方法。Program instructions and applications, such as voice applications, are stored in the memory 250 . The controller 220 can call program instructions in the memory 250 or run an application program, so that the refrigerator executes a related method, such as the method for scanning food labels provided in the embodiments of the present application.
检测器240,至少包括声音采集器,如麦克风,可以用于接收用户的声音。示例性的,包括用户控制冰箱200的控制指令的语音信号。检测器240还可以包括箱门开关状态传感器,如检测磁敏开关、机械开关,用于检测每个箱门的开关信号,当根据检测到的开关信号记录所述箱门的开关状态,发送开关状态信息给控制器220。示例性的,当检测器检测到任意一个箱门的开启信号或者关闭信号时,发送最新的开关状态信息给控制器220。检测器还可以包括一个图像采集器,如摄像头,通过摄像头拍摄食材放入放出,来记录食材的放入/取出时间和存放位置等。The detector 240, including at least a sound collector, such as a microphone, may be used to receive the user's voice. Exemplarily, the voice signal includes a control instruction of the user to control the refrigerator 200 . The detector 240 may also include a box door switch state sensor, such as a magnetic sensitive switch, a mechanical switch, for detecting the switch signal of each box door, and when the switch state of the box door is recorded according to the detected switch signal, the switch is sent. Status information to the controller 220 . Exemplarily, when the detector detects an opening signal or a closing signal of any box door, it sends the latest switch state information to the controller 220 . The detector may further include an image collector, such as a camera, and the camera is used to record the putting-in/out-out time and storage location of the food ingredients.
用户输入接口,包括麦克风、触摸板、传感器、按键等其他输入接口中至少一者。如:用户可以通过语音、触摸、手势、按压等动作实现用户指令输入功能,输入接口通过将接收的模拟信号转换为数字信号,以及数字信号转换为相应指令信号,发送至控制器220。The user input interface includes at least one of other input interfaces such as a microphone, a touch panel, a sensor, and a button. For example, the user can implement the user command input function through actions such as voice, touch, gesture, pressing, etc. The input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the controller 220.
通信器260,用于与服务器或者局域网内的终端设备进行通信。The communicator 260 is used to communicate with the server or the terminal device in the local area network.
在一些实施例中,控制器220可以包括语音识别模块,语音识别模块进一步包括语音解析单元和语音指令数据库,从而使冰箱可以独立完成对用户输入的语音数据的语音识别,以及将识别出的语音内容与语音指令数据库中的语音指令进行匹配的过程。In some embodiments, the controller 220 may include a voice recognition module, and the voice recognition module further includes a voice parsing unit and a voice instruction database, so that the refrigerator can independently complete the voice recognition of the voice data input by the user, and the recognized voice The process of matching content with voice commands in a voice command database.
本申请对天线230的数量不予限定。例如,天线230可以包括设置在每个储藏室内的天线和设置在标签读取区内部的天线,其中,设置在各储藏室内的天线主要用于扫描各储藏室内的RFID标签,以读取RFID标签的标签信息,设置在标签读取区内部的天线则主要用于扫描标签读取区上的RFID标签,以读取RFID标签的标签信息。The present application does not limit the number of antennas 230 . For example, the antenna 230 may include an antenna disposed in each storage chamber and an antenna disposed in a tag reading area, wherein the antenna disposed in each storage chamber is mainly used for scanning RFID tags in each storage chamber to read the RFID tags The antenna set inside the tag reading area is mainly used to scan the RFID tag on the tag reading area to read the tag information of the RFID tag.
在一些实施例中,不同的储藏室内设置的天线的功率可以不同。且,各个储藏室的天线的功率能够保证天线识别到自身间室包括的食材即可,从而避免功率太大时会增加误识别率,功率太小时会识别不全自身间室的食材。在具体的实现中,可以预先根据各个储藏室的空间大小确定天线的功率,并在冰箱中设置各个天线的功率,空间越大,功率越大。In some embodiments, the power of the antennas disposed in different storage compartments may be different. In addition, the power of the antenna of each storage room can ensure that the antenna can recognize the ingredients included in its own compartment, so as to avoid that the false recognition rate will increase when the power is too high, and the ingredients in its own compartment will not be recognized when the power is too small. In a specific implementation, the power of the antenna can be determined in advance according to the space size of each storage room, and the power of each antenna can be set in the refrigerator. The larger the space, the higher the power.
在一些实施例中,将设置在标签读取区下的天线称为第一天线,将设置在储藏室中的天线称为第二天线。In some embodiments, the antenna disposed under the tag reading area is referred to as the first antenna, and the antenna disposed in the storage compartment is referred to as the second antenna.
为了实现对食材的智能管理,可以使用RFID标签对储藏室中的食材进行标识。通过建立RFID标签与食材信息之间的对应关系,实现RFID标签与食材信息之间的虚拟关联。通过修改RFID标签与食材信息之间的对应关系,使得同一个RFID标签先后与不同的食材信息相关联,提高RFID标签的使用灵活性。将贴设有RFID标签的食材存放到冰箱中,通过第二天线检测储藏室中RFID标签以获取其标签信息,根据标签信息与食材信息的关联关系确定该标签所标识的食材。In order to realize the intelligent management of ingredients, RFID tags can be used to identify the ingredients in the storage room. By establishing the corresponding relationship between the RFID tag and the ingredient information, the virtual association between the RFID tag and the ingredient information is realized. By modifying the corresponding relationship between the RFID tag and the food information, the same RFID tag is associated with different food information successively, and the flexibility of using the RFID tag is improved. The ingredients with the RFID tags are stored in the refrigerator, the RFID tags in the storage room are detected by the second antenna to obtain the tag information, and the ingredients identified by the tags are determined according to the association relationship between the tag information and the ingredient information.
在一些实施例中,标签信息包括标签编码,标签编码中的特定码段为标签标识。建立 RFID标签的标识信息与食材信息的对应关系,可以实现RFID标签与食材的虚拟关联。进而,在获取到储藏室中RFID标签的标签标识后,即可根据标签标识和预先建立的对应关系确定RFID标签对应的食材。In some embodiments, the label information includes a label code, and a specific code segment in the label code is a label identifier. Establishing the corresponding relationship between the identification information of the RFID tag and the food material information can realize the virtual association between the RFID tag and the food material. Furthermore, after the label identification of the RFID tag in the storage room is obtained, the food material corresponding to the RFID tag can be determined according to the label identification and the pre-established correspondence.
在一些实施例中,冰箱控制器通过运行食材管理应用实现食材管理功能,食材管理应用提供的应用界面包括食材管理界面、标签编辑界面、食材库界面、食材添加界面等等。In some embodiments, the refrigerator controller implements an ingredient management function by running an ingredient management application, and the application interfaces provided by the ingredient management application include an ingredient management interface, a tag editing interface, an ingredient library interface, an ingredient adding interface, and the like.
在一些实施例中,响应于冰箱终端开机或者用户输入的指示启动食材管理应用的指令,控制器启动食材管理应用。食材管理应用启动后,用户可以在食材管理应用中输入触发显示标签编辑界面的指令,在显示标签编辑界面中,输入用于与指定标签关联的食材信息,食材管理应用接收到用户输入的与指定标签关联的食材信息后,建立该食材信息与该指定标签的标签标识之间的关联关系,例如,将标签标识与食材信息对应保存在本地食材信息集合中。In some embodiments, in response to the refrigerator terminal being powered on or an instruction input by the user to instruct to start the ingredient management application, the controller starts the ingredient management application. After the ingredient management application is started, the user can input an instruction to trigger the display of the label editing interface in the ingredient management application, and in the display label editing interface, enter the ingredient information associated with the specified label, and the ingredient management application receives the user input and the specified label. After the ingredient information associated with the tag, establish an association relationship between the ingredient information and the tag identifier of the specified tag, for example, save the tag identifier and ingredient information in a local ingredient information collection.
在一些实施例中,食材信息包括食材ID、食材名称、存放位置标识、食材数量、食材保质期、起始时间等中的一项或者多项。其中,根据存放位置标识可以确定该食材存放的储藏室。例如,如果食材信息“苹果”中包含的存放位置标识是“冷藏室”,则可以确定苹果存放在冷藏室中。根据当前时间、食材的保质期和起始时间可以确定食材的新鲜程度,起始时间可以是用户输入的食材的真实生产日期,如面包的生产日期2021年5月1日,也可以是冰箱接收到用户输入的食材信息后,根据信息接收时间保存的食材放入时间。In some embodiments, the ingredient information includes one or more of ingredient ID, ingredient name, storage location identifier, ingredient quantity, ingredient shelf life, start time, and the like. Wherein, the storage room in which the ingredients are stored can be determined according to the storage location identifier. For example, if the storage location identifier included in the ingredient information "apples" is "refrigerating room", it can be determined that the apples are stored in the refrigerating room. The freshness of the ingredients can be determined according to the current time, the shelf life of the ingredients and the starting time. The starting time can be the real production date of the ingredients input by the user, such as the production date of bread on May 1, 2021, or the refrigerator received After the user enters the ingredient information, the ingredient insertion time saved according to the information reception time is stored.
在一些实现方式中,可以使用新鲜度等级作为食材新鲜度的量化表征。示例性的,新鲜度等级包括但不限于:“已过期”、“快过期”、“新鲜”等等,例如,还可以包括:“严重过期”、“刚刚过期”、“较为新鲜”、“非常新鲜”等。In some implementations, a freshness rating can be used as a quantitative indication of the freshness of an ingredient. Exemplarily, the freshness level includes, but is not limited to: "expired", "nearly expired", "fresh", etc. For example, it may also include: "severely expired", "just expired", "relatively fresh", " very fresh" etc.
在一些实现方式中,首先根据食材的保质期和起始时间计算食材的过期时间,过期时间=起始时间+保质期;然后根据当前时间和过期时间计算食材距离过期的剩余时间,剩余时间=过期时间-当前时间;再根据剩余时间与保质期的比值确定食材的新鲜度等级。具体的,可以根据预设的比值与新鲜度等级的对应关系,确定某一个确定比值所对应的新鲜度等级。In some implementations, the expiration time of the ingredient is first calculated according to the shelf life and the starting time of the ingredient, expiration time = starting time + shelf life; then the remaining time until the ingredient expires is calculated according to the current time and the expiration time, remaining time = expiration time - Current time; then determine the freshness level of the ingredients according to the ratio of the remaining time to the shelf life. Specifically, the freshness level corresponding to a certain ratio may be determined according to the corresponding relationship between the preset ratio and the freshness level.
一示例性的,预设的比值与新鲜度等级的对应关系如下表所示:Exemplarily, the corresponding relationship between the preset ratio and the freshness level is shown in the following table:
剩余时间/保质期Remaining time/shelf life | 新鲜度等级freshness level |
<0<0 | 已过期expired |
0~0.30~0.3 | 快过期Expiring soon |
>0.3>0.3 | 新鲜Fresh |
另一示例性的,预设的比值与新鲜度等级的对应关系如下表所示:Another example, the corresponding relationship between the preset ratio and the freshness level is shown in the following table:
剩余时间/保质期Remaining time/shelf life | 新鲜度等级freshness level |
<-0.3<-0.3 | 严重过期seriously overdue |
-0.3~0-0.3~0 | 已过期expired |
0~0.30~0.3 | 一般新鲜generally fresh |
0.3~0.70.3~0.7 | 比较新鲜relatively fresh |
>0.7>0.7 | 非常新鲜very fresh |
在一些实施例中,储藏室中现有食材对应的食材信息保存在本地食材信息集合中。除此之外,本地食材信息集合中还可以保存历史食材对应的食材信息。其中,现有食材是指 当前储藏在冰箱中的食材,而历史食材是指过去储藏在冰箱中、当前已从冰箱中移出的食材。具体实现时,可以本地食材信息集合中食材信息对应的存放状态标记来区分现有食材和历史食材,例如将历史食材的食材信息标记为移出状态,将现有食材的食材信息标记为放入状态。In some embodiments, the ingredient information corresponding to the existing ingredients in the storage room is stored in the local ingredient information set. In addition, the local ingredient information collection can also store ingredient information corresponding to historical ingredients. Among them, the existing ingredients refer to the ingredients currently stored in the refrigerator, and the historical ingredients refer to the ingredients that were stored in the refrigerator in the past and are currently removed from the refrigerator. In specific implementation, the existing ingredients and historical ingredients can be distinguished by the storage status mark corresponding to the ingredient information in the local ingredient information set, for example, the ingredient information of the historical ingredient is marked as the removed state, and the ingredient information of the existing ingredient is marked as the put in state .
在一些实施例中,食材管理应用启动后,从本地食材信息集合中读取存放状态为放入状态的食材信息,从而得到储藏室中现有食材的食材信息。然后根据现有食材的食材信息显示食材管理界面,食材管理界面包括根据储藏室中现有食材对应的食材信息绘制的食材图标,从而使得冰箱中的现有食材以图标、图文等形式尽数展示。除此之外,食材管理界面中还可以显示各类功能控件,如RFID标签编辑控件、食材添加控件、菜谱推荐控件等,以供用户操作以触发控制器220实现相应功能。In some embodiments, after the ingredient management application is started, the information of the ingredients whose storage state is the put-in state is read from the local ingredient information set, so as to obtain ingredient information of the existing ingredients in the storage room. Then, the ingredient management interface is displayed according to the ingredient information of the existing ingredients. The ingredient management interface includes ingredient icons drawn according to the ingredient information corresponding to the existing ingredients in the storage room, so that the existing ingredients in the refrigerator are displayed in the form of icons, pictures and texts. . In addition, various functional controls, such as RFID tag editing controls, ingredient adding controls, recipe recommendation controls, etc., may also be displayed in the ingredient management interface for user operations to trigger the controller 220 to implement corresponding functions.
在一些实施例中,食材管理界面可以包括多个食材展示区,一个食材展示区可以对应一个储藏室。食材管理应用根据现有食材的食材信息中的存放位置标识确定现有食材所在的储藏室,并将现有食材的食材图标显示在其所在储藏室对应的食材展示区中,从而将冰箱中的食材分区展示出来。比如,在冷藏室对应的食材展示区中显示冷藏室中食材的食材图标。In some embodiments, the ingredient management interface may include multiple ingredient display areas, and one ingredient display area may correspond to one storage room. The ingredient management application determines the storage room where the existing ingredient is located according to the storage location identifier in the ingredient information of the existing ingredient, and displays the ingredient icon of the existing ingredient in the ingredient display area corresponding to the storage room where it is located, so as to display the storage room in the refrigerator. The food section is displayed. For example, the ingredient icons of the ingredients in the refrigerating chamber are displayed in the ingredient display area corresponding to the refrigerating chamber.
在另一些实施例中,用户可以通过操作食材管理界面中的添加食材控件,输入食材添加指令。食材管理应用响应于用户输入的食材添加指令,显示食材库界面,食材库界面中显示大量可选的食材图标,每个食材图标对应一个食材信息。用户可以通过输入对某个食材图标的选中操作,选择要添加的食材,一方面可以将选中的食材图标添加到食材管理界面中,另一方面可以将选中的食材图标对应的食材信息添加到本地食材信息集合,并将其标记为放入状态。In other embodiments, the user may input an ingredient adding instruction by operating the ingredient adding control in the ingredient management interface. The ingredient management application displays an ingredient library interface in response to an ingredient addition instruction input by the user, and the ingredient library interface displays a large number of selectable ingredient icons, each ingredient icon corresponding to an ingredient information. The user can select the ingredient to be added by inputting the selection operation of an ingredient icon. On the one hand, the selected ingredient icon can be added to the ingredient management interface, and on the other hand, the ingredient information corresponding to the selected ingredient icon can be added to the local. A collection of ingredient information and mark it as put.
上述通过输入食材添加指令添加食材的过程,至少适用于以下场景:用户将真实食材(如苹果)存放到冰箱后,操作食材管理界面中的添加食材控件,以触发显示食材库界面中,在食材库界面中选中与真实食材(如苹果)对应的食材图标(如苹果图标),将选中的食材图标添加到食材管理界面中,同时将该食材图标关联的食材信息添加到本地食材信息集合中。这样,无需在真实食材上贴设RFID标签,也可以将对应的食材信息添加到本地食材信息集合中,也可以将对应的食材图标显示在食材管理界面中,从而实现对冰箱中食材的智能管理。The above process of adding ingredients by inputting an ingredient adding instruction is at least applicable to the following scenarios: after the user stores real ingredients (such as apples) in the refrigerator, the user operates the control for adding ingredients in the ingredient management interface to trigger the display of ingredients in the ingredient library interface. In the library interface, select the ingredient icon (eg apple icon) corresponding to the real ingredient (eg apple), add the selected ingredient icon to the ingredient management interface, and at the same time add the ingredient information associated with the ingredient icon to the local ingredient information collection. In this way, there is no need to attach RFID tags to real ingredients, and the corresponding ingredient information can also be added to the local ingredient information collection, and the corresponding ingredient icons can also be displayed in the ingredient management interface, so as to realize the intelligent management of ingredients in the refrigerator. .
在一些实现方式中,食材库界面包括标签切换栏和内容区,标签切换栏包括多个标签控件,当不同标签控件被选中时,内容区中将显示不同范围内的食材图标。例如,当不同标签控件被选中时,内容区中显示不同类别的食材的食材图标。这样,用户可以先根据要添加的食材的类别,选中对应类别的标签控件,以触发在内容区中显示对应类别的食材图标,然后再从内容区中显示的食材图标中选中要添加的食材的食材图标。In some implementations, the ingredient library interface includes a tab switch bar and a content area, the tab switch bar includes multiple tab controls, and when different tab controls are selected, the content area will display ingredient icons in different ranges. For example, when the different tab controls are selected, ingredient icons for different categories of ingredients are displayed in the content area. In this way, the user can first select the label control of the corresponding category according to the category of the ingredient to be added to trigger the display of the icon of the ingredient of the corresponding category in the content area, and then select the ingredient icon to be added from the ingredient icons displayed in the content area. ingredients icon.
在一些实施例中,食材管理应用还可以根据现有食材对应的新鲜度标识,绘制对应的包含新鲜度显性标识的食材图标。顾名思义,新鲜度显性标识是食材新鲜度的显示表示,而食材新鲜度即食材的新鲜程度。需要说明的是,本申请对新鲜度显性标识的样式不予限定,其可以是直接指示新鲜度等级的文字标识、颜色标识,也可以表征剩余天数与保质期之间关系的图形标识,如进度条,还可以是文字、颜色和图形的各种组合。In some embodiments, the ingredient management application may also draw a corresponding ingredient icon containing an explicit freshness identifier according to the freshness identifier corresponding to the existing ingredient. As the name implies, the dominant freshness indicator is a display representation of the freshness of the ingredients, and the freshness of the ingredients is the freshness of the ingredients. It should be noted that this application does not limit the style of the freshness explicit mark, which can be a text mark, a color mark that directly indicates the freshness level, or a graphic mark that represents the relationship between the remaining days and the shelf life, such as progress. Bars can also be various combinations of text, colors, and graphics.
在一些实施例中,当对于具有摄像头功能的智能冰箱,可以通过对冰箱内食材进行拍照以记录冰箱中的食材,通过控制器解析并识别采集的图像中对应的食材,或者通过通信 器发送至服务器进行解析和识别。In some embodiments, for a smart refrigerator with a camera function, the ingredients in the refrigerator can be recorded by taking pictures of the ingredients in the refrigerator, and the corresponding ingredients in the collected images can be parsed and identified by the controller, or sent to the The server does the parsing and identification.
例如,当冰箱门是关闭状态时,不启用摄像头检测图像;当冰箱门打开时,触发摄像头开启,并拍摄冰箱内照片。控制器将根据摄像头采集的数据发送至服务器,服务器对拍摄的图片进行图像分析和识别,并反馈回冰箱中具体有什么食材。控制器还用于记录食材首次放入的时间,以及存储食材的保质期限。For example, when the refrigerator door is closed, the camera is not enabled to detect images; when the refrigerator door is opened, the camera is triggered to turn on and take pictures of the inside of the refrigerator. The controller sends the data collected by the camera to the server, and the server analyzes and recognizes the captured pictures, and feeds back the specific ingredients in the refrigerator. The controller is also used to record when the ingredients are first put in, and the shelf life of the stored ingredients.
在一些实施例中,由于RFID模块和摄像头均用于记录食材数据,可以择一应用在冰箱上。In some embodiments, since both the RFID module and the camera are used to record food data, one can be applied to the refrigerator.
图3为本申请根据示例性实施例示出的一种用户界面,其具体为一种示例性的食材管理界面。参阅图3,该食材管理界面包括RFID标签编辑控件301、推荐菜谱控件302、添加食材控件306,还包括与各个储藏室对应的食材展示区,如冷藏室对应的食材展示区303、变温室对应的食材展示区304和冷温室对应的食材展示区305。每个食材展示区中显示有对应储藏室中各食材的食材图标,如食材展示区303中的食材1、食材2和食材3,食材展示区304中的食材4和食材5、以及食材展示区305中的食材6和食材7。每个食材图标包括食材图片和食材名称。FIG. 3 is a user interface shown in the present application according to an exemplary embodiment, which is specifically an exemplary ingredient management interface. Referring to FIG. 3 , the ingredient management interface includes an RFID tag editing control 301, a recommended recipe control 302, an ingredient adding control 306, and also includes an ingredient display area corresponding to each storage room, such as an ingredient display area 303 corresponding to a refrigerator room, and a corresponding change room. The food material display area 304 and the food material display area 305 corresponding to the cold greenhouse. Each ingredient display area displays an ingredient icon corresponding to each ingredient in the storage room, such as ingredient 1, ingredient 2, and ingredient 3 in ingredient display area 303, ingredient 4 and ingredient 5 in ingredient display area 304, and ingredient display area. Ingredient 6 and ingredient 7 in 305. Each ingredient icon includes an ingredient image and ingredient name.
在一些实施例中,食材管理应用每隔预设时间间隔,根据当前时间、现有食材的保质期和起始时间,确定现有食材的新鲜度。确定现有食材的新鲜度后,使用对应的新鲜度标识对本地食材信息集合中对应的食材信息进行标记,或者更新在先标记的新鲜度标识。示例性的,本地食材信息集合中“苹果”的保质期为30天、起始时间为5月1日,在5月20日,“苹果”对应的食材信息对应的新鲜度标识为“新鲜”。控制器在5月21日0:00,重新计算“苹果”的新鲜度等级,得到最新的新鲜度等级为“快过期”,在本地食材信息集合中将“苹果”对应的新鲜度标识更新为“快过期”。In some embodiments, the ingredient management application determines the freshness of the existing ingredients at preset time intervals according to the current time, the shelf life and the starting time of the existing ingredients. After determining the freshness of the existing ingredients, use the corresponding freshness identifier to mark the corresponding ingredient information in the local ingredient information set, or update the previously marked freshness identifier. Exemplarily, the shelf life of "apple" in the local ingredient information set is 30 days, and the starting time is May 1. On May 20, the freshness indicator corresponding to the ingredient information corresponding to "apple" is "fresh". The controller recalculated the freshness level of "apple" at 0:00 on May 21, and obtained the latest freshness level as "expiring soon", and updated the freshness identifier corresponding to "apple" in the local ingredient information collection as "Expiring soon".
基于此,在一些实施例中,食材图标除了包括食材图片、食材名称,还可以包括食材的新鲜度显性标识。顾名思义,新鲜度显性标识是食材新鲜度的显示表示,而食材新鲜度即食材的新鲜程度。具体实现时,食材管理应用在显示食材管理界面过程中,根据现有食材对应的新鲜度标识,绘制对应的包含新鲜度显性标识的食材图标。需要说明的是,本申请对新鲜度显性标识的样式不予限定,其可以是直接指示新鲜度等级的文字标识、颜色标识,也可以表征剩余天数与保质期之间关系的图形标识,如进度条,还可以是文字、颜色和图形的各种组合。Based on this, in some embodiments, the ingredient icon may include, in addition to the image of the ingredient and the name of the ingredient, an explicit identifier of the freshness of the ingredient. As the name implies, the dominant freshness indicator is a display representation of the freshness of the ingredients, and the freshness of the ingredients is the freshness of the ingredients. During specific implementation, the ingredient management application draws a corresponding ingredient icon containing an explicit freshness identifier according to the freshness identifier corresponding to the existing ingredient during the process of displaying the ingredient management interface. It should be noted that this application does not limit the style of the freshness explicit mark, which can be a text mark, a color mark that directly indicates the freshness level, or a graphic mark that represents the relationship between the remaining days and the shelf life, such as progress. Bars can also be various combinations of text, colors, and graphics.
图4为本申请根据示例性实施例示出的另一种食材管理界面。与图3所示食材管理界面不同的是,在图4中,每个食材图标还包括新鲜度显性标识。其中,食材1和食材12的新鲜度显性标识为显示在食材图片上的“已过期”字样,表示食材1和食材12的新鲜度等级为“已过期”;食材4和食材6的新鲜度显性标识为显示在食材图片下方的内容为“剩余2天”的文字标识和进度条,进度条的进度表征剩余时间或者剩余时间与保质期的比值,表示食材4和食材6剩余两天过期,即快过期;其余食材的新鲜度显性标识为进度条,进度条的进度表征剩余时间或者剩余时间与保质期的比值。FIG. 4 is another food material management interface shown in this application according to an exemplary embodiment. Different from the ingredient management interface shown in FIG. 3 , in FIG. 4 , each ingredient icon also includes an explicit freshness indicator. Among them, the freshness of Ingredient 1 and Ingredient 12 is explicitly marked as the word "Expired" displayed on the picture of the ingredient, indicating that the freshness level of Ingredient 1 and Ingredient 12 is "Expired"; the freshness of Ingredient 4 and Ingredient 6 The dominant mark is a text mark and a progress bar with the content "2 days remaining" displayed below the image of the ingredients. The progress of the progress bar represents the remaining time or the ratio of the remaining time to the shelf life, indicating that the remaining two days of the ingredients 4 and 6 expire. That is, it is about to expire; the freshness of the remaining ingredients is explicitly marked as a progress bar, and the progress of the progress bar represents the remaining time or the ratio of the remaining time to the shelf life.
在一些实施例中,食材管理应用在根据本地食材信息集合中现有食材的食材信息显示食材管理界面时,根据现有食材对应的新鲜度标识和存放位置标识,将各个储藏室中现有食材的食材图标展示在对应的食材展示区中,其中,各储藏室中现有食材的食材图标在对应食材展示区中按照新鲜度逐渐降低的顺序排列。In some embodiments, when the ingredient management application displays the ingredient management interface according to the ingredient information of the existing ingredients in the local ingredient information set, according to the freshness identifiers and storage location identifiers corresponding to the existing ingredients, the existing ingredients in each storage room are sorted. The icon of the ingredients is displayed in the corresponding ingredient display area, wherein the ingredient icons of the existing ingredients in each storage room are arranged in the order of decreasing freshness in the corresponding ingredient display area.
在一些实施例中,控制器220通过检测器240,分别检测每个所述箱门的开关信号,根 据检测到的开关信号记录箱门的开关状态,根据开关状态信息分析用户对箱门的操作行为。当监测到最后一个开启的箱门关闭时,检测储藏室中的RFID标签,以获取RFID标签的标识信息;根据储藏室中的RFID标签的标识信息,更新本地食材信息集合中食材信息的存放状态。具体的,将储藏室中的RFID标签的标识信息与本地食材信息集合中的标识信息进行对比,确定最新移出标签和最新放入标签;将最新移出标签对应的存放状态标记为移出状态,将最新放入标签对应的存放状态标记为放入状态。这样,可以及时地根据冰箱中的现有食材对本地食材信息集合中食材信息的存放状态进行更新。In some embodiments, the controller 220 detects the switch signal of each of the cabinet doors separately through the detector 240, records the switch state of the cabinet door according to the detected switch signal, and analyzes the user's operation of the cabinet door according to the switch state information behavior. When it is detected that the last opened door is closed, the RFID tag in the storage room is detected to obtain the identification information of the RFID tag; according to the identification information of the RFID tag in the storage room, the storage status of the ingredient information in the local ingredient information collection is updated . Specifically, the identification information of the RFID tag in the storage room is compared with the identification information in the local food material information set to determine the latest removed label and the latest inserted label; the storage state corresponding to the latest removed label is marked as the removed state, and the latest removed label is marked as the removed state. The storage state corresponding to the put-in label is marked as the put-in state. In this way, the storage state of the ingredient information in the local ingredient information set can be updated in time according to the existing ingredients in the refrigerator.
在另一些实施例中,用户可以通过操作食材管理界面中的添加食材控件,输入食材添加指令。食材管理应用响应于用户输入的食材添加指令,显示食材库界面,食材库界面中显示大量可选的食材图标,每个食材图标对应一个食材信息。用户可以通过输入对某个食材图标的选中操作,选择要添加的食材,一方面可以将选中的食材图标添加到食材管理界面中,另一方面可以将选中的食材图标对应的食材信息添加到本地食材信息集合,并将其标记为放入状态。In other embodiments, the user may input an ingredient adding instruction by operating the ingredient adding control in the ingredient management interface. The ingredient management application displays an ingredient library interface in response to an ingredient addition instruction input by the user, and the ingredient library interface displays a large number of optional ingredient icons, each ingredient icon corresponding to an ingredient information. The user can select the ingredient to be added by inputting the selection operation of an ingredient icon. On the one hand, the selected ingredient icon can be added to the ingredient management interface, and on the other hand, the ingredient information corresponding to the selected ingredient icon can be added to the local. A collection of ingredient information and mark it as put.
上述通过输入食材添加指令添加食材的过程,至少适用于以下场景:用户将真实食材(如苹果)存放到冰箱后,操作食材管理界面中的添加食材控件,以触发显示食材库界面中,在食材库界面中选中与真实食材(如苹果)对应的食材图标(如苹果图标),将选中的食材图标添加到食材管理界面中,同时将该食材图标关联的食材信息添加到本地食材信息集合中。这样,无需在真实食材上贴设RFID标签,也可以将对应的食材信息添加到本地食材信息集合中,也可以将对应的食材图标显示在食材管理界面中,从而实现对冰箱中食材的智能管理。The above process of adding ingredients by inputting an ingredient adding instruction is at least applicable to the following scenarios: after the user stores real ingredients (such as apples) in the refrigerator, the user operates the control for adding ingredients in the ingredient management interface to trigger the display of ingredients in the ingredient library interface. In the library interface, select the ingredient icon (eg apple icon) corresponding to the real ingredient (eg apple), add the selected ingredient icon to the ingredient management interface, and at the same time add the ingredient information associated with the ingredient icon to the local ingredient information collection. In this way, there is no need to attach RFID tags to real ingredients, and the corresponding ingredient information can also be added to the local ingredient information collection, and the corresponding ingredient icons can also be displayed in the ingredient management interface, so as to realize the intelligent management of ingredients in the refrigerator. .
在一些实现方式中,食材库界面包括标签切换栏和内容区,标签切换栏包括多个标签控件,当不同标签控件被选中时,内容区中将显示不同范围内的食材图标。例如,当不同标签控件被选中时,内容区中显示不同类别的食材的食材图标。这样,用户可以先根据要添加的食材的类别,选中对应类别的标签控件,以触发在内容区中显示对应类别的食材图标,然后再从内容区中显示的食材图标中选中要添加的食材的食材图标。In some implementations, the ingredient library interface includes a tab switch bar and a content area, the tab switch bar includes multiple tab controls, and when different tab controls are selected, the content area will display ingredient icons in different ranges. For example, when the different tab controls are selected, ingredient icons for different categories of ingredients are displayed in the content area. In this way, the user can first select the label control of the corresponding category according to the category of the ingredient to be added to trigger the display of the icon of the ingredient of the corresponding category in the content area, and then select the ingredient icon to be added from the ingredient icons displayed in the content area. ingredients icon.
在一些实施例中,食材管理应用响应于指示显示食材管理界面的用户操作或者响应于用户对食材管理界面中“菜谱推荐控件”的操作,在显示食材管理界面的同时,根据冰箱中的现有食材向用户展示推荐的菜谱信息。In some embodiments, the ingredient management application displays the ingredient management interface while displaying the ingredient management interface according to the existing The ingredients display recommended recipe information to the user.
在一些实现方式中,食材管理应用从本地食材信息集合中读取存放状态为放入状态的食材信息,即读取出冰箱中现有食材的食材信息;向服务器发送菜谱推荐请求,菜谱推荐请求中至少包括现有食材的食材名称。服务器接收到食材管理应用发送的菜谱推荐请求后,根据现有食材的食材名称匹配菜谱,得到至少一个包括一种或者多种现有食材的菜谱,将匹配到的菜谱信息返回给食材管理应用。食材管理应用接收服务器返回的菜谱信息后,显示服务器返回的菜谱。In some implementations, the ingredient management application reads the ingredient information whose storage state is in the put-in state from the local ingredient information set, that is, reads out ingredient information of the existing ingredients in the refrigerator; sends a recipe recommendation request to the server, and the recipe recommendation request Include at least the ingredient name of the existing ingredient. After receiving the recipe recommendation request sent by the ingredient management application, the server matches the recipe according to the ingredient name of the existing ingredient, obtains at least one recipe including one or more existing ingredients, and returns the matched recipe information to the ingredient management application. After receiving the recipe information returned by the server, the ingredient management application displays the recipe returned by the server.
值得注意的是,菜谱推荐请求中还可以包括第一推荐数量和/或第二推荐数量,第一推荐数量用于限定包含同种食材的菜谱的数量,第二推荐数量用于限定服务器下发菜谱的总数量。服务器接收到食材管理应用发送的菜谱推荐请求后,根据现有食材的食材名称匹配待推荐菜谱,待推荐菜谱包括一种或者多种现有食材,然后遵循包含同种食材的菜谱数量不大于第一推荐数量,和/或,菜谱总数量不大于第二推荐数量的原则,从待推荐菜谱中选择出一定数量的菜谱返回给食材管理应用。由于同一种食材可以对应多个不同的菜谱,因 此本申请可以通过第一推荐数量和/或第二推荐数量限定服务器返回的菜谱总数和/或多样性,避免数据量过大带来不必要的资源浪费,同时提高用户体验。It is worth noting that the recipe recommendation request may also include the first recommended quantity and/or the second recommended quantity, where the first recommended quantity is used to limit the quantity of recipes containing the same ingredient, and the second recommended quantity is used to limit the delivery by the server. The total number of recipes. After receiving the recipe recommendation request sent by the ingredient management application, the server matches the recipe to be recommended according to the ingredient name of the existing ingredient. The first recommended quantity, and/or the principle that the total number of recipes is not greater than the second recommended quantity, select a certain number of recipes from the recipes to be recommended and return them to the ingredient management application. Since the same ingredient can correspond to multiple different recipes, the application can limit the total number and/or diversity of recipes returned by the server through the first recommended quantity and/or the second recommended quantity, so as to avoid unnecessary data volume caused by excessive data volume. Waste of resources while improving user experience.
在一些实施例中,菜谱推荐请求中还可以包括用户信息,用户信息可以包括用户特性标签和用户偏好标签,用户特性标签如普通用户、普通会员用户、钻石会员用户等等,用户偏好标签可以表征用户的口味偏好,如“无辣不欢”、“清淡养生”等。In some embodiments, the recipe recommendation request may further include user information. The user information may include user characteristic tags and user preference tags. User characteristic tags such as ordinary users, ordinary member users, diamond member users, etc. User's taste preferences, such as "no spicy food", "light health care", etc.
服务器接收到菜谱推荐请求后,可以根据其中的用户特性标签确定与用户特性标签对应的菜谱库,然后将现有食材的食材名称与相对应的菜谱库进行匹配。这样,在不同用户特性特性标签对应的菜谱库不同时,为普通用户、普通会员用户、钻石会员用户等不同特性用户推荐菜谱的可选范围是不同的。用户偏好标签则为服务器提供为用户推荐菜谱的参考维度,在基于现有食材为用户推荐菜谱的同时,还可以为用户推荐符合其口味偏好的菜谱。例如,根据现有食材的食材名称匹配到大量的待推荐菜谱后,根据用户偏好标签所表征的口味偏好,从待推荐菜谱中进一步筛选出符合用户口味偏好的菜谱。After receiving the recipe recommendation request, the server may determine the recipe library corresponding to the user characteristic tag according to the user characteristic tag therein, and then match the ingredient name of the existing ingredient with the corresponding recipe library. In this way, when the recipe libraries corresponding to different user characteristic characteristic tags are different, the selectable ranges of recommended recipes for users with different characteristics such as ordinary users, ordinary member users, and diamond member users are different. The user preference tag provides the server with a reference dimension for recommending recipes for users. While recommending recipes to users based on existing ingredients, it can also recommend recipes that meet their taste preferences. For example, after matching a large number of recipes to be recommended according to the ingredient names of the existing ingredients, and according to the taste preference represented by the user preference tag, a recipe that meets the user's taste preference is further screened from the recipes to be recommended.
在一些实施例中,服务器返回的菜谱信息包括但不限于菜谱名称、封面图片、涉及的食材的食材名称及用量、做法介绍以及做法视频的播放地址、食材的购买链接等。In some embodiments, the recipe information returned by the server includes, but is not limited to, the recipe name, cover image, the ingredient name and amount of the ingredients involved, the recipe introduction and the playback address of the recipe video, and the purchase link of the ingredient.
在一些实施例中,食材管理界面包括多个分别与各个储藏室对应的食材展示区,还包括菜谱展示区。食材管理应用接收到服务器返回的M个菜谱信息后,根据M个菜谱信息中的推荐优先级靠前的N个菜谱信息在菜谱展示区中显示N个菜谱控件,一个菜谱控件对应一个菜谱信息,菜谱控件中加载菜谱名称和/或菜谱封面,N≤M。其中,N小于等于菜谱展示区预设的菜谱控件展示位数量,预设的展示位数量的大小取决于菜谱展示区的尺寸、菜谱控件的尺寸以及菜谱控件间的间隔距离。In some embodiments, the ingredient management interface includes a plurality of ingredient display areas corresponding to respective storage compartments, and further includes a recipe display area. After receiving the M recipe information returned by the server, the ingredient management application displays N recipe controls in the recipe display area according to the N recipe information with the highest recommendation priority in the M recipe information, and one recipe control corresponds to one recipe information. Load the recipe name and/or recipe cover in the recipe control, N≤M. Wherein, N is less than or equal to the preset number of display positions for recipe controls in the recipe display area, and the preset number of display positions depends on the size of the recipe display area, the size of the recipe controls, and the distance between the recipe controls.
图5为本申请在一些示例性实施例中示出的一种食材管理界面。在图3所示食材管理界面的基础上,在该食材管理界面还包括菜谱展示区510,菜谱展示区510中显示有根据服务器返回的菜谱A-E生成的菜谱控件511-515,每个菜谱控件中显示有对应的菜谱名称和封面图片。用户可以点击任意一个菜谱控件查看菜谱的详细内容,用户可以点击翻页按钮“>”查看更多的菜谱。FIG. 5 is an ingredient management interface shown in some exemplary embodiments of the present application. On the basis of the ingredient management interface shown in FIG. 3, the ingredient management interface further includes a recipe display area 510. The recipe display area 510 displays recipe controls 511-515 generated according to the recipe AE returned by the server. The corresponding recipe name and cover image are displayed. The user can click any recipe control to view the detailed content of the recipe, and the user can click the page turning button ">" to view more recipes.
在另一些实施例中,食材管理应用接收到服务器返回的M个菜谱信息后,在食材管理界面上显示弹窗,根据M个菜谱信息中的N个菜谱信息在弹窗中显示N个菜谱控件,一个菜谱控件对应一个菜谱信息,菜谱控件中加载菜谱名称和/或菜谱封面,N≤M。其中,N小于等于菜谱展示区预设的菜谱控件展示位数量,预设的展示位数量的大小取决于菜谱展示区的尺寸、菜谱控件的尺寸以及菜谱控件间的间隔距离。In other embodiments, after receiving the M recipe information returned by the server, the ingredient management application displays a pop-up window on the ingredient management interface, and displays N recipe controls in the pop-up window according to N recipe information in the M recipe information , one recipe control corresponds to one recipe information, the recipe name and/or recipe cover are loaded in the recipe control, N≤M. Wherein, N is less than or equal to the preset number of display positions for recipe controls in the recipe display area, and the preset number of display positions depends on the size of the recipe display area, the size of the recipe controls, and the distance between the recipe controls.
图6为本申请在一些示例性实施例中示出的一种食材管理界面。在图3和图4所示食材管理界面的基础上,在该食材管理界面的下部显示有弹窗610,弹窗610中显示有关闭按钮和根据服务器返回的菜谱A-E生成的菜谱控件611-615,菜谱控件中显示有对应的菜谱名称和封面图片。用户可以点击任意一个菜谱控件查看菜谱的详细内容,可以点击关闭按钮关闭该弹窗。FIG. 6 is an ingredient management interface shown in some exemplary embodiments of the present application. On the basis of the ingredient management interface shown in FIG. 3 and FIG. 4 , a pop-up window 610 is displayed in the lower part of the ingredient management interface. The pop-up window 610 displays a close button and recipe controls 611-615 generated according to the recipe AE returned by the server. , the corresponding recipe name and cover image are displayed in the recipe control. The user can click any recipe control to view the detailed content of the recipe, and can click the close button to close the pop-up window.
在一些实施例中,用户可以通过操作食材管理界面中的推荐菜谱控件,输入菜谱推荐指令。食材管理应用响应于输入的菜谱推荐指令,从本地食材信息集合中读取存放状态为放入状态的食材信息,即读取出冰箱中现有食材的食材信息;向服务器发送至少包括现有食材的食材名称的菜谱推荐请求。服务器接收到食材管理应用发送的菜谱推荐请求后,根据现有食材的食材名称匹配菜谱,得到至少一个包括一种或者多种现有食材的菜谱,将匹 配到的菜谱信息返回给食材管理应用。食材管理应用接收服务器返回的菜谱信息后,从食材管理界面进入到菜谱展示界面,在菜谱展示界面中显示服务器返回的菜谱。可以前述,这些实施例与前述实施例不同的是,食材管理应用提供独立的菜谱展示界面,在菜谱展示界面中显示服务器返回的菜谱。In some embodiments, the user may input a recipe recommendation instruction by operating the recommended recipe control in the ingredient management interface. In response to the input recipe recommendation instruction, the ingredient management application reads the ingredient information whose storage state is the put-in state from the local ingredient information set, that is, reads out the ingredient information of the existing ingredients in the refrigerator; and sends the information to the server that includes at least the existing ingredients. The recipe recommendation request for the name of the ingredient. After receiving the recipe recommendation request sent by the ingredient management application, the server matches the recipe according to the ingredient name of the existing ingredient, obtains at least one recipe including one or more existing ingredients, and returns the matched recipe information to the ingredient management application. After receiving the recipe information returned by the server, the ingredient management application enters the recipe display interface from the ingredient management interface, and displays the recipe returned by the server in the recipe display interface. As mentioned above, these embodiments are different from the previous embodiments in that the ingredient management application provides an independent recipe display interface, and the recipe returned by the server is displayed in the recipe display interface.
图7为本申请在一些示例性实施例中示出的一种菜谱展示界面,其具体可以为在显示图3所示食材管理界面时,用户点击推荐菜谱界面后显示的界面。如图7所示,菜谱展示界面中显示有返回按钮和根据服务器返回的菜谱A-J生成的菜谱控件701-710,菜谱控件中显示有对应的菜谱名称和封面图片。用户可以点击任意一个菜谱控件查看菜谱的详细内容,可以点击返回按钮返回到食材管理界面。FIG. 7 is a recipe display interface shown in some exemplary embodiments of the present application, which may specifically be an interface displayed after the user clicks on the recommended recipe interface when the ingredient management interface shown in FIG. 3 is displayed. As shown in FIG. 7 , the recipe display interface displays a return button and recipe controls 701-710 generated according to recipes A-J returned by the server, and the recipe controls display the corresponding recipe name and cover image. The user can click any recipe control to view the detailed content of the recipe, and can click the back button to return to the ingredient management interface.
在一些实施例中,食材管理应用接收到服务器返回的菜谱信息后,根据当前时间和预先存储的现有食材的时间相关信息,确定每个菜谱中每种现有食材的新鲜度;然后根据每个菜谱中每种现有食材的新鲜度,基于菜谱中所有现有食材的整体新鲜度越低,菜谱对应的推荐优先级越高的原则,确定每个菜谱的推荐优先级。最后以各菜谱的推荐优先级的降序为各菜谱的展示顺序,在食材管理界面中展示部分或者全部的菜谱。其中,食材的时间相关信息包括食材的保质期和起始时间,起始时间为食材的生产时间或者放入时间。In some embodiments, after receiving the recipe information returned by the server, the ingredient management application determines the freshness of each existing ingredient in each recipe according to the current time and the pre-stored time-related information of the existing ingredient; The freshness of each existing ingredient in each recipe is based on the principle that the lower the overall freshness of all the existing ingredients in the recipe, the higher the recommendation priority corresponding to the recipe, the recommendation priority of each recipe is determined. Finally, the display order of each recipe is in descending order of the recommended priority of each recipe, and some or all of the recipes are displayed in the ingredient management interface. The time-related information of the ingredients includes the shelf life and start time of the ingredients, and the start time is the production time or the insertion time of the ingredients.
在一些实现方式中,食材管理应用根据菜谱信息中现有食材的食材名称,从本地食材信息集合中查找各食材对应的新鲜度标识,以根据新鲜度标识确定各现有食材的新鲜度等级。或者,食材管理应用根据菜谱信息中现有食材的食材名称,从本地食材信息集合中查找各现有食材对应的保质期和起始时间;然后根据当前时间、各现有食材对应的保质期和起始时间,确定各现有食材的新鲜度等级。接着,食材管理应用根据各菜谱中各现有食材的新鲜度等级确定各现有食材对应的权重值,其中,不同新鲜度等级对应的权重值不同;再计算各菜谱中所有现有食材对应的权重值的加和,加和结果用于反映菜谱中所有现有食材的整体新鲜度;最后,基于各菜谱对应的加和结果对各菜谱进行排序,以确定各菜谱的推荐优先级排序。In some implementations, the ingredient management application searches the local ingredient information set for the freshness identifier corresponding to each ingredient according to the ingredient name of the existing ingredient in the recipe information, so as to determine the freshness level of each existing ingredient according to the freshness identifier. Alternatively, the ingredient management application searches the local ingredient information collection for the shelf life and starting time corresponding to each existing ingredient according to the ingredient name of the existing ingredient in the recipe information; and then according to the current time and the shelf life and starting time corresponding to each existing ingredient time to determine the freshness level of each existing ingredient. Next, the ingredient management application determines the weight value corresponding to each existing ingredient according to the freshness level of each existing ingredient in each recipe, wherein the weight values corresponding to different freshness levels are different; and then calculates the corresponding weight value of all existing ingredients in each recipe. The sum of the weight values is used to reflect the overall freshness of all the existing ingredients in the recipe; finally, the recipes are sorted based on the corresponding addition results of each recipe to determine the recommended priority of each recipe.
在一个例子中,服务器返回的菜谱信息包括菜谱A-菜谱E,菜谱A-菜谱E所分别包括的现有食材如下表所示:In one example, the recipe information returned by the server includes recipe A-recipe E, and the existing ingredients included in recipe A-recipe E respectively are shown in the following table:
菜谱menu | 现有食材existing ingredients |
AA | 食材1、食材2ingredient 1, ingredient 2 |
BB | 食材3Ingredients 3 |
CC | 食材1、食材3ingredient 1, ingredient 3 |
DD | 食材4ingredients 4 |
EE | 食材3、食材5ingredients 3, ingredients 5 |
根据菜谱A-菜谱E中包括的食材1-5的食材名称,从本地信息集合中查找食材1-5的新鲜度标识,确定食材1-5的新鲜度等级如下表所示:According to the ingredient names of ingredients 1-5 included in recipe A-recipe E, look up the freshness labels of ingredients 1-5 from the local information collection, and determine the freshness levels of ingredients 1-5 as shown in the following table:
食材Ingredients | 新鲜度等级freshness level |
食材1Ingredients 1 | 新鲜Fresh |
食材2ingredients 2 | 快过期Expiring soon |
食材3Ingredients 3 | 已过期expired |
食材4ingredients 4 | 快过期Expiring soon |
食材5ingredients 5 | 新鲜Fresh |
新鲜度等级与权重值的预设对应关系如下表所示,其中,新鲜度等级越低,对应的权重值越大。The preset correspondence between the freshness level and the weight value is shown in the following table, where the lower the freshness level, the greater the corresponding weight value.
新鲜度等级freshness level | 权重值Weights |
新鲜Fresh | 11 |
快过期Expiring soon | 55 |
已过期expired | 1515 |
分别将菜谱A-E中各食材对应的权重值进行求和,结果如下:The weight values corresponding to the ingredients in recipes A-E are summed up, and the results are as follows:
菜谱menu | 求和结果Summation result |
AA | 1+5=61+5=6 |
BB | 1515 |
CC | 1+15=161+15=16 |
DD | 55 |
EE | 15+1=1615+1=16 |
由于在该示例中新鲜度等级越低,对应的权重值越大,而菜谱对应的求和结果可以反映菜谱中现有食材的整体新鲜度,因此基于菜谱中现有食材的整体新鲜度越低,对应的推荐优先级越高的原则,根据菜谱A-E对应的求和结果的降序对菜谱A-E进行排列,可以确定菜谱A-E的推荐优先级顺序如下:In this example, the lower the freshness level, the higher the corresponding weight value, and the summation result corresponding to the recipe can reflect the overall freshness of the existing ingredients in the recipe, so the overall freshness based on the existing ingredients in the recipe is lower. , the corresponding recommendation priority is higher, and the recipes AE are arranged according to the descending order of the summation results corresponding to the recipes AE, and the recommended priority order of the recipes AE can be determined as follows:
菜谱menu | 推荐优先级Recommended priority |
CC | 11 |
EE | 22 |
BB | 33 |
AA | 44 |
DD | 55 |
从以上示例中可以看出,根据现有食材的新鲜度确定推荐菜谱的优先级,将菜谱A-E按照上表所示推荐优先级的排列顺序进行展示,可以提醒用户及时食用新鲜度较低的食材,并优先为用户展示相应的菜谱,避免食材腐坏和浪费,提升用户体验。As can be seen from the above example, the priority of the recommended recipes is determined according to the freshness of the existing ingredients, and the recipes AE are displayed in the order of the recommended priorities shown in the table above, which can remind users to eat ingredients with low freshness in time , and give priority to displaying corresponding recipes for users to avoid spoilage and waste of ingredients and improve user experience.
图8为本申请在一些示例性实施例中示出的一种食材管理界面。与图6所示食材管理界面不同的是,该食材管理界面中,弹窗810中菜谱A-E的展示顺序为菜谱C、菜谱E、菜谱B、菜谱A、菜谱D。FIG. 8 is an ingredient management interface shown in some exemplary embodiments of the present application. Different from the ingredient management interface shown in FIG. 6 , in the ingredient management interface, the display order of recipes A-E in the pop-up window 810 is recipe C, recipe E, recipe B, recipe A, recipe D.
在一些实施例中,食材管理应用响应于用户对显示的菜谱控件的选中操作(如点击操作),显示菜谱详情界面。其中,菜谱详情界面中显示对应菜谱的详细内容。图9为本申请在一些示例性实施例中示出的菜谱详情界面,如图9所示,该界面中显示有菜谱的封面图片901、菜谱名称902、用料列表区903和做法介绍区904,其中,用料列表区中罗列菜谱涉及的食材及用量、做法介绍区则显示做法步骤。In some embodiments, the ingredient management application displays a recipe detail interface in response to a user's selection operation (eg, a click operation) on the displayed recipe control. Among them, the detailed content of the corresponding recipe is displayed in the recipe details interface. FIG. 9 is a recipe details interface shown in some exemplary embodiments of the present application. As shown in FIG. 9 , the interface displays a cover image 901 of a recipe, a recipe name 902 , an ingredient list area 903 and a recipe introduction area 904 , among them, the ingredients and amounts involved in the recipe are listed in the ingredient list area, and the method steps are displayed in the method introduction area.
值得注意的是,在另一些实施例中,食材管理应用响应于用户对显示的菜谱控件的选中操作,根据菜谱信息中的做法视频播放地址跳转到做法视频播放页面,进而,用户可以在做法视频播放页面中观看做法视频。在一些实施例中,食材管理界面上的弹窗中或者独立的菜谱展示界面中还包括分别与各个储藏室对应的过期食材提醒区,过期食材提醒区中 显示有相应储藏室中的过期食材的食材图标。具体的,食材管理应用在根据服务器返回的菜谱信息显示菜谱控件的同时,根据本地食材信息集合中现有食材的存放位置标识、时间相关信息或者新鲜度标识确定每个储藏室中每个现有食材的新鲜度,并将每个储藏室中“已过期”的现有食材对应的食材图标显示在对应的过期食材提醒区中。It is worth noting that, in other embodiments, the ingredient management application, in response to the user's selection operation on the displayed recipe control, jumps to the recipe video playback page according to the recipe video playback address in the recipe information, and further, the user can click the recipe in the recipe. Watch how-to videos on the video playback page. In some embodiments, the pop-up window on the ingredient management interface or the independent recipe display interface further includes an expired ingredient reminder area corresponding to each storage room, and the expired ingredient reminder area displays the expired ingredients in the corresponding storage room. ingredients icon. Specifically, while displaying the recipe control according to the recipe information returned by the server, the ingredient management application determines each existing ingredient in each storage room according to the storage location identifier, time-related information or freshness identifier of the existing ingredient in the local ingredient information set. The freshness of the ingredients is displayed, and the icon of the ingredients corresponding to the "expired" existing ingredients in each storage room is displayed in the corresponding expired ingredient reminder area.
图10为本申请在一些示例性实施例中示出的一种食材管理界面,如图10所示,在图8所示食材管理界面的基础上,弹窗中还包括多个过期食材提醒区,分别为冷藏室对应的过期食材提醒区101、变温室对应的过期食材提醒区102和冷温室对应的过期食材提醒区103。每个过期食材提醒区中展示相应储藏室中已过期的现有食材,如,过期食材提醒区101中显示有冷藏室中已过期的现有食材11-13,过期食材提醒区102中显示有冷冻室中已过期的现有食材14-15,过期食材提醒区103中显示有变温室中已过期的现有食材16-17。FIG. 10 is an ingredient management interface shown in some exemplary embodiments of the present application. As shown in FIG. 10 , on the basis of the ingredient management interface shown in FIG. 8 , the pop-up window further includes a plurality of expired ingredient reminder areas , which are respectively an expired food reminder area 101 corresponding to the refrigerating room, an expired food reminder area 102 corresponding to the changing room, and an expired food reminder area 103 corresponding to the cooling room. Each expired ingredient reminder area displays the expired existing ingredients in the corresponding storage room. For example, the expired ingredient reminder area 101 displays the expired existing ingredients 11-13 in the refrigerator compartment, and the expired ingredient reminder area 102 displays Expired existing ingredients 14-15 in the freezing chamber, expired ingredients 16-17 in the changing chamber are displayed in the expired ingredient reminder area 103.
图11为本申请在一些示例性实施例中示出的一种菜谱展示界面,如图11所示,在图9所示菜谱展示界面基础上,在菜谱控件下方还包括多个过期食材提醒区,分别为冷藏室对应的过期食材提醒区111、冷冻室对应的过期食材提醒区112和变温室对应的过期食材提醒区113。每个过期食材提醒区中展示相应储藏室中已过期的现有食材,如,过期食材提醒区111中显示有冷藏室中已过期的现有食材11-13,过期食材提醒区112中显示有冷冻室中已过期的现有食材14-15,过期食材提醒区113中显示有变温室中已过期的现有食材16-17。FIG. 11 is a recipe display interface shown in some exemplary embodiments of the present application. As shown in FIG. 11 , on the basis of the recipe display interface shown in FIG. 9 , a plurality of expired ingredient reminder areas are further included below the recipe control. , which are respectively an expired food reminder area 111 corresponding to the refrigerating room, an expired food reminder area 112 corresponding to the freezing room, and an expired food reminder area 113 corresponding to the changing room. Each expired ingredient reminder area displays the expired existing ingredients in the corresponding storage room. For example, the expired ingredient reminder area 111 displays the expired existing ingredients 11-13 in the refrigerator compartment, and the expired ingredient reminder area 112 displays Expired existing ingredients 14-15 in the freezing chamber, expired ingredients 16-17 in the changing chamber are displayed in the expired ingredient reminder area 113.
在一些实施例中,菜谱中包括主食材和辅食材,主食材一般为用量较多的食材,辅食材一般指用量较少的食材或者调味品。食材管理应用在得到各菜谱的推荐优先级排列以后,根据各菜谱的推荐优先级确定待展示的前N个菜谱,N≤M,M为服务器下发的菜谱总数。然后统计前N个菜谱中每种主食材在该N个菜谱中的频次n2,若某个主食材在该N个菜谱中的频次n2大于n1,则确定该主食材是高频主食材。对于高频主食材,随机删除(n2-n1)个包含该高频主食材的菜谱,并使第(N+1)至第[N+(n2-n1)]个菜谱向前补足,直到待展示的前N个菜谱中每种主食材的频次都不大于n1。In some embodiments, the recipe includes a main ingredient and an auxiliary ingredient, the main ingredient is generally an ingredient in a larger amount, and the auxiliary ingredient generally refers to an ingredient or a condiment in a smaller amount. After obtaining the recommended priority ranking of each recipe, the ingredient management application determines the top N recipes to be displayed according to the recommended priority of each recipe, where N≤M, where M is the total number of recipes delivered by the server. Then, the frequency n2 of each main ingredient in the first N recipes in the N recipes is counted. If the frequency n2 of a main ingredient in the N recipes is greater than n1, it is determined that the main ingredient is a high-frequency main ingredient. For high-frequency main ingredients, randomly delete (n2-n1) recipes containing the high-frequency main ingredients, and make the (N+1)th to [N+(n2-n1)]th recipes to be supplemented forward until it is to be displayed The frequency of each main ingredient in the top N recipes is not greater than n1.
在一个例子中,服务器下发的菜谱总数M=10,N=5,每种主食材在这5个菜谱中出现的频次为2,前5个待展示的菜谱的主食材如下表所示:In one example, the total number of recipes delivered by the server is M=10, N=5, the frequency of each main ingredient in these 5 recipes is 2, and the main ingredients of the first 5 recipes to be displayed are shown in the following table:
菜谱menu | 主食材main ingredient |
11 | 食材1、食材2ingredient 1, ingredient 2 |
22 | 食材1Ingredients 1 |
33 | 食材1、食材3ingredient 1, ingredient 3 |
44 | 食材2、食材4ingredient 2, ingredient 4 |
55 | 食材2ingredients 2 |
如上表所示,对该5个菜谱中的每种主食材在该5个菜谱中出现的频次进行统计,得到每种主食材对应的频次如下表所示:As shown in the above table, the frequency of occurrence of each main ingredient in the 5 recipes is counted, and the frequency corresponding to each main ingredient is obtained as shown in the following table:
食材Ingredients | 频次frequency |
11 | 33 |
22 | 33 |
33 | 11 |
44 | 11 |
可以确定,食材1和食材2的频次大于2,因此食材1和食材2为高频主食材。对于食材1 和食材2,需要随机删除(3-2)个包含食材1和/或食材2的菜谱,如删除菜谱1,或者删除菜谱2和菜谱5。若删除菜谱1,则使推荐优先级为第6位的菜谱向上补足,并重新确定最新的前5个菜谱中每种主食材的频次及后续过程,若删除菜谱2和菜谱5,则使推荐优先级为第6-7位的菜谱向上补足,并重新确定最新的前5个菜谱中每种主食材的频次及后续过程,直到待展示的前5个菜谱中每种主食材的频次都不大于2,从而避免向用户展示的前N个菜谱多数是采用相同食材的食谱,提升用户体验。It can be determined that the frequency of ingredient 1 and ingredient 2 is greater than 2, so ingredient 1 and ingredient 2 are high-frequency main ingredients. For Ingredient 1 and Ingredient 2, (3-2) recipes containing Ingredient 1 and/or Ingredient 2 need to be deleted randomly, for example, Recipe 1 is deleted, or Recipe 2 and Recipe 5 are deleted. If Recipe 1 is deleted, the recipe with the sixth recommended priority will be supplemented upward, and the frequency and subsequent process of each main ingredient in the latest top 5 recipes will be re-determined. If Recipe 2 and Recipe 5 will be deleted, the recommended Recipes with priorities 6-7 are supplemented upwards, and the frequency of each main ingredient in the latest top 5 recipes and the subsequent process are re-determined until the frequency of each main ingredient in the top 5 recipes to be displayed is no longer. greater than 2, so as to avoid that most of the top N recipes displayed to the user are recipes using the same ingredients, and improve the user experience.
由以上实施例可知,本申请提供一种冰箱,包括显示屏和控制器,控制器被配置为:接收服务器根据储藏室中的现有食材下发的至少一个菜谱,每个菜谱包括至少一种现有食材;根据当前时间和预先存储的现有食材的时间相关信息,确定菜谱中各现有食材的新鲜度;根据菜谱中各现有食材的新鲜度,基于菜谱中所有现有食材的整体新鲜度越低,菜谱对应的推荐优先级越高的原则,确定每个菜谱的推荐优先级;以各菜谱的推荐优先级的降序作为各菜谱的展示顺序,在用户界面中展示部分或者全部菜谱。基于本申请提供的冰箱,可以根据现有食材的新鲜度确定推荐菜谱的优先级,可以提醒用户及时食用新鲜度较低的食材,并优先为用户展示相应的菜谱,避免食材腐坏和浪费,提升用户体验。It can be seen from the above embodiments that the present application provides a refrigerator, including a display screen and a controller, the controller is configured to: receive at least one recipe issued by the server according to the existing ingredients in the storage room, and each recipe includes at least one recipe. Existing ingredients; determine the freshness of each existing ingredient in the recipe according to the current time and the pre-stored time-related information of the existing ingredient; according to the freshness of each existing ingredient in the recipe, based on the overall The lower the freshness is, the higher the recommendation priority corresponding to the recipe is, the recommendation priority of each recipe is determined; the descending order of the recommended priority of each recipe is used as the display order of each recipe, and some or all recipes are displayed in the user interface. . Based on the refrigerator provided by this application, the priority of the recommended recipes can be determined according to the freshness of the existing ingredients, the user can be reminded to eat the ingredients with lower freshness in time, and the corresponding recipes can be displayed for the user first, so as to avoid the spoilage and waste of the ingredients, Improve user experience.
基于以上实施例提供的冰箱,本申请实施例还提供一种信息推送方法,具体在冰箱显示屏上为用户推送菜谱信息的方法,如图12所示,该方法可以包括:Based on the refrigerator provided by the above embodiment, the embodiment of the present application further provides a method for pushing information, specifically a method for pushing recipe information for a user on the display screen of the refrigerator, as shown in FIG. 12 , the method may include:
S101,接收服务器根据储藏室中的现有食材下发的至少一个菜谱,每个菜谱包括至少一个所述现有食材。S101: Receive at least one recipe issued by the server according to the existing ingredients in the storage room, where each recipe includes at least one of the existing ingredients.
在一些实施例中,所述接收服务器根据储藏室中的现有食材下发的至少一个菜谱之前,还包括:从本地食材信息集合中读取储藏室中的现有食材,所述现有食材为所述本地食材信息中存放状态为放入状态的食材;向服务器发送菜谱推荐请求,所述菜谱推荐请求至少包括所述现有食材的食材名称,所述菜谱推荐请求用于使服务器根据所述现有食材的食材名称匹配包括至少一种所述现有食材的菜谱。In some embodiments, before the receiving the at least one recipe delivered by the server according to the existing ingredients in the storage room, the method further includes: reading the existing ingredients in the storage room from the local ingredient information set, the existing ingredients In the local ingredient information, the storage state is an ingredient in the state of being put in; send a recipe recommendation request to the server, the recipe recommendation request at least includes the ingredient name of the existing ingredient, and the recipe recommendation request is used to make the server according to the The ingredient name of the existing ingredient matches a recipe that includes at least one of the existing ingredient.
S102,根据当前时间和预先存储的所述现有食材的时间相关信息,确定所述菜谱中各现有食材的新鲜度。S102: Determine the freshness of each existing ingredient in the recipe according to the current time and the pre-stored time-related information of the existing ingredient.
在一些实施例中,所述现有食材具有用于表征新鲜度的新鲜度标识;所述时间相关信息包括保质期和起始时间,所述起始时间为食材放入储藏室的时间或者食材的生产时间;所述方法还包括:每隔预设时间间隔,根据当前时间、所述现有食材的保质期和起始时间,确定所述现有食材的新鲜度;根据所述现有食材的新鲜度更新所述现有食材的新鲜度标识。所述根据当前时间和预先存储的所述现有食材的时间相关信息,确定所述菜谱中各现有食材的新鲜度,包括:根据所述菜谱中各现有食材的食材名称,从本地食材信息集合中查找各现有食材对应的新鲜度标识,以根据所述新鲜度标识确定各现有食材的新鲜度。In some embodiments, the existing food material has a freshness identifier used to represent freshness; the time-related information includes a shelf life and a start time, and the start time is the time when the food material is put into the storage room or the time of the food material. production time; the method further includes: at preset time intervals, determining the freshness of the existing ingredients according to the current time, the shelf life and starting time of the existing ingredients; according to the freshness of the existing ingredients The freshness indicator of the existing food item is updated. Determining the freshness of each existing ingredient in the recipe according to the current time and the pre-stored time-related information of the existing ingredient includes: according to the ingredient name of each existing ingredient in the recipe, from local ingredients. The freshness identifier corresponding to each existing ingredient is searched in the information set, so as to determine the freshness of each existing ingredient according to the freshness identifier.
在一些实施例中,所述时间相关信息包括保质期和起始时间,所述起始时间为食材放入储藏室的时间或者食材的生产时间,所述根据当前时间和预先存储的所述现有食材的时间相关信息,确定所述菜谱中各现有食材的新鲜度,包括:根据所述菜谱中各现有食材的食材名称,从本地食材信息集合中查找各现有食材对应的保质期和起始时间;根据所述现有食材对应的保质期和起始时间,确定所述现有食材的过期时间;计算所述现有食材的过期时间与当前时间的差值,根据所述差值与所述现有食材的保质期的比值确定所述现有食材的新鲜度等级。In some embodiments, the time-related information includes a shelf life and a start time, and the start time is the time when the food was put into the storage room or the production time of the food, and the time according to the current time and the pre-stored existing Time-related information of the ingredients, and determining the freshness of each existing ingredient in the recipe, including: according to the ingredient name of each existing ingredient in the recipe, searching for the shelf life and start date corresponding to each existing ingredient from the local ingredient information collection start time; determine the expiration time of the existing food according to the shelf life and start time corresponding to the existing food; calculate the difference between the expiration time of the existing food and the current time, according to the difference and the The ratio of the shelf life of the existing ingredients determines the freshness level of the existing ingredients.
S103,根据所述菜谱中各现有食材的新鲜度确定所述菜谱的推荐优先级。S103: Determine a recommendation priority of the recipe according to the freshness of each existing ingredient in the recipe.
在一些实施例中,根据所述菜谱中各现有食材的新鲜度等级确定各现有食材对应的权重值,不同新鲜度等级对应的权重值不同;将所述菜谱中各现有食材对应的权重值的加和,基于各菜谱对应的所述加和对各菜谱进行排序,以确定各菜谱的推荐优先级。In some embodiments, the weight value corresponding to each existing ingredient is determined according to the freshness level of each existing ingredient in the recipe, and the weight values corresponding to different freshness levels are different; The sum of the weight values is used to sort each recipe based on the sum corresponding to each recipe, so as to determine the recommendation priority of each recipe.
S104,以各菜谱的推荐优先级的降序作为各菜谱的展示顺序,在所述用户界面中展示部分或者全部菜谱。S104: Display some or all of the recipes in the user interface by using the descending order of the recommended priorities of the recipes as the display order of the recipes.
在一些实施例中,在所述菜谱展示区中展示N个菜谱控件,将服务器返回的M个菜谱中推荐优先级靠前的N个菜谱的菜谱名称和菜谱封面依次加载在所述N个菜谱控件中,N≤M,N小于等于所述菜谱展示区中菜谱控件展示位的预设数量;In some embodiments, N recipe controls are displayed in the recipe display area, and the recipe names and recipe covers of the N recipes with the highest recommended priority among the M recipes returned by the server are sequentially loaded on the N recipes In the control, N≤M, and N is less than or equal to the preset number of display positions for the recipe controls in the recipe display area;
在一些实施例中,本申请方法还包括:响应于用户对显示的目标菜谱控件的选中操作,显示对应菜谱的详细内容。In some embodiments, the method of the present application further includes: in response to the user's selection operation on the displayed target recipe control, displaying the detailed content of the corresponding recipe.
在一些实施例中,现有食材具有用于表征储藏室的存放位置标识;所述用户界面还包括多个分别与各个储藏室对应的特定食材提醒区,本申请方法还包括:在所述菜谱展示区中展示所述菜谱控件的同时,根据所述现有食材对应的存放位置标识和新鲜度,将各个储藏室中新鲜度符合预设提醒条件的现有食材的食材图标展示在对应的特定食材提醒区中。In some embodiments, the existing ingredients have storage location identifiers used to represent storage compartments; the user interface further includes a plurality of reminder areas for specific ingredients corresponding to each storage compartment, and the method of the present application further includes: in the recipe While displaying the recipe controls in the display area, according to the storage location identification and freshness corresponding to the existing ingredients, the ingredients icons of the existing ingredients in each storage room whose freshness meets the preset reminder conditions are displayed in the corresponding specific ingredients. In the food reminder area.
在一些实施例中,本申请方法还包括:在所述用户界面展示多个分别与各储藏室对应的食材展示区,根据所述现有食材对应的新鲜度标识和存放位置标识,将各个储藏室中现有食材的食材图标展示在对应的食材展示区中,其中,各储藏室中现有食材的食材图标在对应食材展示区中按照新鲜度逐渐降低的顺序排列。In some embodiments, the method of the present application further includes: displaying on the user interface a plurality of food material display areas corresponding to each storage room, and according to the freshness identification and storage location identification corresponding to the existing food ingredients, each storage room is displayed. The ingredient icons of the existing ingredients in the room are displayed in the corresponding ingredient display area, wherein the ingredient icons of the existing ingredients in each storage room are arranged in the order of decreasing freshness in the corresponding ingredient display area.
在一些实施例中,用户可以通过单点或者长按操作选中食材库界面中的食材图标。食材管理应用响应于用户对食材库界面中食材图标的选中操作,将用户选中的食材图标对应的食材信息直接添加到本地食材信息集合中,并标记为存放状态。在一些实施例中,冰箱控制器通过运行食材管理应用,周期性地执行图13示出的下述步骤,即每隔预设时间间隔,执图13示出的下述步骤,该预设时间间隔即为预设提醒周期。如图13所示:In some embodiments, the user can select an ingredient icon in the ingredient library interface through a single-click or long-press operation. In response to the user's selection of the ingredient icon in the ingredient library interface, the ingredient management application directly adds ingredient information corresponding to the ingredient icon selected by the user to the local ingredient information set, and marks it as a storage state. In some embodiments, the refrigerator controller periodically executes the following steps shown in FIG. 13 by running an ingredient management application, that is, every preset time interval, executes the following steps shown in FIG. 13 , the preset time interval The interval is the preset reminder period. As shown in Figure 13:
S201,确定目标食材,所述目标食材至少包括根据储藏室中现有食材对应的时间相关信息确定的新鲜度满足预设提醒条件的食材。S201: Determine a target ingredient, where the target ingredient at least includes an ingredient whose freshness satisfies a preset reminder condition determined according to time-related information corresponding to the existing ingredient in the storage room.
在一些实施例中,预设提醒条件为“已过期”,即目标食材为过期食材。在另一些实施例中,预设提醒条件为“已过期”和“快过期”,即目标食材包括过期食材和快过期的食材。In some embodiments, the preset reminder condition is "expired", that is, the target ingredient is an expired ingredient. In other embodiments, the preset reminder conditions are "expired" and "expiring soon", that is, the target ingredients include expired ingredients and ingredients that are about to expire.
在一些实施例中,目标食材还包括根据未读的历史提醒消息所包含的食材名称对应的食材。为便于区分,可以将根据储藏室中现有食材对应的时间相关信息确定的目标食材称为第一过期食材,将根据未读的历史提醒消息确定的过期食材称为第二过期食材。In some embodiments, the target ingredient further includes an ingredient corresponding to the ingredient name included in the unread historical reminder message. For the convenience of distinction, the target ingredient determined according to the time-related information corresponding to the existing ingredients in the storage room may be referred to as the first expired ingredient, and the expired ingredient determined according to the unread historical reminder messages may be referred to as the second expired ingredient.
在一些实施例中,第一过期食材为储藏室中最新产生的过期食材,例如在上一个提醒周期内产生的过期食材。这样,可以避免针对同一过期食材进行重复多次提醒,而造成用户困扰。其中,储藏室中现有食材中的过期食材至少包括第一过期食材。In some embodiments, the first expired food item is the newly generated expired food item in the storage room, for example, the expired food item produced in the last reminder period. In this way, it is possible to avoid repeated reminders for the same expired ingredient, which may cause confusion to the user. Wherein, the expired ingredients in the existing ingredients in the storage room include at least the first expired ingredients.
在一些实施例中,本地食材信息集合中的食材信息具有提醒状态标识,提醒状态标识分为第一标识和第二标识。其中,第一标识是每个食材信息默认的提醒状态标识。食材管理应用在根据某个过期食材生成提醒消息后,在本地食材信息集合中将该过期食材的食材信息的提醒状态标识由第一标识修改为第二标识,也就是说,第一标识标记的食材是未提醒过的食材,第二标识标记的食材是提醒过的食材。基于此,作为S201的一种实现方式,首先根据储藏室中现有食材的时间相关信息或者新鲜度标识确定现有食材中的过期食材; 然后将提醒状态标识为第一标识的过期食材确定为第一过期食材。也就是说,S201中确定的第一过期食材是指所有过期食材中提醒状态标识为第一标识的过期食材,也即未提醒过的过期食材。In some embodiments, the ingredient information in the local ingredient information set has a reminder state identifier, and the reminder state identifier is divided into a first identifier and a second identifier. The first identifier is a default reminder state identifier for each ingredient information. After the ingredient management application generates a reminder message according to an expired ingredient, it modifies the reminder status identifier of the ingredient information of the expired ingredient in the local ingredient information set from the first identifier to the second identifier, that is, the first identifier marked. The ingredients are the ingredients that have not been reminded, and the ingredients marked by the second identification are the ingredients that have been reminded. Based on this, as an implementation manner of S201, first determine the expired ingredients in the existing ingredients according to the time-related information or the freshness identifier of the existing ingredients in the storage room; and then determine the expired ingredients whose reminder status is identified as the first identifier as The first expired food. That is to say, the first expired ingredient determined in S201 refers to an expired ingredient whose reminder status is identified as the first identifier among all expired ingredients, that is, an expired ingredient that has not been reminded.
另外,由于食材管理应用周期性执行S201-S203,以提醒用户及时消耗冰箱中的过期食材,因此过期时长大于提醒周期的过期食材应是提醒过的食材,而过期时长小于或者等于提醒周期的过期食材应该未提醒过的食材。基于此,作为S201的另一种实现方式,首先根据储藏室中现有食材的时间相关信息或者新鲜度标识确定现有食材中的过期食材及每个过期食材的过期时长;然后将过期时长小于或者等于提醒周期的过期食材确定为第一过期食材。其中,过期时长=当前时间-过期时间。In addition, since the ingredient management application periodically executes S201-S203 to remind the user to consume the expired ingredients in the refrigerator in time, the expired ingredients whose expiration time is longer than the reminder period should be reminded ingredients, and the expiration time is less than or equal to the expiration of the reminder period The ingredients should be the ingredients that have not been reminded. Based on this, as another implementation of S201, first determine the expired ingredients in the existing ingredients and the expiration time of each expired ingredient according to the time-related information or the freshness identifier of the existing ingredients in the storage room; Or the expired ingredient equal to the reminder period is determined as the first expired ingredient. Wherein, expiration time = current time - expiration time.
在上述实施例中,食材管理应用首先从本地食材信息集合中读取现有食材的食材信息,例如,读取存取状态为放入状态的食材信息。然后根据现有食材的食材信息中的时间相关信息确定现有食材中的过期食材,过期食材即过期时间早于当前时间的食材。在另一些实现方式中,食材管理应用首先从本地食材信息集合中读取现有食材的食材信息。然后根据现有食材的食材信息中的新鲜度标识确定现有食材中的过期食材,过期食材即新鲜度标识为“已过期”的食材。其中,过期时间的计算方法及新鲜度标识的标记方法可以参见前述实施例,此处不予赘述。In the above embodiment, the ingredient management application first reads the ingredient information of the existing ingredient from the local ingredient information set, for example, reads the ingredient information whose access state is the put state. Then, the expired ingredients in the existing ingredients are determined according to the time-related information in the ingredient information of the existing ingredients, and the expired ingredients are the ingredients whose expiration time is earlier than the current time. In other implementations, the ingredient management application first reads ingredient information of existing ingredients from the local ingredient information set. Then, the expired ingredients in the existing ingredients are determined according to the freshness identifier in the ingredient information of the existing ingredients, and the expired ingredients are the ingredients whose freshness identifier is "expired". The method for calculating the expiration time and the method for marking the freshness identifier may refer to the foregoing embodiments, and details are not described here.
在一些实施例中,第二过期食材为预设时间截点前的未读提醒消息所指示的食材,未读提醒消息指示的食材即未读提醒消息包含的食材名称或者食材ID对应的食材。其中,预设时间截点是指早于当前时间点预设时间间隔的时间点。例如,当前时间点为2021年5月24日8:00,预设时间间隔为3天,那么预设时间截点则是2021年5月21日8:00。值得注意的是,在预设时间间隔为0的实施情形中,第二过期食材包括通知应用中全部未读提醒消息所指示的过期食材。基于此,作为S201的一种实现方式,获取通知应用中预设时间截点前的未读的历史提醒消息,预设时间截点是指早于当前时间点预设时间间隔的时间点;根据历史提醒消息包含的食材名称,确定历史提醒消息指示的目标食材。In some embodiments, the second expired ingredient is the ingredient indicated by the unread reminder message before the preset time cut-off point, and the ingredient indicated by the unread reminder message is the ingredient name contained in the unread reminder message or the ingredient corresponding to the ingredient ID. The preset time cut-off point refers to a time point earlier than the current time point by a preset time interval. For example, if the current time point is 8:00 on May 24, 2021, and the preset time interval is 3 days, then the preset time cutoff point is 8:00 on May 21, 2021. It is worth noting that, in the implementation situation where the preset time interval is 0, the second expired ingredients include expired ingredients indicated by all unread reminder messages in the notification application. Based on this, as an implementation manner of S201, the unread historical reminder messages before the preset time cut-off point in the notification application are obtained, and the preset time cut-off point refers to a time point earlier than the preset time interval of the current time point; according to The name of the ingredient contained in the historical reminder message determines the target ingredient indicated by the historical reminder message.
需要说明的是,通知应用可以是安装在冰箱上的独立于食材管理应用的***应用,也可以是集成在食材管理应用中的功能模块。通知应用用于接收***中产生的通知消息、其他应用发送的提醒消息或者通知消息,并将接收到的通知消息或者提醒消息展示在用户界面中。例如,接收食材管理应用发送的提醒消息,并将提醒消息展示在用户界面中。It should be noted that the notification application may be a system application installed on the refrigerator independent of the food management application, or may be a functional module integrated in the food management application. The notification application is used to receive notification messages generated in the system, reminder messages or notification messages sent by other applications, and display the received notification messages or reminder messages in the user interface. For example, a reminder message sent by an ingredient management application is received, and the reminder message is displayed in the user interface.
在一些实施例中,将储藏室中所有的过期食材都确定为目标食材。In some embodiments, all expired ingredients in the storage compartment are identified as target ingredients.
S202,根据所述目标食材生成提醒消息,所述提醒消息包括所述目标食材的食材名称。S202: Generate a reminder message according to the target ingredient, where the reminder message includes an ingredient name of the target ingredient.
在一些实施例中,根据上述第一过期食材和/或第二过期食材生成提醒消息,生成的提醒消息包括第一过期食材和/或第二过期食材的食材名称。In some embodiments, a reminder message is generated according to the first expired ingredient and/or the second expired ingredient, and the generated reminder message includes the ingredient name of the first expired ingredient and/or the second expired ingredient.
可以看出,根据第一过期食材生成提醒消息的实施例,可以保证针对每一过期食材只进行一次提醒,避免重复多次的提醒策略给用户带来困扰。在根据第一过期食材生成提醒消息后,将第一过期食材对应的提醒状态标识由第一标识修改为第二标识。It can be seen that, according to the embodiment in which the reminder message is generated for the first expired ingredient, it can be ensured that only one reminder is performed for each expired ingredient, and the repeated reminder strategy can be prevented from causing trouble to the user. After the reminder message is generated according to the first expired ingredient, the reminder state identifier corresponding to the first expired ingredient is modified from the first identifier to the second identifier.
另外,由于冰箱使用场景的局限性,用户通常不会及时查看到每一个提醒消息,造成历史提醒消息累计在通知应用中而被用户忽略,从而无法达到提醒用户的目的。根据第二过期食材生成提醒消息的实施例,可以解决冰箱端的历史提醒消息长时间未读所带来的问题,在避免给用户带来困扰的同时,提醒用户及时消耗掉过期食材。In addition, due to the limitations of refrigerator usage scenarios, users usually do not view every reminder message in time, resulting in historical reminder messages accumulated in the notification application and ignored by the user, thus failing to achieve the purpose of reminding the user. According to the embodiment of generating the reminder message for the second expired ingredient, the problem caused by the unread historical reminder message on the refrigerator end for a long time can be solved, and the user is reminded to consume the expired ingredient in time while avoiding trouble to the user.
在S202中,可以分别根据各个目标食材生成对应的提醒消息,即一个目标食材对应一 个单独的提醒消息,各目标食材对应的提醒消息中至少包括对应目标食材的食材名称。还可以根据所有目标食材生成唯一一个提醒消息,该提醒消息中包括所有目标食材的食材名称。应理解的是,提醒消息中还可以相应目标食材的过期时间、过期时长和/或食材ID等内容。In S202, a corresponding reminder message can be generated according to each target ingredient, that is, a target ingredient corresponds to a separate reminder message, and the reminder message corresponding to each target ingredient at least includes the name of the ingredient corresponding to the target ingredient. It is also possible to generate a unique reminder message according to all the target ingredients, and the reminder message includes the ingredient names of all the target ingredients. It should be understood that the reminder message may also correspond to the expiration time, expiration time, and/or the ID of the target ingredient.
S203,将所述提醒消息推送到至少一个关联的终端设备,以在至少一个关联的终端设备上展示所述提醒消息。S203. Push the reminder message to at least one associated terminal device, so as to display the reminder message on the at least one associated terminal device.
其中,冰箱关联的终端设备包括与冰箱处于同一局域网中或者同一组网中的终端设备,如家庭中的显示设备、便携式移动终端设备、PC设备等。冰箱关联的终端设备还可以是基于业务账号与冰箱实现关联的终端设备。The terminal devices associated with the refrigerator include terminal devices located in the same local area network or the same group network as the refrigerator, such as display devices, portable mobile terminal devices, and PC devices in a home. The terminal device associated with the refrigerator may also be a terminal device associated with the refrigerator based on a service account.
示例性的,将冰箱上食材管理应用登录的账号称为主业务账号。那么,冰箱关联的终端设备可以是与主业务账号绑定的终端设备,如与主业账号绑定的手机、电视、平板电脑等终端设备。还可以是与主业务账号关联的业务账号对应的终端设备,如与主业务账号关联的微信账号对应的手机、电脑等。还可以是登录该主业务账号的其他终端设备,如用户在电视上安装食材管理应用,并使用主业务账号在电视上登录食材管理应用时,电视即称为与冰箱关联的终端设备。Exemplarily, the account logged in by the ingredient management application on the refrigerator is called the main business account. Then, the terminal device associated with the refrigerator may be a terminal device bound with the main business account, such as a mobile phone, a TV, a tablet computer and other terminal devices bound with the main business account. It may also be a terminal device corresponding to a business account associated with the main business account, such as a mobile phone, a computer, and the like corresponding to the WeChat account associated with the main business account. It can also be other terminal devices that log in to the main business account. For example, when a user installs an ingredient management application on the TV and uses the main business account to log in the ingredient management application on the TV, the TV is called the terminal device associated with the refrigerator.
在一些实现方式中,S203具体包括:食材管理应用向服务器发送消息推送请求,消息推送请求中包括主业务账号和S202中生成的提醒消息。服务器接收到该消息推送请求后,根据主业务账号查找与冰箱关联的终端设备,并将提醒消息发送给冰箱关联的终端设备。In some implementations, S203 specifically includes: the ingredient management application sends a message push request to the server, where the message push request includes the main business account and the reminder message generated in S202. After receiving the message push request, the server searches for the terminal device associated with the refrigerator according to the main service account, and sends a reminder message to the terminal device associated with the refrigerator.
在一些实现方式中,S203具体包括:向局域网内的终端设备发送设备发现消息,并根据是否接收到终端设备发送的应答消息判断局域网内是否存在活跃设备。In some implementations, S203 specifically includes: sending a device discovery message to the terminal device in the local area network, and determining whether there is an active device in the local area network according to whether a response message sent by the terminal device is received.
应理解的是,活跃设备至少包括处于开机状态的终端设备,还可以包括处于未完全待机状态下的终端设备,如处于息屏状态,同时部分数据处理功能及通信功能处于工作状态的终端设备。It should be understood that an active device includes at least a terminal device in a powered-on state, and may also include a terminal device in an incomplete standby state, such as a terminal device in an off-screen state while some data processing functions and communication functions are in a working state.
图14为本申请示例性示出的一种应用场景。如图14所示,该场景包括局域网I和局域网I内的冰箱及终端设备A-E,其中,终端设备A、终端设备B、终端设备C为局域网I内的活跃设备。基于局域网I,冰箱上的食材管理应用可以通过通信器发送设备发现消息,如UDP(User Datagram Protocol,用户数据报协议)广播消息和/或组播消息。活跃设备A-C可以接收到冰箱发出的设备发现消息,并根据设备发现消息中冰箱的IP地址向冰箱上的食材管理应用发送应答消息,如UDP单播消息。当食材管理应用在预设等待时长(5S)内依次接收到活跃设备A-C发送的应答消息时,即可确定局域网内存在活跃设备A-C。FIG. 14 is an application scenario exemplarily shown in this application. As shown in FIG. 14 , the scenario includes LAN I and refrigerators and terminal devices A-E in LAN I, where terminal device A, terminal device B, and terminal device C are active devices in LAN I. Based on the local area network I, the ingredient management application on the refrigerator can send device discovery messages through the communicator, such as UDP (User Datagram Protocol, User Datagram Protocol) broadcast messages and/or multicast messages. The active devices A-C can receive the device discovery message sent by the refrigerator, and send a response message, such as a UDP unicast message, to the ingredient management application on the refrigerator according to the IP address of the refrigerator in the device discovery message. When the ingredient management application sequentially receives the response messages sent by the active devices A-C within the preset waiting time period (5S), it can be determined that the active devices A-C exist in the local area network.
在一些实现方式中,设备发现消息包括携带设备发现标识的UDP广播消息,UDP广播消息中包括本端IP地址,即冰箱终端的IP地址。局域网内的活跃设备接收到冰箱发送的UDP广播消息后,根据UDP广播消息中的设备发现标识确认该消息为设备发现消息,响应于确认该消息为设备发现消息,从UDP广播消息中解析出冰箱的IP地址,根据解析出的IP地址向冰箱发送对该UDP广播消息的应答消息,应答消息中包括活跃设备的IP地址。In some implementation manners, the device discovery message includes a UDP broadcast message carrying a device discovery identifier, and the UDP broadcast message includes the local IP address, that is, the IP address of the refrigerator terminal. After receiving the UDP broadcast message sent by the refrigerator, the active device in the local area network confirms that the message is a device discovery message according to the device discovery identifier in the UDP broadcast message, and parses the refrigerator from the UDP broadcast message in response to confirming that the message is a device discovery message. The IP address of the UDP broadcast message is sent to the refrigerator according to the parsed IP address, and the response message includes the IP address of the active device.
在另一些实现方式中,设备发现消息包括向目标组网内终端设备发送的组播消息,组播消息携带设备发现标识和本端IP地址。其中,目标组网是指冰箱终端所在组网。目标组网内的活跃设备接收到冰箱发送的组播消息后,根据组播消息中的设备发现标识确认该消息为设备发现消息,响应于确认该消息为设备发现消息,从组播消息中解析出冰箱的IP地址,根据解析出的IP地址向冰箱发送对该组播消息的应答消息,应答消息中包括活跃设备 的IP地址。In other implementation manners, the device discovery message includes a multicast message sent to the terminal device in the target network, and the multicast message carries the device discovery identifier and the local IP address. The target network refers to the network where the refrigerator terminal is located. After receiving the multicast message sent by the refrigerator, the active device in the target network confirms that the message is a device discovery message according to the device discovery identifier in the multicast message, and parses the message from the multicast message in response to confirming that the message is a device discovery message The IP address of the refrigerator is obtained, and a response message to the multicast message is sent to the refrigerator according to the resolved IP address, and the response message includes the IP address of the active device.
在另一些实现方式中,设备发现消息同时包括上述UDP广播消息和组播消息,即食材管理应用同时向局域网内终端设备发送UDP广播消息和向目标组网内终端设备发送组播消息。局域网内活跃设备或者目标组网内活跃设备接收到UDP广播消息或者组播消息后,根据UDP广播消息或者组播消息中的冰箱的IP地址,向食材管理应用发送应答消息。In other implementations, the device discovery message includes both the above-mentioned UDP broadcast message and multicast message, that is, the ingredient management application simultaneously sends the UDP broadcast message to the terminal device in the local area network and the multicast message to the terminal device in the target network. After receiving the UDP broadcast message or the multicast message, the active device in the local area network or the active device in the target group network sends a response message to the ingredient management application according to the IP address of the refrigerator in the UDP broadcast message or the multicast message.
在一些实施例中,目标组网内的终端设备为局域网内全部或者部分终端设备。In some embodiments, the terminal devices in the target network are all or part of the terminal devices in the local area network.
在局域网内存在活跃设备时,将提醒消息推送到至少一个活跃设备。在局域网内不存在活跃设备时,则通过通知应用,在所述显示器上展示所述提醒消息。When there are active devices in the local area network, push a reminder message to at least one active device. When there is no active device in the local area network, the reminder message is displayed on the display through a notification application.
在一些实施例中,从各个活跃设备发送的应答消息中分别解析出各个活跃设备的IP地址,然后根据各个活跃设备的IP地址,将S202中生成的提醒消息以UDP单播的方式分别发送给各个活跃设备,以使得各个活跃设备接收到冰箱端发送的提醒消息后,在其屏幕上展示提醒消息。In some embodiments, the IP addresses of the respective active devices are parsed from the response messages sent by the respective active devices, and then according to the IP addresses of the respective active devices, the reminder messages generated in S202 are sent to the respective active devices in a UDP unicast manner. Each active device, so that each active device displays the reminder message on its screen after receiving the reminder message sent by the refrigerator.
可以理解的是,局域网内的终端设备包括智能电视或者智能大屏等显示设备。终端设备在接收到冰箱端发送的提醒消息后,按照预设的展示逻辑和方式,将收到的提醒消息展示在用户界面中。需要说明的是,本申请对终端设备展示提醒消息的逻辑和方式不予限定。It can be understood that the terminal devices in the local area network include display devices such as smart TVs or smart large screens. After receiving the reminder message sent by the refrigerator end, the terminal device displays the received reminder message in the user interface according to the preset display logic and method. It should be noted that the present application does not limit the logic and manner in which the terminal device displays the reminder message.
例如,显示设备在接收到冰箱端发送的提醒消息后,可以采用非模态对话框的形式在当用户界面中展示该提醒消息,以提醒用户及时消耗过期食材,同时不影响用户观看或者操作当前用户界面。图15为本申请示例性示出的一种显示设备用户界面,如图15所示,该用户界面包括视频播放画面701和在视频播放画面70上层的右上角位置处显示的弹窗提示702,弹窗提示702中展示提醒消息的文字内容,具体为“西瓜、酸奶已经过期,请及时食用”。For example, after receiving the reminder message sent by the refrigerator, the display device may display the reminder message in the current user interface in the form of a modeless dialog box, so as to remind the user to consume the expired ingredients in time without affecting the user's viewing or operation of the current User Interface. FIG. 15 is a user interface of a display device exemplarily shown in the application. As shown in FIG. 15 , the user interface includes a video playback screen 701 and a pop-up window prompt 702 displayed at the upper right corner of the upper layer of the video playback screen 70. The pop-up window prompt 702 displays the text content of the reminder message, specifically "watermelon and yogurt have expired, please eat them in time".
在一些实施例中,局域网或者目标组网内的每个终端设备都对应一个优先级,不同终端设备对应不同的优先级。在S203中,食材管理应用根据各活跃设备的设备信息,如IP地址,确定各活跃设备预设的优先级,并将优先级最高的活跃设备确定为目标设备。然后根据目标设备的IP地址,将S202中生成的提醒消息发送给目标设备,以在目标设备的用户界面中展示该提醒消息,从而实现提醒用户及时消耗过期食材的目的。In some embodiments, each terminal device in the local area network or target network corresponds to a priority, and different terminal devices correspond to different priorities. In S203, the ingredient management application determines the preset priority of each active device according to the device information of each active device, such as the IP address, and determines the active device with the highest priority as the target device. Then, according to the IP address of the target device, the reminder message generated in S202 is sent to the target device, so as to display the reminder message in the user interface of the target device, thereby realizing the purpose of reminding the user to consume expired ingredients in time.
结合图14所示应用场景,假设局域网I内的终端设备A-E的优先级由高到低的依次为终端设备A、终端设备B、终端设备C、终端设备D及终端设备E。食材管理应用根据接收到的应答消息确定局域网内存在活跃设备A-C后,根据活跃设备A-C对应的优先级确定活跃设备A为目标设备,进而根据活跃设备A的IP地址将提醒消息发送给活跃设备A。With reference to the application scenario shown in FIG. 14 , it is assumed that the priorities of terminal devices A-E in LAN I are terminal device A, terminal device B, terminal device C, terminal device D, and terminal device E in descending order. After determining that there is an active device AC in the local area network according to the received response message, the food management application determines that the active device A is the target device according to the priority corresponding to the active device AC, and then sends a reminder message to the active device A according to the IP address of the active device A. .
在一些实施例中,通知应用还用于接收用户输入的对展示的提醒消息的预设操作,如查看操作、清除操作等。当通知应用接收到前述预设操作时,将提醒消息标记为已读状态或者清,例如,当接收到对提醒消息的查看操作后,将用户操作的提醒消息标记为已读状态,当接收到对提醒消息的清除操作后,将用户操作的提醒消息删除。否则(即在未接收到前述预设操作的情况下),将提醒消息的状态保持为未读状态或者保留提醒消息。In some embodiments, the notification application is further configured to receive a preset operation on the displayed reminder message input by the user, such as a viewing operation, a clearing operation, and the like. When the notification application receives the aforementioned preset operation, it will mark the reminder message as read or clear. After clearing the reminder message, delete the reminder message operated by the user. Otherwise (ie, in the case where the aforementioned preset operation is not received), the state of the reminder message is kept as the unread state or the reminder message is retained.
需要说明的是,本申请不限定通知应用展示提醒消息的逻辑和方式。例如,通知应用可以在接收到提醒消息时,将该提醒消息即时展示的当前用户界面上,也可以在用户打开通知栏或者通知消息界面时,在通知栏或者通知消息界面中展示接收到的提醒提醒消息。图16为本申请示例性示出的一种冰箱显示器用户界面示意图,如图16所示,在食材管理界面801的上层显示通知消息框802和“清除”按钮,通知消息框802中显示有提醒消息的文 字内容,具体为“西瓜、酸奶已经过期,请及时食用”。用户可以点击“清除”按钮,撤销该通知消息框的显示,并指示通知应用清除该提醒消息。用户也可以点击该通知消息框以查看消息详情。It should be noted that this application does not limit the logic and manner in which the notification application displays the reminder message. For example, the notification application can immediately display the reminder message on the current user interface when receiving the reminder message, or display the received reminder in the notification bar or notification message interface when the user opens the notification bar or notification message interface Alert message. Fig. 16 is a schematic diagram of a refrigerator display user interface exemplarily shown in this application. As shown in Fig. 16 , a notification message box 802 and a "clear" button are displayed on the upper layer of the ingredient management interface 801, and a reminder is displayed in the notification message box 802 The text content of the message is specifically "watermelon and yogurt have expired, please eat in time". The user can click the "Clear" button to cancel the display of the notification message box, and instruct the notification application to clear the reminder message. The user can also click on the notification message box to view the message details.
基于本申请实施例提供的冰箱,可以根据储藏室中最新产生的过期食材及未读的历史提醒消息所指示的食材,确定目标食材。针对未读的历史提醒消息所指示的过期食材和/或冰箱内最新产生的过期食材进行提醒,可以避免针对同一过期食材重复多次提醒而影响用户体验。然后根据目标食材生成提醒消息,同时主动发现局域网内的活跃设备。在发现局域网内存在活跃设备时,将提醒消息推送到至少一个活跃设备,利用其他活跃设备提醒用户及时消耗过期食材,而不限于在冰箱端进行提醒,也无需依托云端平台和外部网络,灵活性强且节约资源。在局域网内不存在活跃设备时,将提醒消息推送到通知应用。Based on the refrigerator provided by the embodiment of the present application, the target ingredient can be determined according to the newly generated expired ingredient in the storage room and the ingredient indicated by the unread historical reminder message. Reminding the expired ingredients indicated by the unread historical reminder message and/or the newly generated expired ingredients in the refrigerator can avoid repeating multiple reminders for the same expired ingredient and affecting the user experience. Then, a reminder message is generated according to the target ingredients, and active devices in the local area network are actively discovered at the same time. When an active device is found in the local area network, a reminder message is pushed to at least one active device, and other active devices are used to remind users to consume expired ingredients in time, not limited to reminding on the refrigerator side, and no need to rely on cloud platforms and external networks, flexibility Powerful and resource-saving. When there is no active device in the local area network, push the reminder message to the notification application.
根据以上实施例提供的冰箱,本申请实施例还提供一种消息提醒方法,该方法的执行主体包括但不限于上述冰箱的控制器。According to the refrigerator provided in the above embodiment, the embodiment of the present application further provides a message reminding method, the execution subject of the method includes but is not limited to the controller of the above refrigerator.
在一些实施例中,推荐食谱可由冰箱和服务器交互完成,还可以将另外一个或者多个终端设备(包括但不限于:智能电视、机顶盒、冰箱、微波炉、烤箱等包括显示屏的家用电器)也加入到交互中。无论几个终端设备和服务器进行交互,最终在其对应的显示器上显示,以更直观的提供给用户,增进冰箱中食材与用户之间的相关性。In some embodiments, the recommended recipe can be completed by the interaction between the refrigerator and the server, and one or more other terminal devices (including but not limited to: smart TVs, set-top boxes, refrigerators, microwave ovens, ovens, and other household appliances including display screens) can also be into the interaction. No matter how several terminal devices interact with the server, they are finally displayed on their corresponding displays, so as to be more intuitively provided to the user, and to improve the correlation between the ingredients in the refrigerator and the user.
在一些实施例中服务器具有第二控制器,智能电视具有第三控制器,以及智能电视第三显示器。需要说明的是,任意终端设备显示器的内容都可以通过局域网、广域网、有线等方式呈现在其他终端设备上。In some embodiments the server has a second controller, the smart TV has a third controller, and the smart TV third display. It should be noted that the content displayed on any terminal device can be presented on other terminal devices through a local area network, a wide area network, a wired connection, or the like.
图17A示出了本申请实施例电视应用UI示意图。FIG. 17A shows a UI schematic diagram of a TV application according to an embodiment of the present application.
图中示出了显示屏展示电视的应用程序UI界面,例如,所述应用程序UI界面包括4个已安装于电视的应用程序,分别是新闻头条、影院点播、推荐食谱、K歌等。通过使用遥控器等控制器在显示屏上移动焦点,可以选择不同的应用程序、或其他功能按钮。The figure shows the application UI interface of the TV displayed on the display screen. For example, the application UI interface includes 4 applications installed on the TV, namely news headlines, theater on-demand, recommended recipes, and K songs. Different applications, or other function buttons can be selected by moving the focus on the display using a controller such as a remote control.
在一些实施例中,电视显示屏在展示应用程序UI界面的同时,还被配置为可以展示其他交互控件,所述交互控件可包括例如电视主页控件、搜索控件、消息按钮控件、邮箱控件、浏览器控件、收藏夹控件、信号栏控件等。In some embodiments, the TV display screen is configured to display other interactive controls while displaying the application UI interface, and the interactive controls may include, for example, TV homepage controls, search controls, message button controls, mailbox controls, browsing Controls, Favorites Controls, Signal Bar Controls, etc.
为提高电视UI的便利性、形象性,在一些实施例中,本申请实施例中显示设备包含的第三控制器响应于对所述交互控件的操作而对电视的UI进行控制。例如,用户通过遥控器等控制器对搜索控件进行点击,可以将搜索UI展示于其它UI的顶部,即控制交互控件映射的应用组件的UI能够变大、或全屏运行和显示。In order to improve the convenience and visualization of the TV UI, in some embodiments, the third controller included in the display device in the embodiments of the present application controls the TV UI in response to the operation of the interactive control. For example, when a user clicks a search control through a controller such as a remote control, the search UI can be displayed on top of other UIs, that is, the UI of the application component that controls the mapping of the interactive control can be enlarged, or run and displayed in full screen.
在一些实施例中,所述交互控件还可通过传感器进行操作,所述传感器可以是但不限于是声学输入传感器,例如麦克风,其可检测包括所需交互控件指示的语音命令。例如,用户可使用“推荐食谱”或任意其它合适的标识识别所需交互控件,例如推荐食谱控件,并且还可描述将执行与所需交互控件相关的所需动作。第三控制器可识别语音命令并向UI或其处理部件或引擎提交表征交互的数据。In some embodiments, the interactive controls are also operable via sensors, which may be, but are not limited to, acoustic input sensors, such as microphones, that can detect voice commands that include an indication of the desired interactive control. For example, the user may identify a desired interactive control, such as a recommended recipe control, using "recommended recipe" or any other suitable identification, and may also describe the desired action to be performed in relation to the desired interactive control. The third controller may recognize the voice command and submit data characterizing the interaction to the UI or its processing component or engine.
在一些实施例中,用户可通过遥控器控制显示屏的焦点,选择推荐食谱应用程序,使得其图标在电视显示屏的用户界面上高亮度显示;然后通过点击所述高亮度的图标,可实现打开图标映射的应用程序。In some embodiments, the user can control the focus of the display screen through the remote control, select the recommended recipe application, so that its icon is highlighted on the user interface of the TV display screen; then by clicking on the highlighted icon, the user can achieve Open the icon-mapped application.
需要说明的是,本申请实施例UI界面的图标、及文字仅作为示例对推荐食谱技术方案进行阐述,附图中UI界面的图标、及文字还可以实施为其它内容,本申请附图不做具 体的限制。It should be noted that the icons and texts of the UI interface in the embodiments of the present application are only used as examples to illustrate the technical solution of recommended recipes. The icons and texts of the UI interface in the accompanying drawings can also be implemented as other contents, which are not described in the accompanying drawings of the present application. specific restrictions.
图17B示出了本申请一实施例显示设备推荐食谱数据UI示意图。FIG. 17B shows a UI schematic diagram of a display device recommending recipe data according to an embodiment of the present application.
本申请提供的显示设备包括显示屏,所述显示屏用于显示用户界面,所述用户界面可以为用户提供交互功能,用户通过对所述用户界面中不同交互控件的操作,可以实现显示设备的不同功能。在一些实施例中,所述显示设备的显示屏可实施为附图的第三显示器280。The display device provided by the present application includes a display screen, and the display screen is used to display a user interface, and the user interface can provide interactive functions for the user. different functions. In some embodiments, the display screen of the display device may be implemented as the third display 280 of the drawings.
本申请提供的显示设备还包括第三控制器,所述第三控制器控制用户界面根据确定的推荐食谱数据显示包含控件的推荐食谱操作界面,所述控件用于在接收到用户的确认操作后,跳转至推荐食谱详情界面。The display device provided by the present application further includes a third controller, the third controller controls the user interface to display a recommended recipe operation interface including controls according to the determined recommended recipe data, and the controls are used for after receiving the user's confirmation operation to jump to the recommended recipe details interface.
下文将就本申请提供的显示设备实现推荐食谱的技术方案进行阐述。The following will describe the technical solution for implementing the recommended recipe by the display device provided by the present application.
当用户启动推荐食谱应用程序时,显示设备的第三控制器响应于用户对推荐食谱应用程序的操作,根据用户冰箱存储食材中的主食材确定服务器可以提供的推荐食谱数据,所述用户冰箱存储食材包括主食材和辅食材主食材辅食材。When the user starts the recommended recipe application, the third controller of the display device, in response to the user's operation on the recommended recipe application, determines the recommended recipe data that the server can provide according to the main ingredients in the ingredients stored in the user's refrigerator, and the user's refrigerator stores the recommended recipe data. The ingredients include main ingredients and auxiliary ingredients.
在一些实施例中,本申请提供的服务器包括第二控制器,所述第二控制器将来自冰箱发送的用户冰箱存储食材识别为主食材、辅食材。In some embodiments, the server provided by the present application includes a second controller, and the second controller identifies the user's refrigerator storage ingredients sent from the refrigerator as main ingredients and auxiliary ingredients.
其中,辅食材可实施为葱、和/或姜、和/或蒜,主食材为用户冰箱存储食材除所述辅食材外的食材。例如,当智能冰箱识别其存储食材包括:鱼、牛肉、番茄、青椒、葱、姜、蒜时,本申请提供的服务器将其中的葱、姜、蒜判定为辅食材;将其中的鱼、牛肉、番茄、青椒判定为主食材。Wherein, the auxiliary ingredients may be implemented as green onions, and/or ginger, and/or garlic, and the main ingredients are the ingredients stored in the user's refrigerator other than the auxiliary ingredients. For example, when the smart refrigerator recognizes that the stored ingredients include: fish, beef, tomato, green pepper, onion, ginger, and garlic, the server provided in this application determines the onion, ginger, and garlic as auxiliary ingredients; , tomatoes, and green peppers are determined as the main ingredients.
智能冰箱能够自动识别用户冰箱存储食材,并将识别的食材上传至本申请提供的服务器。本申请提供的显示设备中推荐食谱应用程序在访问服务器时,可以读取所述服务器已保存的用户冰箱存储食材。需要说明的是,所述主食材、辅食材可根据实际情况进行预设,本申请对其具体内容不作限定。The smart refrigerator can automatically identify the ingredients stored in the user's refrigerator, and upload the identified ingredients to the server provided in this application. When accessing the server, the recommended recipe application in the display device provided by the present application can read the stored ingredients in the user's refrigerator that have been saved by the server. It should be noted that the main ingredients and auxiliary ingredients can be preset according to actual conditions, and the specific contents thereof are not limited in this application.
在一些实施例中,用户冰箱存储食材包括食材的名称、以及各食材存放的时间长度等。实际应用中冰箱中的食材信息可以通过冰箱获得,例如,本申请提供的服务器可以通过有线或无线的方式向用户冰箱发送查询请求,冰箱在接收到服务器发送的查询请求后,可通过扫描食材上的RFID标签的方式,或者图像采集模块拍照等方式获取冰箱中存放的食材的食材信息,并通过有线或无线的方式将该食材信息反馈给服务器。In some embodiments, the foodstuffs stored in the user's refrigerator include the names of the foodstuffs, the length of time for which each foodstuffs are stored, and the like. In practical applications, the information of the ingredients in the refrigerator can be obtained through the refrigerator. For example, the server provided in this application can send a query request to the user's refrigerator in a wired or wireless manner. After receiving the query request sent by the server, the refrigerator can scan the ingredients on the The information of the ingredients stored in the refrigerator is obtained by means of the RFID tag of the refrigerator, or the image acquisition module takes pictures, and the information of the ingredients is fed back to the server in a wired or wireless manner.
在一些实施例中,冰箱可以通过以下方法即时的获取存储食材的信息。首先,冰箱的控制器获取储藏室图像,基于所述储藏室图像进行处理得到格层位置;然后,冰箱获取用户的手部轨迹,基于所述手部轨迹的运动趋势,选择对应的拟合轨迹,所述拟合轨迹为物品存取时刻的手部轨迹;根据所述拟合轨迹、格层位置,计算得到物品存取位置,从而可以实时监控冰箱内食材的存或取,得到用户冰箱存储食材的详细信息,例如食材在冰箱内的位置、存入时间、保质期剩余天数等;最后,冰箱将所述用户冰箱存储食材上传至本申请提供的服务器。In some embodiments, the refrigerator can obtain the information of the stored food in real time through the following methods. First, the controller of the refrigerator acquires an image of the storage room, and processes the image of the storage room to obtain the grid position; then, the refrigerator acquires the user's hand trajectory, and selects the corresponding fitting trajectory based on the movement trend of the hand trajectory , the fitting trajectory is the hand trajectory at the time of item access; according to the fitting trajectory and grid position, the item access position is calculated and obtained, so that the storage or retrieval of ingredients in the refrigerator can be monitored in real time, and the user's refrigerator storage can be obtained. Detailed information of the ingredients, such as the location of the ingredients in the refrigerator, the storage time, the remaining days of the shelf life, etc.; finally, the refrigerator uploads the ingredients stored in the user's refrigerator to the server provided in this application.
在一些实施例中,所述推荐食谱数据包括食谱的属性信息,其中,食谱的属性信息包括食谱所需的主食材、菜肴口味、烹饪方法、适合人群、适合场景、菜系、菜式、功效以及所需的厨房工具等属性元素。实际应用中食谱和食谱的属性信息关联存储在本申请提供服务器的媒资库中,以便调阅和使用。In some embodiments, the recommended recipe data includes attribute information of the recipe, wherein the attribute information of the recipe includes main ingredients required by the recipe, dish taste, cooking method, suitable crowd, suitable scene, cuisine, dish, efficacy, and Properties elements such as required kitchen tools. In practical applications, the recipes and the attribute information of the recipes are associated and stored in the media resource library of the server provided by this application, so that they can be accessed and used.
在一些实施例中,本申请提供的服务器包括媒资库,所述媒资库用于保存食材对应的食谱数据。例如,服务器的媒资库内置一个食材到食谱的对应关系字典,该字典中包含所 有已知食材的名称,以及食材与包含该食材的所有食谱之间的对应关系。当获得冰箱中所有食材的食材信息后,根据食材信息中食材的名称从上述字典中查找获得食材名称对应的食谱。其中,每个食材名称对应的食谱可以是一个也可以是若干个。In some embodiments, the server provided by this application includes a media repository, where the media repository is used to store recipe data corresponding to ingredients. For example, the media repository of the server has a built-in dictionary of correspondence between ingredients and recipes, and the dictionary contains the names of all known ingredients and the correspondence between ingredients and all recipes containing the ingredients. After obtaining the ingredient information of all the ingredients in the refrigerator, the recipe corresponding to the ingredient name is obtained from the dictionary according to the name of the ingredient in the ingredient information. The recipe corresponding to each ingredient name may be one or several.
举例来说,假设,冰箱中的食材中包括洋葱和黄瓜,则可以通过上述字典查找获得洋葱和黄瓜各自对应的食谱。进一步的,在获得洋葱和黄瓜各自对应的食谱后,通过求得洋葱对应的食谱和黄瓜对应的食谱之间的并集来获得推荐食谱数据。For example, assuming that the ingredients in the refrigerator include onions and cucumbers, the corresponding recipes for onions and cucumbers can be obtained through the above dictionary lookup. Further, after the recipes corresponding to the onions and the cucumbers are obtained, the recommended recipe data is obtained by obtaining the union between the recipes corresponding to the onions and the recipes corresponding to the cucumbers.
在一些实施例中,第三控制器响应于用户对推荐食谱应用程序的操作,根据用户冰箱存储食材中的主食材确定服务器可以提供的推荐食谱数据包括,所述第三控制器响应于所述推荐食谱应用程序的启动确认操作发送第一推荐请求至所述服务器,所述第一推荐请求用于使所述服务器反馈已确定的推荐食谱数据,所述推荐食谱数据由所述服务器根据已识别用户冰箱存储食材中的主食材确定;然后,所述第三控制器接收所述服务器发送的推荐食谱数据。In some embodiments, the third controller, in response to the user's operation on the recommended recipe application, determining the recommended recipe data that can be provided by the server according to the main ingredients in the ingredients stored in the user's refrigerator includes, and the third controller responds to the The startup confirmation operation of the recommended recipe application sends a first recommendation request to the server, and the first recommendation request is used to make the server feed back the determined recommended recipe data, and the recommended recipe data is determined by the server according to the identified recipe data. The main ingredient in the ingredients stored in the user's refrigerator is determined; then, the third controller receives the recommended recipe data sent by the server.
显示设备在启动推荐食谱应用程序时,第三控制器将发送第一推荐请求至所述服务器以获取推荐食谱数据。即服务器根据用户冰箱上传的用户冰箱存储食材中的主食材确定可以提供给显示设备的推荐食谱数据,需要说明的是,在生成推荐食谱数据的过程中,服务器的第二控制器将用户冰箱存储食材中的辅食材滤除,即滤除上述实施例中的葱姜蒜,从而使得服务器可以基于主食材生成与用户需求契合度更高的推荐食谱数据,可以避免服务器基于辅食材葱姜蒜生成的推荐食谱,但是推荐食谱中所需的主食材用户冰箱并没有存储的情况。When the display device starts the recommended recipe application, the third controller will send a first recommendation request to the server to obtain recommended recipe data. That is, the server determines the recommended recipe data that can be provided to the display device according to the main ingredients in the ingredients stored in the user's refrigerator uploaded by the user's refrigerator. It should be noted that in the process of generating the recommended recipe data, the second controller of the server stores the user's refrigerator storage The auxiliary ingredients in the ingredients are filtered out, that is, the onion, ginger, and garlic in the above-mentioned embodiment are filtered out, so that the server can generate recommended recipe data based on the main ingredients that are more in line with the user's needs, and can avoid the server from generating the onion, ginger, and garlic based on the auxiliary ingredients. Recommended recipes, but the main ingredients required in the recommended recipes are not stored in the user's refrigerator.
继续参考图17B,在确定服务器可以提供的推荐食谱数据后,显示设备的第三控制器控制用户界面根据所述推荐食谱数据显示包含控件的推荐食谱操作界面,所述控件用于在接收到用户的确认操作后,跳转至推荐食谱详情界面。Continuing to refer to FIG. 17B , after determining the recommended recipe data that the server can provide, the third controller of the display device controls the user interface to display a recommended recipe operation interface including controls according to the recommended recipe data, the controls are used for receiving user After confirming the operation, jump to the recommended recipe details interface.
服务器的第二控制器接收来自显示设备发送的推荐请求,在所述媒资库中根据所述用户冰箱存储食材的主食材查询可以提供的推荐食谱数据,所述用户冰箱存储食材被所述服务器识别为主食材或辅食材;并将所述推荐食谱数据发送至所述显示设备。The second controller of the server receives the recommendation request sent from the display device, and queries the available recommended recipe data in the media repository according to the main ingredients of the ingredients stored in the user's refrigerator, and the ingredients stored in the user's refrigerator are stored by the server Identify the main ingredient or auxiliary ingredient; and send the recommended recipe data to the display device.
例如,服务器的第二控制器接收来自显示设备发送的第一推荐请求,所述第一推荐请求表征所述显示设备开机上线,即可以认为只要显示设备启动推荐食谱应用程序时,服务器将收到显示设备发送的第一推荐请求;然后第二控制器在媒资库中根据接收到的用户冰箱存储食材中的主食材查询确定可以提供的推荐食谱数据,将所述推荐食谱数据发送至所述显示设备。For example, the second controller of the server receives the first recommendation request sent from the display device, and the first recommendation request indicates that the display device is turned on and online, that is, it can be considered that as long as the display device starts the recommended recipe application, the server will receive The first recommendation request sent by the display device is displayed; then the second controller determines the available recommended recipe data in the media repository according to the received main ingredient query in the ingredients stored in the user's refrigerator, and sends the recommended recipe data to the display screen.
在一些实施例中,用户的智能冰箱将用户冰箱存储食材的信息上报到云端的服务器,服务器的第二控制器、或推荐食谱业务***会每天定时查询、确定当前冰箱的主食材信息、根据所述主食材信息查询确定推荐食谱数据,并将所述推荐食谱数据保存,在显示设备的推荐食谱应用程序请求推荐食谱数据时,将已保存的推荐食谱数据发送至显示设备,以提升响应速度。In some embodiments, the user's smart refrigerator reports the information of the ingredients stored in the user's refrigerator to the server in the cloud, and the second controller of the server or the recommended recipe business system will regularly query every day to determine the main ingredient information of the current refrigerator, and according to the The main ingredient information is queried to determine the recommended recipe data, and the recommended recipe data is saved. When the recommended recipe application of the display device requests the recommended recipe data, the saved recommended recipe data is sent to the display device to improve the response speed.
在一些实施例中,第三控制器控制用户界面根据推荐食谱数据显示包含控件的推荐食谱操作界面包括,所述第三控制器在接收到的推荐食谱数据包含第一推荐食谱数据和第二推荐食谱数据时,根据所述显示设备绑定的不同用户的预设匹配特征与所述推荐食谱数据中的食谱构建映射关系,基于所述映射关系生成用户列表,并根据所述用户列表中焦点位置处的用户,控制第二推荐窗口显示所述用户映射的推荐食谱数据,其中,所述用户列表 和所述第二推荐窗口同时显现在用户界面中。In some embodiments, the third controller controlling the user interface to display the recommended recipe operation interface including controls according to the recommended recipe data includes, the third controller includes the first recommended recipe data and the second recommended recipe data when the received recommended recipe data includes the first recommended recipe data and the second recommended recipe. When the recipe data is used, a mapping relationship is constructed according to the preset matching characteristics of different users bound by the display device and the recipes in the recommended recipe data, a user list is generated based on the mapping relationship, and a focus position in the user list is generated according to the The user at the location controls the second recommendation window to display the recommended recipe data mapped by the user, wherein the user list and the second recommendation window are simultaneously displayed in the user interface.
如图17B所示,服务器生成的推荐食谱数据包含第一推荐食谱数据、第二推荐食谱数据时,即包含多个推荐食谱数据时,第三控制器根据所述显示设备绑定的不同用户的预设匹配特征与所述推荐食谱数据中的食谱构建映射关系,基于所述映射关系生成用户列表,即在生产的多个食谱中根据不同的用户预设匹配特征进行分类,是的推荐食谱更具有针对性,提高用户需求的契合度。As shown in FIG. 17B , when the recommended recipe data generated by the server includes the first recommended recipe data and the second recommended recipe data, that is, when it includes multiple recommended recipe data, the third controller can use the display device to bind different users' The preset matching features and the recipes in the recommended recipe data build a mapping relationship, and a user list is generated based on the mapping relationship, that is, the multiple recipes produced are classified according to different user preset matching features, and the recommended recipes are more Targeted to improve the fit of user needs.
例如,图中用户列表包括3个用户:爸爸、妈妈、大宝大宝大,其中,For example, the user list in the figure includes 3 users: father, mother, Dabao Dabaoda, among which,
用户爸爸的预设匹配特征为:口味:辣、鲜;其他:降低血脂;The preset matching features of the user's father are: taste: spicy, fresh; others: reduce blood lipids;
用户妈妈的预设匹配特征为:口味:酸;其他:孕早期;The preset matching features of the user's mother are: taste: sour; others: early pregnancy;
用户大宝大宝大的预设匹配特征为:口味:甜;其他:保护视力。The preset matching features of user Dabao Dabaoda are: taste: sweet; others: protect eyesight.
第三控制器控制用户界面的左侧显示所述用户列表、控制用户界面的右侧生成第二推荐窗口;所述用户列表中焦点位置处为用户爸爸,第三控制器控制所述第二推荐窗口显示用户爸爸映射推荐食谱数据,包括酸菜鱼、麻婆豆腐、夫妻肺片等。The third controller controls the left side of the user interface to display the user list, and controls the right side of the user interface to generate a second recommendation window; the user's father is the focus position in the user list, and the third controller controls the second recommendation window The window displays the recommended recipe data mapped by the user's father, including pickled fish, Mapo tofu, and couple's lung slices.
即显示设备的第三控制器将服务器确定的推荐食谱数据中口味为辣、鲜、具有降低血脂功能的食谱作为用户爸爸的映射推荐食谱数据。通过操作用户列表,可以在所述第二推荐窗口显示对应用户的推荐食谱数据。That is, the third controller of the display device uses the recipes in the recommended recipe data determined by the server that are spicy, fresh, and have the function of lowering blood lipids as the mapped recommended recipe data of the user's father. By operating the user list, the recommended recipe data of the corresponding user can be displayed in the second recommendation window.
在一些实施例中,第三控制器控制控制用户界面根据推荐食谱数据显示包含控件的推荐食谱操作界面包括,所述第三控制器在接收到的推荐食谱数据仅包含第一推荐食谱数据时,控制第一推荐窗口显示所述第一推荐食谱数据。In some embodiments, the third controller controlling the user interface to display the recommended recipe operation interface including controls according to the recommended recipe data includes: when the received recommended recipe data only includes the first recommended recipe data, the third controller: The first recommendation window is controlled to display the first recommended recipe data.
在一些实施例中,根据显示设备绑定的不同用户的预设匹配特征与所述推荐食谱数据中的食谱构建映射关系,其中所述预设匹配特征还可以从以下角度进行预设。In some embodiments, a mapping relationship is constructed according to the preset matching features of different users bound to the display device and the recipes in the recommended recipe data, wherein the preset matching features can also be preset from the following perspectives.
例如,人群大致分为婴幼儿、小孩、成年人、老年人、孕妇、高考人群等;场景分为早餐、午餐、晚餐和宵夜等;食谱按照地理区域分成湘菜、川菜、鲁菜等;食谱品种分成荤菜、素菜、汤、甜点、小吃、蒸菜、煮菜、炒菜等;功效分为补血、补钙、补铁、降血压、降血脂等;口味偏好可以包括酸、辣、苦、甜、咸、酸、鲜等;烹饪方式可以分成蒸煮、爆炒、油炸、烘烤等。For example, the crowd is roughly divided into infants, children, adults, the elderly, pregnant women, college entrance examination people, etc.; the scenes are divided into breakfast, lunch, dinner and supper, etc.; the recipes are divided into Hunan cuisine, Sichuan cuisine, Shandong cuisine, etc. according to geographical areas; recipes Varieties are divided into meat dishes, vegetarian dishes, soups, desserts, snacks, steamed dishes, boiled dishes, stir-fried dishes, etc.; efficacy is divided into blood, calcium, iron, blood pressure, blood lipid lowering, etc.; taste preferences can include sour, spicy, bitter, sweet , salty, sour, fresh, etc.; cooking methods can be divided into steaming, stir-frying, frying, baking, etc.
图17D示出了本申请实施例推荐食谱数据操作界面示意图。FIG. 17D shows a schematic diagram of a recommended recipe data operation interface according to an embodiment of the present application.
在一些实施例中,显示设备的第三控制器控制用户界面根据推荐食谱数据显示包含控件的推荐食谱操作界面,所述控件用于在接收到用户的确认操作后,跳转至推荐食谱详情界面,其中,所述推荐食谱操作界面包括购买控件,所述购买控件用于接收到用户的确认操作后,跳转至推荐食谱对应食材的购买操作界面。In some embodiments, the third controller of the display device controls the user interface to display, according to the recommended recipe data, a recommended recipe operation interface including controls for jumping to the recommended recipe details interface after receiving the user's confirmation operation , wherein the recommended recipe operation interface includes a purchase control, and the purchase control is used to jump to the purchase operation interface of the ingredients corresponding to the recommended recipe after receiving the user's confirmation operation.
在包含甜甜圈的推荐食谱操作界面中,用户点击甜甜圈海报控件后,,第三控制器控制甜甜圈海报控件跳转至所述食谱的操作界面,包括食谱的名称、图片、简介、用料、以及制作方法,其中,所述制作方法可以包括图文教程、或视频教程;所述操作界面还包括购买控件,用户通过操作所述所述购买控件,操作界面可以跳转至推荐食谱对应食材的购买操作界面,用户可以在线购买制作甜甜圈所需的各种材料。In the recommended recipe operation interface containing donuts, after the user clicks the donut poster control, the third controller controls the donut poster control to jump to the operation interface of the recipe, including the name, picture, and introduction of the recipe , materials, and a production method, wherein the production method may include graphic tutorials or video tutorials; the operation interface further includes a purchase control, and the user can jump to the recommendation by operating the purchase control. The recipe corresponds to the purchase operation interface of the ingredients, and users can purchase various materials needed to make donuts online.
在一些实施例中,用户界面显示的推荐食谱操作界面包括多个食谱,所述食谱包括海报控件,所述海报控件显示为对应食谱的图片;并且服务器在发送推荐食谱数据时为所述海报控件预设有URL、或ID,以使得用户点击海报控件后用户界面加载为推荐食谱详情界面。在一些实施例中,服务器在发送推荐食谱数据时包含食谱的推荐食谱详情,用户点 击海报控件后,用户界面根据推荐食谱详情加载为推荐食谱详情界面。图17C示出了本申请另一实施例显示设备推荐食谱数据UI示意图。In some embodiments, the recommended recipe operation interface displayed on the user interface includes a plurality of recipes, the recipes include a poster control, and the poster control is displayed as a picture corresponding to the recipe; and the server is the poster control when sending the recommended recipe data A URL or ID is preset, so that after the user clicks the poster control, the user interface is loaded as the recommended recipe details interface. In some embodiments, the server includes the recommended recipe details of the recipe when sending the recommended recipe data, and after the user clicks the poster control, the user interface is loaded into the recommended recipe details interface according to the recommended recipe details. FIG. 17C shows a UI schematic diagram of a display device recommending recipe data according to another embodiment of the present application.
在一些实施例中,显示设备的第三控制器响应于用户对推荐食谱应用程序的操作,根据用户冰箱存储食材中的主食材确定服务器可以提供的推荐食谱数据包括,所述第三控制器响应于用户对所述用户冰箱存储食材的选择构建第一食材集合;发送第二推荐请求至所述服务器,所述第二推荐请求包括所述第一食材集合,所述第二推荐请求用于使所述服务器根据所述第一食材集合中的主食材确定所述服务器可以提供的推荐食谱数据;接收来自服务器发送的所述推荐食谱数据。In some embodiments, the third controller of the display device, in response to the user's operation on the recommended recipe application, determining the recommended recipe data that the server can provide according to the main ingredients in the ingredients stored in the user's refrigerator includes, the third controller responding Constructing a first set of ingredients based on the user's selection of ingredients stored in the user's refrigerator; sending a second recommendation request to the server, where the second recommendation request includes the first set of ingredients, and the second recommendation request is used to make The server determines recommended recipe data that can be provided by the server according to the main ingredient in the first ingredient set; and receives the recommended recipe data sent from the server.
第三控制器将服务器接收的来自冰箱的用户冰箱存储食材显示于用户界面,第三控制器基于用户通过对用户界面中焦点的操作,选择确认至少一种食材构成第一食材集合,并向服务器发送包含所述第一食材集合的第二推荐请求;The third controller displays the user's refrigerator storage ingredients received by the server from the refrigerator on the user interface. Based on the user's operation on the focus in the user interface, the third controller selects and confirms that at least one ingredient constitutes the first ingredient set, and reports to the server. sending a second recommendation request containing the first set of ingredients;
服务器的第二控制器接收来自显示设备发送的包含第一食材集合的第二推荐请求,在服务器包含的媒资库中根据所述第二推荐请求中所述第一食材集合中的主食材查询确定可以提供的推荐食谱数据,并将所述推荐食谱数据发送至所述显示设备。The second controller of the server receives a second recommendation request including the first ingredient set sent from the display device, and queries the media library included in the server according to the main ingredient in the first ingredient set in the second recommendation request Determining the available recommended recipe data and sending the recommended recipe data to the display device.
显示设备的第三控制器接收来自服务器反馈的推荐食谱数据,所述推荐食谱数据基于用户选择的第一食材集合中的主食材生成。从而可以缩小推荐食谱数据的范围,使得推荐食谱数据更加契合用户需求。The third controller of the display device receives recommended recipe data fed back from the server, where the recommended recipe data is generated based on the main ingredient in the first ingredient set selected by the user. Thereby, the scope of the recommended recipe data can be narrowed, so that the recommended recipe data is more suitable for the user's needs.
在一些实施例中,第三控制器将用户选择的第一食材集合控制在3种食材以下,服务器根据所述第一食材集合中主食材进行匹配,将匹配度最高的食谱构建推荐食谱数据并进行反馈。In some embodiments, the third controller controls the first set of ingredients selected by the user to be less than 3 kinds of ingredients, and the server matches the main ingredients in the first set of ingredients, constructs recommended recipe data for the recipe with the highest matching degree, and Give feedback.
在一些实施例中,显示设备的第三控制器响应于用户对用户冰箱存储食材的选择构建第一食材集合包括,所述第三控制器在用户界面上显示根据所述用户冰箱存储食材生成的配菜列表,所述配菜列表包含的食材根据保质期剩余天数从小到大排列;响应于用户对所述配菜列表中所述食材的选择操作,构建第一食材集合。In some embodiments, constructing the first set of ingredients by the third controller of the display device in response to the user's selection of ingredients stored in the user's refrigerator includes, the third controller displaying on the user interface a set of ingredients generated according to the ingredients stored in the user's refrigerator A side dish list, where the ingredients included in the side dish list are arranged in ascending order according to the remaining days of the shelf life; in response to a user's selection operation on the ingredients in the side dish list, a first ingredient set is constructed.
如图17C所示的智能配菜用户界面中,第三控制器生成的配菜列表包括用户冰箱存储食材中的所有食材,图中显示了每种食材的名称、图片、保质期剩余天数。例如,图中配菜列表包括苹果、西兰花、葡萄、胡萝卜、白菜、火腿、草莓、西瓜、牛奶、面包、豆奶、水果果汁、红酒、虾、樱桃、蛋糕等。In the smart side dish user interface shown in FIG. 17C , the side dish list generated by the third controller includes all the ingredients stored in the user's refrigerator, and the figure shows the name, picture, and remaining days of the shelf life of each ingredient. For example, the list of side dishes in the figure includes apples, broccoli, grapes, carrots, cabbage, ham, strawberries, watermelon, milk, bread, soy milk, fruit juice, red wine, shrimp, cherries, cakes, etc.
第三控制器根据所述配菜列表中食材保质期剩余天数从小到大对食材进行排列,保质期剩余天数越小的食材其排列越靠前,以提示用户选择、使用临近保质期的食材,避免造成浪费,提高推荐食谱对于用户需求、实用性的契合度。The third controller arranges the ingredients according to the remaining days of the shelf life of the ingredients in the side dish list from small to large, and the smaller the remaining days of the shelf life, the higher the order, so as to prompt the user to select and use the ingredients that are close to the shelf life to avoid waste. , to improve the fit of the recommended recipes to user needs and practicability.
在一些实施例中,第三控制器根据食材的保质期剩余天数为食材生成进度条,将保质期剩余天数小于等于预设阈值的食材的进度条显示为高亮度、或预设颜色,以提示用户尽快使用食材。In some embodiments, the third controller generates a progress bar for the ingredients according to the remaining days in the shelf life of the ingredients, and displays the progress bar of the ingredients whose remaining days in the shelf life is less than or equal to a preset threshold as a high brightness or a preset color to remind the user to quickly Use ingredients.
基于上述显示设备实现推荐食谱数据的技术方案介绍以及附图说明,本申请还提供了一种显示设备端进行推荐食谱的方法。Based on the introduction of the technical solution for realizing the recommended recipe data by the display device and the description of the drawings, the present application also provides a method for recommending recipes on the display device side.
图18示出了本申请一实施例一种推荐食谱方法的流程示意图。FIG. 18 shows a schematic flowchart of a method for recommending recipes according to an embodiment of the present application.
在步骤301中,推荐食谱应用程序启动后,发送第一推荐请求至所述服务器,所述第一推荐请求用于使所述服务器反馈根据用户冰箱存储食材中的主食材确定的推荐食谱数据。In step 301, after the recommended recipe application is started, a first recommendation request is sent to the server, and the first recommendation request is used to make the server feed back recommended recipe data determined according to the main ingredients in the ingredients stored in the user's refrigerator.
在步骤302中,在用户界面根据所述推荐食谱数据显示包含控件的推荐食谱操作界面,所述控件用于在接收到用户的确认操作后,跳转至推荐食谱详情界面。In step 302, a recommended recipe operation interface including controls is displayed on the user interface according to the recommended recipe data, and the controls are used to jump to the recommended recipe details interface after receiving the user's confirmation operation.
所述显示设备实现推荐食谱的具体操作已在上文电视侧推荐食谱实现技术方案介绍中进行详细阐述,在此不再赘述。The specific operation of implementing the recommended recipe by the display device has been described in detail in the introduction of the technical solution for implementing the recommended recipe on the TV side above, and will not be repeated here.
在一些实施例中,在推荐食谱应用程序启动后,还包括:发送第二推荐请求至所述服务器,所述第二推荐请求包括用户对所述用户冰箱存储食材选择构建的第一食材集合,所述第二推荐请求用于使所述服务器根据所述第一食材集合中的主食材确定所述服务器可以提供的推荐食谱数据;接收来自服务器发送的所述推荐食谱数据。所述显示设备实现推荐食谱的具体操作已在上文电视侧推荐食谱实现技术方案介绍中进行详细阐述,在此不再赘述。In some embodiments, after the recommended recipe application is started, the method further includes: sending a second recommendation request to the server, where the second recommendation request includes a first set of ingredients selected and constructed by the user for the ingredients stored in the refrigerator of the user, The second recommendation request is used to enable the server to determine, according to the main ingredient in the first ingredient set, recommended recipe data that the server can provide; and to receive the recommended recipe data sent from the server. The specific operation of implementing the recommended recipe by the display device has been described in detail in the introduction of the technical solution for implementing the recommended recipe on the TV side above, and will not be repeated here.
基于上述显示设备、服务器实现推荐食谱数据的技术方案介绍以及附图说明,本申请还提供了一种服务器端进行推荐食谱的方法。Based on the introduction of the technical solution for realizing the recommended recipe data by the display device and the server and the description of the drawings, the present application also provides a method for recommending recipes on the server side.
图19示出了本申请另一实施例一种推荐食谱方法的流程示意图。FIG. 19 shows a schematic flowchart of a method for recommending recipes according to another embodiment of the present application.
在步骤401中,接收来自显示设备发送的推荐请求,根据所述用户冰箱存储食材中的主食材查询可以提供的推荐食谱数据,所述用户冰箱存储食材被所述服务器识别为主食材或辅食材;In step 401, a recommendation request sent from a display device is received, and the recommended recipe data that can be provided is queried according to the main ingredients in the user's refrigerator storage ingredients, and the user's refrigerator storage ingredients are identified by the server as main ingredients or auxiliary ingredients ;
在步骤402中,将所述推荐食谱数据发送至所述显示设备。In step 402, the recommended recipe data is sent to the display device.
所述服务器实现推荐食谱的具体操作已在上文电视侧推荐食谱实现技术方案介绍中进行详细阐述,在此不再赘述。The specific operation of implementing the recommended recipe by the server has been described in detail in the introduction of the technical solution for implementing the recommended recipe on the TV side above, and will not be repeated here.
在一些实施例中,接收来自显示设备发送的推荐请求,根据所述用户冰箱存储食材中的主食材查询可以提供的推荐食谱数据包括:接收来自显示设备发送的包含第一食材集合的第二推荐请求,根据所述第二推荐请求中所述第一食材集合中的主食材确定可以提供的推荐食谱数据;将所述推荐食谱数据发送至所述显示设备。所述服务器实现推荐食谱的具体操作已在上文电视侧推荐食谱实现技术方案介绍中进行详细阐述,在此不再赘述。In some embodiments, receiving a recommendation request sent from a display device, and querying the available recommended recipe data according to the main ingredients in the ingredients stored in the refrigerator of the user includes: receiving a second recommendation including a first set of ingredients sent from the display device request, determine the recommended recipe data that can be provided according to the main ingredient in the first ingredient set in the second recommendation request; and send the recommended recipe data to the display device. The specific operation of implementing the recommended recipe by the server has been described in detail in the introduction of the technical solution for implementing the recommended recipe on the TV side above, and will not be repeated here.
图20A示出了本申请实施例一种冰箱的侧视外观示意图。FIG. 20A shows a schematic side view of the appearance of a refrigerator according to an embodiment of the present application.
如图所示,图20A还示出了本申请还示例性提供了的一种冰箱,包括摄像头(图中未示出)、显示屏以及控制器(图中未显示)。As shown in the figure, FIG. 20A also shows a refrigerator provided by the present application as an example, including a camera (not shown in the figure), a display screen and a controller (not shown in the figure).
图中所述冰箱为4门冰箱,其摄像头设置于冰箱内部,被配置为采集所述冰箱的内部图像,例如获取冰箱内部冷藏室、冷冻室的图像,并将其发送至控制器用于识别食材以及生成推荐食谱数据。The refrigerator in the figure is a 4-door refrigerator, and its camera is arranged inside the refrigerator and is configured to capture the internal images of the refrigerator, for example, to obtain the images of the refrigerator compartment and the freezer compartment inside the refrigerator, and send them to the controller for identifying the ingredients As well as generating recommended recipe data.
显示屏,被配置为用于显示用户界面,通常设置于冰箱冷藏室门板的外部。The display screen, which is configured to display the user interface, is usually provided on the outside of the door panel of the refrigerator compartment.
在一些实施例中,控制器被配置为将根据所述摄像头采集的冰箱内部图像获取的用户冰箱存储食材发送至服务器,所述用户冰箱存储食材被所述服务器识别为主食材或辅食材;响应于用户对推荐食谱应用程序的操作,根据所述用户冰箱存储食材中的主食材确定服务器可以提供的推荐食谱数据;控制所述用户界面根据所述推荐食谱数据显示包含控件的推荐食谱操作界面,所述控件用于在接收到用户的确认操作后,跳转至推荐食谱详情界面。所述推荐食谱操作界面的位置示意如图20B所示。所述冰箱中的控制器、摄像头、显示屏实现推荐食谱的具体操作与电视端实现推荐食谱类似,已在上文电视、服务器端推荐食谱实现技术方案介绍中进行详细阐述,在此不再赘述。In some embodiments, the controller is configured to send the user's refrigerator storage ingredients obtained according to the image of the interior of the refrigerator captured by the camera to the server, where the user's refrigerator storage ingredients are identified by the server as main ingredients or auxiliary ingredients; responding In response to the user's operation of the recommended recipe application, the recommended recipe data that can be provided by the server is determined according to the main ingredients in the ingredients stored in the user's refrigerator; the user interface is controlled to display a recommended recipe operation interface including controls according to the recommended recipe data, The control is used to jump to the recommended recipe details interface after receiving the user's confirmation operation. The position diagram of the recommended recipe operation interface is shown in FIG. 20B . The specific operation of the controller, camera, and display screen in the refrigerator to implement recommended recipes is similar to the implementation of recommended recipes on the TV side, which has been described in detail in the introduction of the technical solutions for the implementation of recommended recipes on the TV and server sides above, and will not be repeated here. .
具体实现中,本申请还提供一些非易失性计算机存储介质,其中,该计算机存储 介质可存储有程序,该程序执行时可包括本申请提供的屏保展示方法和屏保跳转方法的各实施例中的部分或全部步骤。所述的存储介质可为磁碟、光盘、只读存储记忆体(英文:read-only memory,简称:ROM)或随机存储记忆体(英文:random access memory,简称:RAM)等。In a specific implementation, the present application also provides some non-volatile computer storage media, wherein the computer storage medium can store a program, and when the program is executed, it can include the various embodiments of the screen saver display method and the screen saver jump method provided by the present application some or all of the steps in . The storage medium can be a magnetic disk, an optical disk, a read-only memory (English: read-only memory, abbreviated as: ROM) or a random access memory (English: random access memory, abbreviated as: RAM) and the like.
本领域的技术人员可以清楚地了解到本申请实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解,本申请实施例中的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例或者实施例的某些部分所述的方法。Those skilled in the art can clearly understand that the technology in the embodiments of the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solutions in the embodiments of the present application can be embodied in the form of software products in essence or in the parts that make contributions to related technologies, and the computer software products can be stored in storage media, such as ROM/RAM, A magnetic disk, an optical disk, etc., includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present application.
最后应说明的是:以上各实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述各实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some or all of the technical features thereof can be equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present application. Scope.
为了方便解释,已经结合具体的实施方式进行了上述说明。但是,上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导,可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用,从而使得本领域技术人员更好的使用所述实施方式以及适于具体使用考虑的各种不同的变形的实施方式。For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussions are not intended to be exhaustive or to limit implementations to the specific forms disclosed above. Numerous modifications and variations are possible in light of the above teachings. The above embodiments are chosen and described to better explain the principles and practical applications, so as to enable those skilled in the art to better utilize the described embodiments and various modified embodiments suitable for specific use considerations.
Claims (21)
- 一种冰箱,其特征在于,包括:A refrigerator, characterized in that, comprising:箱体,内部设有储藏室,所述储藏室中储藏有至少一个食材;The box body is provided with a storage room inside, and at least one food material is stored in the storage room;箱门,设于所述储藏室的开口处;a box door, located at the opening of the storage room;显示屏,设于所述箱门,用于显示用户界面;a display screen, arranged on the box door, for displaying the user interface;与所述显示屏连接的控制器,被配置为:A controller connected to the display screen is configured to:接收服务器根据储藏室中的现有食材下发的至少一个菜谱,每个菜谱包括至少一种所述现有食材;receiving at least one recipe issued by the server according to the existing ingredients in the storage room, each recipe including at least one of the existing ingredients;根据当前时间和预先存储的所述现有食材的时间相关信息,确定所述菜谱中各现有食材的新鲜度;Determine the freshness of each existing ingredient in the recipe according to the current time and the pre-stored time-related information of the existing ingredient;根据所述菜谱中各现有食材的新鲜度确定所述菜谱的推荐优先级;Determine the recommendation priority of the recipe according to the freshness of each existing ingredient in the recipe;以各菜谱的推荐优先级的降序作为各菜谱的展示顺序,在所述用户界面中展示部分或者全部菜谱。A part or all of the recipes are displayed in the user interface in the descending order of the recommended priority of each recipe as the display order of each recipe.
- 根据权利要求1所述的冰箱,其特征在于,所述接收服务器根据储藏室中的现有食材下发的至少一个菜谱之前,还包括:The refrigerator according to claim 1, wherein before the receiving the at least one recipe issued by the server according to the existing ingredients in the storage room, the method further comprises:从本地食材信息集合中读取储藏室中的现有食材,所述现有食材为所述本地食材信息中存放状态为放入状态的食材;Read the existing ingredients in the storage room from the local ingredient information collection, where the existing ingredients are the ingredients in the local ingredient information whose storage state is the put-in state;向服务器发送菜谱推荐请求,所述菜谱推荐请求至少包括所述现有食材的食材名称,所述菜谱推荐请求用于使服务器根据所述现有食材的食材名称匹配包括至少一种所述现有食材的菜谱。Sending a recipe recommendation request to the server, where the recipe recommendation request includes at least an ingredient name of the existing ingredient, and the recipe recommendation request is used to make the server match at least one of the existing ingredients according to the ingredient name of the existing ingredient food recipes.
- 根据权利要求2所述的冰箱,其特征在于,所述现有食材具有用于表征新鲜度的新鲜度标识;所述时间相关信息包括保质期和起始时间,所述起始时间为食材放入储藏室的时间或者食材的生产时间;The refrigerator according to claim 2, wherein the existing food material has a freshness mark used to represent freshness; the time-related information includes a shelf life and a start time, and the start time is when the food material is put in The time in the storage room or the production time of the ingredients;所述控制器还被配置为:The controller is also configured to:每隔预设时间间隔,根据当前时间、所述现有食材的保质期和起始时间,确定所述现有食材的新鲜度;At every preset time interval, determine the freshness of the existing ingredients according to the current time, the shelf life and the starting time of the existing ingredients;根据所述现有食材的新鲜度更新所述现有食材的新鲜度标识;Update the freshness identifier of the existing food according to the freshness of the existing food;所述根据当前时间和预先存储的所述现有食材的时间相关信息,确定所述菜谱中各现有食材的新鲜度,包括:The determining the freshness of each existing ingredient in the recipe according to the current time and the pre-stored time-related information of the existing ingredient, including:根据所述菜谱中各现有食材的食材名称,从本地食材信息集合中查找各现有食材对应的新鲜度标识,以根据所述新鲜度标识确定各现有食材的新鲜度。According to the ingredient name of each existing ingredient in the recipe, the freshness identifier corresponding to each existing ingredient is searched from the local ingredient information set, so as to determine the freshness of each existing ingredient according to the freshness identifier.
- 根据权利要求1所述的冰箱,其特征在于,所述时间相关信息包括保质期和起始时间,所述起始时间为食材放入储藏室的时间或者食材的生产时间,所述根据当前时间和预先存储的所述现有食材的时间相关信息,确定所述菜谱中各现有食材的新鲜度,包括:The refrigerator according to claim 1, wherein the time-related information includes a shelf life and a start time, and the start time is the time when the ingredients are put into the storage room or the production time of the ingredients. The pre-stored time-related information of the existing ingredients determines the freshness of each existing ingredient in the recipe, including:根据所述菜谱中各现有食材的食材名称,从本地食材信息集合中查找各现有食材对应的保质期和起始时间;According to the ingredient name of each existing ingredient in the recipe, search the shelf life and start time corresponding to each existing ingredient from the local ingredient information collection;根据当前时间、各现有食材对应的保质期和起始时间,确定各现有食材的新鲜度。The freshness of each existing ingredient is determined according to the current time, the shelf life and starting time corresponding to each existing ingredient.
- 根据权利要求3或者4所述的冰箱,其特征在于,所述根据当前时间、各现有食材对应的保质期和起始时间,确定各现有食材的新鲜度,包括:The refrigerator according to claim 3 or 4, wherein the determining the freshness of each existing ingredient according to the current time, the shelf life and the starting time corresponding to each existing ingredient, including:根据所述现有食材对应的保质期和起始时间,确定所述现有食材的过期时间;Determine the expiration time of the existing ingredients according to the shelf life and starting time corresponding to the existing ingredients;计算所述现有食材的过期时间与当前时间的差值,根据所述差值与所述现有食材的保质期的比值确定所述现有食材的新鲜度等级。Calculate the difference between the expiration time of the existing food and the current time, and determine the freshness level of the existing food according to the ratio of the difference to the shelf life of the existing food.
- 根据权利要求5所述的冰箱,其特征在于,所述根据所述菜谱中各现有食材的新鲜度确定所述菜谱的推荐优先级,包括:The refrigerator according to claim 5, wherein the determining the recommendation priority of the recipe according to the freshness of each existing ingredient in the recipe comprises:根据所述菜谱中各现有食材的新鲜度等级确定各现有食材对应的权重值,不同新鲜度等级对应的权重值不同;The weight value corresponding to each existing ingredient is determined according to the freshness grade of each existing ingredient in the recipe, and the weight value corresponding to different freshness grades is different;将所述菜谱中各现有食材对应的权重值的加和,基于各菜谱对应的所述加和对各菜谱进行排序,以确定各菜谱的推荐优先级。The sum of the weight values corresponding to the existing ingredients in the recipe is added, and the recipes are sorted based on the sum corresponding to each recipe, so as to determine the recommendation priority of each recipe.
- 根据权利要求6所述的冰箱,其特征在于,所述用户界面包括菜谱展示区,所述在所述用户界面中展示部分或者全部的菜谱,包括:The refrigerator according to claim 6, wherein the user interface includes a recipe display area, and the displaying part or all of the recipes in the user interface includes:在所述菜谱展示区中展示N个菜谱控件,将服务器返回的M个菜谱中推荐优先级靠前的N个菜谱的菜谱名称和菜谱封面依次加载在所述N个菜谱控件中,N≤M,N小于等于所述菜谱展示区中菜谱控件展示位的预设数量;Display N recipe controls in the recipe display area, and load the recipe names and recipe covers of the N recipes with the highest recommended priority among the M recipes returned by the server into the N recipe controls, N≤M , N is less than or equal to the preset number of display positions for recipe controls in the recipe display area;所述控制器进一步被配置为:The controller is further configured to:响应于用户对显示的目标菜谱控件的选中操作,显示对应菜谱的详细内容。In response to the user's selection operation on the displayed target recipe control, the detailed content of the corresponding recipe is displayed.
- 根据权利要求1所述的冰箱,其特征在于,所述现有食材具有用于表征储藏室的存放位置标识;所述用户界面还包括多个分别与各个储藏室对应的特定食材提醒区,所述控制器进一步被配置为:The refrigerator according to claim 1, wherein the existing food material has a storage location identifier used to represent a storage room; the user interface further comprises a plurality of reminder areas for specific food materials corresponding to each storage room, wherein the The controller is further configured to:在所述菜谱展示区中展示所述菜谱控件的同时,根据所述现有食材对应的存放位置标识和新鲜度,将各个储藏室中新鲜度符合预设提醒条件的现有食材的食材图标展示在对应的特定食材提醒区中。While displaying the recipe controls in the recipe display area, according to the storage location identification and freshness corresponding to the existing ingredients, the ingredients icons of the existing ingredients in each storage room whose freshness meets the preset reminder conditions are displayed. In the corresponding specific ingredient reminder area.
- 根据权利要求1所述的冰箱,其特征在于,所述现有食材具有用于表征储藏室的存放位置标识;所述控制器进一步被配置为:The refrigerator according to claim 1, wherein the existing food material has a storage position identification used to represent a storage compartment; the controller is further configured to:在所述用户界面展示多个分别与各储藏室对应的食材展示区,根据所述现有食材对应的新鲜度标识和存放位置标识,将各个储藏室中现有食材的食材图标展示在对应的食材展示区中,其中,各储藏室中现有食材的食材图标在对应食材展示区中按照新鲜度逐渐降低的顺序排列。A plurality of ingredient display areas corresponding to each storage room are displayed on the user interface, and according to the freshness identification and storage location identification corresponding to the existing ingredients, the ingredient icons of the existing ingredients in each storage room are displayed in the corresponding In the ingredient display area, the ingredient icons of the existing ingredients in each storage room are arranged in the order of decreasing freshness in the corresponding ingredient display area.
- 一种信息推送的方法,其特征在于,应用于冰箱,所述冰箱包括显示屏,所述方法包括:A method for pushing information, characterized in that it is applied to a refrigerator, wherein the refrigerator includes a display screen, and the method includes:接收服务器根据储藏室中的现有食材下发的至少一个菜谱,每个菜谱包括至少一个所述现有食材;receiving at least one recipe issued by the server according to the existing ingredients in the storage room, each recipe including at least one of the existing ingredients;根据当前时间和预先存储的所述现有食材的时间相关信息,确定所述菜谱中各现有食材的新鲜度;determining the freshness of each existing ingredient in the recipe according to the current time and the pre-stored time-related information of the existing ingredient;根据所述菜谱中各现有食材的新鲜度确定所述菜谱的推荐优先级;Determine the recommendation priority of the recipe according to the freshness of each existing ingredient in the recipe;以各菜谱的推荐优先级的降序作为各菜谱的展示顺序,在所述用户界面中展示部分或者全部菜谱。A part or all of the recipes are displayed in the user interface by taking the descending order of the recommended priority of each recipe as the display order of each recipe.
- 一种冰箱,其特征在于,包括:A refrigerator, characterized in that, comprising:箱体,内部设有储藏室,用于储藏食材;The box body has a storage room inside for storing ingredients;箱门,设于所述储藏室的开口处;a box door, located at the opening of the storage room;显示器,设于所述箱门,用于显示用户界面;a display, arranged on the box door, for displaying a user interface;通信器,用于与关联的终端设备进行通信;A communicator for communicating with the associated end device;与所述显示器及所述通信器连接的控制器,被配置为:A controller connected to the display and the communicator is configured to:确定目标食材,所述目标食材至少包括根据储藏室中现有食材对应的时间相关信息确定的新鲜度满足预设提醒条件的食材;Determining a target ingredient, the target ingredient at least includes an ingredient whose freshness satisfies a preset reminder condition determined according to time-related information corresponding to the existing ingredient in the storage room;根据所述目标食材生成提醒消息,所述提醒消息包括所述目标食材的食材名称;generating a reminder message according to the target ingredient, the reminder message including the ingredient name of the target ingredient;将所述提醒消息推送到至少一个所述终端设备,以在至少一个所述终端设备上展示所述提醒消息。Pushing the reminder message to at least one of the terminal devices to display the reminder message on at least one of the terminal devices.
- 根据权利要求11所述的冰箱,其特征在于,根据储藏室中现有食材对应的时间相关信息确定目标食材,包括:The refrigerator according to claim 11, wherein determining the target ingredients according to the time-related information corresponding to the existing ingredients in the storage room comprises:从本地食材信息集合中获取所述现有食材的食材信息,所述食材信息包括时间相关信息,所述食材信息具有提醒状态标识;Obtain the ingredient information of the existing ingredient from the local ingredient information collection, the ingredient information includes time-related information, and the ingredient information has a reminder status identifier;根据所述现有食材对应的所述时间相关信息,确定所述现有食材中的过期食材;determining expired ingredients in the existing ingredients according to the time-related information corresponding to the existing ingredients;将过期时长小于或等于预设提醒周期或者提醒状态标识为第一标识的过期食材确定为所述目标食材。An expired ingredient whose expiration duration is less than or equal to the preset reminder period or whose reminder status is identified as the first identifier is determined as the target ingredient.
- 根据权利要求11所述的冰箱,其特征在于,所述目标食材还包括根据未读的历史提醒消息所包含的食材名称对应的食材。The refrigerator according to claim 11, wherein the target ingredient further comprises an ingredient corresponding to an ingredient name contained in an unread historical reminder message.
- 根据权利要求13所述的冰箱,其特征在于,所述确定目标食材,包括:The refrigerator according to claim 13, wherein the determining the target ingredient comprises:获取通知应用中预设时间截点前的未读的历史提醒消息,所述通知应用用于在显示器上显示生成的所述提醒消息,所述预设时间截点是指早于当前时间点预设时间间隔的时间点;Acquire unread historical reminder messages before a preset time point in the notification application, where the notification application is used to display the generated reminder message on the display, where the preset time point refers to a predetermined time point earlier than the current time point. Set the time point of the time interval;将所述历史提醒消息包含的食材名称对应的食材确定为所述目标食材。The ingredient corresponding to the ingredient name included in the historical reminder message is determined as the target ingredient.
- 根据权利要求11所述的冰箱,其特征在于,所述将所述提醒消息推送到至少一个所述终端设备,以在至少一个所述终端设备上展示所述提醒消息,包括:The refrigerator according to claim 11, wherein the pushing the reminder message to at least one of the terminal devices to display the reminder message on the at least one terminal device comprises:向局域网内的终端设备发送设备发现消息,所述设备发现消息携带所述冰箱的IP地址;sending a device discovery message to a terminal device in the local area network, where the device discovery message carries the IP address of the refrigerator;若在预设等待时长内接收到至少一个所述终端设备对所述设备发现消息的应答消息,则根据所述应答消息中所述终端设备的IP地址,将所述提醒消息推送到所述终端设备;If at least one response message from the terminal device to the device discovery message is received within the preset waiting time period, the reminder message is pushed to the terminal according to the IP address of the terminal device in the response message. equipment;若在预设等待时长内未接收到所述终端设备对所述设备发现消息的应答消息,则通过通知应用,在所述显示器上展示所述提醒消息。If a response message from the terminal device to the device discovery message is not received within a preset waiting time period, the reminder message is displayed on the display through a notification application.
- 根据权利要求15所述的冰箱,其特征在于,所述向局域网内的终端设备发送设备发现消息,包括:The refrigerator according to claim 15, wherein the sending a device discovery message to the terminal device in the local area network comprises:向局域网内的终端设备发送UDP广播消息和/或向目标组网内的终端设备发送组播消息,所述目标组网是指所述冰箱对应的组网,所述UDP广播消息和所述组播消息均携带所述冰箱的IP地址。Send a UDP broadcast message to the terminal device in the local area network and/or send a multicast message to the terminal device in the target network, the target network refers to the network corresponding to the refrigerator, the UDP broadcast message and the group All broadcast messages carry the IP address of the refrigerator.
- 根据权利要求15所述的冰箱,其特征在于,所述若在预设等待时长内接收到至少一个所述终端设备对所述设备发现消息的应答消息,则根据所述应答消息中所述终端设备的IP地址,将所述提醒消息推送到所述终端设备,包括:The refrigerator according to claim 15, wherein, if at least one response message from the terminal device to the device discovery message is received within a preset waiting time period, according to the response message in the terminal device The IP address of the device to push the reminder message to the terminal device, including:确定各个所述终端设备预设的优先级,将优先级最高的终端设备确定为目标设备;determining the preset priority of each of the terminal devices, and determining the terminal device with the highest priority as the target device;根据所述目标设备的IP地址,将所述提醒消息推送到所述目标设备。The reminder message is pushed to the target device according to the IP address of the target device.
- 根据权利要求12所述的冰箱,其特征在于,所述控制器进一步被配置为:The refrigerator of claim 12, wherein the controller is further configured to:在将提醒状态标识为第一标识的过期食材确定为所述目标食材后,将所述提醒状态标识为第一标识的过期食材的提醒状态标识修改为第二标识。After the expired ingredients whose reminder status is identified as the first identification are determined as the target ingredients, the reminder status identification of the expired ingredients whose reminder status is identified as the first identification is modified to the second identification.
- 根据权利要求11所述的冰箱,其特征在于,所述时间相关信息包括保质期和起始时间,根据所述现有食材对应的时间相关信息确定所述现有食材中的过期食材,包括:The refrigerator according to claim 11, wherein the time-related information includes a shelf life and a start time, and the expired ingredients in the existing ingredients are determined according to the time-related information corresponding to the existing ingredients, including:根据所述现有食材对应的保质期和起始时间,确定所述现有食材的过期时间;Determine the expiration time of the existing ingredients according to the shelf life and starting time corresponding to the existing ingredients;将过期时间早于当前时间的现有食材确定为过期食材。Existing ingredients whose expiration time is earlier than the current time are determined as expired ingredients.
- 根据权利要求14所述的冰箱,其特征在于,所述控制器进一步被配置为:The refrigerator of claim 14, wherein the controller is further configured to:通过所述通知应用,接收到输入的对所述提醒消息的预设操作;receiving an input preset operation on the reminder message through the notification application;响应于所述预设操作,将所述提醒消息标记为已读状态或者将所述提醒消息清除。In response to the preset operation, the reminder message is marked as a read state or the reminder message is cleared.
- 一种消息提醒方法,其特征在于,应用于冰箱,所述方法包括:A message reminder method, characterized in that, applied to a refrigerator, the method comprising:确定目标食材,所述目标食材至少包括根据冰箱中现有食材对应的时间相关信息确定的新鲜度满足预设提醒条件的食材;Determining target ingredients, the target ingredients at least include ingredients whose freshness satisfies the preset reminder condition determined according to the time-related information corresponding to the existing ingredients in the refrigerator;根据所述目标食材生成提醒消息,所述提醒消息包括所述目标食材的食材名称;generating a reminder message according to the target ingredient, the reminder message including the ingredient name of the target ingredient;将所述提醒消息推送到至少一个关联的终端设备,以在所述至少一个关联的终端设备上展示所述提醒消息。Pushing the reminder message to at least one associated terminal device to display the reminder message on the at least one associated terminal device.
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010855107.X | 2020-08-24 | ||
CN202010855107.XA CN111984838A (en) | 2020-08-24 | 2020-08-24 | Display device, server, refrigerator and recipe recommending method |
CN202110606093.2A CN113251727A (en) | 2021-05-25 | 2021-05-25 | Refrigerator and information recommendation method |
CN202110606093.2 | 2021-05-25 | ||
CN202110617466.6A CN114294884B (en) | 2021-05-28 | 2021-05-28 | Refrigerator and message reminding method |
CN202110617466.6 | 2021-05-28 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022041992A1 true WO2022041992A1 (en) | 2022-03-03 |
Family
ID=80354192
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/102312 WO2022041992A1 (en) | 2020-08-24 | 2021-06-25 | Refrigerator, display device, server, recommendation method, and message reminding method |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2022041992A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023202221A1 (en) * | 2022-04-22 | 2023-10-26 | 海信视像科技股份有限公司 | Electronic device and data processing method |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140102127A1 (en) * | 2009-05-11 | 2014-04-17 | Kwanho YUM | Mobile terminal, operating method thereof, and refrigerator |
CN106327098A (en) * | 2016-08-31 | 2017-01-11 | 九阳股份有限公司 | Refrigerator and menu determining method therefor |
CN111552874A (en) * | 2020-04-24 | 2020-08-18 | 海信集团有限公司 | Refrigerator and recipe recommendation method |
CN111984838A (en) * | 2020-08-24 | 2020-11-24 | 聚好看科技股份有限公司 | Display device, server, refrigerator and recipe recommending method |
-
2021
- 2021-06-25 WO PCT/CN2021/102312 patent/WO2022041992A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140102127A1 (en) * | 2009-05-11 | 2014-04-17 | Kwanho YUM | Mobile terminal, operating method thereof, and refrigerator |
CN106327098A (en) * | 2016-08-31 | 2017-01-11 | 九阳股份有限公司 | Refrigerator and menu determining method therefor |
CN111552874A (en) * | 2020-04-24 | 2020-08-18 | 海信集团有限公司 | Refrigerator and recipe recommendation method |
CN111984838A (en) * | 2020-08-24 | 2020-11-24 | 聚好看科技股份有限公司 | Display device, server, refrigerator and recipe recommending method |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023202221A1 (en) * | 2022-04-22 | 2023-10-26 | 海信视像科技股份有限公司 | Electronic device and data processing method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP2005276171A (en) | Cooking assist system, information terminal, and server | |
WO2021204115A1 (en) | Data generation method, data processing method, data execution method and device | |
US20170293964A1 (en) | Consumable Goods Inventory Management System | |
CN111811182B (en) | Refrigerator and recipe recommendation method | |
WO2022001768A1 (en) | Refrigerator | |
WO2022041992A1 (en) | Refrigerator, display device, server, recommendation method, and message reminding method | |
WO2022095564A1 (en) | Display device and interface display method | |
CN112417282B (en) | Information recommendation method, food storage equipment and server | |
CN108172273A (en) | A kind of refrigerator food materials based on visitor recommend method | |
CN110806697B (en) | Method and device for determining prompt mode based on smart home operating system | |
CN111984838A (en) | Display device, server, refrigerator and recipe recommending method | |
CN113251727A (en) | Refrigerator and information recommendation method | |
CN112199406A (en) | Information recommendation method, food material storage device and server | |
CN115082149A (en) | Electronic equipment, server and cooking equipment recommendation method | |
WO2023165227A1 (en) | Food ingredient storage device, food ingredient library, and method for sorting recipes | |
WO2022068536A1 (en) | Information recommendation method, ingredient storage device, and server | |
WO2022002047A1 (en) | Refrigerator and ingredient management method | |
CN114294884B (en) | Refrigerator and message reminding method | |
CN114143578A (en) | Food material reminding method, display device and server | |
CN115587245A (en) | Menu list recommendation method and device, storage medium and electronic device | |
WO2022042516A1 (en) | Information recommendation method, food material storage device, and server | |
CN114115626A (en) | Method for inquiring food material of food material storage device and display device | |
CN111552874B (en) | Refrigerator and recipe recommendation method | |
WO2023109247A1 (en) | Food storage device, server, and interface display method | |
WO2023098114A1 (en) | Multi-terminal food material management method and display device and food material storage device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21859834 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21859834 Country of ref document: EP Kind code of ref document: A1 |