WO2023202221A9 - Electronic device and data processing method - Google Patents

Electronic device and data processing method Download PDF

Info

Publication number
WO2023202221A9
WO2023202221A9 PCT/CN2023/078530 CN2023078530W WO2023202221A9 WO 2023202221 A9 WO2023202221 A9 WO 2023202221A9 CN 2023078530 W CN2023078530 W CN 2023078530W WO 2023202221 A9 WO2023202221 A9 WO 2023202221A9
Authority
WO
WIPO (PCT)
Prior art keywords
ingredient
recipe
information
inventory
ingredients
Prior art date
Application number
PCT/CN2023/078530
Other languages
French (fr)
Chinese (zh)
Other versions
WO2023202221A1 (en
Inventor
马晓娜
穆聪聪
程晋
卢可敬
王全强
李金昆
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202210429991.XA external-priority patent/CN114820122A/en
Priority claimed from CN202210842481.5A external-priority patent/CN115203559A/en
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2023202221A1 publication Critical patent/WO2023202221A1/en
Publication of WO2023202221A9 publication Critical patent/WO2023202221A9/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes

Definitions

  • the present application relates to the field of display technology, and in particular, to an electronic device and a data processing method.
  • Recipe recommendations allow users to clearly see the recipes corresponding to the ingredients they bought, so they can choose their favorite dishes to cook.
  • recipe recommendation is an important function that embodies intelligence.
  • recipe recommendations cannot be based on the ingredients actually stored by the user, only default recommendations can be displayed, causing a serious problem that is far from the actual ingredient information.
  • This application provides an electronic device and a data processing method.
  • An embodiment of the present application discloses an electronic device, including: a display, used to display content; a communicator, used to communicate with external devices; a processor, the processor is communicatively connected to the display, and the processor is configured The steps are: in response to the operation of recipe recommendation, determine the ingredient request information, and the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device; obtain the recipe according to the ingredient information; and control the display to display the recipe.
  • An embodiment of the present application discloses a data processing method, which includes: an electronic device determines ingredient request information in response to an operation of recipe recommendation, and the ingredient request information is used to obtain ingredient information stored locally by an ingredient storage device; according to the ingredient The information obtains the recipe; the electronic device controls its display to display the recipe.
  • Figure 1 is a schematic diagram of an operation scenario between a display device and a control device according to some exemplary embodiments of the present application
  • FIG. 2 is a hardware configuration block diagram of the control device 100 shown in this application according to some exemplary embodiments;
  • Figure 3 is a hardware configuration block diagram of the display device 200 shown in this application according to some exemplary embodiments.
  • Figure 4A is one of the flow diagrams of the data processing method shown in this application according to some exemplary embodiments.
  • Figure 4B is the second schematic flowchart of the data processing method shown in this application according to some exemplary embodiments.
  • Figure 5 is a schematic diagram of the display effect of the recipe recommendation interface shown in this application according to some exemplary embodiments.
  • Figure 6 is a schematic flow chart of obtaining the LAN address of a device according to some exemplary embodiments of this application.
  • Figure 7 is a schematic diagram of the communication connection relationship of devices in the local area network shown in this application according to some exemplary embodiments.
  • Figure 8 is a schematic flowchart of another example of a data processing method shown in this application according to some exemplary embodiments.
  • Figure 9 is a usage scenario diagram of a smart refrigerator shown in this application according to some exemplary embodiments.
  • Figure 10A is a perspective view of a smart refrigerator shown in this application according to some exemplary embodiments.
  • Figure 10B is a schematic diagram of the appearance of a smart refrigerator according to some exemplary embodiments of the present application.
  • Figure 11 is a schematic diagram of the hardware configuration of a smart refrigerator shown in this application according to some exemplary embodiments.
  • Figure 12 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments;
  • Figure 13 is a schematic diagram of an ingredient management interface shown in this application according to some exemplary embodiments.
  • Figure 14 is a schematic diagram of another food material management interface shown in this application according to some exemplary embodiments.
  • Figure 15 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments.
  • Figure 16 is a schematic diagram of an intelligent dish preparation interface shown in this application according to some exemplary embodiments.
  • Figure 17 is a schematic diagram of a recipe details interface shown in this application according to some exemplary embodiments.
  • Figure 18 is a schematic flow chart of generating a purchase list according to some exemplary embodiments of this application.
  • Figure 19 is a schematic diagram of a purchase list interface shown in this application according to some exemplary embodiments.
  • Figure 20 is a schematic diagram of the procurement recommendation list interface shown in this application according to some exemplary embodiments.
  • Figure 21 is a schematic diagram of another purchase list interface shown in this application according to some exemplary embodiments.
  • Figure 22 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments.
  • Figure 23 is a schematic diagram of an interior image shown in this application according to some exemplary embodiments.
  • Figure 24 is a schematic diagram of the interaction between a terminal device, a smart refrigerator and a server according to some exemplary embodiments of this application.
  • FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to some exemplary embodiments of the present application. As shown in FIG. 1 , the user can operate the display device 200 through the terminal device 2 or the control device 100 .
  • control device 100 may be a remote controller.
  • the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods to control the display device 200 through wireless or wired methods.
  • the user can control the display device 200 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc.
  • a terminal device 2 (such as a mobile terminal, a tablet, a computer, a laptop, etc.) can also be used to control the display device 200 .
  • the display device 200 is controlled using an application program running on the terminal device.
  • the display device 200 can also be controlled in a manner other than the control device 100 and the terminal device 2.
  • the display device 200 can directly receive the user's voice command control through a module configured inside the display device 200 to obtain voice commands.
  • the user's voice command control can also be received through a voice control device provided outside the display device 200 .
  • the display device 200 also communicates data with the server 4 .
  • the display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.
  • the server 4 can provide various contents and interactions to the display device 200.
  • Server 4 may be a cluster or multiple clusters, and may include one or more types of servers.
  • FIG. 2 is a configuration block diagram of the control device 100 shown in this application according to some exemplary embodiments.
  • the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply.
  • the control device 100 can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, thus serving as an interactive mediator between the user and the display device 200 .
  • FIG. 3 is a hardware configuration block diagram of the display device 200 shown in this application according to some exemplary embodiments.
  • the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a processor 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface. At least one.
  • the processor includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, first to nth interfaces for input/output.
  • the display 260 includes a display screen component for presenting images, and a driving component for driving image display, for receiving image signals output from the processor, and displaying video content, image content, and menu control interfaces. Components and user control UI interface.
  • the display 260 can be a liquid crystal display, an OLED display, a projection display, or a projection device and a projection screen.
  • communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types.
  • the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near field communication protocol chips, and an infrared receiver.
  • the display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 4 through the communicator 220 .
  • the user interface may be used to receive control signals from the control device 100 (such as an infrared remote control, etc.).
  • the detector 230 is used to collect signals from the external environment or interactions with the outside.
  • the detector 230 includes a light receiver, a sensor used to collect ambient light intensity; or the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
  • the external device interface 240 may include, but is not limited to, the following: High Definition Multimedia Interface (HDMI), Analog or Data High Definition Component Input Interface (Component), Composite Video Input Interface (CVBS), USB Input Interface (USB), RGB port and any one or more interfaces. It can also be a composite input/output interface formed by the above-mentioned multiple interfaces.
  • HDMI High Definition Multimedia Interface
  • Component Analog or Data High Definition Component Input Interface
  • CVBS Composite Video Input Interface
  • USB Input Interface USB Input Interface
  • RGB port any one or more interfaces. It can also be a composite input/output interface formed by the above-mentioned multiple interfaces.
  • the tuner-demodulator 210 receives broadcast television signals through wired or wireless reception methods, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.
  • the processor 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the processor 250 is located, such as an external set-top box. wait.
  • the processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory.
  • the processor 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on display 260, processor 250 may perform operations related to the object selected by the user command.
  • the object may be any of selectable objects, such as a hyperlink, an icon, or other operable control. Operations related to the selected object include: displaying a link to a hyperlinked page, document, image, etc., or executing a program corresponding to the icon.
  • the processor includes a central processing unit (CPU), a video processor, Audio processor, Graphics Processing Unit (GPU), RAM (Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first interface to nth interface for input/output, communication bus (Bus) and so on.
  • CPU central processing unit
  • video processor Audio processor
  • Graphics Processing Unit GPU
  • RAM Random Access Memory
  • ROM Read-Only Memory
  • the CPU processor is used to execute operating system and application program instructions stored in the memory, and to execute various application programs, data and content according to various interactive instructions received from external inputs, so as to ultimately display and play various audio and video contents.
  • CPU processor which can include multiple processors. For example, it includes a main processor and one or more sub-processors.
  • the video processor is configured to receive an external video signal and perform decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal. Through processing, the signal displayed or played on the display device 200 can be obtained.
  • the audio processor is used to receive external audio signals, perform decompression and decoding according to the standard codec protocol of the input signal, as well as noise reduction, digital-to-analog conversion, and amplification processing to obtain the result.
  • the user may input user commands in a graphical user interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
  • the recipes recommended to the user can only be the default recommended recipes, which are inconsistent with the user's actual ingredients and are not intelligent enough.
  • some embodiments of the present application provide an electronic device and a data processing method.
  • FIG. 4A is one of the schematic flow diagrams of the data processing method shown in this application according to some exemplary embodiments.
  • the electronic device in this application may be a display device, or a device with a food management function such as a food storage device.
  • Data may include data related to recipes, data processing related to ingredient processing, etc.
  • the present application provides a display device.
  • the display device 200 includes a display 260, a communicator 220, and a processor 250.
  • the processor 250 is communicatively connected to the display 260, and the communicator 220 is used to In communication with an external device, the processor 250 is configured to perform the data processing process in FIG. 4A.
  • the data processing process is as follows:
  • the display device 200 determines the ingredient request information in response to the operation of recipe recommendation, and the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device.
  • S220 The display device 200 obtains recipes according to the ingredient information.
  • the display device and the food storage device may be the same device or different devices. If the display device is not an ingredient storage device, such as a TV or other devices that do not store ingredients, it cannot recommend recipes based on the ingredients actually stored by the user. As a result, only default recommendations can be displayed, which seriously deviates from the actual ingredient information. It is worth studying how to display recipe recommendations that match actual ingredients on equipment that does not store ingredients.
  • some embodiments of the present application provide a data processing method in which the display device and the food storage device are not the same device.
  • Figure 4B is the second schematic flowchart of the data processing method shown in this application according to some exemplary embodiments.
  • the display device 200 responds to the operation of recipe recommendation and obtains the local area network address of the ingredient storage device.
  • the food storage device refers to a device used to store food, and has a food management module that stores food information.
  • the user performs operations such as adding, deleting, or modifying ingredients, the operation is performed on the ingredient information stored locally by the ingredient management module.
  • This application does not limit the number of food storage devices. That is, the display device 200 can obtain the LAN address of one food storage device or the LAN addresses of multiple food storage devices.
  • the display device 200 can recommend recipes for the user.
  • FIG. 5 is a schematic diagram of the display effect of the recipe recommendation interface shown in this application according to some exemplary embodiments.
  • the interface provides interface choices for several functions such as "Recommended Recipes”, “Recipe Classification”, “Recipe Collection” and “Food Circle”. Users can choose one of the interfaces to view according to their needs. For example, after selecting the "recipe recommendation” function, the display device 200 displays a recipe recommendation list in response to the recipe recommendation operation, and the user can select the recipe he wants to cook on this interface.
  • the LAN address is the Internet Protocol (IP) address of the device within the LAN.
  • IP Internet Protocol
  • the local area network is a local area network covering a home area.
  • the ingredient information includes ingredient category, ingredient name, ingredient storage time, ingredient shelf life, etc.
  • the shelf life of food ingredients refers to the time that the food ingredients can be stored or preserved, such as 3 days, 24 hours, etc.
  • Figure 6 is a schematic flow chart of obtaining the LAN address of a device according to some exemplary embodiments of this application.
  • the process for the processor 250 to obtain the LAN address of the food storage device is as shown in Figure 6:
  • the display device 200 determines the address request information, which is used to obtain the local area network address of the food storage device.
  • the processor 250 of the display device 200 determines the LAN address of the display device 200, and then determines the address request information according to the LAN address of the display device 200.
  • the address request information includes the local area network address of the display device 200 and a first information type.
  • the first information type indicates that an online food storage device has been found.
  • the display device 200 sends the address request information.
  • the display device 200 sends the address request information in the local area network it accesses through the communicator 220 in a multicast or broadcast manner.
  • the display device 200 receives address response information, which includes the local area network address of the food storage device.
  • other online devices in the local area network After receiving the address request information, other online devices in the local area network determine address response information based on the address request information, and the other devices send address response information to the display device 200 .
  • the processor 250 sends address request information to devices connected to the same local area network.
  • the address request information includes a first information type.
  • the first information type indicates that the online food storage device is found, so that other devices can be configured according to the first information type.
  • An information type determines whether the device is a food storage device; the address request information also includes the LAN address of the display device 200, which can cause other devices to send the LAN address of the device to them based on the LAN address of the display device 200. Since the display device 200 enables devices connected to the same local area network to receive address request information through multicast or broadcast, the LAN addresses of all food storage devices in the local area network can be accurately and effectively obtained.
  • the address request information is transmitted in a data packet in User Datagram Protocol (UDP) format.
  • UDP User Datagram Protocol
  • the way for an online device in the local area network to determine and send the address response information includes: after the device accessing the local area network receives the address request information, based on the first information type in the address request information, based on the packet manager ( Package Manager) determines whether the device is a food storage device. If the device is a food storage device, determines the address response information. The address response information includes the LAN address of the device. Then connect the device root of the LAN The address response information is sent to the display device 200 in a unicast manner according to the LAN address of the display device 200 in the address request information, where the address response information is included in a data packet in UDP format and transmitted.
  • the address response information also includes a second information type, and the second information type indicates that the device sending the address response information is an ingredient storage device with an ingredient management function.
  • the device that sends the address response information may have the food management function by default. Therefore, the address response information may not include the above-mentioned second information. type. If the address response information also includes the second information type, it is further ensured that the device sending the address response information is a food storage device with a food management function.
  • the address response information also includes the login account information of the food storage device.
  • the login account information includes the user ID and may also include family information, where the family information is used to distinguish different families under the same user account. After each device logs in and establishes a communication connection with the server, the server will synchronize its user's login account information to the device.
  • the home information includes the address of the home where the device is located, or the identification made by the server (or the user) of the home where the device is located.
  • the display device 200 determines the food material request information, and the food material request information is used to obtain the food material information stored locally by the food material storage device.
  • the display device 200 determines the above food ingredient request information according to the local area network address of the display device.
  • the food material request information includes the local area network address of the display device 200 and a third information type.
  • the third information type is used to represent obtaining the food material information stored locally in the food material storage device.
  • the display device 200 sends food ingredient request information.
  • the display device 200 sends the food material request information according to the local area network address of the food material storage device.
  • the processor 250 determines whether the login account information of the display device 200 and the login account information of the food storage device are the same. If they are the same, then determines whether the login account information of the food storage device is the same. is the food source device, and then sends food request information to the food source device in a unicast manner according to the LAN address of the food source device. If they are different, the food storage device is determined to be a non-food source device, and the local address response information about the device is deleted.
  • the login account information includes the user's identification
  • the processor 250 determines whether the user identification of the display device 200 is the same as the user identification of the food storage device. If they are the same, the food storage device is determined to be the food source device.
  • the login account information includes the user's identification and family information.
  • the processor 250 determines whether the user identification of the display device 200 is the same as the user identification of the food storage device, and determines whether the family information of the display device 200 is the same as that of the food storage device. The household information of the food storage device is the same. If both are the same, the food storage device is determined to be the food source device.
  • the above method determines whether the food storage device and the display device 200 are devices of the same user by determining whether the user ID of the display device 200 and the user ID of the food storage device are the same. In this way, the user's information can be filtered out from the food storage device. A valid device that provides ingredient information, not another user's device. The accuracy of the filtered devices can be further improved based on whether the two family information are the same. Thus, the food material request information is sent to the food material storage device, and accurate food material information stored in the user's home can be obtained.
  • the display device 200 has an ingredient management function
  • the local ingredient information on the ingredient management module on the local device is obtained, and the local ingredient information and the ingredient information obtained from other devices are merged and then sent to the server. send.
  • the display device 200 can store food ingredients, by merging the food material information of other devices, The comprehensive recommended recipes obtained will be more comprehensive.
  • the display device 200 After receiving the ingredient information, the display device 200 obtains the recipe based on the ingredient information.
  • the ingredient storage device after receiving the ingredient request information, the ingredient storage device reads the locally stored ingredient information through the interface of the ingredient management module. Then determine the ingredient information list based on the ingredient information. Then, the ingredient information list is converted into information text in JS object notation (JavaScript Object Notation, JSON) format, and the ingredient information list is sent to the display device 200 according to its local area network address in a unicast manner.
  • JS object notation JavaScript Object Notation, JSON
  • the list of ingredient information is shown in Table 1 below:
  • the storage time of ingredients is determined by the date (year, month, day) and time (hours, minutes, seconds) when the ingredients are stored.
  • the unit of the shelf life of ingredients can be time units such as days, hours, minutes, etc.
  • the display device 200 parses the information text in JSON format and converts it into an ingredient information list of each ingredient storage device. Then obtain all the food material information stored in the current user's home according to each food material information list.
  • the display device 200 determines the expiration time of each food item based on the current time in the food material information, the storage time of the food material, and the shelf life of the food material.
  • the expiration time is the time from the current moment to the shelf life date of the food material.
  • all the ingredients are sorted according to the expiration time of each ingredient, and the ingredient information of the ingredients that meet the first preset condition is determined, and then the ingredient information of the ingredient that meets the first preset condition is sent to the server.
  • Receive a recipe from the server where the recipe is determined by the server based on the ingredient information of the ingredients that meet the first preset condition.
  • the expiry time the storage time of the food material + the shelf life of the food material - the current time.
  • the corresponding ingredient information will be deleted. Then sort the retained ingredients according to the expiration time from small to large.
  • the priority of the ingredients is from high to low, and each expiration time corresponds to a priority.
  • the priority of the ingredients with the shortest expiration time is the first level, the priority of the ingredients ranked after it is the second level, and so on.
  • the ingredients that meet the first preset condition are the ingredients from the first to the third level among the sorted ingredients.
  • the server calculates the correlation based on the ingredient names in the ingredient information and the side dish information and recipe names in each recipe, calculates the recipe with the highest matching degree, and sends it to the display device 200 .
  • the display device 200 can obtain the fused food information from multiple devices that store food, and prioritize the food based on the shelf life of each food. After deleting expired ingredients, priority is given to obtaining recommended recipes based on ingredients with shorter expiration dates to avoid expiration of ingredients due to untimely consumption, which enhances the intelligence of the display device.
  • the processor 250 of the display device 200 controls the display 260 to display the recipe.
  • the processor 250 controls the display 260 to display the recipe according to the recipe sent by the server.
  • the display effect can be seen in Figure 5.
  • FIG. 7 is a schematic diagram of the communication connection relationship of devices in a local area network according to some exemplary embodiments of this application.
  • the display device of the present application obtains the LAN addresses of multiple food storage devices (food storage device 1 and food storage device 2 in Figure 7) that are connected to the same local area network as the display device, and can obtain the LAN addresses according to the LAN address of the display device and the multiple food storage devices.
  • the local area network address of each food material storage device enables interaction between the multiple food material storage devices, thereby obtaining food material information of the multiple food material storage devices.
  • the device fuses the ingredient information of multiple ingredient storage devices and sends it to the server, so that the server can recommend recipes based on the merged ingredient information of multiple devices in the home local area network, so that the recipe finally obtained by the display device conforms to the actual storage of ingredients. Achieve more intelligent recommendation of recipes to users.
  • the display device 200 does not have an ingredient management function, the recipes obtained through the above method avoid the problem that only default recommended recipes can be displayed, which is not practical; if the display device 200 can store ingredients, then by merging other ingredient storage
  • the equipment's ingredient information makes the comprehensive recommended recipes available more comprehensive.
  • Some embodiments of this application also provide a data processing method, which method includes:
  • the display device determines the ingredient request information, and the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device;
  • the display device controls its display to display the recipe.
  • FIG. 8 is a schematic flowchart of another data processing method shown in this application according to some exemplary embodiments. Referring to Figure 8, the method includes:
  • the display device 200 obtains the local area network address of the ingredient storage device.
  • the display device 200 obtains the LAN address of an ingredient storage device connected to the same local area network as the display device, where the ingredient storage device includes the first terminal device.
  • the display device 200 determines the food material request information, and the food material request information is used to obtain the food material information stored locally by the food material storage device.
  • the display device 200 determines the food ingredient request information according to the local area network address of the display device.
  • S430 The display device 200 sends the food material request information, and the first terminal device receives the food material request information.
  • the display device 200 sends the food ingredient request information to the first terminal device according to the LAN address of the first terminal device.
  • S440 The first terminal device sends the food material information, and the display device 200 receives the food material information.
  • the first terminal device determines the locally stored food material information based on the food material management module, and then sends the food material information to the display device.
  • the display device 200 obtains the recipe based on the ingredient information.
  • the display device 200 controls its display 260 to display the recipe.
  • the display device 200 determines and sends address request information according to the LAN address of the display device, and the address request information is used to obtain the LAN address of the food storage device. Then, address response information from the first terminal device is received, where the address response information includes the local area network address of the first terminal device.
  • Ingredient storage equipment can provide users with multiple functions such as intelligent management of ingredients, intelligent storage, recipe recommendations, and multi-functional reminders.
  • the user can control the recipe recommendation interface to be displayed on the display screen of the smart refrigerator, and select any recipe in the recipe recommendation interface so that the display screen displays the details of the recipe, for example , so that the display shows the cooking ingredients, cooking steps and cooking time required for the recipe.
  • the ingredient storage device can be connected to the Internet, and users can add the ingredients required for the recipe to the shopping cart with one click and purchase the required ingredients.
  • this method of purchasing ingredients may lead to repeated purchases. For example, if ingredient A is stored in the ingredient storage device, and the recipe selected by the user also includes ingredient A, one-click purchase of the ingredients in the recipe will result in repeated purchases.
  • Ingredient A causes a waste of ingredients and is not conducive to user experience.
  • some embodiments of the present application provide another display device and a data processing method.
  • the device is a smart refrigerator.
  • Figure 9 shows the root of this application
  • a usage scenario diagram of a smart refrigerator is shown according to some exemplary embodiments.
  • Figure 9 exemplarily shows the operation scenario between the food storage device, the control device and the terminal device.
  • the user can operate the food storage device 3 through the control device 100 , or the user can interact with the food storage device 3 through the terminal device 2 connected to the server 4 to operate the food storage device 3 .
  • the control device 100 may be a remote control.
  • the communication between the remote controller and the food storage device 3 includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods.
  • the food storage is controlled through wireless or other wired methods.
  • Device 3. the wireless mode can be direct connection or indirect connection, and can be routed or not.
  • the user can control the food storage device 3 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc.
  • users can control food storage equipment by inputting corresponding control instructions through the volume up and down keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, power on/off keys, etc. on the remote control. 3 functions.
  • terminal devices 2 such as mobile phones, tablets, computers, laptops, and other smart devices can also be used to control the food storage device 3 .
  • the terminal device 2 can realize connection and communication with the food storage device 3 through a network communication protocol to achieve the purpose of one-to-one control operation and data communication.
  • the food storage device 3 and the terminal device 2 also perform data communication with the server 4 through a variety of communication methods.
  • the food storage device 3 and the terminal device 2 can be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN) and other networks.
  • the server 4 can provide various contents and interactions to the food storage device 3 and the terminal device 2 .
  • the server 4 may be a cluster or multiple clusters, and may include one or more types of servers. Other network service contents such as popular recipes and cooking services are provided through server 4.
  • the food storage device 3 may be a device with intelligent management for storing food, such as a smart refrigerator, a smart freezer, a smart wine cabinet, a smart fruit and vegetable cabinet, or the like.
  • a smart refrigerator a device with intelligent management for storing food
  • a smart freezer a smart freezer
  • a smart wine cabinet a smart fruit and vegetable cabinet
  • the technical solution of this application is explained by taking the food storage device as a smart refrigerator as an example. The structure and functions of the smart refrigerator are first described in detail below.
  • FIG. 10A is a three-dimensional view of a smart refrigerator according to some exemplary embodiments of the present application.
  • the shape of the smart refrigerator provided by the embodiments of the present application is approximately a rectangular parallelepiped.
  • the smart refrigerator is defined by a storage compartment providing limited storage space and a door 1200 (1200A-1200B) provided at the opening of the storage compartment.
  • the storage room is a box with an opening.
  • the storage chamber includes a freezing chamber 1100 located below and a refrigerating chamber 1101 located above.
  • the freezing chamber 1100 and the refrigerating chamber 1101 respectively have one or more independent storage spaces, as included in the freezing chamber 1100 Drawer-type compartments, etc., as well as a plurality of storage compartments 1101A-1101B included in the refrigerator compartment 1101, the top lighting is located inside the storage compartment.
  • the refrigerating compartment 1101 is divided into left and right sides, and the left and right sides are respectively covered by doors that are pivotably installed on the box body.
  • FIG. 10A is an example of an embodiment of the present application, and the smart refrigerator shown in FIG. 10A does not constitute a limitation on the smart refrigerator provided by the present application.
  • the smart refrigerator box is divided into left and right sides, the left box is defined as the freezing chamber 1100, and the right box is defined as the refrigerating chamber 1101.
  • the freezing chamber 1100 and the refrigeration chamber are Each chamber 1101 can be covered by a door pivotably mounted on the box.
  • the storage room includes a refrigerating room 1101, a freezing room 1100, and a changing room.
  • the smart refrigerator can have a display function.
  • Figure 10B is a schematic diagram of the appearance of a smart refrigerator according to some exemplary embodiments of the present application. As shown in Figure 10B, A display is provided on the refrigerator door, and the display is embedded in the door body.
  • the refrigerator may also be provided with an ingredient detector.
  • the ingredient detector may be used to detect the type and quantity of ingredients stored in the refrigerator.
  • the ingredient detector may include a camera. The camera is installed in the refrigerated room. The interior image of the refrigerator room is analyzed, and the type and quantity of the inventory ingredients stored in the refrigerator room are obtained.
  • the ingredient detector can be a tag reader set on the refrigerator door. The tag reader has a built-in user interface. An antenna for reading RFID tags is used to identify RFID tags at close range, thereby recording the type and quantity of inventory ingredients stored in the cold storage room.
  • the plane of the display screen is flush with the outer surface of the door.
  • FIG 11 is a schematic diagram of the hardware configuration of a smart refrigerator according to some exemplary embodiments of the present application.
  • the smart refrigerator 2000 may include a display 260, a processor 250, multiple antennas 280 for detecting RFID tags, a detector 230, Memory 290 and several user input interfaces.
  • the display 260, the antenna 280, the detector 230, and the memory 290 are coupled with the processor 250 through a communication interface.
  • the display 260 is used to receive the image signal output by the processor 250, display video content and images and components of the menu control interface, and display a user control UI interface for controlling the smart refrigerator 2000.
  • the processor 250 may include one or more processing units, such as a system on a chip (SoC), a central processing unit (CPU), a microprocessor (microcontroller, MCU), a storage processor, etc. Among them, different processing units can be independent devices or integrated in one or more processors.
  • SoC system on a chip
  • CPU central processing unit
  • MCU microprocessor
  • storage processor etc.
  • different processing units can be independent devices or integrated in one or more processors.
  • the processor 250 communicates with the antenna 280 through a serial port.
  • the processor 250 includes an RFID module.
  • the RFID module, antenna 280 and RFID tag constitute an RFID reading and writing system.
  • the antenna 280 is used to transmit radio frequency signals between the RFID module and the RFID tag.
  • the RFID module completes the communication through the antenna 280. Read and write operations of RFID tags.
  • the RFID module communicates with the antenna via a serial port.
  • Memory 290 may include one or more storage units, for example, may include volatile memory (volatile memory), such as: dynamic random access memory (dynamic random access memory, DRAM), static random access memory (static random access memory) , SRAM), etc.; it can also include non-volatile memory (NVM), such as read-only memory (ROM), flash memory (flash memory), etc.
  • volatile memory volatile memory
  • DRAM dynamic random access memory
  • static random access memory static random access memory
  • SRAM static random access memory
  • NVM non-volatile memory
  • ROM read-only memory
  • flash memory flash memory
  • the memory 290 stores program instructions and application programs, such as voice applications.
  • the processor 250 can call program instructions in the memory 290 or run an application program to cause the smart refrigerator to perform related methods, such as the food label scanning method provided in the embodiment of the present application.
  • the detector 230 which at least includes a sound collector such as a microphone, may be used to receive the user's voice.
  • the voice signal includes a user's control instruction for controlling the smart refrigerator 2000 .
  • the detector 230 may also include a door switch state sensor, such as a magnetic sensitive switch or a mechanical switch, for detecting the switch signal of each door. When the switch state of the door is recorded according to the detected switch signal, a switch is sent. Status information to processor 250. For example, when the detector detects an opening signal or a closing signal of any door, the latest switch status information is sent to the processor 250 .
  • the user input interface includes at least one of a microphone, a touch pad, a sensor, a button, and other input interfaces.
  • the user can realize the user command input function through actions such as voice, touch, gesture, and pressing.
  • the input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the processor 250 .
  • the communicator 220 is used to communicate with the server or the terminal device 2 connected to the server.
  • the processor 250 may include a voice recognition module, and the voice recognition module may further include a voice parsing unit and a voice instruction database, so that the smart refrigerator can independently complete voice recognition of the voice data input by the user, and convert the recognized voice data into a voice recognition module. The process of matching voice content with voice commands in the voice command database.
  • the antenna 280 may include an antenna provided in each storage room and an antenna provided inside the tag reader, wherein the antenna provided in each storage room is mainly used to scan the RFID tags in each storage room to read the RFID tags.
  • the antenna set inside the tag reader is mainly used to scan the RFID tag on the tag reader to read the tag information of the RFID tag.
  • the power of antennas provided in different storage rooms may be different.
  • the power of the antennas in each storage room is sufficient to ensure that the antenna can recognize the food contained in its own room, thereby avoiding an increase in false recognition rates when the power is too high, and when the power is too low, the food in its own room cannot be recognized.
  • the power of the antenna can be determined in advance according to the space size of each storage room, and the power of each antenna can be set in the smart refrigerator. The larger the space, the greater the power.
  • the antenna disposed under the tag reader is called a first antenna
  • the antenna disposed in the storage room is called a second antenna
  • RFID tags can be used to identify the ingredients in the storage room. There is a corresponding relationship between the tag information of the RFID tag (such as the tag identification) and the ingredient information of the identified ingredients, thereby realizing the RFID tag Virtual association with ingredient information.
  • ingredients with RFID tags are stored in a smart refrigerator, and the RFID tag in the storage room is detected through the second antenna to obtain the tag information. The ingredients identified by the tag are determined based on the relationship between the tag information and the ingredient information. .
  • the tag information includes tag encoding, and a specific code segment in the tag encoding is the tag identification.
  • Establishing the corresponding relationship between the identification information of the RFID tag and the food material information can realize the virtual association between the RFID tag and the food material.
  • the food ingredients corresponding to the RFID tag can be determined based on the tag identification and the pre-established correspondence relationship.
  • the processor 250 implements the food material management function by running a food material management application.
  • the application interface provided by the food material management application includes: a food material management interface that can be used as the main interface of the application, and an API for establishing an association between RFID tags and food material information.
  • Tag editing interface recipe display interface for displaying recommended recipe information, etc.
  • the processor 250 starts the food management application in response to booting or a user input command to start the food management application.
  • the user can enter label editing instructions in the food management application.
  • the food management application scans the RFID tag placed by the user on the tag reader through the first antenna to obtain the tag information of the RFID tag, such as "A", and displays the tag editing interface. Users can enter ingredient information in the label editing interface to associate with "A".
  • the food material management application receives the food material information input by the user and establishes an association between the food material information and "A".
  • the food material management application When the food material management application detects the RFID tag "A” in the storage room through the second antenna, it can determine the real food materials in the storage room based on the food material information associated with "A", thereby realizing intelligent management of food materials. It should be understood that when the food material management application detects that there is an RFID tag "A” in the storage room through the second antenna, the food material associated with "A” is the existing food material in the storage room.
  • the ingredient information includes one or more of ingredient ID, ingredient name, storage location identification, ingredient quantity, ingredient shelf life, starting time, etc.
  • the storage room where the ingredient is stored can be determined based on the storage location identification. For example, if the storage location identifier contained in the ingredient information "apple” is "1", then it is determined that "apple” is stored in the refrigerator compartment. If the storage location identifier included in the ingredient information "apple” is "2", then it is determined that "apple” is stored in the refrigerator. Apples” stored in the freezer.
  • the freshness of the ingredients can be determined based on the current time, the shelf life and the starting time of the ingredients. Among them, at the beginning The time can be the real production date of the ingredients input by the user, such as the production date of bread on May 1, 2021, or it can be the time when the ingredients were put into the storage room.
  • the food material information corresponding to the existing food materials in the storage room is stored in a local food material information collection.
  • the existing food ingredients refer to the food ingredients currently stored in the smart refrigerator.
  • the above-mentioned local food material information collection may also store food material information corresponding to historical food materials.
  • the historical ingredients refer to ingredients that were stored in the smart refrigerator in the past and have been removed from the smart refrigerator at present.
  • existing food materials and historical food materials can be distinguished by storage status marks. For example, the food material information of historical food materials is marked as removed state, and the food material information of existing food materials is marked as put in state.
  • the ingredient information of existing ingredients and the ingredient information of historical ingredients are stored in different ingredient information sets.
  • the food material information of existing food materials is read from the local food material information collection, for example, the food material information whose storage status is the put-in state is read. Then the food material management interface is displayed according to the food material information of the existing food materials.
  • the food material management interface includes food material controls drawn according to the food material information, so that all the existing food materials in the smart refrigerator are displayed in the form of icons, pictures and texts.
  • various functional controls such as RFID tag editing controls, ingredient adding controls, recipe recommendation controls, etc., can also be displayed in the food material management interface for user operations to trigger the processor 250 to implement corresponding functions.
  • the smart refrigerator may also include an ingredient detector and a communicator.
  • the ingredient detector may be used to collect interior images of the smart refrigerator, and the communicator may be used to establish a connection with the server to implement information interaction with the server.
  • the smart refrigerator can obtain the image information of the ingredients inside the refrigerator through the ingredient detector, and send the image information to the server, so that the server can identify the ingredients stored inside the smart refrigerator.
  • the processor of the smart refrigerator can control the automatic identification of ingredients inside the refrigerator.
  • the processor can control the automatic identification of ingredients in the storage room every preset time period, or can control the automatic identification of ingredients in the storage room when the refrigerator door is detected. Controls the identification of ingredients inside the refrigerator when it is turned on or off.
  • the processor can also identify the ingredients in the storage room after receiving a control instruction input by the user to identify the ingredients in stock. For example, the user interface displayed on the display of the smart refrigerator displays a message for identifying the ingredients stored in the smart refrigerator. Recognized related controls, the user clicks on the control processor to perform the operation of identifying the internal ingredients.
  • the food material detector may control the collection of interior images of the smart refrigerator, where the interior images include images of food materials stored inside the smart refrigerator.
  • the food detector can include cameras, and the number of cameras can be multiple. The multiple cameras can be dispersedly distributed inside the refrigerator to ensure that interior images of every corner inside the smart refrigerator can be collected.
  • Figure 12 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments.
  • the processor can control the camera to obtain the interior image of the storage room, and in S1402
  • the server sends an ingredient identification request to the server, and the ingredient identification request includes the interior image.
  • the server can identify the stock ingredient image on the interior image to Obtain the inventory ingredient name and inventory ingredient quantity corresponding to each ingredient image on the interior image.
  • the server can generate an inventory ingredient set based on the recognized inventory ingredient name and the inventory ingredient quantity corresponding to each inventory ingredient name, and store the inventory
  • the food material set is sent to the processor.
  • the processor responds to the received stock food material set to complete the operation of identifying the internally stored food materials.
  • the ingredient detector may also include a weight measuring device for detecting ingredients at a preset position in the smart refrigerator to obtain the preset position in the refrigerator.
  • the number of weight measuring devices can also be multiple, respectively distributed at specific positions inside the refrigerator.
  • a smart refrigerator can be equipped with a fresh-keeping bin, and a weight measurer can be installed at the bottom of the fresh-keeping bin. The inside of the fresh-keeping bin can be used for Store food such as meat that cannot be accurately measured in quantity.
  • the interior image collected by the camera and the weight of the food can be sent to the server through the server.
  • the server can identify the interior image based on the weight of the food and can update the image.
  • the interior image includes "ingredient 1/600g", "ingredient 2/200g” and "ingredient 3/1kg", etc.
  • the names of the ingredients and the exact quantity of ingredients corresponding to each ingredient name can be generated based on the recognized ingredient names and the number of ingredients corresponding to each ingredient name, and the set of inventory ingredients is sent to the processor.
  • the processor receives the set of inventory ingredients to complete the identification of internally stored ingredients. operate.
  • the processor may control, based on the name of each inventory ingredient in the inventory ingredient collection, to display an ingredient control corresponding to the name of each inventory ingredient in the user interface of the display.
  • the ingredient control may be presented in the style of an inventory ingredient icon, so as to The user interface shown in Figure 13 is presented.
  • Figure 13 is a schematic diagram of a food material management interface shown in this application according to some exemplary embodiments. It is specifically an exemplary food material management interface.
  • the food material management interface can display Ingredient controls corresponding to the inventory ingredients stored in the storage room.
  • the storage room may include a refrigerator room 501 and a freezer room 502, and the inventory ingredient icons include but are not limited to corresponding inventory ingredient pictures, inventory ingredient names, inventory ingredient quantity, and inventory ingredient freshness indicators, etc.
  • the picture of the stock ingredients may be a pictographic picture of the stock ingredients, and the freshness mark of the stock ingredients is used to show any one or more of the time when the stock ingredients were put in, the remaining time until expiration, and the expiration time. It should be understood that the inventory ingredient pictures, inventory ingredient names, inventory ingredient quantities, and inventory ingredient freshness indicators may be part of the inventory ingredient icon, that is, included in the inventory ingredient icon.
  • the refrigerator processor can control the calculation of the freshness of the stored ingredients, and each time the processor detects an action of opening or closing the door, it will trigger a check of the stored ingredients in the storage room.
  • the ingredients are identified to identify whether there are newly stored ingredients in stock. If there are newly stored ingredients in inventory, the storage time and temperature of the storage location are recorded, and the inventory ingredients of the inventory ingredients are sent to the server. name and the temperature at the storage location. After the server receives the name of the inventory ingredient and the temperature at its storage location, it can analyze the shelf life of the inventory ingredient corresponding to the name of the inventory ingredient based on big data, and send the shelf life to the processor. .
  • the processor can further filter the set of inventory ingredients returned by the server.
  • the processor can calculate the freshness of each inventory ingredient based on the storage time, shelf life and current time of each inventory ingredient. The shorter the storage time of the inventory ingredient in the refrigerator, the fresher the inventory ingredient. The higher the value, the longer the storage time of the inventory ingredients in the refrigerator exceeds the shelf life, the lower the freshness.
  • the freshness of the inventory ingredients is lower than the preset threshold, it is determined that the inventory ingredients are seriously expired, and the inventory ingredients can be removed.
  • the corresponding inventory ingredient name and inventory ingredient quantity are deleted from the inventory ingredient collection, and the information shown in Figure 14 is displayed in the ingredient management interface to remind the user that the inventory ingredient has expired.
  • Figure 14 shows some exemplary examples of this application.
  • the embodiment shows a schematic diagram of another food material management interface.
  • Figure 15 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments.
  • the user can select any ingredient control in the user management interface of the display.
  • the intelligent processor sends a recipe in response to the user's selection operation on a specific ingredient control.
  • the recommendation request is sent to the server, and the recipe recommendation request includes the name of the stock ingredients and the quantity of the stock ingredients for the food control.
  • the server After the server receives the name of the stock ingredients and the quantity of the stock ingredients, it obtains the information related to the stock ingredients.
  • Several recipes that match the names of the inventory ingredients and the quantities of the inventory ingredients, and generate a recipe recommendation column in S1703 Table.
  • FIG. 16 is a schematic diagram of an intelligent side dish interface shown in this application according to some exemplary embodiments.
  • the intelligent side dish interface includes an inventory area 801, a side dish area 802, and a recipe recommendation area 803.
  • the inventory area 801 at least displays the ingredient controls corresponding to all the inventory ingredients stored in the refrigerator, and the side dish area 802 displays the ingredients selected by the user.
  • the ingredient control corresponding to the inventory ingredient, the recipe recommendation area 803 displays a recipe recommendation list returned by the server for the ingredient control selected by the user.
  • the user interface of the display shown in Figure 16 displays ingredient controls such as "Ingredients 2", “Ingredients 3", and “Ingredients 4".
  • the user selects the ingredient controls corresponding to "Ingredients 2", and the processor responds to the user's Operation, control the ingredient control corresponding to "ingredient 2" to be displayed in the side dish area 802, and send a recipe recommendation request to the server.
  • the recipe recommendation request includes the information of "ingredient 2+600g". After the server receives the information, it can Obtain several recipes made using "Ingredients 2" and generate a recipe recommendation list.
  • Recipes in which the quantity of "Ingredients 2" is less than or equal to 600g in the recipe recommendation list can be recorded in front of the recipe recommendation list. Apply “Ingredients 2" 2" Recipes with the quantity of ingredients greater than 600g can be recorded behind the recipe recommendation list.
  • the server sends the recipe recommendation list to the processor.
  • the processor can trigger as shown in Figure 16 An intelligent side dish interface.
  • the side dish area 802 in the smart side dish interface can display recipe icons corresponding to each recipe in the recipe recommendation list.
  • the recipe icons include but are not limited to recipe pictures, recipe names, etc. corresponding to the recipes. , it should be understood that the recipe picture, recipe name, etc. may be part of the recipe icon, that is, included in the recipe icon.
  • the user can select two or more food ingredient controls at the same time. For example, the user can select both the ingredient controls corresponding to "Ingredients 2" and “Ingredients 3", and the processor can control The ingredient controls corresponding to "Ingredients 2" and "Ingredients 3" are displayed in the side dish area 802, and a recipe recommendation request is sent to the server.
  • the recipe recommendation request includes the information of "Ingredients 2+600g” and “Ingredients 3+200g", and the server receives After obtaining the above information, you can obtain several recipes made using “ingredient 2" and “ingredient 3", and generate a recipe recommendation list, in which the quantity of "ingredient 2" in the recipe recommendation list is less than or equal to 600g and the application Recipes with "Ingredients 3" ingredients less than or equal to 200g can be recorded at the front of the recipe recommendation list. Recipes with "Ingredients 2" ingredients greater than 600g and “Ingredients 3" ingredients greater than 200g can be recorded in the recipe list.
  • the server sends the recipe recommendation list to the processor.
  • the processor can trigger the display of an intelligent side dish interface including the corresponding recipe recommendation list.
  • the user can select any recipe icon in the recipe recommendation list, and the processor responds to the user's operation by sending a recipe acquisition request to the server, where the recipe acquisition request includes the identification of the recipe icon selected by the user.
  • the server After the server receives the recipe acquisition request, it can match the corresponding recipe information according to the identification of the recipe icon.
  • the recipe information at least includes a set of recipe ingredients required to make the recipe, and the set of recipe ingredients includes recipe ingredients. The name and the number of ingredients for the recipe.
  • the recipe information may also include a picture of the recipe, the steps for making the recipe, etc., which are not limited by this application.
  • the server after the server matches the recipe information corresponding to the identification of the received recipe, it can send the recipe information to the smart refrigerator.
  • the refrigerator processor can trigger the display to display the recipe details.
  • Interface wherein the recipe details interface at least includes the recipe ingredient controls required for making the recipe.
  • the recipe ingredient controls can be presented in the style of recipe ingredient icons.
  • the recipe ingredient icons include but are not limited to corresponding recipe ingredient pictures, recipes Ingredient names, recipe ingredient quantities, etc. It should be understood that the recipe ingredient pictures, recipe ingredient names, recipe ingredient quantities, etc. may be part of the recipe ingredient icon, that is, included in the recipe ingredient icon.
  • the refrigerator processor can compare the name of each recipe ingredient in the recipe ingredient set with the name of the inventory ingredient in the inventory ingredient set. If there is a name in the inventory ingredient set that matches The names of inventory ingredients with the same names as the recipe ingredients indicate that the ingredient is stored in the refrigerator. The quantity of the ingredient's recipe ingredients and the quantity of the ingredient in stock are further compared to determine whether the quantity of the ingredient stored in the refrigerator meets the needs of making the recipe. If the quantity of the ingredient in stock is greater than the quantity of the recipe ingredient, an inventory mark is added to the name of the recipe ingredient corresponding to the ingredient. After comparing the recipe ingredient set and the inventory ingredient set, the recipe details interface can be triggered.
  • the item being displayed is The status of the recipe ingredient control corresponding to the name of the recipe ingredient with the added inventory mark changes to remind the user that the recipe ingredient is stored in sufficient quantity in the refrigerator to meet the needs of making the recipe.
  • the user interface can be refreshed to display the recipe details interface as shown in Figure 17 in the user interface
  • Figure 17 17 is a schematic diagram of a recipe details interface shown in this application according to some exemplary embodiments.
  • the recipe details interface displays the recipe ingredient controls marked by the inventory icon 900 and the recipe ingredient controls not marked by the inventory icon 900 .
  • the recipe details interface may also include a purchasing control 910.
  • Figure 18 is a schematic flowchart of generating a purchasing list according to some exemplary embodiments of this application.
  • the processor may respond to the user's selection operation on the purchasing control 910, and in S2002, control the comparison of the recipe ingredient set and the inventory ingredient set. If there is a recipe ingredient with the same name as the recipe ingredient in the inventory ingredient set, The name of the inventory ingredient.
  • the processor controls whether the quantity of the inventory ingredient is greater than the quantity of the recipe ingredient. If not, in S2004, the difference between the recipe ingredient and the inventory ingredient is calculated, and in S2005, according to the quantity of the recipe ingredient and The quantity difference of the quantity of ingredients in stock and the names of recipe ingredients generate the first list of information.
  • the processor may generate second list information based on the recipe ingredient name and the recipe ingredient quantity.
  • the stock ingredient set includes 1/100g of ingredients, 2/80g of ingredients, and 3/20g of ingredients
  • the recipe ingredient set includes 1/100g, 2/500g of ingredients, 3/10g of ingredients, 9/50g of ingredients, and 14/1kg of ingredients. and 15/200g of ingredients.
  • the first list information and the second purchase list can be generated.
  • the first purchase list includes 2/420g of ingredients
  • the second purchase list includes 9/50g of ingredients.
  • the purchase list interface can be triggered to be displayed based on the first list information and the second list information.
  • Figure 19 shows this
  • the application shows a schematic diagram of a purchase list interface according to some exemplary embodiments.
  • the first purchase list corresponding to the first list information and the second purchase list corresponding to the second list information are displayed on the purchase list page as shown in FIG. 19 .
  • the recipe acquisition request sent by the smart refrigerator to the server may also include the identification of the recipe icon selected by the user and the set of inventory ingredients. After the server receives the recipe acquisition request, it may match the identification of the recipe icon according to the identification of the recipe icon.
  • the recipe information at least includes a set of recipe ingredients required to make the recipe.
  • the set of recipe ingredients includes the name of the recipe ingredients and the quantity of the recipe ingredients.
  • the server can compare the set of recipe ingredients and the set of inventory ingredients. If the set of inventory ingredients There is an inventory ingredient name that is the same as the recipe ingredient name in , and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient.
  • the first list of information can be generated based on the quantity difference between the quantity of the recipe ingredient and the quantity of the inventory ingredient and the name of the recipe ingredient. If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient collection, the second list of information can be generated based on the recipe ingredient name and the recipe ingredient quantity.
  • the server may send the recipe information, the first list information, and the second list information to the smart refrigerator.
  • the refrigerator processor triggers Display the recipe details interface and/or the purchase list interface.
  • the recipe details interface at least includes the recipe ingredient controls corresponding to the recipe ingredients required when making the recipe.
  • the purchase list interface at least includes the first purchase list corresponding to the first list information and The second purchase list corresponding to the second list information.
  • the purchase list interface also includes a shopping cart control 111.
  • the processor may send a purchase request to the server, where the purchase request includes the The first list information corresponding to the first purchase list and the second list information corresponding to the second purchase list, the purchase request is used to request the server to return a purchase recommendation list, the purchase recommendation list at least includes information for the third purchase list. A list of information and a purchase link of the second list of information.
  • the smart refrigerator can control the display of the purchase recommendation list interface as shown in Figure 20 in the user interface of the display.
  • Figure 20 is This application shows a schematic diagram of a purchasing recommendation list interface according to some exemplary embodiments.
  • the purchase recommendation list interface may include the name of the ingredients, the quantity of the ingredients, the purchase link, the purchase price, etc. on the displayed purchase list.
  • the first list information and the second list information can be merged to generate the third list information, and trigger the trigger based on the third list information.
  • the purchase list interface is displayed.
  • Figure 21 is a schematic diagram of another purchase list interface shown in this application according to some exemplary embodiments.
  • the third purchase list corresponding to the third list information is displayed in the purchase list interface as shown in FIG. 21 .
  • the processor controls the comparison of the recipe ingredient set and the inventory ingredient set.
  • the recipe ingredient controls corresponding to the selected recipe ingredients can be displayed in the recipe details interface.
  • the processor can control to calculate the quantity difference between the quantity of the recipe ingredient and the quantity of the inventory ingredient, and
  • the selected recipe ingredient control displayed in the recipe details interface at least includes the name of the recipe ingredient and the difference value.
  • the recipe ingredient control corresponding to the selected recipe ingredient is still displayed in the recipe details interface.
  • the recipe ingredient control at least includes the name of the recipe ingredient and the quantity of the recipe ingredient.
  • the unselected ingredient can be displayed in the recipe details interface. Recipe ingredient controls corresponding to recipe ingredients.
  • the user can perform a selection operation on the recipe ingredient control shown in Figure 17.
  • the processor In response to the user's operation, the processor generates and displays the inventory identifier if it detects that the recipe ingredient name included in the recipe ingredient control is marked with an inventory identifier.
  • Reminder interface to remind the user that the inventory of the ingredient is sufficient. If it is detected that the name of the recipe ingredient included in the recipe ingredient control is not marked with an inventory identifier, the recipe ingredient control can be directly controlled to be in a selected state.
  • the user selects the shopping cart control in the recipe details interface.
  • the processor can generate a list of ingredients to be purchased based on the recipe ingredient control in the selected state.
  • the list information of the ingredients includes the name of the recipe ingredient corresponding to the selected recipe ingredient control and the quantity of the ingredient that needs to be purchased corresponding to the name of the recipe ingredient. and sends a purchase request to the server, the purchase request including the list information of the ingredients to be purchased, the purchase request is used to request the server to return a purchase recommendation list, the The purchase recommendation list at least includes a purchase link for the list information of the ingredients to be purchased.
  • the processor can control the display of the purchase recommendation list interface as shown in Figure 20 in the user interface of the display.
  • the recipe details interface may also include positioning controls 920 corresponding to each recipe ingredient control.
  • Figure 22 is a schematic diagram of the interaction between a smart refrigerator and a server according to some exemplary embodiments of this application. As shown in Figure 22, after the user selects any positioning control 920, in S2401, the processor responds to the user's operation and sends a positioning request to the server. The positioning request includes the name of the inventory ingredients and the information collected by the ingredient detector. Interior image, the positioning request is used to request the server to mark the position of the stock ingredient image in the interior image, and return the marked interior image. In S2402, the processor responds to receiving the marked interior image returned by the server. The marked interior image may be displayed in a user interface of the display.
  • the processor responds to the user's operation and sends a positioning request to the server.
  • the positioning request includes the ingredient name and ingredient detection of ingredient 1.
  • the interior image collected by the processor.
  • the server can mark the position of the image of ingredient 1 in the interior image and return the marked interior image.
  • the processor responds to the marked position returned by the server.
  • the interior image may be displayed in the user interface of the display after being marked as shown in Figure 23.
  • Figure 23 is a schematic diagram of the interior image according to some embodiments.
  • a detection frame 151 is displayed in the interior image, and the detection frame 151 is used to indicate the location of the food material 1 .
  • the smart refrigerator can be connected to other terminal devices through the server.
  • the terminal device can be a mobile phone, a tablet, a wearable device, or any other device with a display function.
  • the processor of the smart refrigerator can control the storage of ingredients.
  • the collection, list information corresponding to the purchase list, etc. are uploaded to the server and forwarded to the terminal device through the server.
  • the refrigerator processor responds to the sharing instruction. , can trigger the display of a user list on the user interface of the display.
  • the user list includes at least one device identification of a terminal device connected to the server.
  • the user performs a selection operation on the device identification in the user list, and the processor responds to the For the selection operation of the device identifier, a synchronization instruction may be sent to the server.
  • the synchronization instruction includes the list information corresponding to the device identifier and the purchase list.
  • the synchronization instruction is used to instruct the server to select the device identifier based on the device identifier.
  • the list information corresponding to the purchase list is sent to the terminal device, so that the purchase list can be displayed on the terminal device.
  • embodiments of the present application also provide a terminal device, including a display, a communicator, and a processor, wherein the display can display a user interface; the communicator can establish a communication connection with the server, so that the terminal device can communicate with the server through the server. Information interaction is performed with the smart refrigerator connected to the server; the processor is used to execute corresponding control programs.
  • Figure 24 is a schematic diagram of the interaction between a terminal device, a smart refrigerator and a server according to some exemplary embodiments of this application.
  • the terminal device may be installed with an application program associated with the above-mentioned smart refrigerator.
  • the application program is run and can be sent to the server.
  • the control instruction is used to cause the server to send a request for obtaining a set of stock ingredients to the smart refrigerator.
  • the smart refrigerator agrees to the set of stock ingredients.
  • the set of inventory ingredients can be sent to the server, where the set of inventory ingredients at least includes the name and quantity of the inventory ingredients corresponding to the inventory ingredients stored in the smart refrigerator; in S2603, the terminal device responds to the received
  • the set of stock ingredients returned by the server can trigger the display of a smart side dish interface in the user interface.
  • the smart side dish interface displays the stock ingredients generated based on the set of stock ingredients. controls.
  • the user performs a selection operation on any inventory ingredient control.
  • the processor can send a recipe recommendation request to the server.
  • the recipe recommendation request includes the name and quantity of the inventory ingredients corresponding to the inventory ingredient control selected by the user.
  • the server receives After the names of the stock ingredients and the quantity of the stock ingredients are obtained, several recipes matching the names of the stock ingredients and the quantity of the stock ingredients are obtained, a recipe recommendation list is generated, and the recipe recommendation list is sent to the terminal device, and the terminal
  • the device may trigger display of the recipe recommendation list, where the recipe recommendation list includes at least one recipe icon for the name of the stock ingredient and the quantity of the stock ingredient.
  • the terminal device may send a recipe acquisition request to the server, where the recipe acquisition request includes the identification of the recipe icon selected by the user, and the server receives the After the recipe acquisition request is made, the corresponding recipe information can be matched according to the identification of the recipe icon, and the recipe information is sent to the processor, where the recipe information at least includes a set of recipe ingredients required to make the recipe, so The set of recipe ingredients includes the name of the recipe ingredients and the quantity of the recipe ingredients.
  • the recipe information may also include recipe pictures, steps for making the recipe, etc., which are not limited by this application.
  • the terminal device can compare the name of each recipe ingredient in the recipe ingredient set with the name of the inventory ingredient in the inventory ingredient set. If there is a name in the inventory ingredient set that matches the name of the recipe ingredient The same name of the ingredient in stock means that the ingredient is stored in the refrigerator, and the quantity of the ingredient in the recipe and the quantity of the ingredient in stock are further compared to determine whether the quantity of the ingredient stored in the refrigerator meets the needs of making the recipe. If the ingredient The number of ingredients in the recipe is greater than the number of ingredients in stock, then the inventory identification is added to the name of the recipe ingredient corresponding to the ingredient. After comparing the recipe ingredient collection and the inventory ingredient collection, the recipe details interface can be triggered.
  • the inventory identification is added
  • the status of the recipe ingredient control corresponding to the recipe ingredient name changes. For example, a stock icon is displayed next to the recipe ingredient control to remind the user that the recipe ingredients are stored in sufficient quantities in the refrigerator to meet the needs of making the recipe.
  • the user interface can be refreshed to display the recipe details interface in the user interface, and the recipe details interface displays Recipe ingredient controls marked by the inventory icon and recipe ingredient controls not marked by the inventory icon.
  • the recipe details interface may also include a purchasing control.
  • the terminal device may compare the recipe ingredient collection and the inventory ingredient collection. If the inventory ingredient set contains the same name as the recipe ingredient, For the same inventory ingredient names, and the quantity of the recipe ingredients is greater than the quantity of the inventory ingredients, the first list of information can be generated based on the quantity difference between the quantity of the recipe ingredients and the quantity of the inventory ingredients and the names of the recipe ingredients. If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient collection, the second list of information can be generated based on the recipe ingredient name and the recipe ingredient quantity.
  • the display of the purchase list interface can be triggered based on the first list information and the second list information.
  • the first list information corresponding to the first list information can trigger the display of the purchase list interface.
  • Both the purchase list and the second purchase list corresponding to the second list information are displayed in the purchase list interface.
  • the recipe acquisition request sent by the terminal device to the server may also include the identifier of the recipe icon selected by the user.
  • the server may match the corresponding recipe information based on the identifier of the recipe icon.
  • the recipe information at least includes a set of recipe ingredients required to make the recipe
  • the set of recipe ingredients includes the name of the recipe ingredients and the quantity of the recipe ingredients.
  • the server sends a stock ingredient acquisition request to the smart refrigerator to obtain the inventory ingredients stored in the smart refrigerator. Inventory ingredient collection. After the server receives the inventory ingredient collection sent by the smart refrigerator, You can compare the recipe ingredient collection and the inventory ingredient collection.
  • the name can generate the first list of information. If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient collection, the second list of information can be generated based on the recipe ingredient name and the recipe ingredient quantity.
  • the server may send the recipe information, the first list information, and the second list information to the terminal device, and the processor of the terminal device responds to receiving the recipe information, the first list information, and the second list information. , triggering the display of the recipe details interface and/or the purchase list interface.
  • the recipe details interface at least includes the recipe ingredient controls corresponding to the recipe ingredients required when making the recipe.
  • the purchase list interface at least includes the first purchase corresponding to the first list information. list and the second purchase list corresponding to the information in the second list.
  • the purchase list interface further includes a shopping cart control.
  • the terminal device may send a purchase request to the server, where the purchase request includes the first List information and the second list information, the purchase request is used to request the server to return a purchase recommendation list, the purchase recommendation list at least includes items to be purchased in the first list information and the second list information.
  • the purchase recommendation list interface can include the first list information and the second list information corresponding to the to-be-received list. The name of the ingredients, the quantity of the ingredients, the purchase link and the purchase price of the purchased ingredients.
  • the above UI takes smart refrigerators and terminal equipment as examples respectively, and the interactive content takes smart refrigerators, servers, and smart terminals as examples.
  • the UI of other categories of smart refrigerators and terminal equipment when generating purchase lists is basically similar to the above UI, and will not be repeated here. List one.
  • the UI interface provided in this application is only an example, and the actual application and design shall prevail.
  • embodiments of the present application also provide a method for generating a purchase list, which can be executed on the smart refrigerator side, and the execution subject of the method is a processor in the smart refrigerator.
  • Methods include:
  • S100 Receive recipe selection instructions input by the user.
  • the method before receiving the recipe selection instruction input by the user, the method further includes receiving a control instruction input by the user indicating the identification of inventory ingredients; in response to the control instruction, sending an ingredient identification request to the server, the ingredient identification The request includes the interior image, and the ingredient identification request is used to request the server to identify the interior image and return the inventory ingredient set; receive the inventory ingredient set returned by the server; and according to the inventory ingredient set , displaying an ingredient control for the name of the inventory ingredient and the quantity of the inventory ingredient on the user interface of the display.
  • the method further includes receiving a user's selection operation on the food ingredient control; in response to the selection operation on the food ingredient control, sending a recipe recommendation request to the server, where the recipe recommendation request includes a selection for the food ingredient control.
  • the inventory ingredient name and the inventory ingredient quantity of the ingredient control receiving a recipe recommendation list returned by the server in response to the recipe recommendation request, the recipe recommendation list including at least one item for the ingredient name and the recipe ingredient quantity of recipes; displaying the recipe recommendation list on the user interface of the display.
  • S120 In response to the recipe selection instruction, obtain a recipe ingredient set and a stock ingredient set.
  • the recipe ingredient set includes the name of the recipe ingredient and the quantity of the recipe ingredient for the name of the recipe ingredient.
  • the set of stock ingredients includes the name of the inventory ingredient and The quantity of the inventory ingredient for the inventory ingredient name.
  • obtaining a set of recipe ingredients and a set of stock ingredients also includes if there is a name of the stock ingredient that is the same as the name of the recipe ingredient in the set of stock ingredients, and the number of the recipe ingredients is greater than the The quantity of ingredients in stock is added to the name of the recipe ingredients.
  • a list of recipe ingredients is displayed in the user interface of the display. The list of recipe ingredients at least includes all the ingredients. The name of the recipe ingredient, the quantity of the recipe ingredient, and the inventory identification added to the name of the recipe ingredient.
  • obtaining the recipe ingredient set and the inventory ingredient set further includes calculating the freshness of the inventory ingredients based on the current time and the time when the inventory ingredients are stored in the storage room; if the freshness is lower than a threshold, Then the inventory ingredient name and inventory ingredient quantity of the inventory ingredient are deleted from the inventory ingredient set.
  • obtaining the recipe ingredient set and the inventory ingredient set further includes if there is an inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, and the inventory ingredient quantity is greater than the recipe If the quantity of ingredients is determined, a positioning request is sent to the server.
  • the positioning request includes the name of the inventory ingredients and the interior image.
  • the positioning request is used to request the server to mark the position of the image of the inventory ingredients in the interior image. , and returns the marked interior image; receives the marked interior image returned by the server; and displays the interior image in the user interface of the display.
  • the method further includes sending a purchase request to the server, the purchase request including the first list information and the second list information, and the purchase request is used to request the server to return a purchase request.
  • Recommendation list the purchase recommendation list at least includes purchase links for the first list information and the second list information; receiving the purchase recommendation list returned by the server; displaying the purchase in the user interface of the display Recommended list.
  • the method further includes receiving a sharing instruction input by the user indicating sharing of the purchase list; in response to the sharing instruction, displaying a user list on the user interface of the display, the user list including connecting to the server the device identification of the terminal device; receiving the user's selection operation on the device identification in the user list; in response to the selection operation on the device identification, sending a synchronization instruction to the server, where the synchronization instruction includes the device identification, the first list information and the second list information.
  • the synchronization instruction is used to instruct the server to send the first list information and the second list information to the server according to the device identification. Terminal Equipment.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Multimedia (AREA)
  • Tourism & Hospitality (AREA)
  • Human Resources & Organizations (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Computer Interaction (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present application discloses an electronic device and a data processing method. The electronic device comprises: a display, used for displaying content; a communicator, used for communicating with an external device; a processor, the processor being communicatively connected to the display, and the processor being configured to: determine food ingredient request information in response to a recipe recommendation operation, the food ingredient request information being used for obtaining food ingredient information locally stored by a food ingredient storage device; obtain a recipe according to the food ingredient information; and control the display to display the recipe. Recipe recommendations matching actual food ingredients can be displayed.

Description

一种电子设备及数据处理方法An electronic device and data processing method
相关申请的交叉引用Cross-references to related applications
本申请要求在2022年04月22日提交、申请号为202210429991.X的中国专利申请的优先权，其全部内容通过引用结合在本申请中；在2022年07月18日提交、申请号为202210842481.5的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims priority to the Chinese patent application submitted on April 22, 2022, with application number 202210429991. priority of the Chinese patent application, the entire content of which is incorporated into this application by reference.
技术领域Technical field
本申请涉及显示技术领域，尤其涉及一种电子设备及数据处理方法。The present application relates to the field of display technology, and in particular, to an electronic device and a data processing method.
背景技术Background technique
目前用户经常买很多菜却不知道可以制作什么菜，菜谱推荐可以让用户清晰明了的看到自己买的食材对应的食谱，从而选择自己喜欢的菜式来烹饪。Currently, users often buy a lot of vegetables but don’t know what they can make. Recipe recommendations allow users to clearly see the recipes corresponding to the ingredients they bought, so they can choose their favorite dishes to cook.
在目前的设备中，菜谱推荐是体现智能化的重要功能，但是如果无法基于用户实际存放的食材进行菜谱推荐，导致仅能展示默认推荐，造成严重脱离实际食材信息的问题。In current devices, recipe recommendation is an important function that embodies intelligence. However, if recipe recommendations cannot be based on the ingredients actually stored by the user, only default recommendations can be displayed, causing a serious problem that is far from the actual ingredient information.
如何能够展示与实际食材匹配的菜谱推荐值得研究。How to display recipe recommendations that match actual ingredients is worth studying.
发明内容Contents of the invention
本申请提供了一种电子设备及数据处理方法。This application provides an electronic device and a data processing method.
本申请实施例公开了一种电子设备，包括：显示器，用于显示内容；通信器，用于与外部设备通信；处理器，所述处理器与所述显示器通信连接，所述处理器被配置为：响应于菜谱推荐的操作，确定食材请求信息，所述食材请求信息用于获取食材存储设备在本地存储的食材信息；根据所述食材信息获取菜谱；控制所述显示器展示所述菜谱。An embodiment of the present application discloses an electronic device, including: a display, used to display content; a communicator, used to communicate with external devices; a processor, the processor is communicatively connected to the display, and the processor is configured The steps are: in response to the operation of recipe recommendation, determine the ingredient request information, and the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device; obtain the recipe according to the ingredient information; and control the display to display the recipe.
本申请实施例公开了一种数据处理方法，包括：电子设备响应于菜谱推荐的操作，确定食材请求信息，所述食材请求信息用于获取食材存储设备在本地存储的食材信息；根据所述食材信息获取菜谱；所述电子设备控制其显示器展示所述菜谱。An embodiment of the present application discloses a data processing method, which includes: an electronic device determines ingredient request information in response to an operation of recipe recommendation, and the ingredient request information is used to obtain ingredient information stored locally by an ingredient storage device; according to the ingredient The information obtains the recipe; the electronic device controls its display to display the recipe.
附图说明Description of the drawings
图1为本申请根据一些示例性的实施例示出的显示设备与控制装置之间操作场景的示意图；Figure 1 is a schematic diagram of an operation scenario between a display device and a control device according to some exemplary embodiments of the present application;
图2为本申请根据一些示例性的实施例示出的控制装置100的硬件配置框图；Figure 2 is a hardware configuration block diagram of the control device 100 shown in this application according to some exemplary embodiments;
图3为本申请根据一些示例性的实施例示出的显示设备200的硬件配置框图；Figure 3 is a hardware configuration block diagram of the display device 200 shown in this application according to some exemplary embodiments;
图4A为本申请根据一些示例性的实施例示出的数据处理方法的流程示意图之一；Figure 4A is one of the flow diagrams of the data processing method shown in this application according to some exemplary embodiments;
图4B为本申请根据一些示例性的实施例示出的数据处理方法的流程示意图之二；Figure 4B is the second schematic flowchart of the data processing method shown in this application according to some exemplary embodiments;
图5为本申请根据一些示例性的实施例示出的菜谱推荐界面的显示效果示意图；Figure 5 is a schematic diagram of the display effect of the recipe recommendation interface shown in this application according to some exemplary embodiments;
图6为本申请根据一些示例性的实施例示出的获取设备的局域网地址的示意性流程图；Figure 6 is a schematic flow chart of obtaining the LAN address of a device according to some exemplary embodiments of this application;
图7为本申请根据一些示例性的实施例示出的局域网内设备的通信连接关系示意图；Figure 7 is a schematic diagram of the communication connection relationship of devices in the local area network shown in this application according to some exemplary embodiments;
图8为本申请根据一些示例性的实施例示出的又一例数据处理方法的流程示意图；Figure 8 is a schematic flowchart of another example of a data processing method shown in this application according to some exemplary embodiments;
图9为本申请根据一些示例性的实施例示出的智能冰箱的使用场景图；Figure 9 is a usage scenario diagram of a smart refrigerator shown in this application according to some exemplary embodiments;
图10A为本申请根据一些示例性的实施例示出的智能冰箱立体图； Figure 10A is a perspective view of a smart refrigerator shown in this application according to some exemplary embodiments;
图10B为本申请根据一些示例性的实施例示出的智能冰箱外观示意图；Figure 10B is a schematic diagram of the appearance of a smart refrigerator according to some exemplary embodiments of the present application;
图11为本申请根据一些示例性的实施例示出的智能冰箱硬件配置示意图；Figure 11 is a schematic diagram of the hardware configuration of a smart refrigerator shown in this application according to some exemplary embodiments;
图12为本申请根据一些示例性的实施例示出的智能冰箱与服务器之间的交互示意图；Figure 12 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments;
图13为本申请根据一些示例性的实施例示出的一种食材管理界面的示意图；Figure 13 is a schematic diagram of an ingredient management interface shown in this application according to some exemplary embodiments;
图14为本申请根据一些示例性的实施例示出的另一种食材管理界面的示意图；Figure 14 is a schematic diagram of another food material management interface shown in this application according to some exemplary embodiments;
图15为本申请根据一些示例性的实施例示出的智能冰箱与服务器之间的交互示意图；Figure 15 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments;
图16为本申请根据一些示例性的实施例示出的一种智能配菜界面的示意图；Figure 16 is a schematic diagram of an intelligent dish preparation interface shown in this application according to some exemplary embodiments;
图17为本申请根据一些示例性的实施例示出的一种菜谱详情界面的示意图；Figure 17 is a schematic diagram of a recipe details interface shown in this application according to some exemplary embodiments;
图18为本申请根据一些示例性的实施例示出的生成采购清单的流程示意图；Figure 18 is a schematic flow chart of generating a purchase list according to some exemplary embodiments of this application;
图19为本申请根据一些示例性的实施例示出的一种采购清单界面的示意图；Figure 19 is a schematic diagram of a purchase list interface shown in this application according to some exemplary embodiments;
图20为本申请根据一些示例性的实施例示出的采购推荐列表界面的示意图；Figure 20 is a schematic diagram of the procurement recommendation list interface shown in this application according to some exemplary embodiments;
图21为本申请根据一些示例性的实施例示出的另一种采购清单界面的示意图；Figure 21 is a schematic diagram of another purchase list interface shown in this application according to some exemplary embodiments;
图22为本申请根据一些示例性的实施例示出的智能冰箱与服务器之间的交互示意图；Figure 22 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments;
图23为本申请根据一些示例性的实施例示出的内景图像的示意图；Figure 23 is a schematic diagram of an interior image shown in this application according to some exemplary embodiments;
图24为本申请根据一些示例性的实施例示出的终端设备、智能冰箱与服务器之间的交互示意图。Figure 24 is a schematic diagram of the interaction between a terminal device, a smart refrigerator and a server according to some exemplary embodiments of this application.
具体实施方式Detailed ways
为使本申请的目的和实施方式更加清楚，下面将结合本申请示例性实施例中的附图，对本申请示例性实施方式进行清楚、完整地描述，显然，描述的示例性实施例仅是本申请一部分实施例，而不是全部的实施例。In order to make the purpose and implementation of the present application clearer, the exemplary embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only for the purpose of this application. Apply for some of the embodiments, not all of them.
需要说明的是，本申请中对于术语的简要说明，仅是为了方便理解接下来描述的实施方式，而不是意图限定本申请的实施方式。除非另有说明，这些术语应当按照其普通和通常的含义理解。It should be noted that the brief description of terms in this application is only to facilitate understanding of the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood according to their ordinary and usual meaning.
图1为本申请根据一些示例性的实施例示出的显示设备与控制装置之间操作场景的示意图。如图1所示，用户可通过终端设备2或控制装置100操作显示设备200。FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to some exemplary embodiments of the present application. As shown in FIG. 1 , the user can operate the display device 200 through the terminal device 2 or the control device 100 .
在一些实施例中，控制装置100可以是遥控器，遥控器和显示设备的通信包括红外协议通信或蓝牙协议通信，及其他短距离通信方式，通过无线或有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入、控制面板输入等输入用户指令，来控制显示设备200。In some embodiments, the control device 100 may be a remote controller. The communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods to control the display device 200 through wireless or wired methods. The user can control the display device 200 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc.
在一些实施例中，也可以使用终端设备2(如移动终端、平板电脑、计算机、笔记本电脑等)以控制显示设备200。例如，使用在终端设备上运行的应用程序控制显示设备200。In some embodiments, a terminal device 2 (such as a mobile terminal, a tablet, a computer, a laptop, etc.) can also be used to control the display device 200 . For example, the display device 200 is controlled using an application program running on the terminal device.
在一些实施例中，显示设备200还可以采用除了控制装置100和终端设备2之外的方式进行控制，例如，可以通过显示设备200设备内部配置的获取语音指令的模块直接接收用户的语音指令控制，也可以通过显示设备200设备外部设置的语音控制设备来接收用户的语音指令控制。In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the terminal device 2. For example, the display device 200 can directly receive the user's voice command control through a module configured inside the display device 200 to obtain voice commands. , the user's voice command control can also be received through a voice control device provided outside the display device 200 .
在一些实施例中，显示设备200还与服务器4进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器4可以向显示设备200提供各种内容和互动。服务器4可以是一个集群，也可以是多个集群，可以包括一类或多类服务器。 In some embodiments, the display device 200 also communicates data with the server 4 . The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 4 can provide various contents and interactions to the display device 200. Server 4 may be a cluster or multiple clusters, and may include one or more types of servers.
图2为本申请根据一些示例性的实施例示出的控制装置100的配置框图。如图2所示，控制装置100包括控制器110、通信接口130、用户输入/输出接口140、存储器、供电电源。控制装置100可接收用户的输入操作指令，且将操作指令转换为显示设备200可识别和响应的指令，起到用户与显示设备200之间交互中介作用。FIG. 2 is a configuration block diagram of the control device 100 shown in this application according to some exemplary embodiments. As shown in Figure 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control device 100 can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, thus serving as an interactive mediator between the user and the display device 200 .
图3为本申请根据一些示例性的实施例示出的显示设备200的硬件配置框图。FIG. 3 is a hardware configuration block diagram of the display device 200 shown in this application according to some exemplary embodiments.
在一些实施例中，显示设备200包括调谐解调器210、通信器220、检测器230、外部装置接口240、处理器250、显示器260、音频输出接口270、存储器、供电电源、用户接口中的至少一种。In some embodiments, the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a processor 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface. At least one.
在一些实施例中处理器包括处理器，视频处理器，音频处理器，图形处理器，RAM，ROM，用于输入/输出的第一接口至第n接口。In some embodiments the processor includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, first to nth interfaces for input/output.
在一些实施例中，显示器260包括用于呈现画面的显示屏组件，以及驱动图像显示的驱动组件，用于接收源自处理器输出的图像信号，进行显示视频内容、图像内容以及菜单操控界面的组件以及用户操控UI界面。In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, for receiving image signals output from the processor, and displaying video content, image content, and menu control interfaces. Components and user control UI interface.
在一些实施例中，显示器260可为液晶显示器、OLED显示器、以及投影显示器，还可以为一种投影装置和投影屏幕。In some embodiments, the display 260 can be a liquid crystal display, an OLED display, a projection display, or a projection device and a projection screen.
在一些实施例中，通信器220是用于根据各种通信协议类型与外部设备或服务器进行通信的组件。例如：通信器可以包括Wifi模块，蓝牙模块，有线以太网模块等其他网络通信协议芯片或近场通信协议芯片，以及红外接收器中的至少一种。显示设备200可以通过通信器220与外部控制装置100或服务器4建立控制信号和数据信号的发送和接收。In some embodiments, communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 4 through the communicator 220 .
在一些实施例中，用户接口，可用于接收控制装置100(如：红外遥控器等)的控制信号。In some embodiments, the user interface may be used to receive control signals from the control device 100 (such as an infrared remote control, etc.).
在一些实施例中，检测器230用于采集外部环境或与外部交互的信号。例如，检测器230包括光接收器，用于采集环境光线强度的传感器；或者，检测器230包括图像采集器，如摄像头，可以用于采集外部环境场景、用户的属性或用户交互手势，再或者，检测器230包括声音采集器，如麦克风等，用于接收外部声音。In some embodiments, the detector 230 is used to collect signals from the external environment or interactions with the outside. For example, the detector 230 includes a light receiver, a sensor used to collect ambient light intensity; or the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
在一些实施例中，外部装置接口240可以包括但不限于如下：高清多媒体接口(HDMI)、模拟或数据高清分量输入接口(分量)、复合视频输入接口(CVBS)、USB输入接口(USB)、RGB端口等任一个或多个接口。也可以是上述多个接口形成的复合性的输入/输出接口。In some embodiments, the external device interface 240 may include, but is not limited to, the following: High Definition Multimedia Interface (HDMI), Analog or Data High Definition Component Input Interface (Component), Composite Video Input Interface (CVBS), USB Input Interface (USB), RGB port and any one or more interfaces. It can also be a composite input/output interface formed by the above-mentioned multiple interfaces.
在一些实施例中，调谐解调器210通过有线或无线接收方式接收广播电视信号，以及从多个无线或有线广播电视信号中解调出音视频信号，如EPG数据信号。In some embodiments, the tuner-demodulator 210 receives broadcast television signals through wired or wireless reception methods, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.
在一些实施例中，处理器250和调谐解调器210可以位于不同的分体设备中，即调谐解调器210也可在处理器250所在的主体设备的外置设备中，如外置机顶盒等。In some embodiments, the processor 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the processor 250 is located, such as an external set-top box. wait.
在一些实施例中，处理器250，通过存储在存储器上中各种软件控制程序，来控制显示设备的工作和响应用户的操作。处理器250控制显示设备200的整体操作。例如：响应于接收到用于选择在显示器260上显示UI对象的用户命令，处理器250便可以执行与由用户命令选择的对象有关的操作。In some embodiments, the processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The processor 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on display 260, processor 250 may perform operations related to the object selected by the user command.
在一些实施例中，所述对象可以是可选对象中的任何一个，例如超链接、图标或其他可操作的控件。与所选择的对象有关操作有：显示连接到超链接页面、文档、图像等操作，或者执行与所述图标相对应程序的操作。In some embodiments, the object may be any of selectable objects, such as a hyperlink, an icon, or other operable control. Operations related to the selected object include: displaying a link to a hyperlinked page, document, image, etc., or executing a program corresponding to the icon.
在一些实施例中处理器包括中央处理器(Central Processing Unit，CPU)，视频处理器， 音频处理器，图形处理器(Graphics Processing Unit，GPU)，RAM(Random Access Memory，RAM)，ROM(Read-Only Memory，ROM)，用于输入/输出的第一接口至第n接口，通信总线(Bus)等中的至少一种。In some embodiments, the processor includes a central processing unit (CPU), a video processor, Audio processor, Graphics Processing Unit (GPU), RAM (Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first interface to nth interface for input/output, communication bus (Bus) and so on.
CPU处理器，用于执行存储在存储器中操作***和应用程序指令，以及根据接收外部输入的各种交互指令，来执行各种应用程序、数据和内容，以便最终显示和播放各种音视频内容。CPU处理器，可以包括多个处理器。如，包括一个主处理器以及一个或多个子处理器。The CPU processor is used to execute operating system and application program instructions stored in the memory, and to execute various application programs, data and content according to various interactive instructions received from external inputs, so as to ultimately display and play various audio and video contents. . CPU processor, which can include multiple processors. For example, it includes a main processor and one or more sub-processors.
在一些实施例中，视频处理器，用于将接收外部视频信号，根据输入信号的标准编解码协议，进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等视频处理，可得到显示设备200上显示或播放的信号。In some embodiments, the video processor is configured to receive an external video signal and perform decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal. Through processing, the signal displayed or played on the display device 200 can be obtained.
在一些实施例中，音频处理器，用于接收外部的音频信号，根据输入信号的标准编解码协议，进行解压缩和解码，以及降噪、数模转换、和放大处理等处理，得到可以在扬声器中播放的声音信号。In some embodiments, the audio processor is used to receive external audio signals, perform decompression and decoding according to the standard codec protocol of the input signal, as well as noise reduction, digital-to-analog conversion, and amplification processing to obtain the result. A sound signal played from a speaker.
在一些实施例中，用户可在显示器260上显示的图形用户界面(GUI)输入用户命令，则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者，用户可通过输入特定的声音或手势输入用户命令，则用户输入接口通过传感器识别出声音或手势，来接收用户输入命令。In some embodiments, the user may input user commands in a graphical user interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
基于上述显示设备200，若显示设备200无法基于用户实际存放的食材进行菜谱推荐，则向用户推荐的菜谱只能是默认推荐的菜谱，与用户的实际食材不符，不够智能化。Based on the above display device 200, if the display device 200 cannot recommend recipes based on the ingredients actually stored by the user, the recipes recommended to the user can only be the default recommended recipes, which are inconsistent with the user's actual ingredients and are not intelligent enough.
为了解决上述问题，本申请一些实施例中提供了一种电子设备及数据处理方法。In order to solve the above problems, some embodiments of the present application provide an electronic device and a data processing method.
下面结合附图，来介绍本申请一些实施例提供的菜谱推荐的过程。The recipe recommendation process provided by some embodiments of the present application will be introduced below with reference to the accompanying drawings.
图4A为本申请根据一些示例性的实施例示出的数据处理方法的流程示意图之一。本申请中的电子设备可以是显示设备，也可以是食材存储设备等具有食材管理功能的设备。数据可包括与菜谱相关的数据，与食材处理相关的数据处理等等。本申请在一些实施例中提供了一种显示设备，该显示设备200包括显示器260、通信器220和处理器250，所述处理器250与所述显示器260通信连接，所述通信器220用于与外部设备通信，所述处理器250被配置为执行图4A中的数据处理的过程。结合图4A，该数据处理的过程如下：Figure 4A is one of the schematic flow diagrams of the data processing method shown in this application according to some exemplary embodiments. The electronic device in this application may be a display device, or a device with a food management function such as a food storage device. Data may include data related to recipes, data processing related to ingredient processing, etc. In some embodiments, the present application provides a display device. The display device 200 includes a display 260, a communicator 220, and a processor 250. The processor 250 is communicatively connected to the display 260, and the communicator 220 is used to In communication with an external device, the processor 250 is configured to perform the data processing process in FIG. 4A. Combined with Figure 4A, the data processing process is as follows:
S210，显示设备200响应于菜谱推荐的操作，确定食材请求信息，所述食材请求信息用于获取食材存储设备在本地存储的食材信息。S210, the display device 200 determines the ingredient request information in response to the operation of recipe recommendation, and the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device.
S220，显示设备200根据所述食材信息获取菜谱。S220: The display device 200 obtains recipes according to the ingredient information.
S230，控制所述显示器展示所述菜谱。S230. Control the display to display the recipe.
其中显示设备和食材存储设备可以是同一设备，也可以是不同的设备。若显示设备不是食材存储设备，例如电视等非存放食材的设备则无法基于用户实际存放的食材进行菜谱推荐，导致仅能展示默认推荐，造成严重脱离实际食材信息的问题。如何能够在非存放食材的设备展示与实际食材匹配的菜谱推荐值得研究。The display device and the food storage device may be the same device or different devices. If the display device is not an ingredient storage device, such as a TV or other devices that do not store ingredients, it cannot recommend recipes based on the ingredients actually stored by the user. As a result, only default recommendations can be displayed, which seriously deviates from the actual ingredient information. It is worth studying how to display recipe recommendations that match actual ingredients on equipment that does not store ingredients.
为了解决上述问题，本申请一些实施例中提供了一种显示设备与食材存储设备非同一设备的数据处理方法。In order to solve the above problem, some embodiments of the present application provide a data processing method in which the display device and the food storage device are not the same device.
图4B为本申请根据一些示例性的实施例示出的数据处理方法的流程示意图之二。Figure 4B is the second schematic flowchart of the data processing method shown in this application according to some exemplary embodiments.
若所述显示设备与所述食材存储设备非同一设备，如图4B所示，执行以下步骤：If the display device and the food storage device are not the same device, as shown in Figure 4B, perform the following steps:
S310，显示设备200响应于菜谱推荐的操作，获取食材存储设备的局域网地址。 S310. The display device 200 responds to the operation of recipe recommendation and obtains the local area network address of the ingredient storage device.
其中，食材存储设备指的是用于存放食材的设备，并且具有存储食材信息的食材管理模块。当用户进行食材的增加、删除、修改等操作时，均是对食材管理模块在本地存储的食材信息进行操作。本申请对食材存储设备的数量不作限定。即显示设备200可获取一个食材存储设备的局域网地址，也可以获取多个食材存储设备的局域网地址。Among them, the food storage device refers to a device used to store food, and has a food management module that stores food information. When the user performs operations such as adding, deleting, or modifying ingredients, the operation is performed on the ingredient information stored locally by the ingredient management module. This application does not limit the number of food storage devices. That is, the display device 200 can obtain the LAN address of one food storage device or the LAN addresses of multiple food storage devices.
例如，显示设备200可以为用户进行菜谱推荐，图5为本申请根据一些示例性的实施例示出的菜谱推荐界面的显示效果示意图。如图5所示，界面上提供了“推荐菜谱”、“菜谱分类”、“菜谱收藏”和“美食圈”几种功能的界面选择，用户可以根据需要选择其中一种界面查看。例如选择“推荐菜谱”功能后，显示设备200响应于该菜谱推荐的操作展示了菜谱推荐列表，用户可在此界面上选择自己要烹饪的菜谱。For example, the display device 200 can recommend recipes for the user. FIG. 5 is a schematic diagram of the display effect of the recipe recommendation interface shown in this application according to some exemplary embodiments. As shown in Figure 5, the interface provides interface choices for several functions such as "Recommended Recipes", "Recipe Classification", "Recipe Collection" and "Food Circle". Users can choose one of the interfaces to view according to their needs. For example, after selecting the "recipe recommendation" function, the display device 200 displays a recipe recommendation list in response to the recipe recommendation operation, and the user can select the recipe he wants to cook on this interface.
例如，局域网地址为设备在局域网内的互联网协议(Internet Protocol Address，IP)地址。例如，该局域网为覆盖家庭区域的局域网。For example, the LAN address is the Internet Protocol (IP) address of the device within the LAN. For example, the local area network is a local area network covering a home area.
例如，食材信息包括食材类别、食材名称、食材的存入时间和食材的保质期等。For example, the ingredient information includes ingredient category, ingredient name, ingredient storage time, ingredient shelf life, etc.
其中，食材的保质期指的是，该食材可存储或者保存的时间，例如3天、24小时等等。Among them, the shelf life of food ingredients refers to the time that the food ingredients can be stored or preserved, such as 3 days, 24 hours, etc.
图6为本申请根据一些示例性的实施例示出的获取设备的局域网地址的示意性流程图。在一个示例中，处理器250获取食材存储设备的局域网地址的流程如图6所示：Figure 6 is a schematic flow chart of obtaining the LAN address of a device according to some exemplary embodiments of this application. In one example, the process for the processor 250 to obtain the LAN address of the food storage device is as shown in Figure 6:
S311，显示设备200确定地址请求信息，该地址请求信息用于获取食材存储设备的局域网地址。S311. The display device 200 determines the address request information, which is used to obtain the local area network address of the food storage device.
显示设备200的处理器250确定所述显示设备200的局域网地址，接着根据该显示设备200的局域网地址确定地址请求信息。其中，该地址请求信息包括所述显示设备200的局域网地址和第一信息类型，该第一信息类型表示发现在线的食材存储设备。The processor 250 of the display device 200 determines the LAN address of the display device 200, and then determines the address request information according to the LAN address of the display device 200. The address request information includes the local area network address of the display device 200 and a first information type. The first information type indicates that an online food storage device has been found.
S312，显示设备200发送该地址请求信息。S312. The display device 200 sends the address request information.
具体地，显示设备200通过通信器220以组播或广播的方式在其接入的局域网内发送该地址请求信息。Specifically, the display device 200 sends the address request information in the local area network it accesses through the communicator 220 in a multicast or broadcast manner.
S313，显示设备200接收地址响应信息，该地址响应信息包括食材存储设备的局域网地址。S313. The display device 200 receives address response information, which includes the local area network address of the food storage device.
该局域网内的在线的其他设备接收到地址请求信息后，根据该地址请求信息确定地址响应信息，其他设备向该显示设备200发送地址响应信息。After receiving the address request information, other online devices in the local area network determine address response information based on the address request information, and the other devices send address response information to the display device 200 .
上述方式中，处理器250通过向接入同一局域网的设备发送地址请求信息，该地址请求信息包括第一信息类型，该第一信息类型表示发现在线的食材存储设备，可使得其他设备根据该第一信息类型确定本设备是否为食材存储设备；该地址请求信息还包括所述显示设备200的局域网地址，可使得其他设备根据显示设备200的局域网地址向其发送本设备的局域网地址。由于显示设备200通过组播或广播的方式使得接入同一局域网的设备通过上述方式能够接收到地址请求信息，能够准确有效地获取该局域网内所有食材存储设备的局域网地址。In the above method, the processor 250 sends address request information to devices connected to the same local area network. The address request information includes a first information type. The first information type indicates that the online food storage device is found, so that other devices can be configured according to the first information type. An information type determines whether the device is a food storage device; the address request information also includes the LAN address of the display device 200, which can cause other devices to send the LAN address of the device to them based on the LAN address of the display device 200. Since the display device 200 enables devices connected to the same local area network to receive address request information through multicast or broadcast, the LAN addresses of all food storage devices in the local area network can be accurately and effectively obtained.
在一些实施例中，地址请求信息包含于用户数据报协议(User Datagram Protocol，UDP)格式的数据包中被传输。In some embodiments, the address request information is transmitted in a data packet in User Datagram Protocol (UDP) format.
在一个示例中，局域网内的在线的设备确定并发送地址响应信息的方式包括：接入该局域网的设备接收到地址请求信息后，根据地址请求信息中的第一信息类型，基于包管理器(Package Manager)确定本设备是否为食材存储设备，若本设备是食材存储设备，则确定地址响应信息，该地址响应信息包括本设备的局域网地址。然后接入该局域网的设备根 据地址请求信息中的显示设备200的局域网地址向该显示设备200以单播的方式发送该地址响应信息，其中，该地址响应信息包含于UDP格式的数据包中被传输。In one example, the way for an online device in the local area network to determine and send the address response information includes: after the device accessing the local area network receives the address request information, based on the first information type in the address request information, based on the packet manager ( Package Manager) determines whether the device is a food storage device. If the device is a food storage device, determines the address response information. The address response information includes the LAN address of the device. Then connect the device root of the LAN The address response information is sent to the display device 200 in a unicast manner according to the LAN address of the display device 200 in the address request information, where the address response information is included in a data packet in UDP format and transmitted.
该地址响应信息还包括第二信息类型，该第二信息类型表示发送该地址响应信息的设备是有食材管理功能的食材存储设备。The address response information also includes a second information type, and the second information type indicates that the device sending the address response information is an ingredient storage device with an ingredient management function.
由于显示设备200在发送地址请求信息后，接收到的地址响应信息是食材存储设备发送的，可默认发送该地址响应信息的设备具有食材管理功能，因此，地址响应信息可以不包括上述第二信息类型。若地址响应信息还包括第二信息类型，则进一步保障了发送该地址响应信息的设备是具有食材管理功能的食材存储设备。Since the address response information received by the display device 200 after sending the address request information is sent by the food storage device, the device that sends the address response information may have the food management function by default. Therefore, the address response information may not include the above-mentioned second information. type. If the address response information also includes the second information type, it is further ensured that the device sending the address response information is a food storage device with a food management function.
该地址响应信息还包括食材存储设备的登录账号信息，登录账号信息包括用户标识，还可以包括家庭信息，其中，家庭信息用于区分同一个用户账号下的不同的家庭。每个设备在登录并建立与服务器的通信连接后，服务器会向该设备同步其用户的登录账号信息。The address response information also includes the login account information of the food storage device. The login account information includes the user ID and may also include family information, where the family information is used to distinguish different families under the same user account. After each device logs in and establishes a communication connection with the server, the server will synchronize its user's login account information to the device.
家庭信息包括该设备所位于的家庭的地址，或服务器(或者用户)对该设备所位于的家庭所作的标识。The home information includes the address of the home where the device is located, or the identification made by the server (or the user) of the home where the device is located.
S320，显示设备200确定食材请求信息，该食材请求信息用于获取该食材存储设备在本地存储的食材信息。S320, the display device 200 determines the food material request information, and the food material request information is used to obtain the food material information stored locally by the food material storage device.
具体地，显示设备200根据该显示设备的局域网地址确定上述食材请求信息。其中，食材请求信息包括显示设备200的局域网地址和第三信息类型，该第三信息类型用于表示获取该食材存储设备本地存储的食材信息。Specifically, the display device 200 determines the above food ingredient request information according to the local area network address of the display device. The food material request information includes the local area network address of the display device 200 and a third information type. The third information type is used to represent obtaining the food material information stored locally in the food material storage device.
S330，显示设备200发送食材请求信息。S330. The display device 200 sends food ingredient request information.
具体地，显示设备200根据食材存储设备的局域网地址发送食材请求信息。Specifically, the display device 200 sends the food material request information according to the local area network address of the food material storage device.
在一个示例中，该处理器250获取食材存储设备发送的地址响应信息后，确定该显示设备200的登录账号信息和该食材存储设备的登录账号信息是否相同，若相同，则确定该食材存储设备为食材来源设备，然后根据该食材来源设备的局域网地址通过单播的方式向该食材来源设备发送食材请求信息。若不同，则确定该食材存储设备为非食材来源设备，并删除本地有关该设备的地址响应信息。In one example, after obtaining the address response information sent by the food storage device, the processor 250 determines whether the login account information of the display device 200 and the login account information of the food storage device are the same. If they are the same, then determines whether the login account information of the food storage device is the same. is the food source device, and then sends food request information to the food source device in a unicast manner according to the LAN address of the food source device. If they are different, the food storage device is determined to be a non-food source device, and the local address response information about the device is deleted.
在一些实施例中，登录账号信息包括用户的标识，处理器250确定该显示设备200的用户标识是否和该食材存储设备的用户标识相同。若相同，则确定该食材存储设备为食材来源设备。In some embodiments, the login account information includes the user's identification, and the processor 250 determines whether the user identification of the display device 200 is the same as the user identification of the food storage device. If they are the same, the food storage device is determined to be the food source device.
在一些实施例中，登录账号信息包括用户的标识和家庭信息，处理器250确定该显示设备200的用户标识是否和该食材存储设备的用户标识相同，并且确定该显示设备200的家庭信息是否和该食材存储设备的家庭信息相同，若两者都相同，则确定该食材存储设备为食材来源设备。In some embodiments, the login account information includes the user's identification and family information. The processor 250 determines whether the user identification of the display device 200 is the same as the user identification of the food storage device, and determines whether the family information of the display device 200 is the same as that of the food storage device. The household information of the food storage device is the same. If both are the same, the food storage device is determined to be the food source device.
上述方式通过确定显示设备200的用户标识和食材存储设备的用户标识是否相同，来确定该食材存储设备与显示设备200是否是同一用户的设备，这样能够从食材存储设备中筛选出该用户下的能够提供食材信息的有效设备，而不是其他用户的设备。根据两者家庭信息是否相同能够进一步提高筛选出的设备的准确性。从而向食材存储设备发送食材请求信息，能够获取精确的该用户家庭中存放的食材信息。The above method determines whether the food storage device and the display device 200 are devices of the same user by determining whether the user ID of the display device 200 and the user ID of the food storage device are the same. In this way, the user's information can be filtered out from the food storage device. A valid device that provides ingredient information, not another user's device. The accuracy of the filtered devices can be further improved based on whether the two family information are the same. Thus, the food material request information is sent to the food material storage device, and accurate food material information stored in the user's home can be obtained.
在一个示例中，若显示设备200具有食材管理功能，则获取本机上的食材管理模块上的本机食材信息，并将该本机食材信息和从其他设备上获取的食材信息合并后向服务器发送。在该方式中，即使该显示设备200能够存放食材，那么通过合并其他设备的食材信息， 从而获取的综合推荐的菜谱会更加全面。In one example, if the display device 200 has an ingredient management function, the local ingredient information on the ingredient management module on the local device is obtained, and the local ingredient information and the ingredient information obtained from other devices are merged and then sent to the server. send. In this method, even if the display device 200 can store food ingredients, by merging the food material information of other devices, The comprehensive recommended recipes obtained will be more comprehensive.
S340，显示设备200接收食材信息后，并根据食材信息获取菜谱。S340: After receiving the ingredient information, the display device 200 obtains the recipe based on the ingredient information.
在一个示例中，食材存储设备接收到食材请求信息后，通过食材管理模块的接口读取本地存储的食材信息。然后根据食材信息确定食材信息列表。然后将食材信息列表转换成JS对象简谱(JavaScript Object Notation，JSON)格式的信息文本，通过单播的方式根据显示设备200的局域网地址向其发送该食材信息列表。食材信息列表如以下表一所示：In one example, after receiving the ingredient request information, the ingredient storage device reads the locally stored ingredient information through the interface of the ingredient management module. Then determine the ingredient information list based on the ingredient information. Then, the ingredient information list is converted into information text in JS object notation (JavaScript Object Notation, JSON) format, and the ingredient information list is sent to the display device 200 according to its local area network address in a unicast manner. The list of ingredient information is shown in Table 1 below:
表一
Table I
从表一可看出，食材的存入时间由存入食材的日期(年月日)和时刻(时分秒)确定的，食材的保质期的单位可以是天、小时、分钟等时间单位。As can be seen from Table 1, the storage time of ingredients is determined by the date (year, month, day) and time (hours, minutes, seconds) when the ingredients are stored. The unit of the shelf life of ingredients can be time units such as days, hours, minutes, etc.
在一个示例中，显示设备200接收到各个食材存储设备发送的食材信息后，对JSON格式的信息文本进行解析，转换成各个食材存储设备的食材信息列表。然后根据各个食材信息列表获取当前用户家庭中存放的所有食材信息。In one example, after receiving the ingredient information sent by each ingredient storage device, the display device 200 parses the information text in JSON format and converts it into an ingredient information list of each ingredient storage device. Then obtain all the food material information stored in the current user's home according to each food material information list.
在一个示例中，显示设备200根据食材信息中的当前时刻、食材的存入时间和食材的保质期确定每一食材的临期时间，该临期时间为当前时刻距离食材的保质日期的时间。然后根据每一食材的临期时间对所有食材排序，并确定符合第一预设条件的食材的食材信息，接着向服务器发送该符合第一预设条件的食材的食材信息。接收来自该服务器的菜谱，该菜谱是该服务器根据该符合第一预设条件的食材的食材信息确定的。In one example, the display device 200 determines the expiration time of each food item based on the current time in the food material information, the storage time of the food material, and the shelf life of the food material. The expiration time is the time from the current moment to the shelf life date of the food material. Then all the ingredients are sorted according to the expiration time of each ingredient, and the ingredient information of the ingredients that meet the first preset condition is determined, and then the ingredient information of the ingredient that meets the first preset condition is sent to the server. Receive a recipe from the server, where the recipe is determined by the server based on the ingredient information of the ingredients that meet the first preset condition.
在一些实施例中，临期时间＝食材的存入时间+食材的保质期-当前时刻。In some embodiments, the expiry time = the storage time of the food material + the shelf life of the food material - the current time.
若临期时间小于0，则删除其对应的食材信息。然后按照临期时间从小到大对保留下来的食材排序，相对应地，食材的优先级由高到低，每一临期时间对应一个优先级。例如，临期时间最小的食材的优先级为第一级，排序位于其后的优先级为第二级，以此类推。If the expiration time is less than 0, the corresponding ingredient information will be deleted. Then sort the retained ingredients according to the expiration time from small to large. Correspondingly, the priority of the ingredients is from high to low, and each expiration time corresponds to a priority. For example, the priority of the ingredients with the shortest expiration time is the first level, the priority of the ingredients ranked after it is the second level, and so on.
例如，符合第一预设条件的食材为排序后的食材中第一级至第三级的食材。For example, the ingredients that meet the first preset condition are the ingredients from the first to the third level among the sorted ingredients.
在一个示例中，服务器根据食材信息中的食材名称和各个菜谱中的配菜信息、菜谱名称进行相关度的计算，计算出匹配度最高的菜谱并发送给显示设备200。In one example, the server calculates the correlation based on the ingredient names in the ingredient information and the side dish information and recipe names in each recipe, calculates the recipe with the highest matching degree, and sends it to the display device 200 .
采用上述方式，显示设备200能够从多个存放食材的设备上获取融合后的食材信息，并综合各个食材的保质期对食材进行优先级的划分。将过期的食材删除后，优先根据临期时间较小的食材获取推荐的菜谱，以避免食材因为食用不及时而导致过期，加强了显示设备的智能化。Using the above method, the display device 200 can obtain the fused food information from multiple devices that store food, and prioritize the food based on the shelf life of each food. After deleting expired ingredients, priority is given to obtaining recommended recipes based on ingredients with shorter expiration dates to avoid expiration of ingredients due to untimely consumption, which enhances the intelligence of the display device.
S350，显示设备200的处理器250控制显示器260展示菜谱。S350, the processor 250 of the display device 200 controls the display 260 to display the recipe.
处理器250根据服务器发送的菜谱控制显示器260展示该菜谱。展示效果可参见图5。The processor 250 controls the display 260 to display the recipe according to the recipe sent by the server. The display effect can be seen in Figure 5.
由上述实施例可以看出，由于一个家庭局域网中可能有多个食材存储设备，该多个食材存储设备与显示设备200以及路由器的通信连接关系参见图7。图7为本申请根据一些示例性的实施例示出的局域网内设备的通信连接关系示意图。本申请的显示设备获取与显示设备接入同一局域网的多个食材存储设备(如图7中的食材存储设备1和食材存储设备2)的局域网地址，并能够根据显示设备的局域网地址和该多个食材存储设备的局域网地址实现该多个食材存储设备之间的交互，从而获取多个食材存储设备的食材信息。显示设 备融合多个食材存储设备的食材信息后发送给服务器，使得服务器能够基于融合后的该家庭局域网内的多个设备的食材信息进行菜谱推荐，使得显示设备最终获取的菜谱符合实际食材的存放，实现了更加智能化地向用户推荐菜谱。另外，若该显示设备不具有食材管理功能，则通过上述方式获取的菜谱避免了只能展示默认推荐菜谱不符合实际的问题的发生；若该显示设备200能够存放食材，那么通过合并其他食材存储设备的食材信息，使能获取的综合推荐的菜谱会更加全面。It can be seen from the above embodiments that since there may be multiple food storage devices in a home local area network, the communication connection relationship between the multiple food storage devices, the display device 200 and the router is as shown in FIG. 7 . Figure 7 is a schematic diagram of the communication connection relationship of devices in a local area network according to some exemplary embodiments of this application. The display device of the present application obtains the LAN addresses of multiple food storage devices (food storage device 1 and food storage device 2 in Figure 7) that are connected to the same local area network as the display device, and can obtain the LAN addresses according to the LAN address of the display device and the multiple food storage devices. The local area network address of each food material storage device enables interaction between the multiple food material storage devices, thereby obtaining food material information of the multiple food material storage devices. display device The device fuses the ingredient information of multiple ingredient storage devices and sends it to the server, so that the server can recommend recipes based on the merged ingredient information of multiple devices in the home local area network, so that the recipe finally obtained by the display device conforms to the actual storage of ingredients. Achieve more intelligent recommendation of recipes to users. In addition, if the display device 200 does not have an ingredient management function, the recipes obtained through the above method avoid the problem that only default recommended recipes can be displayed, which is not practical; if the display device 200 can store ingredients, then by merging other ingredient storage The equipment's ingredient information makes the comprehensive recommended recipes available more comprehensive.
本申请一些实施例还提供了一种数据处理方法，该方法包括：Some embodiments of this application also provide a data processing method, which method includes:
显示设备响应于菜谱推荐的操作，确定食材请求信息，所述食材请求信息用于获取食材存储设备在本地存储的食材信息；In response to the operation of recipe recommendation, the display device determines the ingredient request information, and the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device;
根据所述食材信息获取菜谱；Obtain recipes based on the ingredient information;
所述显示设备控制其显示器展示所述菜谱。The display device controls its display to display the recipe.
若所述显示设备与所述食材存储设备非同一设备，图8为本申请根据一些示例性的实施例示出的又一例数据处理方法的流程示意图。参见图8，该方法包括：If the display device and the food storage device are not the same device, FIG. 8 is a schematic flowchart of another data processing method shown in this application according to some exemplary embodiments. Referring to Figure 8, the method includes:
S410，显示设备200响应于菜谱推荐的操作，获取食材存储设备的局域网地址。S410. In response to the operation of recipe recommendation, the display device 200 obtains the local area network address of the ingredient storage device.
具体地，显示设备200响应于菜谱推荐的操作，获取与该显示设备接入同一局域网的食材存储设备的局域网地址，其中，该食材存储设备包括第一终端设备。Specifically, in response to the operation of recipe recommendation, the display device 200 obtains the LAN address of an ingredient storage device connected to the same local area network as the display device, where the ingredient storage device includes the first terminal device.
S420，显示设备200确定食材请求信息，该食材请求信息用于获取该食材存储设备在本地存储的食材信息。S420, the display device 200 determines the food material request information, and the food material request information is used to obtain the food material information stored locally by the food material storage device.
具体地，该显示设备200根据该显示设备的局域网地址确定该食材请求信息。Specifically, the display device 200 determines the food ingredient request information according to the local area network address of the display device.
S430，显示设备200发送该食材请求信息，第一终端设备接收该食材请求信息。S430: The display device 200 sends the food material request information, and the first terminal device receives the food material request information.
具体地，该显示设备200根据该第一终端设备的局域网地址向该第一终端设备发送该食材请求信息。Specifically, the display device 200 sends the food ingredient request information to the first terminal device according to the LAN address of the first terminal device.
S440，第一终端设备发送该食材信息，该显示设备200接收该食材信息。S440: The first terminal device sends the food material information, and the display device 200 receives the food material information.
具体地，第一终端设备接收食材请求信息后，基于食材管理模块确定本地存储的食材信息，然后向显示设备发送该食材信息。显示设备200接收该食材信息后，并根据该食材信息获取菜谱。Specifically, after receiving the food material request information, the first terminal device determines the locally stored food material information based on the food material management module, and then sends the food material information to the display device. After receiving the ingredient information, the display device 200 obtains the recipe based on the ingredient information.
S450，该显示设备200控制其显示器260展示该菜谱。S450, the display device 200 controls its display 260 to display the recipe.
在一个示例中，显示设备200根据该显示设备的局域网地址确定并发送地址请求信息，该地址请求信息用于获取食材存储设备的局域网地址。然后接收来自该第一终端设备的地址响应信息，该地址响应信息包括该第一终端设备的局域网地址。In one example, the display device 200 determines and sends address request information according to the LAN address of the display device, and the address request information is used to obtain the LAN address of the food storage device. Then, address response information from the first terminal device is received, where the address response information includes the local area network address of the first terminal device.
食材存储设备可以为用户提供食材的智能管理、智能储藏、菜谱推荐以及多功能提醒等多种功能。以食材存储设备是智能冰箱为例，用户可以控制在智能冰箱的显示屏上显示菜谱推荐界面，并对菜谱推荐界面中任意一个菜谱进行选中操作，以使显示屏显示该菜谱的详细内容，例如，使显示屏显示该菜谱所需的烹饪食材，烹饪步骤以及烹饪时间等。Ingredient storage equipment can provide users with multiple functions such as intelligent management of ingredients, intelligent storage, recipe recommendations, and multi-functional reminders. Taking the food storage device as a smart refrigerator as an example, the user can control the recipe recommendation interface to be displayed on the display screen of the smart refrigerator, and select any recipe in the recipe recommendation interface so that the display screen displays the details of the recipe, for example , so that the display shows the cooking ingredients, cooking steps and cooking time required for the recipe.
食材存储设备可以与互联网连接，用户可以一键将菜谱中所需的食材加入购物车中，并对所需的食材进行采买。但是，这种食材采买方式可能会产生重复购买的情况，例如，食材存储设备中储藏有食材A，而用户选中的菜谱中也包括食材A，对菜谱中的食材进行一键采买，会重复购买食材A，造成食材浪费，不利于用户体验。The ingredient storage device can be connected to the Internet, and users can add the ingredients required for the recipe to the shopping cart with one click and purchase the required ingredients. However, this method of purchasing ingredients may lead to repeated purchases. For example, if ingredient A is stored in the ingredient storage device, and the recipe selected by the user also includes ingredient A, one-click purchase of the ingredients in the recipe will result in repeated purchases. Ingredient A causes a waste of ingredients and is not conducive to user experience.
为了解决上述问题，本申请一些实施例中提供了另一种显示设备及数据处理方法。In order to solve the above problem, some embodiments of the present application provide another display device and a data processing method.
如果显示设备与食材存储设备为同一设备，例如该设备是智能冰箱。图9为本申请根 据一些示例性的实施例示出的智能冰箱的使用场景图。图9中示例性示出了食材存储设备、控制装置以及终端设备之间操作场景。如图9中示出，用户可通过控制装置100操作食材存储设备3，或者，用户可以通过与服务器4连接的终端设备2与食材存储设备3进行信息交互，以操作食材存储设备3。If the display device and the food storage device are the same device, for example, the device is a smart refrigerator. Figure 9 shows the root of this application A usage scenario diagram of a smart refrigerator is shown according to some exemplary embodiments. Figure 9 exemplarily shows the operation scenario between the food storage device, the control device and the terminal device. As shown in FIG. 9 , the user can operate the food storage device 3 through the control device 100 , or the user can interact with the food storage device 3 through the terminal device 2 connected to the server 4 to operate the food storage device 3 .
在一些实施例中，控制装置100可以是遥控器，遥控器和食材存储设备3的通信包括红外协议通信或蓝牙协议通信，及其他短距离通信方式等，通过无线或其他有线方式来控制食材存储设备3。其中，无线方式可以是直连和非直连，可以是经过路由的，也可以是不经过路由的。用户可以通过遥控器上按键、语音输入、控制面板输入等输入用户指令，来控制食材存储设备3。如：用户可以通过遥控器上音量加减键、频道控制键、上/下/左/右的移动按键、语音输入按键、菜单键、开关机按键等输入相应控制指令，来实现控制食材存储设备3的功能。In some embodiments, the control device 100 may be a remote control. The communication between the remote controller and the food storage device 3 includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods. The food storage is controlled through wireless or other wired methods. Device 3. Among them, the wireless mode can be direct connection or indirect connection, and can be routed or not. The user can control the food storage device 3 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc. For example, users can control food storage equipment by inputting corresponding control instructions through the volume up and down keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, power on/off keys, etc. on the remote control. 3 functions.
在一些实施例中，也可以使用终端设备2如手机、平板电脑、计算机、笔记本电脑、和其他智能设备以控制食材存储设备3。终端设备2可与食材存储设备3通过网络通信协议实现连接通信，实现一对一控制操作的和数据通信的目的。In some embodiments, terminal devices 2 such as mobile phones, tablets, computers, laptops, and other smart devices can also be used to control the food storage device 3 . The terminal device 2 can realize connection and communication with the food storage device 3 through a network communication protocol to achieve the purpose of one-to-one control operation and data communication.
如图9中还示出，食材存储设备3和终端设备2还与服务器4通过多种通信方式进行数据通信。可允许食材存储设备3和终端设备2通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器4可以向食材存储设备3和终端设备2提供各种内容和互动。As also shown in Figure 9, the food storage device 3 and the terminal device 2 also perform data communication with the server 4 through a variety of communication methods. The food storage device 3 and the terminal device 2 can be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN) and other networks. The server 4 can provide various contents and interactions to the food storage device 3 and the terminal device 2 .
在一些实施例中，服务器4可以是一个集群，也可以是多个集群，可以包括一类或多类服务器。通过服务器4提供热门菜谱和烹饪服务等其他网络服务内容。In some embodiments, the server 4 may be a cluster or multiple clusters, and may include one or more types of servers. Other network service contents such as popular recipes and cooking services are provided through server 4.
在一些实施例中，食材存储设备3可以是如智能冰箱、智能冰柜、智能酒柜以及智能蔬果柜等具备智能化管理的用于存储食材的设备。在本申请具体实现方式中，以食材存储设备是智能冰箱为例对本申请技术方案进行说明。下面首先对智能冰箱的结构和功能等方面进行详细说明。In some embodiments, the food storage device 3 may be a device with intelligent management for storing food, such as a smart refrigerator, a smart freezer, a smart wine cabinet, a smart fruit and vegetable cabinet, or the like. In the specific implementation manner of this application, the technical solution of this application is explained by taking the food storage device as a smart refrigerator as an example. The structure and functions of the smart refrigerator are first described in detail below.
图10A为本申请根据一些示例性的实施例示出的智能冰箱立体图，本申请实施例提供的智能冰箱的形状近似长方体。该智能冰箱由提供有限储存空间的储藏室和设置在储藏室开口处的箱门1200(1200A-1200B)限定。储藏室为具有开口的箱体。在图10A所示示例中，储藏室包括位于下方的冷冻室1100以及位于上方的冷藏室1101，冷冻室1100和冷藏室1101分别具有一个或者多个独立的储存空间，如冷冻室1100所包括的抽屉式间室等，以及冷藏室1101所包括的多个容纳格1101A-1101B，顶部照明灯位于容纳格内部。FIG. 10A is a three-dimensional view of a smart refrigerator according to some exemplary embodiments of the present application. The shape of the smart refrigerator provided by the embodiments of the present application is approximately a rectangular parallelepiped. The smart refrigerator is defined by a storage compartment providing limited storage space and a door 1200 (1200A-1200B) provided at the opening of the storage compartment. The storage room is a box with an opening. In the example shown in FIG. 10A , the storage chamber includes a freezing chamber 1100 located below and a refrigerating chamber 1101 located above. The freezing chamber 1100 and the refrigerating chamber 1101 respectively have one or more independent storage spaces, as included in the freezing chamber 1100 Drawer-type compartments, etc., as well as a plurality of storage compartments 1101A-1101B included in the refrigerator compartment 1101, the top lighting is located inside the storage compartment.
在图10A所示示例中，多个抽屉式间室通过抽屉式箱门封盖。冷藏室1101被分割成左侧和右侧，左侧和右侧分别通过可枢转地安装在箱体上的箱门封盖。In the example shown in Figure 10A, multiple drawer compartments are covered by drawer doors. The refrigerating compartment 1101 is divided into left and right sides, and the left and right sides are respectively covered by doors that are pivotably installed on the box body.
需要说明的是，图10A作为本申请实施例的一个示例，其示出的智能冰箱并不构成对本申请所提供智能冰箱的限定。例如，在本申请另外的实施例中，智能冰箱箱体被分割成左侧和右侧，限定左侧箱体为冷冻室1100，限定右侧箱体为冷藏室1101，该冷冻室1100和冷藏室1101均可通过可枢转地安装在箱体上的箱门封盖。又如，在本申请另外的实施例中，储藏室包括冷藏室1101、冷冻室1100以及变温室。It should be noted that FIG. 10A is an example of an embodiment of the present application, and the smart refrigerator shown in FIG. 10A does not constitute a limitation on the smart refrigerator provided by the present application. For example, in another embodiment of the present application, the smart refrigerator box is divided into left and right sides, the left box is defined as the freezing chamber 1100, and the right box is defined as the refrigerating chamber 1101. The freezing chamber 1100 and the refrigeration chamber are Each chamber 1101 can be covered by a door pivotably mounted on the box. As another example, in another embodiment of the present application, the storage room includes a refrigerating room 1101, a freezing room 1100, and a changing room.
基于上述实施例提供的智能冰箱，通过在智能冰箱箱体外侧设置显示器，可以使智能冰箱具有显示功能。Based on the smart refrigerator provided in the above embodiment, by setting a display outside the smart refrigerator box, the smart refrigerator can have a display function.
图10B为本申请根据一些示例性的实施例示出的智能冰箱外观示意图，如图10B所示， 在冷藏室门上设有显示器，显示器嵌入到门体中。Figure 10B is a schematic diagram of the appearance of a smart refrigerator according to some exemplary embodiments of the present application. As shown in Figure 10B, A display is provided on the refrigerator door, and the display is embedded in the door body.
在一些实施例中，冰箱上还可以设置有食材检测器，食材检测器可以用于检测冰箱内库存食材的种类和数量，例如，食材检测器可以包括摄像头，摄像头设置在冷藏室内，通过采集冷藏室的内景图像，并对内景图像进行分析，获取冷藏室内存储的库存食材的种类和数量，又例如，食材检测器可以是设置在冷藏室门上的标签读取器，标签读取器内置用于读取RFID标签的天线，以用于识别近距离的RFID标签，从而录入存入冷藏室内的库存食材的种类和数量。In some embodiments, the refrigerator may also be provided with an ingredient detector. The ingredient detector may be used to detect the type and quantity of ingredients stored in the refrigerator. For example, the ingredient detector may include a camera. The camera is installed in the refrigerated room. The interior image of the refrigerator room is analyzed, and the type and quantity of the inventory ingredients stored in the refrigerator room are obtained. For another example, the ingredient detector can be a tag reader set on the refrigerator door. The tag reader has a built-in user interface. An antenna for reading RFID tags is used to identify RFID tags at close range, thereby recording the type and quantity of inventory ingredients stored in the cold storage room.
在一些实施例中，显示器的屏幕所在平面与箱门外表面平齐。In some embodiments, the plane of the display screen is flush with the outer surface of the door.
图11为本申请根据一些示例性的实施例示出的智能冰箱硬件配置示意图，作为示例，智能冰箱2000可以包括显示器260、处理器250、多根用于检测RFID标签的天线280、检测器230、存储器290和若干用户输入接口。显示器260、天线280、检测器230、存储器290通过通信接口与处理器250耦合。其中，显示器260，用于接收处理器250输出的图像信号，进行显示视频内容和图像以及菜单操控界面的组件，以及显示用于控制智能冰箱2000的用户操控UI界面。Figure 11 is a schematic diagram of the hardware configuration of a smart refrigerator according to some exemplary embodiments of the present application. As an example, the smart refrigerator 2000 may include a display 260, a processor 250, multiple antennas 280 for detecting RFID tags, a detector 230, Memory 290 and several user input interfaces. The display 260, the antenna 280, the detector 230, and the memory 290 are coupled with the processor 250 through a communication interface. Among them, the display 260 is used to receive the image signal output by the processor 250, display video content and images and components of the menu control interface, and display a user control UI interface for controlling the smart refrigerator 2000.
处理器250，可以包括一个或者多个处理单元，例如***芯片(system on a chip，SoC)、中央处理器(central processing unit，CPU)、微处理器(microcontroller，MCU)、存储处理器等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。The processor 250 may include one or more processing units, such as a system on a chip (SoC), a central processing unit (CPU), a microprocessor (microcontroller, MCU), a storage processor, etc. Among them, different processing units can be independent devices or integrated in one or more processors.
在一些实施例中，处理器250与天线280通过串口通信。In some embodiments, the processor 250 communicates with the antenna 280 through a serial port.
在一些实施例中，处理器250包括RFID模块，RFID模块、天线280以及RFID标签构成RFID读写***，天线280用于在RFID模块和RFID标签之间传递射频信号，RFID模块通过天线280完成对RFID标签的读、写操作。In some embodiments, the processor 250 includes an RFID module. The RFID module, antenna 280 and RFID tag constitute an RFID reading and writing system. The antenna 280 is used to transmit radio frequency signals between the RFID module and the RFID tag. The RFID module completes the communication through the antenna 280. Read and write operations of RFID tags.
在一些实施例中，RFID模块通过串口与天线通信。In some embodiments, the RFID module communicates with the antenna via a serial port.
存储器290，可以包括一个或者多个存储单元，例如可以包括易失性存储器(volatile memory)，如：动态随机存取存储器(dynamic random access memory，DRAM)、静态随机存取存储器(static random access memory，SRAM)等；还可以包括非易失性存储器(non-volatile memory，NVM)，如：只读存储器(read-only memory，ROM)、闪存(flash memory)等。其中，不同的存储单元可以是独立的器件，也可以集成或者封装在一个或者多个处理器或者通信接口中，成为处理器或者通信接口的一部分。Memory 290 may include one or more storage units, for example, may include volatile memory (volatile memory), such as: dynamic random access memory (dynamic random access memory, DRAM), static random access memory (static random access memory) , SRAM), etc.; it can also include non-volatile memory (NVM), such as read-only memory (ROM), flash memory (flash memory), etc. Different storage units can be independent devices, or they can be integrated or packaged in one or more processors or communication interfaces and become part of the processor or communication interface.
存储器290中存储有程序指令和应用程序，如语音应用。处理器250可调用存储器290中的程序指令或者运行应用程序，使智能冰箱执行相关的方法，例如本申请实施例所提供的食材标签的扫描方法。The memory 290 stores program instructions and application programs, such as voice applications. The processor 250 can call program instructions in the memory 290 or run an application program to cause the smart refrigerator to perform related methods, such as the food label scanning method provided in the embodiment of the present application.
检测器230，至少包括声音采集器，如麦克风，可以用于接收用户的声音。示例性的，包括用户控制智能冰箱2000的控制指令的语音信号。检测器230还可以包括箱门开关状态传感器，如检测磁敏开关、机械开关，用于检测每个箱门的开关信号，当根据检测到的开关信号记录所述箱门的开关状态，发送开关状态信息给处理器250。示例性的，当检测器检测到任意一个箱门的开启信号或者关闭信号时，发送最新的开关状态信息给处理器250。The detector 230, which at least includes a sound collector such as a microphone, may be used to receive the user's voice. By way of example, the voice signal includes a user's control instruction for controlling the smart refrigerator 2000 . The detector 230 may also include a door switch state sensor, such as a magnetic sensitive switch or a mechanical switch, for detecting the switch signal of each door. When the switch state of the door is recorded according to the detected switch signal, a switch is sent. Status information to processor 250. For example, when the detector detects an opening signal or a closing signal of any door, the latest switch status information is sent to the processor 250 .
用户输入接口，包括麦克风、触摸板、传感器、按键等其他输入接口中至少一者。如：用户可以通过语音、触摸、手势、按压等动作实现用户指令输入功能，输入接口通过将接收的模拟信号转换为数字信号，以及数字信号转换为相应指令信号，发送至处理器250。 The user input interface includes at least one of a microphone, a touch pad, a sensor, a button, and other input interfaces. For example, the user can realize the user command input function through actions such as voice, touch, gesture, and pressing. The input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the processor 250 .
通信器220，用于与服务器或者与服务器连接的终端设备2进行通信。The communicator 220 is used to communicate with the server or the terminal device 2 connected to the server.
在一些实施例中，处理器250可以包括语音识别模块，语音识别模块进一步包括语音解析单元和语音指令数据库，从而使智能冰箱可以独立完成对用户输入的语音数据的语音识别，以及将识别出的语音内容与语音指令数据库中的语音指令进行匹配的过程。In some embodiments, the processor 250 may include a voice recognition module, and the voice recognition module may further include a voice parsing unit and a voice instruction database, so that the smart refrigerator can independently complete voice recognition of the voice data input by the user, and convert the recognized voice data into a voice recognition module. The process of matching voice content with voice commands in the voice command database.
本申请对天线280的数量不予限定。例如，天线280可以包括设置在每个储藏室内的天线和设置在标签读取器内部的天线，其中，设置在各储藏室内的天线主要用于扫描各储藏室内的RFID标签，以读取RFID标签的标签信息，设置在标签读取器内部的天线则主要用于扫描标签读取器上的RFID标签，以读取RFID标签的标签信息。This application does not limit the number of antennas 280. For example, the antenna 280 may include an antenna provided in each storage room and an antenna provided inside the tag reader, wherein the antenna provided in each storage room is mainly used to scan the RFID tags in each storage room to read the RFID tags. The antenna set inside the tag reader is mainly used to scan the RFID tag on the tag reader to read the tag information of the RFID tag.
在一些实施例中，不同的储藏室内设置的天线的功率可以不同。且各个储藏室的天线的功率能够保证天线识别到自身间室包括的食材即可，从而避免功率太大时会增加误识别率，功率太小时会识别不全自身间室的食材。在具体的实现中，可以预先根据各个储藏室的空间大小确定天线的功率，并在智能冰箱中设置各个天线的功率，空间越大，功率越大。In some embodiments, the power of antennas provided in different storage rooms may be different. The power of the antennas in each storage room is sufficient to ensure that the antenna can recognize the food contained in its own room, thereby avoiding an increase in false recognition rates when the power is too high, and when the power is too low, the food in its own room cannot be recognized. In a specific implementation, the power of the antenna can be determined in advance according to the space size of each storage room, and the power of each antenna can be set in the smart refrigerator. The larger the space, the greater the power.
在一些实施例中，将设置在标签读取器下的天线称为第一天线，将设置在储藏室中的天线称为第二天线。In some embodiments, the antenna disposed under the tag reader is called a first antenna, and the antenna disposed in the storage room is called a second antenna.
基于本申请实施例提供的智能冰箱，可以使用RFID标签对储藏室中的食材进行标识，RFID标签的标签信息(如标签标识)与其标识的食材的食材信息之间具有对应关系，从而实现RFID标签与食材信息之间的虚拟关联。实际应用中，将贴设有RFID标签的食材存放到智能冰箱中，通过第二天线检测储藏室中RFID标签以获取其标签信息，根据标签信息与食材信息的关联关系确定该标签所标识的食材。Based on the smart refrigerator provided by the embodiment of the present application, RFID tags can be used to identify the ingredients in the storage room. There is a corresponding relationship between the tag information of the RFID tag (such as the tag identification) and the ingredient information of the identified ingredients, thereby realizing the RFID tag Virtual association with ingredient information. In practical applications, ingredients with RFID tags are stored in a smart refrigerator, and the RFID tag in the storage room is detected through the second antenna to obtain the tag information. The ingredients identified by the tag are determined based on the relationship between the tag information and the ingredient information. .
在一些实施例中，标签信息包括标签编码，标签编码中的特定码段为标签标识。建立RFID标签的标识信息与食材信息的对应关系，可以实现RFID标签与食材的虚拟关联。进而，在获取到储藏室中RFID标签的标签标识后，即可根据标签标识和预先建立的对应关系确定RFID标签对应的食材。In some embodiments, the tag information includes tag encoding, and a specific code segment in the tag encoding is the tag identification. Establishing the corresponding relationship between the identification information of the RFID tag and the food material information can realize the virtual association between the RFID tag and the food material. Furthermore, after obtaining the tag identification of the RFID tag in the storage room, the food ingredients corresponding to the RFID tag can be determined based on the tag identification and the pre-established correspondence relationship.
在一些实施例中，处理器250通过运行食材管理应用实现食材管理功能，食材管理应用提供的应用界面包括：可作为应用主界面的食材管理界面、用于建立RFID标签与食材信息的关联关系的标签编辑界面、用于展示推荐菜谱信息的菜谱展示界面等。In some embodiments, the processor 250 implements the food material management function by running a food material management application. The application interface provided by the food material management application includes: a food material management interface that can be used as the main interface of the application, and an API for establishing an association between RFID tags and food material information. Tag editing interface, recipe display interface for displaying recommended recipe information, etc.
在一些实施例中，响应于开机或者用户输入的食材管理应用启动指令，处理器250启动食材管理应用。食材管理应用启动后，用户可以在食材管理应用中输入标签编辑指令。响应于该标签编辑指令，食材管理应用通过第一天线扫描用户放置在标签读取器上的RFID标签，以获取RFID标签的标签信息，如“A”，并显示标签编辑界面。用户可以在标签编辑界面中输入食材信息，用于与“A”进行关联。食材管理应用接收用户输入的食材信息，建立该食材信息与“A”之间的关联关系。当食材管理应用通过第二天线检测到储藏室中有RFID标签“A”时，便可根据“A”所关联的食材信息，确定储藏室中的真实食材，从而实现对食材的智能管理。应理解的是，当食材管理应用通过第二天线检测到储藏室中有RFID标签“A”时，“A”所关联的食材为储藏室中的现有食材。In some embodiments, the processor 250 starts the food management application in response to booting or a user input command to start the food management application. After the food management application is launched, the user can enter label editing instructions in the food management application. In response to the tag editing instruction, the food management application scans the RFID tag placed by the user on the tag reader through the first antenna to obtain the tag information of the RFID tag, such as "A", and displays the tag editing interface. Users can enter ingredient information in the label editing interface to associate with "A". The food material management application receives the food material information input by the user and establishes an association between the food material information and "A". When the food material management application detects the RFID tag "A" in the storage room through the second antenna, it can determine the real food materials in the storage room based on the food material information associated with "A", thereby realizing intelligent management of food materials. It should be understood that when the food material management application detects that there is an RFID tag "A" in the storage room through the second antenna, the food material associated with "A" is the existing food material in the storage room.
在一些实施例中，食材信息包括食材ID、食材名称、存放位置标识、食材数量、食材保质期、起始时间等中的一项或者多项。根据存放位置标识可以确定该食材存放的储藏室。例如，如果食材信息“苹果”中包含的存放位置标识是“1”，则确定“苹果”存放在冷藏室中，如果食材信息“苹果”中包含的存放位置标识是“2”，则确定“苹果”存放在冷冻室中。根据当前时间、食材的保质期和起始时间可以确定食材的新鲜程度。其中，起始时 间可以是用户输入的食材的真实生产日期，如面包的生产日期2021年5月1日，也可以是食材放入储藏室的时间。In some embodiments, the ingredient information includes one or more of ingredient ID, ingredient name, storage location identification, ingredient quantity, ingredient shelf life, starting time, etc. The storage room where the ingredient is stored can be determined based on the storage location identification. For example, if the storage location identifier contained in the ingredient information "apple" is "1", then it is determined that "apple" is stored in the refrigerator compartment. If the storage location identifier included in the ingredient information "apple" is "2", then it is determined that "apple" is stored in the refrigerator. Apples” stored in the freezer. The freshness of the ingredients can be determined based on the current time, the shelf life and the starting time of the ingredients. Among them, at the beginning The time can be the real production date of the ingredients input by the user, such as the production date of bread on May 1, 2021, or it can be the time when the ingredients were put into the storage room.
在一些实施例中，储藏室中现有食材对应的食材信息保存在本地食材信息集合中。该现有食材是指当前储藏在智能冰箱中的食材。In some embodiments, the food material information corresponding to the existing food materials in the storage room is stored in a local food material information collection. The existing food ingredients refer to the food ingredients currently stored in the smart refrigerator.
在另一些实施例中，上述本地食材信息集合中还可以保存历史食材对应的食材信息。该历史食材是指过去储藏在智能冰箱中、当前已从智能冰箱中移出的食材。具体实现时，可以通过存放状态标记来区分现有食材和历史食材，例如将历史食材的食材信息标记为移出状态，将现有食材的食材信息标记为放入状态。In other embodiments, the above-mentioned local food material information collection may also store food material information corresponding to historical food materials. The historical ingredients refer to ingredients that were stored in the smart refrigerator in the past and have been removed from the smart refrigerator at present. During specific implementation, existing food materials and historical food materials can be distinguished by storage status marks. For example, the food material information of historical food materials is marked as removed state, and the food material information of existing food materials is marked as put in state.
在另一些实施例中，现有食材的食材信息和历史食材的食材信息保存在不同的食材信息集合中。In other embodiments, the ingredient information of existing ingredients and the ingredient information of historical ingredients are stored in different ingredient information sets.
在一些实施例中，食材管理应用启动后，从本地食材信息集合中读取现有食材的食材信息，例如读取存放状态为放入状态的食材信息。然后根据现有食材的食材信息显示食材管理界面，食材管理界面包括根据食材信息绘制的食材控件，从而使得智能冰箱中的现有食材以图标、图文等形式尽数展示。除此之外，食材管理界面中还可以显示各类功能控件，如RFID标签编辑控件、食材添加控件、菜谱推荐控件等，以供用户操作以触发处理器250实现相应功能。In some embodiments, after the food material management application is started, the food material information of existing food materials is read from the local food material information collection, for example, the food material information whose storage status is the put-in state is read. Then the food material management interface is displayed according to the food material information of the existing food materials. The food material management interface includes food material controls drawn according to the food material information, so that all the existing food materials in the smart refrigerator are displayed in the form of icons, pictures and texts. In addition, various functional controls, such as RFID tag editing controls, ingredient adding controls, recipe recommendation controls, etc., can also be displayed in the food material management interface for user operations to trigger the processor 250 to implement corresponding functions.
在一些实施例中，智能冰箱还可以包括食材检测器和通信器，食材检测器可以用于采集智能冰箱的内景图像，通信器用于与服务器建立连接，以实现与服务器之间的信息交互。智能冰箱可以通过食材检测器获取冰箱内部食材的图像信息，并将所述图像信息发送至服务器，以通过服务器识别智能冰箱内部存储的食材。In some embodiments, the smart refrigerator may also include an ingredient detector and a communicator. The ingredient detector may be used to collect interior images of the smart refrigerator, and the communicator may be used to establish a connection with the server to implement information interaction with the server. The smart refrigerator can obtain the image information of the ingredients inside the refrigerator through the ingredient detector, and send the image information to the server, so that the server can identify the ingredients stored inside the smart refrigerator.
在一些实施例中，智能冰箱的处理器可以控制自动对冰箱内部的食材进行识别，例如，处理器可以控制每隔预设时间段自动对储藏室内的食材进行识别，或者可以在检测到冰箱门在开启或关闭时，控制对冰箱内部的食材进行识别。处理器也可以在接收到用户输入的指示识别库存食材的控制指令后，对储藏室内的食材进行识别，例如，智能冰箱的显示器显示的用户界面中，显示有用于对智能冰箱内存储的食材进行识别的相关控件，用户点击该控件处理器执行对内部的食材进行识别的操作。In some embodiments, the processor of the smart refrigerator can control the automatic identification of ingredients inside the refrigerator. For example, the processor can control the automatic identification of ingredients in the storage room every preset time period, or can control the automatic identification of ingredients in the storage room when the refrigerator door is detected. Controls the identification of ingredients inside the refrigerator when it is turned on or off. The processor can also identify the ingredients in the storage room after receiving a control instruction input by the user to identify the ingredients in stock. For example, the user interface displayed on the display of the smart refrigerator displays a message for identifying the ingredients stored in the smart refrigerator. Recognized related controls, the user clicks on the control processor to perform the operation of identifying the internal ingredients.
在一些实施例中处理器控制对储藏室内的食材进行识别时，食材检测器可以控制采集智能冰箱的内景图像，所述内景图像包括智能冰箱内部储藏的食材图像。其中，食材检测器可以包括摄像头，摄像头的数量可以为多个，多个摄像头可以分散式的分布在冰箱内部，以确保可以采集到智能冰箱内部每一个角落的内景图像。In some embodiments, when the processor controls the identification of food materials in the storage room, the food material detector may control the collection of interior images of the smart refrigerator, where the interior images include images of food materials stored inside the smart refrigerator. Among them, the food detector can include cameras, and the number of cameras can be multiple. The multiple cameras can be dispersedly distributed inside the refrigerator to ensure that interior images of every corner inside the smart refrigerator can be collected.
图12为本申请根据一些示例性的实施例示出的智能冰箱与服务器之间的交互示意图，如图12所示，在S1401中，处理器可以控制摄像头获取到储藏室内的内景图像，并在S1402中，向服务器发送食材识别请求，所述食材识别请求包括所述内景图像，在S1403中，服务器在接收到智能冰箱发送的食材识别请求后，可以对内景图像上的库存食材图像进行识别，以获取内景图像上各食材图像对应的库存食材名称和库存食材数量，在S1404中，服务器根据识别到的库存食材名称和各库存食材名称对应的库存食材数量可以生成库存食材集合，并将所述库存食材集合发送至所述处理器，在S1405中，处理器响应于接收到的所述库存食材集合，以完成对内部储藏的食材识别的操作。Figure 12 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments. As shown in Figure 12, in S1401, the processor can control the camera to obtain the interior image of the storage room, and in S1402 In S1403, the server sends an ingredient identification request to the server, and the ingredient identification request includes the interior image. In S1403, after receiving the ingredient identification request sent by the smart refrigerator, the server can identify the stock ingredient image on the interior image to Obtain the inventory ingredient name and inventory ingredient quantity corresponding to each ingredient image on the interior image. In S1404, the server can generate an inventory ingredient set based on the recognized inventory ingredient name and the inventory ingredient quantity corresponding to each inventory ingredient name, and store the inventory The food material set is sent to the processor. In S1405, the processor responds to the received stock food material set to complete the operation of identifying the internally stored food materials.
在一些实施例中，为了提高处理器控制的对储藏室内的食材进行识别的精度，食材检测器还可以包括用于检测智能冰箱内预设位置的食材的重量测量器，以获取冰箱内预设位 置的食材重量。其中，重量测量器的数量也可以为多个，分别分布在冰箱内部的特定位置，例如，智能冰箱内部可以设置有保鲜仓，保鲜仓的底部可以设置有重量测量器，保鲜仓内部可以用于存储如肉类等无法用数量为单位准确计量的食物。处理器控制重量测量器检测到预设位置处的食材重量后，可以通过服务器将摄像头采集的内景图像和所述食材重量一同发送至服务器，服务器结合所述食材重量对内景图像进行识别，可以更为精确的获取到内景图像中各食材图像对应的食材名称和食材数量，例如，可以识别到该内景图像上包括“食材1/600g”、“食材2/200g”以及“食材3/1kg”等食材名称和各食材名称对应的精确的食材数量。根据识别到的食材名称和各食材名称对应的食材数量可以生成库存食材集合，并将所述库存食材集合发送至处理器，处理器接收所述库存食材集合，以完成对内部储藏的食材识别的操作。In some embodiments, in order to improve the accuracy of processor-controlled identification of ingredients in the storage room, the ingredient detector may also include a weight measuring device for detecting ingredients at a preset position in the smart refrigerator to obtain the preset position in the refrigerator. Bit The weight of the food you set. Among them, the number of weight measuring devices can also be multiple, respectively distributed at specific positions inside the refrigerator. For example, a smart refrigerator can be equipped with a fresh-keeping bin, and a weight measurer can be installed at the bottom of the fresh-keeping bin. The inside of the fresh-keeping bin can be used for Store food such as meat that cannot be accurately measured in quantity. After the processor controls the weight measurer to detect the weight of the food at the preset position, the interior image collected by the camera and the weight of the food can be sent to the server through the server. The server can identify the interior image based on the weight of the food and can update the image. In order to accurately obtain the name and quantity of the ingredients corresponding to each ingredient image in the interior image, for example, it can be recognized that the interior image includes "ingredient 1/600g", "ingredient 2/200g" and "ingredient 3/1kg", etc. The names of the ingredients and the exact quantity of ingredients corresponding to each ingredient name. A set of inventory ingredients can be generated based on the recognized ingredient names and the number of ingredients corresponding to each ingredient name, and the set of inventory ingredients is sent to the processor. The processor receives the set of inventory ingredients to complete the identification of internally stored ingredients. operate.
在一些实施例中，处理器可以根据库存食材集合中各库存食材名称，控制在显示器的用户界面中显示各库存食材名称对应的食材控件，所述食材控件可以呈现为库存食材图标的样式，以呈现如图13所示的用户界面，图13为本申请根据一些示例性的实施例示出的一种食材管理界面的示意图，其具体为一种示例性的食材管理界面，该食材管理界面可以显示储藏室内储藏的库存食材对应的食材控件。其中，所述储藏室可以包括冷藏室501和冷冻室502，所述库存食材图标包括但不限于对应的库存食材图片、库存食材名称、库存食材数量以及库存食材的新鲜度标识等。其中，库存食材图片可以是库存食材的象形图片，库存食材的新鲜度标识用于示出库存食材的放入时间、距离过期的剩余时间和过期时间中的任意一项或者多项。应当理解，库存食材图片、库存食材名称、库存食材数量以及库存食材的新鲜度标识等可以是库存食材图标的一部分，即包含于库存食材图标。In some embodiments, the processor may control, based on the name of each inventory ingredient in the inventory ingredient collection, to display an ingredient control corresponding to the name of each inventory ingredient in the user interface of the display. The ingredient control may be presented in the style of an inventory ingredient icon, so as to The user interface shown in Figure 13 is presented. Figure 13 is a schematic diagram of a food material management interface shown in this application according to some exemplary embodiments. It is specifically an exemplary food material management interface. The food material management interface can display Ingredient controls corresponding to the inventory ingredients stored in the storage room. The storage room may include a refrigerator room 501 and a freezer room 502, and the inventory ingredient icons include but are not limited to corresponding inventory ingredient pictures, inventory ingredient names, inventory ingredient quantity, and inventory ingredient freshness indicators, etc. The picture of the stock ingredients may be a pictographic picture of the stock ingredients, and the freshness mark of the stock ingredients is used to show any one or more of the time when the stock ingredients were put in, the remaining time until expiration, and the expiration time. It should be understood that the inventory ingredient pictures, inventory ingredient names, inventory ingredient quantities, and inventory ingredient freshness indicators may be part of the inventory ingredient icon, that is, included in the inventory ingredient icon.
在一些实施例中，每隔预设时间段，冰箱处理器可以控制对储藏的食材的新鲜度进行计算，处理器在每次检测到有开门或关门的动作时，都会触发对储藏室内储藏的食材进行识别，以识别是否有新存入的库存食材，若存在新存入的库存食材，则记录该库存食材的存入时间以及存放位置处的温度，并向服务器发送该库存食材的库存食材名称以及存放位置处的温度，服务器接收到所述库存食材名称和其存放位置处的温度后，可以基于大数据分析该库存食材名称对应的库存食材的保质期，并将所述保质期发送至处理器。In some embodiments, every preset time period, the refrigerator processor can control the calculation of the freshness of the stored ingredients, and each time the processor detects an action of opening or closing the door, it will trigger a check of the stored ingredients in the storage room. The ingredients are identified to identify whether there are newly stored ingredients in stock. If there are newly stored ingredients in inventory, the storage time and temperature of the storage location are recorded, and the inventory ingredients of the inventory ingredients are sent to the server. name and the temperature at the storage location. After the server receives the name of the inventory ingredient and the temperature at its storage location, it can analyze the shelf life of the inventory ingredient corresponding to the name of the inventory ingredient based on big data, and send the shelf life to the processor. .
当处理器对冰箱内部的食材进行识别时，可以对服务器返回的库存食材集合进一步的筛选。在一些实施例中，处理器可以根据各库存食材的存入时间、保质期以及当前时间，计算每一个库存食材的新鲜度，其中，冰箱存放库存食材的时间越短，说明该库存食材的新鲜度越高，当冰箱存放库存食材的时间超出保质期后，存放的时间越久，其新鲜度越低，当库存食材的新鲜度低于预设阈值时，判定该库存食材严重过期，可以将该库存食材对应的库存食材名称和库存食材数量从库存食材集合中删除，并在食材管理界面中显示如图14所示的用于提示用户该库存食材已经过期的信息，图14为本申请根据一些示例性的实施例示出的另一种食材管理界面的示意图。When the processor identifies the ingredients inside the refrigerator, it can further filter the set of inventory ingredients returned by the server. In some embodiments, the processor can calculate the freshness of each inventory ingredient based on the storage time, shelf life and current time of each inventory ingredient. The shorter the storage time of the inventory ingredient in the refrigerator, the fresher the inventory ingredient. The higher the value, the longer the storage time of the inventory ingredients in the refrigerator exceeds the shelf life, the lower the freshness. When the freshness of the inventory ingredients is lower than the preset threshold, it is determined that the inventory ingredients are seriously expired, and the inventory ingredients can be removed. The corresponding inventory ingredient name and inventory ingredient quantity are deleted from the inventory ingredient collection, and the information shown in Figure 14 is displayed in the ingredient management interface to remind the user that the inventory ingredient has expired. Figure 14 shows some exemplary examples of this application. The embodiment shows a schematic diagram of another food material management interface.
图15为本申请根据一些示例性的实施例示出的智能冰箱与服务器之间的交互示意图。在一些实施例中，如图15所示，用户可以对显示器的用户管理界面中的任意食材控件进行选中操作，在S1701中，智处理器响应于用户对特定的食材控件的选中操作，发送菜谱推荐请求至服务器，菜谱推荐请求包括针对所述食材控件的所述库存食材名称和所述库存食材数量，在S1702中，服务器接收到所述库存食材名称和所述库存食材数量后，获取与所述库存食材名称和所述库存食材数量相匹配的若干菜谱，并在S1703中生成菜谱推荐列 表，在S1704中，服务器将所述菜谱推荐列表发送至处理器，在S1705中，处理器响应于接收到服务器返回的菜谱推荐列表后，在S1706中，可以触发显示如图16所示的智能配菜界面，图16为本申请根据一些示例性的实施例示出的一种智能配菜界面的示意图。所述智能配菜界面包括库存区801、配菜区802以及菜谱推荐区803，其中，库存区801至少显示有冰箱内储藏的所有库存食材对应的食材控件，配菜区802显示有用户选中的库存食材对应的食材控件，菜谱推荐区803显示有服务器返回的针对用户选中的食材控件的菜谱推荐列表。Figure 15 is a schematic diagram of the interaction between the smart refrigerator and the server shown in this application according to some exemplary embodiments. In some embodiments, as shown in Figure 15, the user can select any ingredient control in the user management interface of the display. In S1701, the intelligent processor sends a recipe in response to the user's selection operation on a specific ingredient control. The recommendation request is sent to the server, and the recipe recommendation request includes the name of the stock ingredients and the quantity of the stock ingredients for the food control. In S1702, after the server receives the name of the stock ingredients and the quantity of the stock ingredients, it obtains the information related to the stock ingredients. Several recipes that match the names of the inventory ingredients and the quantities of the inventory ingredients, and generate a recipe recommendation column in S1703 Table. In S1704, the server sends the recipe recommendation list to the processor. In S1705, after the processor responds to receiving the recipe recommendation list returned by the server, in S1706, the intelligent display shown in Figure 16 can be triggered. Side dish interface. Figure 16 is a schematic diagram of an intelligent side dish interface shown in this application according to some exemplary embodiments. The intelligent side dish interface includes an inventory area 801, a side dish area 802, and a recipe recommendation area 803. The inventory area 801 at least displays the ingredient controls corresponding to all the inventory ingredients stored in the refrigerator, and the side dish area 802 displays the ingredients selected by the user. The ingredient control corresponding to the inventory ingredient, the recipe recommendation area 803 displays a recipe recommendation list returned by the server for the ingredient control selected by the user.
图16所示的显示器的用户界面中显示有“食材2”、“食材3”、“食材4”等食材控件，用户对“食材2”对应的食材控件进行选中操作，处理器响应于用户的操作，控制在配菜区802显示“食材2”对应的食材控件，并向服务器发送菜谱推荐请求，所述菜谱推荐请求包括“食材2+600g”的信息，服务器接收到所述信息后，可以获取应用“食材2”制成的若干菜谱，并生成菜谱推荐列表，其中，菜谱推荐列表中应用“食材2”食材的数量小于或等于600g的菜谱可以被记录在菜谱推荐列表前面，应用“食材2”食材的数量大于600g的菜谱可以被记录在菜谱推荐列表的后面，服务器将所述菜谱推荐列表发送至处理器，处理器响应于接收到所述菜谱推荐列表，可以触发如图16所示的智能配菜界面，该智能配菜界面中的配菜区802可以显示有菜谱推荐列表中各菜谱对应的菜谱图标，所述菜谱图标包括但不限于所述菜谱对应的菜谱图片、菜谱名称等，应当理解，菜谱图片、菜谱名称等可以是菜谱图标的一部分，即包含于菜谱图标。The user interface of the display shown in Figure 16 displays ingredient controls such as "Ingredients 2", "Ingredients 3", and "Ingredients 4". The user selects the ingredient controls corresponding to "Ingredients 2", and the processor responds to the user's Operation, control the ingredient control corresponding to "ingredient 2" to be displayed in the side dish area 802, and send a recipe recommendation request to the server. The recipe recommendation request includes the information of "ingredient 2+600g". After the server receives the information, it can Obtain several recipes made using "Ingredients 2" and generate a recipe recommendation list. Recipes in which the quantity of "Ingredients 2" is less than or equal to 600g in the recipe recommendation list can be recorded in front of the recipe recommendation list. Apply "Ingredients 2" 2" Recipes with the quantity of ingredients greater than 600g can be recorded behind the recipe recommendation list. The server sends the recipe recommendation list to the processor. In response to receiving the recipe recommendation list, the processor can trigger as shown in Figure 16 An intelligent side dish interface. The side dish area 802 in the smart side dish interface can display recipe icons corresponding to each recipe in the recipe recommendation list. The recipe icons include but are not limited to recipe pictures, recipe names, etc. corresponding to the recipes. , it should be understood that the recipe picture, recipe name, etc. may be part of the recipe icon, that is, included in the recipe icon.
在一些实施例中，用户可以同时对两个或两个以上的食材控件进行选中操作，例如，用户可以对“食材2”和“食材3”对应的食材控件均进行选中操作，处理器可以控制在配菜区802显示“食材2”和食材3对应的食材控件，并向服务器发送菜谱推荐请求，所述菜谱推荐请求包括“食材2+600g”和“食材3+200g”的信息，服务器接收到所述信息后，可以获取应用“食材2”和“食材3”制成的若干菜谱，并生成菜谱推荐列表，其中，菜谱推荐列表中应用“食材2”食材的数量小于或等于600g以及应用“食材3”食材的数量小于或等于200g的菜谱可以被记录在菜谱推荐列表前面，应用“食材2”食材的数量大于600g和应用“食材3”食材的数量大于200g的菜谱可以被记录在菜谱推荐列表的后面，服务器将所述菜谱推荐列表发送至处理器，处理器响应于接收到所述菜谱推荐列表，可以触发显示包括有对应的菜谱推荐列表的智能配菜界面。In some embodiments, the user can select two or more food ingredient controls at the same time. For example, the user can select both the ingredient controls corresponding to "Ingredients 2" and "Ingredients 3", and the processor can control The ingredient controls corresponding to "Ingredients 2" and "Ingredients 3" are displayed in the side dish area 802, and a recipe recommendation request is sent to the server. The recipe recommendation request includes the information of "Ingredients 2+600g" and "Ingredients 3+200g", and the server receives After obtaining the above information, you can obtain several recipes made using "ingredient 2" and "ingredient 3", and generate a recipe recommendation list, in which the quantity of "ingredient 2" in the recipe recommendation list is less than or equal to 600g and the application Recipes with "Ingredients 3" ingredients less than or equal to 200g can be recorded at the front of the recipe recommendation list. Recipes with "Ingredients 2" ingredients greater than 600g and "Ingredients 3" ingredients greater than 200g can be recorded in the recipe list. After the recommendation list, the server sends the recipe recommendation list to the processor. In response to receiving the recipe recommendation list, the processor can trigger the display of an intelligent side dish interface including the corresponding recipe recommendation list.
在一些实施例中，用户可以对菜谱推荐列表中的任意一个菜谱图标进行选中操作，处理器响应于用户的操作，向服务器发送菜谱获取请求，所述菜谱获取请求包括用户选中的菜谱图标的标识，服务器接收到所述菜谱获取请求后，根据所述菜谱图标的标识，可以匹配对应的菜谱信息，所述菜谱信息至少包括制作该菜谱所需的菜谱食材集合，所述菜谱食材集合包括菜谱食材名称以及菜谱食材数量，此外，所述菜谱信息还可以包括菜谱图片、制作该菜谱的步骤等，本申请不给予限制。In some embodiments, the user can select any recipe icon in the recipe recommendation list, and the processor responds to the user's operation by sending a recipe acquisition request to the server, where the recipe acquisition request includes the identification of the recipe icon selected by the user. After the server receives the recipe acquisition request, it can match the corresponding recipe information according to the identification of the recipe icon. The recipe information at least includes a set of recipe ingredients required to make the recipe, and the set of recipe ingredients includes recipe ingredients. The name and the number of ingredients for the recipe. In addition, the recipe information may also include a picture of the recipe, the steps for making the recipe, etc., which are not limited by this application.
在一些实施例中，服务器匹配到与接收的菜谱的标识对应的菜谱信息后，可以将该菜谱信息发送至智能冰箱，冰箱处理器响应于接收到所述菜谱信息后，可以触发显示器显示菜谱详情界面，其中，菜谱详情界面中至少包括制作该菜谱时需要的菜谱食材控件，所述菜谱食材控件可以呈现为菜谱食材图标的样式，所述菜谱食材图标包括但不限于对应的菜谱食材图片、菜谱食材名称、菜谱食材数量等。应当理解，菜谱食材图片、菜谱食材名称、菜谱食材数量等可以是菜谱食材图标的一部分，即包含于菜谱食材图标。 In some embodiments, after the server matches the recipe information corresponding to the identification of the received recipe, it can send the recipe information to the smart refrigerator. In response to receiving the recipe information, the refrigerator processor can trigger the display to display the recipe details. Interface, wherein the recipe details interface at least includes the recipe ingredient controls required for making the recipe. The recipe ingredient controls can be presented in the style of recipe ingredient icons. The recipe ingredient icons include but are not limited to corresponding recipe ingredient pictures, recipes Ingredient names, recipe ingredient quantities, etc. It should be understood that the recipe ingredient pictures, recipe ingredient names, recipe ingredient quantities, etc. may be part of the recipe ingredient icon, that is, included in the recipe ingredient icon.
在一些实施例中，智能冰箱接收到服务器发送的菜谱信息后，冰箱处理器可以将菜谱食材集合中每一个菜谱食材名称与库存食材集合中的库存食材名称做对比，如果库存食材集合中存在与菜谱食材名称相同的库存食材名称，则说明冰箱中储藏有该食材，并进一步对比该食材的菜谱食材数量和库存食材数量，以判断冰箱内储藏的该食材的数量是否满足制作该菜谱的需要，若该食材的库存食材数量大于菜谱食材数量，则对该食材对应的菜谱食材名称添加库存标识，对比菜谱食材集合和库存食材集合后，可以触发显示菜谱详情界面，在该菜谱详情界面中，被添加库存标识的菜谱食材名称对应的菜谱食材控件的状态发生变化，以提示用户该菜谱食材在冰箱内储藏有足够的数量，可以满足制作该菜谱的需求。示例性的，对比菜谱食材集合和库存食材集合并对菜谱食材集合中的菜谱食材名称添加冰箱库存标识后，可以刷新用户界面，以在用户界面中显示如图17所示的菜谱详情界面，图17为本申请根据一些示例性的实施例示出的一种菜谱详情界面的示意图。该菜谱详情界面中显示有被库存图标900标记的菜谱食材控件和未被库存图标900标记的菜谱食材控件。In some embodiments, after the smart refrigerator receives the recipe information sent by the server, the refrigerator processor can compare the name of each recipe ingredient in the recipe ingredient set with the name of the inventory ingredient in the inventory ingredient set. If there is a name in the inventory ingredient set that matches The names of inventory ingredients with the same names as the recipe ingredients indicate that the ingredient is stored in the refrigerator. The quantity of the ingredient's recipe ingredients and the quantity of the ingredient in stock are further compared to determine whether the quantity of the ingredient stored in the refrigerator meets the needs of making the recipe. If the quantity of the ingredient in stock is greater than the quantity of the recipe ingredient, an inventory mark is added to the name of the recipe ingredient corresponding to the ingredient. After comparing the recipe ingredient set and the inventory ingredient set, the recipe details interface can be triggered. In the recipe details interface, the item being displayed is The status of the recipe ingredient control corresponding to the name of the recipe ingredient with the added inventory mark changes to remind the user that the recipe ingredient is stored in sufficient quantity in the refrigerator to meet the needs of making the recipe. For example, after comparing the recipe ingredient collection and the inventory ingredient collection and adding the refrigerator inventory identification to the recipe ingredient names in the recipe ingredient collection, the user interface can be refreshed to display the recipe details interface as shown in Figure 17 in the user interface, Figure 17 17 is a schematic diagram of a recipe details interface shown in this application according to some exemplary embodiments. The recipe details interface displays the recipe ingredient controls marked by the inventory icon 900 and the recipe ingredient controls not marked by the inventory icon 900 .
在一些实施例中，菜谱详情界面中还可以包括采购控件910，图18为本申请根据一些示例性的实施例示出的生成采购清单的流程示意图。如图18所示，在S2001中，处理器可以响应于用户对所述采购控件910的选中操作，在S2002中控制对比菜谱食材集合和库存食材集合，如果库存食材集合中存在与菜谱食材名称相同的库存食材名称，在S2003中，处理器控制对比库存食材数量是否大于菜谱食材数量，若否，则在S2004中，计算菜谱食材与库存食材的差值，并在S2005中，根据菜谱食材数量与库存食材数量的数量差值和菜谱食材名称生成第一列表信息。In some embodiments, the recipe details interface may also include a purchasing control 910. Figure 18 is a schematic flowchart of generating a purchasing list according to some exemplary embodiments of this application. As shown in Figure 18, in S2001, the processor may respond to the user's selection operation on the purchasing control 910, and in S2002, control the comparison of the recipe ingredient set and the inventory ingredient set. If there is a recipe ingredient with the same name as the recipe ingredient in the inventory ingredient set, The name of the inventory ingredient. In S2003, the processor controls whether the quantity of the inventory ingredient is greater than the quantity of the recipe ingredient. If not, in S2004, the difference between the recipe ingredient and the inventory ingredient is calculated, and in S2005, according to the quantity of the recipe ingredient and The quantity difference of the quantity of ingredients in stock and the names of recipe ingredients generate the first list of information.
如果库存食材集合中不存在与菜谱食材名称相同的库存食材名称，在S2006中，处理器根据菜谱食材名称和菜谱食材数量可以生成第二列表信息。If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, in S2006, the processor may generate second list information based on the recipe ingredient name and the recipe ingredient quantity.
示例性的，库存食材集合包括食材1/100g，食材2/80g以及食材3/20g，菜谱食材集合包括1/100g，食材2/500g，食材3/10g，食材9/50g，食材14/1kg以及食材15/200g，通过对比库存食材集合和菜谱食材集合，可以生成第一列表信息和第二采购清单，其中，第一采购清单包括食材2/420g，第二采购清单包括食材9/50g，食材14/1kg以及食材15/200g，且由于食材1和食材3的库存数量分别大于食材1和食材3的菜谱数量，因此食材1和食材3无需记录在任何采购清单中。For example, the stock ingredient set includes 1/100g of ingredients, 2/80g of ingredients, and 3/20g of ingredients, and the recipe ingredient set includes 1/100g, 2/500g of ingredients, 3/10g of ingredients, 9/50g of ingredients, and 14/1kg of ingredients. and 15/200g of ingredients. By comparing the stock ingredients collection and the recipe ingredient collection, the first list information and the second purchase list can be generated. The first purchase list includes 2/420g of ingredients, and the second purchase list includes 9/50g of ingredients. Ingredient 14/1kg and ingredient 15/200g, and since the inventory quantities of ingredient 1 and ingredient 3 are respectively greater than the recipe quantities of ingredient 1 and ingredient 3, ingredient 1 and ingredient 3 do not need to be recorded in any purchase list.
在一些实施例中，处理器控制生成第一列表信息和第二列表信息后，在S2007和S2008中，可以根据所述第一列表信息和第二列表信息触发显示采购清单界面，图19为本申请根据一些示例性的实施例示出的一种采购清单界面的示意图。以在如图19所示的采购清单页面中显示第一列表信息对应的第一采购清单和第二列表信息对应的第二采购清单。In some embodiments, after the processor controls to generate the first list information and the second list information, in S2007 and S2008, the purchase list interface can be triggered to be displayed based on the first list information and the second list information. Figure 19 shows this The application shows a schematic diagram of a purchase list interface according to some exemplary embodiments. The first purchase list corresponding to the first list information and the second purchase list corresponding to the second list information are displayed on the purchase list page as shown in FIG. 19 .
在一些实施例中，智能冰箱向服务器发送的菜谱获取请求还可以包括用户选中的菜谱图标的标识和库存食材集合，服务器接收到所述菜谱获取请求后，根据所述菜谱图标的标识，可以匹配对应的菜谱信息，所述菜谱信息至少包括制作该菜谱所需的菜谱食材集合，所述菜谱食材集合包括菜谱食材名称以及菜谱食材数量，服务器可以对比菜谱食材集合和库存食材集合，如果库存食材集合中存在与菜谱食材名称相同的库存食材名称，且菜谱食材数量大于库存食材数量，根据菜谱食材数量与库存食材数量的数量差值和菜谱食材名称可以生成第一列表信息。如果库存食材集合中不存在与菜谱食材名称相同的库存食材名称，根据菜谱食材名称和菜谱食材数量可以生成第二列表信息。 In some embodiments, the recipe acquisition request sent by the smart refrigerator to the server may also include the identification of the recipe icon selected by the user and the set of inventory ingredients. After the server receives the recipe acquisition request, it may match the identification of the recipe icon according to the identification of the recipe icon. Corresponding recipe information, the recipe information at least includes a set of recipe ingredients required to make the recipe. The set of recipe ingredients includes the name of the recipe ingredients and the quantity of the recipe ingredients. The server can compare the set of recipe ingredients and the set of inventory ingredients. If the set of inventory ingredients There is an inventory ingredient name that is the same as the recipe ingredient name in , and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient. The first list of information can be generated based on the quantity difference between the quantity of the recipe ingredient and the quantity of the inventory ingredient and the name of the recipe ingredient. If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient collection, the second list of information can be generated based on the recipe ingredient name and the recipe ingredient quantity.
在一些实施例中，服务器可以将菜谱信息、第一列表信息和第二列表信息发送至智能冰箱，冰箱处理器响应于接收到所述菜谱信息、第一列表信息和第二列表信息后，触发显示菜谱详情界面和/或采购清单界面，菜谱详情界面中至少包括制作该菜谱时需要的菜谱食材对应的菜谱食材控件，所述采购清单界面中至少包括第一列表信息对应的第一采购清单以及第二列表信息对应的第二采购清单。In some embodiments, the server may send the recipe information, the first list information, and the second list information to the smart refrigerator. In response to receiving the recipe information, the first list information, and the second list information, the refrigerator processor triggers Display the recipe details interface and/or the purchase list interface. The recipe details interface at least includes the recipe ingredient controls corresponding to the recipe ingredients required when making the recipe. The purchase list interface at least includes the first purchase list corresponding to the first list information and The second purchase list corresponding to the second list information.
在一些实施例中，所述采购清单界面还包括购物车控件111，处理器响应于用户对所述购物车控件111的选中操作，可以向所述服务器发送采购请求，所述采购请求包括所述第一采购清单对应的第一列表信息和所述第二采购清单对应的第二列表信息，所述采购请求用于请求所述服务器返回采购推荐列表，所述采购推荐列表至少包括针对所述第一列表信息和所述第二列表信息的购买链接，智能冰箱接收所述服务器返回的采购推荐列表后，可以控制在显示器的用户界面中显示如图20所示的采购推荐列表界面，图20为本申请根据一些示例性的实施例示出的采购推荐列表界面的示意图。所述采购推荐列表界面可以包括显示的采购清单上的食材名称、食材数量、购买链接以及购买价格等。In some embodiments, the purchase list interface also includes a shopping cart control 111. In response to the user's selection operation on the shopping cart control 111, the processor may send a purchase request to the server, where the purchase request includes the The first list information corresponding to the first purchase list and the second list information corresponding to the second purchase list, the purchase request is used to request the server to return a purchase recommendation list, the purchase recommendation list at least includes information for the third purchase list. A list of information and a purchase link of the second list of information. After receiving the purchase recommendation list returned by the server, the smart refrigerator can control the display of the purchase recommendation list interface as shown in Figure 20 in the user interface of the display. Figure 20 is This application shows a schematic diagram of a purchasing recommendation list interface according to some exemplary embodiments. The purchase recommendation list interface may include the name of the ingredients, the quantity of the ingredients, the purchase link, the purchase price, etc. on the displayed purchase list.
在一些实施例中，处理器控制生成第一列表信息和第二列表信息后，可以将第一列表信息和第二列表信息合并，生成第三列表信息，并根据所述第三列表信息，触发显示采购清单界面，图21为本申请根据一些示例性的实施例示出的另一种采购清单界面的示意图。以在如图21所示的采购清单界面中显示所述第三列表信息对应的第三采购清单。In some embodiments, after the processor controls the generation of the first list information and the second list information, the first list information and the second list information can be merged to generate the third list information, and trigger the trigger based on the third list information. The purchase list interface is displayed. Figure 21 is a schematic diagram of another purchase list interface shown in this application according to some exemplary embodiments. The third purchase list corresponding to the third list information is displayed in the purchase list interface as shown in FIG. 21 .
在一些实施例中，处理器响应于用户对所述采购控件910的选中操作，控制对比菜谱食材集合和库存食材集合，当库存食材集合中存在与菜谱食材名称相同的库存食材名称，且菜谱食材数量大于库存食材数量时，可以在菜谱详情界面中显示处于选中状态的所述菜谱食材对应的菜谱食材控件。In some embodiments, in response to the user's selection operation on the purchasing control 910, the processor controls the comparison of the recipe ingredient set and the inventory ingredient set. When there is an inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, and the recipe ingredient When the quantity is greater than the quantity of ingredients in stock, the recipe ingredient controls corresponding to the selected recipe ingredients can be displayed in the recipe details interface.
其中，当库存食材集合中存在与菜谱食材名称相同的库存食材名称，且菜谱食材数量大于库存食材数量时，处理器可以控制计算所述菜谱食材数量与所述库存食材数量的数量差值，且在菜谱详情界面中显示的处于选中状态的菜谱食材控件至少包括所述菜谱食材名称和所述差值。Wherein, when there is an inventory ingredient with the same name as the recipe ingredient in the inventory ingredient set, and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient, the processor can control to calculate the quantity difference between the quantity of the recipe ingredient and the quantity of the inventory ingredient, and The selected recipe ingredient control displayed in the recipe details interface at least includes the name of the recipe ingredient and the difference value.
在一些实施例中，当库存食材集合中不存在与所述菜谱食材名称相同的所述库存食材名称时，仍在所述菜谱详情界面中显示处于选中状态的所述菜谱食材对应的菜谱食材控件，其中，所述菜谱食材控件至少包括所述菜谱食材名称和所述菜谱食材数量。In some embodiments, when there is no inventory ingredient with the same name as the recipe ingredient in the inventory ingredient collection, the recipe ingredient control corresponding to the selected recipe ingredient is still displayed in the recipe details interface. , wherein the recipe ingredient control at least includes the name of the recipe ingredient and the quantity of the recipe ingredient.
在一些实施例中，当所述库存食材集合中存在与所述菜谱食材名称相同的库存食材名称，且库存食材数量大于菜谱食材数量时，可以在菜谱详情界面中显示未处于选中状态的所述菜谱食材对应的菜谱食材控件。In some embodiments, when there is an inventory ingredient with the same name as the recipe ingredient in the inventory ingredient set, and the number of inventory ingredients is greater than the number of recipe ingredients, the unselected ingredient can be displayed in the recipe details interface. Recipe ingredient controls corresponding to recipe ingredients.
在一些实施例中，用户可以对图17所示的菜谱食材控件进行选中操作，处理器响应于用户的操作，若检测到该菜谱食材控件包括的菜谱食材名称标记有库存标识，则生成并显示提醒界面，以提示用户该食材的库存充足。若检测到该菜谱食材控件包括的菜谱食材名称未标记有库存标识，则可以直接控制所述菜谱食材控件处于被选中状态。In some embodiments, the user can perform a selection operation on the recipe ingredient control shown in Figure 17. In response to the user's operation, the processor generates and displays the inventory identifier if it detects that the recipe ingredient name included in the recipe ingredient control is marked with an inventory identifier. Reminder interface to remind the user that the inventory of the ingredient is sufficient. If it is detected that the name of the recipe ingredient included in the recipe ingredient control is not marked with an inventory identifier, the recipe ingredient control can be directly controlled to be in a selected state.
在一些实施例中，用户对菜谱详情界面中的购物车控件进行选中操作，处理器响应于用户的操作，可以根据处于选中状态的菜谱食材控件，生成待采购食材的列表信息，所述待采购食材的列表信息包括处于选中状态的菜谱食材控件对应的菜谱食材名称和对应于所述菜谱食材名称的需要购买的食材数量。并向服务器发送采购请求，所述采购请求包括所述待采购食材的列表信息，所述采购请求用于请求所述服务器返回采购推荐列表，所述 采购推荐列表至少包括针对所述待采购食材的列表信息的购买链接，处理器接收服务器返回的采购推荐列表后，可以控制在显示器的用户界面中显示如图20所示的采购推荐列表界面。In some embodiments, the user selects the shopping cart control in the recipe details interface. In response to the user's operation, the processor can generate a list of ingredients to be purchased based on the recipe ingredient control in the selected state. The list information of the ingredients includes the name of the recipe ingredient corresponding to the selected recipe ingredient control and the quantity of the ingredient that needs to be purchased corresponding to the name of the recipe ingredient. and sends a purchase request to the server, the purchase request including the list information of the ingredients to be purchased, the purchase request is used to request the server to return a purchase recommendation list, the The purchase recommendation list at least includes a purchase link for the list information of the ingredients to be purchased. After receiving the purchase recommendation list returned by the server, the processor can control the display of the purchase recommendation list interface as shown in Figure 20 in the user interface of the display.
在一些实施例中，菜谱详情界面还可以包括对应于各菜谱食材控件的定位控件920，图22为本申请根据一些示例性的实施例示出的智能冰箱与服务器之间的交互示意图。如图22所示，用户对任意定位控件920进行选中操作后，在S2401中，处理器响应于用户的操作，发送定位请求至服务器，所述定位请求包括库存食材名称和食材检测器采集到的内景图像，所述定位请求用于请求服务器标记库存食材图像在所述内景图像中的位置，并返回标记后的所述内景图像，在S2402中，处理器响应于接收到服务器返回的标记后的所述内景图像，可以在所述显示器的用户界面中显示被标记后的所述内景图像。示例性的，用户对菜谱详情界面中与食材1绑定的定位控件进行选中操作后，处理器响应于用户的操作，发送定位请求至服务器，所述定位请求包括食材1的食材名称和食材检测器采集到的内景图像，服务器接收所述定位请求后，可以在内景图像中的标记食材1图像的位置，并返回标记后的内景图像，处理器响应于接收到服务器返回的标记后的所述内景图像，可以在所述显示器的用户界面中显示如图23所示的被标记后的所述内景图像，图23为根据一些实施例的内景图像的示意图。该内景图像中显示有检测框151，检测框151用于表示食材1所处的位置。In some embodiments, the recipe details interface may also include positioning controls 920 corresponding to each recipe ingredient control. Figure 22 is a schematic diagram of the interaction between a smart refrigerator and a server according to some exemplary embodiments of this application. As shown in Figure 22, after the user selects any positioning control 920, in S2401, the processor responds to the user's operation and sends a positioning request to the server. The positioning request includes the name of the inventory ingredients and the information collected by the ingredient detector. Interior image, the positioning request is used to request the server to mark the position of the stock ingredient image in the interior image, and return the marked interior image. In S2402, the processor responds to receiving the marked interior image returned by the server. The marked interior image may be displayed in a user interface of the display. For example, after the user selects the positioning control bound to ingredient 1 in the recipe details interface, the processor responds to the user's operation and sends a positioning request to the server. The positioning request includes the ingredient name and ingredient detection of ingredient 1. The interior image collected by the processor. After receiving the positioning request, the server can mark the position of the image of ingredient 1 in the interior image and return the marked interior image. The processor responds to the marked position returned by the server. The interior image may be displayed in the user interface of the display after being marked as shown in Figure 23. Figure 23 is a schematic diagram of the interior image according to some embodiments. A detection frame 151 is displayed in the interior image, and the detection frame 151 is used to indicate the location of the food material 1 .
在一些实施例中，智能冰箱可以通过服务器与其他终端设备进行连接，所述终端设备可以是手机、平板电脑，可穿戴设备等任意具有显示功能的设备，智能冰箱的处理器可以控制将库存食材集合、采购清单对应的列表信息等上传至服务器，并通过服务器转发给所述终端设备，例如，智能冰箱接收到用户输入的指示分享采购清单的分享指令后，冰箱处理器响应于所述分享指令，可以触发在所述显示器的用户界面显示用户列表，所述用户列表包括至少一个连接所述服务器的终端设备的设备标识，用户对用户列表中的设备标识进行选中操作，处理器响应于对所述设备标识的选中操作，可以向所述服务器发送同步指令，所述同步指令包括所述设备标识和所述采购清单对应的列表信息，所述同步指令用于指示所述服务器根据所述设备标识将所述采购清单对应的列表信息发送至所述终端设备，以使可以在所述终端设备上显示所述采购清单。In some embodiments, the smart refrigerator can be connected to other terminal devices through the server. The terminal device can be a mobile phone, a tablet, a wearable device, or any other device with a display function. The processor of the smart refrigerator can control the storage of ingredients. The collection, list information corresponding to the purchase list, etc. are uploaded to the server and forwarded to the terminal device through the server. For example, after the smart refrigerator receives a sharing instruction input by the user to share the purchase list, the refrigerator processor responds to the sharing instruction. , can trigger the display of a user list on the user interface of the display. The user list includes at least one device identification of a terminal device connected to the server. The user performs a selection operation on the device identification in the user list, and the processor responds to the For the selection operation of the device identifier, a synchronization instruction may be sent to the server. The synchronization instruction includes the list information corresponding to the device identifier and the purchase list. The synchronization instruction is used to instruct the server to select the device identifier based on the device identifier. The list information corresponding to the purchase list is sent to the terminal device, so that the purchase list can be displayed on the terminal device.
根据以上实施例，本申请实施例还提供一种终端设备，包括显示器、通信器和处理器，其中，显示器可以显示用户界面；通信器可以与服务器建立通信连接，以使所述终端设备通过服务器与连接所述服务器的智能冰箱之间进行信息交互；处理器用于执行相应的控制程序。According to the above embodiments, embodiments of the present application also provide a terminal device, including a display, a communicator, and a processor, wherein the display can display a user interface; the communicator can establish a communication connection with the server, so that the terminal device can communicate with the server through the server. Information interaction is performed with the smart refrigerator connected to the server; the processor is used to execute corresponding control programs.
参见图24，图24为本申请根据一些示例性的实施例示出的终端设备、智能冰箱与服务器之间的交互示意图。终端设备上可以安装有与上述智能冰箱相关联的应用程序，在S2601中，用户对终端设备输入开启所述应用程序的控制指令后，响应于用户输入的指令，运行该应用程序并可以向服务器发送用于指示获取智能冰箱的库存食材集合的控制指令，所述控制指令用于使所述服务器向所述智能冰箱发送获取库存食材集合请求，在S2602中，智能冰箱在同意所述库存食材集合请求后，可以发送所述库存食材集合至服务器，其中，所述库存食材集合至少包括智能冰箱内存储的库存食材对应的库存食材名称和库存食材数量；在S2603中，终端设备响应于接收到的服务器返回的库存食材集合，可以触发在用户界面中显示智能配菜界面，所述智能配菜界面中显示根据库存食材集合生成的库存食材 控件。Referring to Figure 24, Figure 24 is a schematic diagram of the interaction between a terminal device, a smart refrigerator and a server according to some exemplary embodiments of this application. The terminal device may be installed with an application program associated with the above-mentioned smart refrigerator. In S2601, after the user inputs a control instruction to the terminal device to open the application program, in response to the instruction input by the user, the application program is run and can be sent to the server. Send a control instruction for instructing to obtain a set of stock ingredients of the smart refrigerator. The control instruction is used to cause the server to send a request for obtaining a set of stock ingredients to the smart refrigerator. In S2602, the smart refrigerator agrees to the set of stock ingredients. After the request, the set of inventory ingredients can be sent to the server, where the set of inventory ingredients at least includes the name and quantity of the inventory ingredients corresponding to the inventory ingredients stored in the smart refrigerator; in S2603, the terminal device responds to the received The set of stock ingredients returned by the server can trigger the display of a smart side dish interface in the user interface. The smart side dish interface displays the stock ingredients generated based on the set of stock ingredients. controls.
用户对任意库存食材控件进行选中操作，处理器响应于用户的操作可以向服务器发送菜谱推荐请求，所述菜谱推荐请求包括用户选中的库存食材控件对应的库存食材名称和库存食材数量，服务器接收到所述库存食材名称和所述库存食材数量后，获取与所述库存食材名称和所述库存食材数量相匹配的若干菜谱，生成菜谱推荐列表，并将所述菜谱推荐列表发送至终端设备，终端设备响应于接收到服务器返回的菜谱推荐列表后，可以触发显示所述菜谱推荐列表，所述菜谱推荐列表包括至少一个针对所述库存食材名称和所述库存食材数量的菜谱图标。The user performs a selection operation on any inventory ingredient control. In response to the user's operation, the processor can send a recipe recommendation request to the server. The recipe recommendation request includes the name and quantity of the inventory ingredients corresponding to the inventory ingredient control selected by the user. The server receives After the names of the stock ingredients and the quantity of the stock ingredients are obtained, several recipes matching the names of the stock ingredients and the quantity of the stock ingredients are obtained, a recipe recommendation list is generated, and the recipe recommendation list is sent to the terminal device, and the terminal In response to receiving the recipe recommendation list returned by the server, the device may trigger display of the recipe recommendation list, where the recipe recommendation list includes at least one recipe icon for the name of the stock ingredient and the quantity of the stock ingredient.
在一些实施例中，响应于用户对菜谱推荐列表中任意菜谱图标的选中操作，终端设备可以向服务器发送菜谱获取请求，所述菜谱获取请求包括用户选中的菜谱图标的标识，服务器接收到所述菜谱获取请求后，根据所述菜谱图标的标识，可以匹配对应的菜谱信息，并将所述菜谱信息发送至处理器，其中，所述菜谱信息至少包括制作该菜谱所需的菜谱食材集合，所述菜谱食材集合包括菜谱食材名称以及菜谱食材数量，此外，所述菜谱信息还可以包括菜谱图片、制作该菜谱的步骤等，本申请不给予限制。In some embodiments, in response to the user's selection operation on any recipe icon in the recipe recommendation list, the terminal device may send a recipe acquisition request to the server, where the recipe acquisition request includes the identification of the recipe icon selected by the user, and the server receives the After the recipe acquisition request is made, the corresponding recipe information can be matched according to the identification of the recipe icon, and the recipe information is sent to the processor, where the recipe information at least includes a set of recipe ingredients required to make the recipe, so The set of recipe ingredients includes the name of the recipe ingredients and the quantity of the recipe ingredients. In addition, the recipe information may also include recipe pictures, steps for making the recipe, etc., which are not limited by this application.
在一些实施例中，终端设备接收到服务器发送的菜谱信息后，可以将菜谱食材集合中每一个菜谱食材名称与库存食材集合中的库存食材名称做对比，如果库存食材集合中存在与菜谱食材名称相同的库存食材名称，则说明冰箱中储藏有该食材，并进一步对比该食材的菜谱食材数量和库存食材数量，以判断冰箱内储藏的该食材的数量是否满足制作该菜谱的需要，若该食材的菜谱食材数量大于库存食材数量，则对该食材对应的菜谱食材名称添加库存标识，对比菜谱食材集合和库存食材集合后，可以触发显示菜谱详情界面，在该菜谱详情界面中，被添加库存标识的菜谱食材名称对应的菜谱食材控件的状态发生变化，例如，该菜谱食材控件旁显示有库存图标，以提示用户该菜谱食材在冰箱内储藏有足够的数量，可以满足制作该菜谱的需求。示例性的，对比菜谱食材集合和库存食材集合并对菜谱食材集合中的菜谱食材名称添加冰箱库存标识后，可以刷新用户界面，以在用户界面中显示菜谱详情界面，该菜谱详情界面中显示有被库存图标标记的菜谱食材控件和未被库存图标标记的菜谱食材控件。In some embodiments, after receiving the recipe information sent by the server, the terminal device can compare the name of each recipe ingredient in the recipe ingredient set with the name of the inventory ingredient in the inventory ingredient set. If there is a name in the inventory ingredient set that matches the name of the recipe ingredient The same name of the ingredient in stock means that the ingredient is stored in the refrigerator, and the quantity of the ingredient in the recipe and the quantity of the ingredient in stock are further compared to determine whether the quantity of the ingredient stored in the refrigerator meets the needs of making the recipe. If the ingredient The number of ingredients in the recipe is greater than the number of ingredients in stock, then the inventory identification is added to the name of the recipe ingredient corresponding to the ingredient. After comparing the recipe ingredient collection and the inventory ingredient collection, the recipe details interface can be triggered. In the recipe details interface, the inventory identification is added The status of the recipe ingredient control corresponding to the recipe ingredient name changes. For example, a stock icon is displayed next to the recipe ingredient control to remind the user that the recipe ingredients are stored in sufficient quantities in the refrigerator to meet the needs of making the recipe. For example, after comparing the recipe ingredient collection and the inventory ingredient collection and adding the refrigerator inventory identification to the recipe ingredient names in the recipe ingredient collection, the user interface can be refreshed to display the recipe details interface in the user interface, and the recipe details interface displays Recipe ingredient controls marked by the inventory icon and recipe ingredient controls not marked by the inventory icon.
在一些实施例中，菜谱详情界面中还可以包括采购控件，终端设备响应于用户对所述采购控件的选中操作，可以对比菜谱食材集合和库存食材集合，如果库存食材集合中存在与菜谱食材名称相同的库存食材名称，且菜谱食材数量大于库存食材数量，根据菜谱食材数量与库存食材数量的数量差值和菜谱食材名称可以生成第一列表信息。如果库存食材集合中不存在与菜谱食材名称相同的库存食材名称，根据菜谱食材名称和菜谱食材数量可以生成第二列表信息。In some embodiments, the recipe details interface may also include a purchasing control. In response to the user's selection operation of the purchasing control, the terminal device may compare the recipe ingredient collection and the inventory ingredient collection. If the inventory ingredient set contains the same name as the recipe ingredient, For the same inventory ingredient names, and the quantity of the recipe ingredients is greater than the quantity of the inventory ingredients, the first list of information can be generated based on the quantity difference between the quantity of the recipe ingredients and the quantity of the inventory ingredients and the names of the recipe ingredients. If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient collection, the second list of information can be generated based on the recipe ingredient name and the recipe ingredient quantity.
在一些实施例中，终端设备控制生成第一列表信息和第二列表信息后，可以根据所述第一列表信息和第二列表信息触发显示采购清单界面，所述第一列表信息对应的第一采购清单和所述第二列表信息对应的第二采购清单均显示在采购清单界面中。In some embodiments, after the terminal device controls the generation of the first list information and the second list information, the display of the purchase list interface can be triggered based on the first list information and the second list information. The first list information corresponding to the first list information can trigger the display of the purchase list interface. Both the purchase list and the second purchase list corresponding to the second list information are displayed in the purchase list interface.
在一些实施例中，终端设备向服务器发送的菜谱获取请求还可以包括用户选中的菜谱图标的标识，服务器接收到所述菜谱获取请求后，根据所述菜谱图标的标识，可以匹配对应的菜谱信息，所述菜谱信息至少包括制作该菜谱所需的菜谱食材集合，所述菜谱食材集合包括菜谱食材名称以及菜谱食材数量，之后，服务器向智能冰箱发送库存食材获取请求，以获取智能冰箱内存储的库存食材集合，服务器接收到智能冰箱发送的库存食材集合后， 可以对比菜谱食材集合和库存食材集合，如果库存食材集合中存在与菜谱食材名称相同的库存食材名称，且菜谱食材数量大于库存食材数量，根据菜谱食材数量与库存食材数量的数量差值和菜谱食材名称可以生成第一列表信息。如果库存食材集合中不存在与菜谱食材名称相同的库存食材名称，根据菜谱食材名称和菜谱食材数量可以生成第二列表信息。In some embodiments, the recipe acquisition request sent by the terminal device to the server may also include the identifier of the recipe icon selected by the user. After the server receives the recipe acquisition request, the server may match the corresponding recipe information based on the identifier of the recipe icon. , the recipe information at least includes a set of recipe ingredients required to make the recipe, and the set of recipe ingredients includes the name of the recipe ingredients and the quantity of the recipe ingredients. After that, the server sends a stock ingredient acquisition request to the smart refrigerator to obtain the inventory ingredients stored in the smart refrigerator. Inventory ingredient collection. After the server receives the inventory ingredient collection sent by the smart refrigerator, You can compare the recipe ingredient collection and the inventory ingredient collection. If there is an inventory ingredient with the same name as the recipe ingredient in the inventory ingredient set, and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient, the difference in quantity between the quantity of the recipe ingredient and the quantity of the inventory ingredient and the quantity of the recipe ingredient will be compared. The name can generate the first list of information. If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient collection, the second list of information can be generated based on the recipe ingredient name and the recipe ingredient quantity.
在一些实施例中，服务器可以将菜谱信息、第一列表信息和第二列表信息发送至终端设备，终端设备的处理器响应于接收到所述菜谱信息、第一列表信息和第二列表信息后，触发显示菜谱详情界面和/或采购清单界面，菜谱详情界面中至少包括制作该菜谱时需要的菜谱食材对应的菜谱食材控件，所述采购清单界面中至少包括第一列表信息对应的第一采购清单以及第二列表信息对应的第二采购清单。In some embodiments, the server may send the recipe information, the first list information, and the second list information to the terminal device, and the processor of the terminal device responds to receiving the recipe information, the first list information, and the second list information. , triggering the display of the recipe details interface and/or the purchase list interface. The recipe details interface at least includes the recipe ingredient controls corresponding to the recipe ingredients required when making the recipe. The purchase list interface at least includes the first purchase corresponding to the first list information. list and the second purchase list corresponding to the information in the second list.
在一些实施例中，所述采购清单界面还包括购物车控件，终端设备响应于用户对所述购物车控件的选中操作，可以向所述服务器发送采购请求，所述采购请求包括所述第一列表信息和所述第二列表信息，所述采购请求用于请求所述服务器返回采购推荐列表，所述采购推荐列表至少包括针对所述第一列表信息和所述第二列表信息中的待采购食材的购买链接，终端设备接收所述服务器返回的采购推荐列表后，可以控制在用户界面中显示采购推荐列表界面，所述采购推荐列表界面可以包括第一列表信息和第二列表信息对应的待采购食材的食材名称、食材数量、购买链接以及购买价格等。In some embodiments, the purchase list interface further includes a shopping cart control. In response to the user's selection operation on the shopping cart control, the terminal device may send a purchase request to the server, where the purchase request includes the first List information and the second list information, the purchase request is used to request the server to return a purchase recommendation list, the purchase recommendation list at least includes items to be purchased in the first list information and the second list information. For the purchase link of food ingredients, after the terminal device receives the purchase recommendation list returned by the server, it can control the display of the purchase recommendation list interface in the user interface. The purchase recommendation list interface can include the first list information and the second list information corresponding to the to-be-received list. The name of the ingredients, the quantity of the ingredients, the purchase link and the purchase price of the purchased ingredients.
以上UI分别以智能冰箱、终端设备为例，交互内容以智能冰箱、服务器以及智能终端为例，其他类别的智能冰箱、终端设备在生成采购清单时的UI基本与上述UI相似，这里不再一一列举。本申请提供的UI界面仅仅是示例性，具体以实际应用和设计为准。The above UI takes smart refrigerators and terminal equipment as examples respectively, and the interactive content takes smart refrigerators, servers, and smart terminals as examples. The UI of other categories of smart refrigerators and terminal equipment when generating purchase lists is basically similar to the above UI, and will not be repeated here. List one. The UI interface provided in this application is only an example, and the actual application and design shall prevail.
根据以上实施例，本申请实施例还提供一种采购清单生成方法，该方法可在智能冰箱侧执行，方法的执行主体为智能冰箱中的处理器。方法包括：According to the above embodiments, embodiments of the present application also provide a method for generating a purchase list, which can be executed on the smart refrigerator side, and the execution subject of the method is a processor in the smart refrigerator. Methods include:
S100：接收用户输入的菜谱选择指令。S100: Receive recipe selection instructions input by the user.
在一些实施例中，接收用户输入的菜谱选择指令之前，所述方法还包括接收用户输入的指示识别库存食材的控制指令；响应于所述控制指令，向服务器发送食材识别请求，所述食材识别请求包括所述内景图像，所述食材识别请求用于请求所述服务器识别所述内景图像，并返回所述库存食材集合；接收所述服务器返回的所述库存食材集合；根据所述库存食材集合，在所述显示器的用户界面上显示针对所述库存食材名称的食材控件和所述库存食材数量。In some embodiments, before receiving the recipe selection instruction input by the user, the method further includes receiving a control instruction input by the user indicating the identification of inventory ingredients; in response to the control instruction, sending an ingredient identification request to the server, the ingredient identification The request includes the interior image, and the ingredient identification request is used to request the server to identify the interior image and return the inventory ingredient set; receive the inventory ingredient set returned by the server; and according to the inventory ingredient set , displaying an ingredient control for the name of the inventory ingredient and the quantity of the inventory ingredient on the user interface of the display.
在一些实施例中，所述方法还包括接收用户对所述食材控件的选中操作；响应于对所述食材控件的选中操作，发送菜谱推荐请求至所述服务器，所述菜谱推荐请求包括针对所述食材控件的所述库存食材名称和所述库存食材数量；接收服务器响应于所述菜谱推荐请求返回的菜谱推荐列表，所述菜谱推荐列表包括至少一个针对所述食材名称和所述菜谱食材数量的菜谱；在所述显示器的用户界面上显示所述菜谱推荐列表。In some embodiments, the method further includes receiving a user's selection operation on the food ingredient control; in response to the selection operation on the food ingredient control, sending a recipe recommendation request to the server, where the recipe recommendation request includes a selection for the food ingredient control. The inventory ingredient name and the inventory ingredient quantity of the ingredient control; receiving a recipe recommendation list returned by the server in response to the recipe recommendation request, the recipe recommendation list including at least one item for the ingredient name and the recipe ingredient quantity of recipes; displaying the recipe recommendation list on the user interface of the display.
S120：响应于所述菜谱选择指令，获取菜谱食材集合和库存食材集合，所述菜谱食材集合包括菜谱食材名称和针对所述菜谱食材名称的菜谱食材数量，所述库存食材集合包括库存食材名称和针对所述库存食材名称的库存食材数量。S120: In response to the recipe selection instruction, obtain a recipe ingredient set and a stock ingredient set. The recipe ingredient set includes the name of the recipe ingredient and the quantity of the recipe ingredient for the name of the recipe ingredient. The set of stock ingredients includes the name of the inventory ingredient and The quantity of the inventory ingredient for the inventory ingredient name.
在一些实施例中，所述获取菜谱食材集合和库存食材集合，还包括如果所述库存食材集合中存在与所述菜谱食材名称相同的所述库存食材名称，且所述菜谱食材数量大于所述库存食材数量，对所述菜谱食材名称添加库存标识；根据添加所述库存标识后的所述菜谱食材集合，在所述显示器的用户界面中显示菜谱食材列表，所述菜谱食材列表至少包括所 述菜谱食材名称、所述菜谱食材数量以及针对所述菜谱食材名称添加的所述库存标识。In some embodiments, obtaining a set of recipe ingredients and a set of stock ingredients also includes if there is a name of the stock ingredient that is the same as the name of the recipe ingredient in the set of stock ingredients, and the number of the recipe ingredients is greater than the The quantity of ingredients in stock is added to the name of the recipe ingredients. According to the set of recipe ingredients after adding the inventory ID, a list of recipe ingredients is displayed in the user interface of the display. The list of recipe ingredients at least includes all the ingredients. The name of the recipe ingredient, the quantity of the recipe ingredient, and the inventory identification added to the name of the recipe ingredient.
在一些实施例中，所述获取菜谱食材集合和库存食材集合还包括根据当前时间和库存食材存入所述储藏室中的时间，计算库存食材的新鲜度；如果所述新鲜度低于阈值，则将所述库存食材的库存食材名称和库存食材数量从所述库存食材集合中删除。In some embodiments, obtaining the recipe ingredient set and the inventory ingredient set further includes calculating the freshness of the inventory ingredients based on the current time and the time when the inventory ingredients are stored in the storage room; if the freshness is lower than a threshold, Then the inventory ingredient name and inventory ingredient quantity of the inventory ingredient are deleted from the inventory ingredient set.
在一些实施例中，所述获取菜谱食材集合和库存食材集合还包括如果所述库存食材集合中存在与所述菜谱食材名称相同的所述库存食材名称，且所述库存食材数量大于所述菜谱食材数量，则发送定位请求至所述服务器，所述定位请求包括所述库存食材名称和所述内景图像，所述定位请求用于请求所述服务器标记库存食材图像在所述内景图像中的位置，并返回标记后的所述内景图像；接收所述服务器返回的标记后的所述内景图像；在所述显示器的用户界面中显示所述内景图像。In some embodiments, obtaining the recipe ingredient set and the inventory ingredient set further includes if there is an inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, and the inventory ingredient quantity is greater than the recipe If the quantity of ingredients is determined, a positioning request is sent to the server. The positioning request includes the name of the inventory ingredients and the interior image. The positioning request is used to request the server to mark the position of the image of the inventory ingredients in the interior image. , and returns the marked interior image; receives the marked interior image returned by the server; and displays the interior image in the user interface of the display.
S130：如果所述库存食材集合中存在与所述菜谱食材名称相同的所述库存食材名称，且所述菜谱食材数量大于所述库存食材数量，根据所述菜谱食材数量与所述库存食材数量的数量差值和所述菜谱食材名称生成第一列表信息，以及在所述显示器的用户界面中显示所述第一列表信息对应的第一采购清单。S130: If there is the same name of the inventory ingredient as the name of the recipe ingredient in the set of inventory ingredients, and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient, according to the number of the recipe ingredient and the quantity of the inventory ingredient The quantity difference and the names of the recipe ingredients generate first list information, and a first purchase list corresponding to the first list information is displayed in the user interface of the display.
S140：如果所述库存食材集合中不存在与所述菜谱食材名称相同的所述库存食材名称，根据所述菜谱食材名称和所述菜谱食材数量生成第二列表信息，以及在所述显示器的用户界面中显示所述第二列表信息对应的第二采购清单。S140: If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, generate second list information based on the recipe ingredient name and the recipe ingredient quantity, and the user on the display The second purchase list corresponding to the second list information is displayed on the interface.
在一些实施例中，所述方法还包括向所述服务器发送采购请求，所述采购请求包括所述第一列表信息和所述第二列表信息，所述采购请求用于请求所述服务器返回采购推荐列表，所述采购推荐列表至少包括针对所述第一列表信息和所述第二列表信息的购买链接；接收所述服务器返回的采购推荐列表；在所述显示器的用户界面中显示所述采购推荐列表。In some embodiments, the method further includes sending a purchase request to the server, the purchase request including the first list information and the second list information, and the purchase request is used to request the server to return a purchase request. Recommendation list, the purchase recommendation list at least includes purchase links for the first list information and the second list information; receiving the purchase recommendation list returned by the server; displaying the purchase in the user interface of the display Recommended list.
在一些实施例中，所述方法还包括接收用户输入的指示分享采购清单的分享指令；响应于所述分享指令，在所述显示器的用户界面显示用户列表，所述用户列表包括连接所述服务器的终端设备的设备标识；接收用户对所述用户列表中的所述设备标识的选中操作；响应于对所述设备标识的选中操作，向所述服务器发送同步指令，所述同步指令包括所述设备标识、所述第一列表信息和所述第二列表信息，所述同步指令用于指示所述服务器根据所述设备标识将所述第一列表信息和所述第二列表信息发送至所述终端设备。In some embodiments, the method further includes receiving a sharing instruction input by the user indicating sharing of the purchase list; in response to the sharing instruction, displaying a user list on the user interface of the display, the user list including connecting to the server the device identification of the terminal device; receiving the user's selection operation on the device identification in the user list; in response to the selection operation on the device identification, sending a synchronization instruction to the server, where the synchronization instruction includes the device identification, the first list information and the second list information. The synchronization instruction is used to instruct the server to send the first list information and the second list information to the server according to the device identification. Terminal Equipment.
为了方便解释，已经结合具体的实施方式进行了上述说明。但是，上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导，可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用，从而使得本领域技术人员更好的使用所述实施方式以及适于具体使用考虑的各种不同的变形的实施方式。 For convenience of explanation, the above description has been made in conjunction with specific implementation modes. However, the above illustrative discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed. Various modifications and variations are possible in light of the above teachings. The above embodiments are selected and described to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various modified embodiments suitable for specific use considerations.

Claims (19)

  1. 一种电子设备，所述电子设备包括：An electronic device, the electronic device includes:
    显示器，用于显示内容；Display, used to display content;
    通信器，用于与外部设备通信；Communicator, used to communicate with external devices;
    处理器，所述处理器与所述显示器通信连接，所述处理器被配置为：A processor, the processor is communicatively connected to the display, and the processor is configured to:
    响应于菜谱推荐的操作，确定食材请求信息，所述食材请求信息用于获取食材存储设备在本地存储的食材信息；In response to the operation of recipe recommendation, determine the ingredient request information, where the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device;
    根据所述食材信息获取菜谱；Obtain recipes based on the ingredient information;
    控制所述显示器展示所述菜谱。The display is controlled to display the recipe.
  2. 根据权利要求1所述的电子设备，若所述电子设备与所述食材存储设备非同一设备，所述处理器还被配置为：The electronic device according to claim 1, if the electronic device and the food storage device are not the same device, the processor is further configured to:
    获取与所述电子设备接入同一局域网的食材存储设备的局域网地址；Obtain the LAN address of the food storage device connected to the same LAN as the electronic device;
    根据所述显示设备的局域网地址确定食材请求信息；Determine food ingredient request information according to the LAN address of the display device;
    根据所述食材存储设备的局域网地址发送所述食材请求信息；Send the food material request information according to the local area network address of the food material storage device;
    接收所述食材信息。Receive the ingredient information.
  3. 根据权利要求2所述的电子设备，所述处理器进一步被配置为：The electronic device of claim 2, the processor further configured to:
    根据所述显示设备的局域网地址确定并发送地址请求信息，所述地址请求信息用于获取食材存储设备的局域网地址；Determine and send address request information according to the LAN address of the display device, where the address request information is used to obtain the LAN address of the food storage device;
    接收地址响应信息，所述地址响应信息包括所述食材存储设备的局域网地址。Receive address response information, where the address response information includes the local area network address of the food material storage device.
  4. 根据权利要求3所述的电子设备，所述地址响应信息还包括所述食材存储设备的登录账号信息，所述登录账号信息包括用户标识。The electronic device according to claim 3, the address response information further includes login account information of the food material storage device, and the login account information includes a user identification.
  5. 根据权利要求4所述的电子设备，所述处理器被配置为：The electronic device of claim 4, the processor configured to:
    确定所述电子设备的登录账号信息和所述食材存储设备的登录账号信息是否相同；Determine whether the login account information of the electronic device and the login account information of the food storage device are the same;
    若相同，则所述根据所述食材存储设备的局域网地址确定并发送食材请求信息，包括：If they are the same, then determining and sending the food material request information based on the local area network address of the food material storage device, including:
    确定所述食材存储设备为食材来源设备；Determine the food material storage device as the food material source device;
    根据所述食材来源设备的局域网地址确定食材请求信息；Determine the food material request information according to the LAN address of the food material source device;
    向所述食材来源设备发送所述食材请求信息。Send the food material request information to the food material source device.
  6. 根据权利要求1所述的电子设备，所述食材信息包括食材类别、食材名称、食材的存入时间和食材的保质期。The electronic device according to claim 1, wherein the food material information includes food material category, food material name, food material storage time, and food material shelf life.
  7. 根据权利要求6所述的电子设备，所述根据所述食材信息获取菜谱，进一步被配置为：The electronic device according to claim 6, said obtaining recipes according to said ingredient information, is further configured to:
    根据当前时刻、所述食材的存入时间和所述食材的保质期确定每一食材的临期时间，所述临期时间为当前时刻距离食材的保质日期的时间；Determine the expiry time of each food ingredient based on the current time, the storage time of the food material and the shelf life of the food material, where the expiry time is the time from the current moment to the shelf life date of the food material;
    根据每一食材的临期时间对所有食材排序，并确定符合第一预设条件的食材的食材信息；Sort all the ingredients according to the expiration time of each ingredient, and determine the ingredient information of the ingredients that meet the first preset condition;
    向服务器发送所述符合第一预设条件的食材的食材信息；Send the ingredient information of the ingredient that meets the first preset condition to the server;
    接收来自所述服务器的菜谱，所述菜谱是所述服务器根据所述符合第一预设条件的食材的食材信息确定的。Receive a recipe from the server, where the recipe is determined by the server based on the ingredient information of the ingredient that meets the first preset condition.
  8. 根据权利要求1所述的电子设备，所述电子设备还包括：The electronic device according to claim 1, further comprising:
    箱体，内设有储藏室； The box has a storage room inside;
    食材检测器，用于采集所述储藏室的内景图像；Food detector, used to collect interior images of the storage room;
    所述处理器，还被配置为：The processor is also configured to:
    接收用户输入的菜谱选择指令；Receive recipe selection instructions input by the user;
    响应于所述菜谱选择指令，获取菜谱食材集合和库存食材集合，所述菜谱食材集合包括菜谱食材名称和针对所述菜谱食材名称的菜谱食材数量，所述库存食材集合包括库存食材名称和针对所述库存食材名称的库存食材数量；In response to the recipe selection instruction, a recipe ingredient set and a stock ingredient set are obtained. The recipe ingredient set includes the name of the recipe ingredient and the quantity of the recipe ingredient for the recipe ingredient name. The stock ingredient set includes the name of the inventory ingredient and the number of the recipe ingredient for the name. The quantity of the inventory ingredients stated in the name of the inventory ingredients;
    如果所述库存食材集合中存在与所述菜谱食材名称相同的所述库存食材名称，且所述菜谱食材数量大于所述库存食材数量，根据所述菜谱食材数量与所述库存食材数量的数量差值和所述菜谱食材名称生成第一列表信息，以及控制所述显示器显示所述第一列表信息对应的第一采购清单；If there is a name of the inventory ingredient that is the same as the name of the recipe ingredient in the set of inventory ingredients, and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient, according to the quantity difference between the quantity of the recipe ingredient and the quantity of the inventory ingredient value and the name of the recipe ingredient to generate first list information, and control the display to display the first purchase list corresponding to the first list information;
    如果所述库存食材集合中不存在与所述菜谱食材名称相同的所述库存食材名称，根据所述菜谱食材名称和所述菜谱食材数量生成第二列表信息，以及控制所述显示器显示所述第二列表信息对应的第二采购清单。If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, generate second list information based on the recipe ingredient name and the recipe ingredient quantity, and control the display to display the third list information. The second purchase list corresponding to the information in the second list.
  9. 根据权利要求8所述的电子设备，所述处理器还被配置为：The electronic device of claim 8, the processor further configured to:
    所述接收用户输入的菜谱选择指令步骤之前，接收用户输入的指示识别库存食材的控制指令；Before the step of receiving the recipe selection instruction input by the user, receive a control instruction input by the user instructing to identify the ingredients in stock;
    响应于所述控制指令，向服务器发送食材识别请求，所述食材识别请求包括所述内景图像，所述食材识别请求用于请求所述服务器识别所述内景图像，并返回所述库存食材集合；In response to the control instruction, send a food ingredient identification request to the server, where the food ingredient identification request includes the interior image, and the food ingredient identification request is used to request the server to identify the interior image and return the inventory food set;
    接收所述服务器返回的所述库存食材集合；Receive the set of inventory ingredients returned by the server;
    根据所述库存食材集合，在所述显示器上显示针对所述库存食材名称的食材控件。According to the set of inventory ingredients, an ingredient control for the name of the inventory ingredients is displayed on the display.
  10. 根据权利要求9所述的电子设备，所述处理器还被配置为：The electronic device of claim 9, the processor further configured to:
    接收用户对所述食材控件的选中操作；Receive the user's selection operation on the food ingredient control;
    响应于对所述食材控件的选中操作，发送菜谱推荐请求至所述服务器，所述菜谱推荐请求包括针对所述食材控件的所述库存食材名称和所述库存食材数量；In response to the selection operation of the food ingredient control, send a recipe recommendation request to the server, where the recipe recommendation request includes the name of the inventory ingredient and the quantity of the inventory ingredient for the ingredient control;
    接收所述服务器响应于所述菜谱推荐请求返回的菜谱推荐列表，所述菜谱推荐列表包括至少一个针对所述食材名称和所述菜谱食材数量的菜谱；Receive a recipe recommendation list returned by the server in response to the recipe recommendation request, where the recipe recommendation list includes at least one recipe for the name of the ingredient and the quantity of the recipe ingredient;
    在所述显示器上显示所述菜谱推荐列表。The recipe recommendation list is displayed on the display.
  11. 根据权利要求8所述的电子设备，所述处理器还被配置为：The electronic device of claim 8, the processor further configured to:
    如果所述库存食材集合中存在与所述菜谱食材名称相同的所述库存食材名称，且所述库存食材数量大于所述菜谱食材数量，对所述菜谱食材名称添加库存标识；If there is a name of the inventory ingredient that is the same as the name of the recipe ingredient in the set of inventory ingredients, and the number of the inventory ingredients is greater than the number of the recipe ingredients, add an inventory identification to the name of the recipe ingredient;
    根据添加所述库存标识后的所述菜谱食材集合，在所述显示器中显示菜谱食材列表，所述菜谱食材列表至少包括所述菜谱食材名称、所述菜谱食材数量以及针对所述菜谱食材名称添加的所述库存标识。According to the set of recipe ingredients after adding the inventory identification, a list of recipe ingredients is displayed on the display. The list of recipe ingredients at least includes the name of the recipe ingredient, the quantity of the recipe ingredient, and the addition of the name of the recipe ingredient. of the inventory identification.
  12. 根据权利要求8所述的电子设备，所述处理器还被配置为：The electronic device of claim 8, the processor further configured to:
    根据当前时间和库存食材存入所述储藏室中的时间，计算库存食材的新鲜度；Calculate the freshness of the inventory ingredients based on the current time and the time the inventory ingredients were stored in the storage room;
    如果所述新鲜度低于阈值，则将所述库存食材的库存食材名称和库存食材数量从所述库存食材集合中删除。If the freshness is lower than the threshold, the inventory ingredient name and inventory ingredient quantity of the inventory ingredient are deleted from the inventory ingredient collection.
  13. 根据权利要求8所述的电子设备，所述处理器还被配置为：The electronic device of claim 8, the processor further configured to:
    向服务器发送采购请求，所述采购请求包括所述第一采购清单和所述第二采购清单， 所述采购请求用于请求所述服务器返回采购推荐列表，所述采购推荐列表至少包括针对所述第一采购清单和所述第二采购清单的购买链接；Send a purchase request to the server, the purchase request including the first purchase list and the second purchase list, The purchase request is used to request the server to return a purchase recommendation list, where the purchase recommendation list at least includes purchase links for the first purchase list and the second purchase list;
    接收所述服务器返回的采购推荐列表；Receive the purchase recommendation list returned by the server;
    在所述显示器中显示所述采购推荐列表。The purchase recommendation list is displayed on the display.
  14. 根据权利要求8所述的电子设备，所述处理器还被配置为：The electronic device of claim 8, the processor further configured to:
    接收用户输入的指示分享采购清单的分享指令；Receive sharing instructions input by the user instructing to share the purchase list;
    响应于所述分享指令，在所述显示器显示用户列表，所述用户列表包括与所述电子设备连接同一服务器的终端设备的设备标识；In response to the sharing instruction, display a user list on the display, where the user list includes device identifications of terminal devices connected to the same server as the electronic device;
    接收用户对所述用户列表中的所述设备标识的选中操作；Receive a user's selection operation on the device identification in the user list;
    响应于对所述设备标识的选中操作，向所述服务器发送同步指令，所述同步指令包括所述设备标识、所述第一采购清单和所述第二采购清单，所述同步指令用于指示所述服务器根据所述设备标识将所述第一采购清单和所述第二采购清单发送至所述终端设备。In response to the selection operation of the equipment identification, a synchronization instruction is sent to the server, the synchronization instruction includes the equipment identification, the first purchase list and the second purchase list, and the synchronization instruction is used to indicate The server sends the first purchase list and the second purchase list to the terminal device according to the device identification.
  15. 根据权利要求8所述的电子设备，所述处理器还被配置为：The electronic device of claim 8, the processor further configured to:
    如果所述库存食材集合中存在与所述菜谱食材名称相同的所述库存食材名称，且所述库存食材数量大于所述菜谱食材数量，则发送定位请求至服务器，所述定位请求包括所述库存食材名称和所述内景图像，所述定位请求用于请求所述服务器标记库存食材图像在所述内景图像中的位置，并返回标记后的所述内景图像；If there is a name of the inventory ingredient that is the same as the name of the recipe ingredient in the set of inventory ingredients, and the number of the inventory ingredients is greater than the number of the recipe ingredients, a positioning request is sent to the server, and the positioning request includes the inventory The name of the food ingredient and the interior image, the positioning request is used to request the server to mark the location of the stock food image in the interior image, and return the marked interior image;
    接收所述服务器返回的标记后的所述内景图像；Receive the marked interior image returned by the server;
    在所述显示器中显示所述内景图像。The interior image is displayed on the display.
  16. 一种用于电子设备的数据处理方法，所述方法包括：A data processing method for electronic equipment, the method includes:
    电子设备响应于菜谱推荐的操作，确定食材请求信息，所述食材请求信息用于获取食材存储设备在本地存储的食材信息；In response to the operation of recipe recommendation, the electronic device determines the ingredient request information, and the ingredient request information is used to obtain the ingredient information stored locally by the ingredient storage device;
    根据所述食材信息获取菜谱；Obtain recipes based on the ingredient information;
    所述电子设备控制其显示器展示所述菜谱。The electronic device controls its display to display the recipe.
  17. 根据权利要求16所述的方法，若所述电子设备与所述食材存储设备非同一设备，所述响应于菜谱推荐的操作，确定食材请求信息，包括：The method according to claim 16, if the electronic device and the food material storage device are not the same device, the operation in response to recipe recommendation, determining the food material request information includes:
    获取与所述电子设备接入同一局域网的食材存储设备的局域网地址；Obtain the LAN address of the food storage device connected to the same LAN as the electronic device;
    根据所述电子设备的局域网地址确定食材请求信息；Determine food ingredient request information according to the LAN address of the electronic device;
    根据所述食材存储设备的局域网地址发送所述食材请求信息；Send the food material request information according to the local area network address of the food material storage device;
    接收所述食材信息。Receive the ingredient information.
  18. 根据权利要求17所述的方法，所述获取与所述电子设备接入同一局域网的食材存储设备的局域网地址包括：The method according to claim 17, said obtaining the local area network address of a food storage device connected to the same local area network as the electronic device includes:
    根据所述电子设备的局域网地址确定并发送地址请求信息，所述地址请求信息用于获取食材存储设备的局域网地址；Determine and send address request information according to the LAN address of the electronic device, where the address request information is used to obtain the LAN address of the food storage device;
    接收来自所述食材存储设备的地址响应信息，所述地址响应信息包括所述食材存储设备的局域网地址。Receive address response information from the food material storage device, where the address response information includes the local area network address of the food material storage device.
  19. 根据权利要求16所述的方法，所述方法还包括：The method of claim 16, further comprising:
    所述电子设备控制其显示器展示所述菜谱之后，接收用户输入的菜谱选择指令；After the electronic device controls its display to display the recipe, it receives a recipe selection instruction input by the user;
    响应于所述菜谱选择指令，获取菜谱食材集合和库存食材集合，所述菜谱食材集合包括菜谱食材名称和针对所述菜谱食材名称的菜谱食材数量，所述库存食材集合包括库存食 材名称和针对所述库存食材名称的库存食材数量；In response to the recipe selection instruction, a recipe ingredient set and a stock ingredient set are obtained. The recipe ingredient set includes the name of the recipe ingredient and the quantity of the recipe ingredient for the name of the recipe ingredient. The stock ingredient set includes the inventory ingredient. The name of the material and the quantity of the stocked food material corresponding to the name of the stocked food material;
    如果所述库存食材集合中存在与所述菜谱食材名称相同的所述库存食材名称，且所述菜谱食材数量大于所述库存食材数量，根据所述菜谱食材数量与所述库存食材数量的数量差值和所述菜谱食材名称生成第一列表信息，以及在所述显示器中显示所述第一列表信息对应的第一采购清单；If there is a name of the inventory ingredient that is the same as the name of the recipe ingredient in the set of inventory ingredients, and the quantity of the recipe ingredient is greater than the quantity of the inventory ingredient, according to the quantity difference between the quantity of the recipe ingredient and the quantity of the inventory ingredient value and the name of the recipe ingredient to generate first list information, and display the first purchase list corresponding to the first list information on the display;
    如果所述库存食材集合中不存在与所述菜谱食材名称相同的所述库存食材名称，根据所述菜谱食材名称和所述菜谱食材数量生成第二列表信息，以及在所述显示器中显示所述第二列表信息对应的第二采购清单。 If there is no inventory ingredient name that is the same as the recipe ingredient name in the inventory ingredient set, generate second list information based on the recipe ingredient name and the recipe ingredient quantity, and display the recipe ingredient on the display. The second purchase list corresponding to the second list information.
PCT/CN2023/078530 2022-04-22 2023-02-27 Electronic device and data processing method WO2023202221A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202210429991.X 2022-04-22
CN202210429991.XA CN114820122A (en) 2022-04-22 2022-04-22 Food material storage device, terminal device and purchase list generation method
CN202210842481.5A CN115203559A (en) 2022-07-18 2022-07-18 Display device and menu recommendation method
CN202210842481.5 2022-07-18

Publications (2)

Publication Number Publication Date
WO2023202221A1 WO2023202221A1 (en) 2023-10-26
WO2023202221A9 true WO2023202221A9 (en) 2023-11-23

Family

ID=88419112

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/078530 WO2023202221A1 (en) 2022-04-22 2023-02-27 Electronic device and data processing method

Country Status (1)

Country Link
WO (1) WO2023202221A1 (en)

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017135742A1 (en) * 2016-02-03 2017-08-10 주식회사 원더풀플랫폼 Food ingredient management system and food ingredient managing method, method for providing recipe using food ingredient and server for implementing same, and method for generating creative recipe using food ingredient
WO2018023425A1 (en) * 2016-08-02 2018-02-08 步晓芳 Method for automatically recommending recipe, and refrigerator
CN110955692B (en) * 2019-11-29 2021-11-16 广东美的厨房电器制造有限公司 Menu information processing method, processing device, kitchen appliance and readable storage medium
JP2021165622A (en) * 2020-04-08 2021-10-14 パナソニックＩｐマネジメント株式会社 Food storage system, taste information acquisition method and taste information acquisition device
WO2022041992A1 (en) * 2020-08-24 2022-03-03 海信视像科技股份有限公司 Refrigerator, display device, server, recommendation method, and message reminding method
CN114820122A (en) * 2022-04-22 2022-07-29 海信视像科技股份有限公司 Food material storage device, terminal device and purchase list generation method
CN115203559A (en) * 2022-07-18 2022-10-18 海信视像科技股份有限公司 Display device and menu recommendation method

Also Published As

Publication number Publication date
WO2023202221A1 (en) 2023-10-26

Similar Documents

Publication Publication Date Title
TWI744368B (en) Play processing method, device and equipment
CN103748871A (en) Interactive channel navigation and switching
CN108205408B (en) Message display method and device
CN111811182B (en) Refrigerator and recipe recommendation method
US11470363B2 (en) Dynamically interactive digital media delivery
WO2022095564A1 (en) Display device and interface display method
CN111984838A (en) Display device, server, refrigerator and recipe recommending method
WO2022078172A1 (en) Display device and content display method
CN112417282B (en) Information recommendation method, food storage equipment and server
WO2023202221A9 (en) Electronic device and data processing method
CN113251727A (en) Refrigerator and information recommendation method
WO2023165227A1 (en) Food ingredient storage device, food ingredient library, and method for sorting recipes
WO2022041992A1 (en) Refrigerator, display device, server, recommendation method, and message reminding method
US11863829B2 (en) Display apparatus and method for displaying image recognition result
CN114294884B (en) Refrigerator and message reminding method
WO2022068536A1 (en) Information recommendation method, ingredient storage device, and server
CN114820122A (en) Food material storage device, terminal device and purchase list generation method
CN115203559A (en) Display device and menu recommendation method
CN115460452A (en) Display device and channel playing method
CN114279137A (en) Refrigerator and information synchronization method
CN115270808A (en) Display device and semantic understanding method
CN114741610A (en) Information pushing method, device, equipment and storage medium
US20230221066A1 (en) Refrigerator and method for editing food information
CN114390329A (en) Display device and image recognition method
CN111782875B (en) Video search recommendation method, recipe recommendation method based on refrigerator and server

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23790884

Country of ref document: EP

Kind code of ref document: A1