WO2019056331A1

WO2019056331A1 - Method and device for controlling cooking apparatus, computer storage medium, and system

Info

Publication number: WO2019056331A1
Application number: PCT/CN2017/103042
Authority: WO
Inventors: 龙永文; 肖群虎; 李志铭; 程凡; 谭华; 冯钰仪
Original assignee: 佛山市顺德区美的电热电器制造有限公司
Priority date: 2017-09-22
Filing date: 2017-09-22
Publication date: 2019-03-28

Abstract

Provided are a method and device for controlling a cooking apparatus, a computer storage medium, and a system. The method comprises: capturing an image of ingredients to be cooked in a cooking apparatus (S101); performing recognition on the basis of the image of the ingredients, and acquiring a recognition result of the ingredients (S102); acquiring, according to the recognition result and reference information obtained during cooking, a cooking control command corresponding to the ingredients (S103); and cooking the ingredients according to the cooking control command (S104). Fine control of an entire cooking process can be realized by recognizing ingredients to be cooked, thereby enhancing overall cooking performance.

Description

一种烹饪设备的控制方法、装置及计算机存储介质和***Method, device and computer storage medium and system for controlling cooking equipment

技术领域Technical field

本发明涉及终端设备领域，尤指一种烹饪设备的控制方法、装置及计算机存储介质和***。The present invention relates to the field of terminal devices, and more particularly to a method and device for controlling a cooking device, and a computer storage medium and system.

背景技术Background technique

传统烹饪设备，比如电饭煲、电压力锅、微波炉等，通常会在烹饪设备的操作面板上提供固定的功能按键供用户选择。用户在手动点选功能按键之后，触发烹饪设备的控制装置按照被点选的功能按键所对应的烹饪程序进行烹饪。这样的烹饪控制过程需要用户了解待烹饪食材的种类才能够选择与待烹饪食材相匹配的烹饪程序，并且由于待烹饪食材的种类丰富，而烹饪设备操作面板上的功能按键无法覆盖所有待烹饪食材匹配的烹饪程序，因此，目前针对烹饪设备的控制方案的控制效率较低。Traditional cooking equipment, such as rice cookers, electric pressure cookers, microwave ovens, etc., usually provide fixed function buttons on the operating panel of the cooking device for the user to select. After the user manually clicks the function button, the control device that triggers the cooking device performs cooking according to the cooking program corresponding to the selected function button. Such a cooking control process requires the user to know the type of the food to be cooked in order to be able to select a cooking program that matches the food to be cooked, and because the variety of ingredients to be cooked is rich, the function buttons on the operation panel of the cooking device cannot cover all the ingredients to be cooked. Matching cooking programs, therefore, current control schemes for cooking equipment are less efficient.

发明内容Summary of the invention

为了解决上述技术问题，本发明实施例期望提供一种烹饪设备的控制方法、装置及计算机存储介质和***；能够通过对烹饪食材的识别，实现对整体烹饪控制过程的精细化控制，提升整体烹饪效果。In order to solve the above technical problem, embodiments of the present invention are directed to provide a control method and apparatus for a cooking apparatus, and a computer storage medium and system; capable of achieving fine control of the overall cooking control process and enhancing overall cooking by recognizing the cooking ingredients. effect.

本发明实施例的技术方案可以如下实现：The technical solution of the embodiment of the present invention can be implemented as follows:

第一方面，本发明实施例提供了一种烹饪设备的控制方法，所述方法应用于烹饪设备，所述方法包括：In a first aspect, an embodiment of the present invention provides a control method of a cooking device, the method being applied to a cooking device, the method comprising:

采集烹饪设备内待烹饪食材的图像；Collecting images of the ingredients to be cooked in the cooking device;

基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果； Identifying the image of the food item to be cooked, and obtaining a recognition result of the food item to be cooked;

根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令；Obtaining a cooking control instruction corresponding to the to-be-cooked food material according to the recognition result and reference information at the time of cooking;

按照所述烹饪控制指令对所述待烹饪食材进行烹饪。The food to be cooked is cooked according to the cooking control instruction.

在上述方案中，所述基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果，包括：In the above aspect, the identifying the image of the food to be cooked based on the image of the food to be cooked, and obtaining the recognition result of the food to be cooked, includes:

当所述烹饪设备处于网络接入状态时，将所述待烹饪食材的图像发送至服务器；Sending an image of the food to be cooked to a server when the cooking device is in a network access state;

接收由所述服务器根据所述待烹饪食材的图像所返回的识别结果。Receiving a recognition result returned by the server according to the image of the item to be cooked.

当所述烹饪设备处于离线状态时，根据本地图像库对所述待烹饪食材的图像进行识别，获取所述识别结果。When the cooking device is in an offline state, the image of the to-be-cooked food material is identified according to a local image library, and the recognition result is obtained.

在上述方案中，所述根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令，包括：In the above solution, the obtaining, according to the identification result and the reference information during cooking, the cooking control instruction corresponding to the to-be-cooked foodstuff, comprising:

将所述识别结果以及用户习惯信息和当前地理位置信息发送至服务器；Sending the identification result and user habit information and current geographical location information to the server;

接收由所述服务器根据所述识别结果、所述用户习惯信息和所述当前地理位置返回的烹饪控制指令。A cooking control instruction returned by the server based on the recognition result, the user habit information, and the current geographic location is received.

接收由所述服务器根据所述识别结果、所述用户习惯信息和所述当前地理位置返回的候选烹饪菜谱；Receiving a candidate cooking recipe returned by the server according to the recognition result, the user habit information, and the current geographic location;

接收针对所述候选烹饪菜谱的选择指令，确定选定的烹饪菜谱； Receiving a selection instruction for the candidate cooking recipe to determine a selected cooking recipe;

将所述选定的烹饪菜谱发送至所述服务器；Sending the selected cooking recipe to the server;

接收由所述服务器根据所述选定的烹饪菜谱所返回的烹饪控制指令。A cooking control command returned by the server in accordance with the selected cooking recipe is received.

在上述方案中，所述根据本地图像库对所述待烹饪食材的图像进行识别，获取所述识别结果，包括：In the above solution, the image of the food to be cooked is identified according to a local image library, and the recognition result is obtained, including:

提取所述待烹饪食材的图像的第一特征值；Extracting a first characteristic value of the image of the food item to be cooked;

根据所述第一特征值以及所述本地图像库中各图像的第二特征值，计算所述待烹饪食材的图像与所述本地图像库中各图像之间的相似度值；Calculating a similarity value between the image of the item to be cooked and each image in the local image library according to the first feature value and the second feature value of each image in the local image library;

按照设定相似度阈值，从所述本地图像库中选取至少一个备选食材的图像；Selecting an image of at least one candidate food item from the local image library according to a set similarity threshold;

将所述备选食材的图像所对应的备选食材名称进行展示；Displaying an alternate food item name corresponding to the image of the alternative food item;

接收针对备选食材名称的选择指令，并将所述选择指令所指示的备选食材名称作为所述待烹饪食材的名称；或，当展示时间大于或等于设定时间阈值时，将所述备选食材名称中与所述待烹饪食材的图像之间的相似度值最大的备选食材名称作为所述待烹饪食材的名称。Receiving a selection instruction for the name of the alternative food item, and using the name of the alternative food item indicated by the selection instruction as the name of the item to be cooked; or, when the display time is greater than or equal to the set time threshold, the preparation The name of the alternative food item having the highest similarity value between the food item name and the image of the food item to be cooked is selected as the name of the food item to be cooked.

第二方面，本发明实施例提供了一种烹饪设备的控制装置，包括：采集单元、第一处理单元、第二处理单元、控制单元；其中，In a second aspect, an embodiment of the present invention provides a control device for a cooking device, including: an acquisition unit, a first processing unit, a second processing unit, and a control unit;

所述采集单元，用于采集烹饪设备内待烹饪食材的图像；The collecting unit is configured to collect an image of the food to be cooked in the cooking device;

所述第一处理单元，用于基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；The first processing unit is configured to perform recognition based on the image of the food to be cooked, and obtain a recognition result of the food to be cooked;

所述第二处理单元，用于根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令；The second processing unit is configured to acquire a cooking control instruction corresponding to the to-be-cooked food material according to the recognition result and reference information during cooking;

所述控制单元，用于按照所述烹饪控制指令对所述待烹饪食材进行烹饪。The control unit is configured to cook the food to be cooked according to the cooking control instruction.

在上述方案中，所述第一处理单元包括：第一发送子单元和第一接收子单元；其中， In the above solution, the first processing unit includes: a first sending subunit and a first receiving subunit; wherein

所述第一发送子单元，用于当所述烹饪设备处于网络接入状态时，将所述待烹饪食材的图像发送至服务器；The first sending subunit is configured to send an image of the food to be cooked to a server when the cooking device is in a network access state;

所述第一接收子单元，用于接收由所述服务器根据所述待烹饪食材的图像所返回的识别结果。The first receiving subunit is configured to receive a recognition result returned by the server according to the image of the food item to be cooked.

在上述方案中，所述第一处理单元，具体用于：In the above solution, the first processing unit is specifically configured to:

在上述方案中，所述第二处理单元，包括：第二发送子单元、第二接收子单元；其中，In the above solution, the second processing unit includes: a second sending subunit and a second receiving subunit; wherein

所述第二发送子单元，用于将所述识别结果以及用户习惯信息和当前地理位置信息发送至服务器；The second sending subunit is configured to send the identification result, user habit information, and current geographic location information to a server;

所述第二接收子单元，用于接收由所述服务器根据所述识别结果、所述用户习惯信息和所述当前地理位置返回的烹饪控制指令。The second receiving subunit is configured to receive a cooking control instruction returned by the server according to the identification result, the user habit information, and the current geographic location.

在上述方案中，所述第二处理单元，包括：第三发送子单元和第三接收子单元；其中，In the above solution, the second processing unit includes: a third sending subunit and a third receiving subunit; wherein

所述第三发送子单元，用于将所述识别结果以及用户习惯信息和当前地理位置信息发送至服务器；The third sending subunit is configured to send the identification result, user habit information, and current geographic location information to a server;

所述第三接收子单元，用于接收由所述服务器根据所述识别结果、所述用户习惯信息和所述当前地理位置返回的候选烹饪菜谱；以及，接收针对所述候选烹饪菜谱的选择指令，确定选定的烹饪菜谱；The third receiving subunit is configured to receive a candidate cooking recipe returned by the server according to the recognition result, the user habit information, and the current geographic location; and receive a selection instruction for the candidate cooking recipe , determining the selected cooking recipe;

所述第三发送子单元，还用于将所述选定的烹饪菜谱发送至所述服务器；The third sending subunit is further configured to send the selected cooking recipe to the server;

所述第三接收子单元，还用于接收由所述服务器根据所述选定的烹饪菜谱所返回的烹饪控制指令。The third receiving subunit is further configured to receive a cooking control instruction returned by the server according to the selected cooking recipe.

在上述方案中，所述第一处理单元包括：第一处理子单元、第二处理子单元、第四接收子单元；其中，In the above solution, the first processing unit includes: a first processing subunit, and a second processing a subunit, a fourth receiving subunit; wherein

所述第一处理子单元，用于提取所述待烹饪食材的图像的第一特征值；以及，根据所述第一特征值以及所述本地图像库中各图像的第二特征值，计算所述待烹饪食材的图像与所述本地图像库中各图像之间的相似度值；The first processing subunit is configured to extract a first feature value of the image of the food item to be cooked; and, according to the first feature value and the second feature value of each image in the local image library, calculate the Determining a similarity value between the image of the cooked food material and each image in the local image library;

所述第二处理子单元，用于按照设定相似度阈值，从所述本地图像库中选取至少一个备选食材的图像；以及，将所述备选食材的图像所对应的备选食材名称进行展示；The second processing sub-unit is configured to select an image of the at least one candidate food material from the local image library according to a set similarity threshold; and select an alternate food material name corresponding to the image of the candidate food material Display

第四接收子单元，用于接收针对备选食材名称的选择指令；a fourth receiving subunit, configured to receive a selection instruction for the name of the alternative food item;

所述第二处理子单元，还用于将所述选择指令所指示的备选食材名称作为所述待烹饪食材的名称；或，当展示时间大于或等于设定时间阈值时，将所述备选食材名称中与所述待烹饪食材的图像之间的相似度值最大的备选食材名称作为所述待烹饪食材的名称。The second processing sub-unit is further configured to use the name of the alternative food material indicated by the selection instruction as the name of the food item to be cooked; or, when the display time is greater than or equal to the set time threshold, the preparation The name of the alternative food item having the highest similarity value between the food item name and the image of the food item to be cooked is selected as the name of the food item to be cooked.

第三方面，本发明实施例提供了一种计算机存储介质，所述计算机存储介质中存储有烹饪设备的控制程序，所述烹饪设备的控制程序被处理器执行时实现如第一方面所述方法的步骤。In a third aspect, an embodiment of the present invention provides a computer storage medium, where the computer storage medium stores a control program of a cooking device, and the control program of the cooking device is executed by a processor to implement the method according to the first aspect. A step of.

第四方面，本发明实施例提供了一种烹饪设备，包括：第一网络接口、第一存储器和第一处理器；In a fourth aspect, an embodiment of the present invention provides a cooking device, including: a first network interface, a first memory, and a first processor;

其中，所述第一网络接口，用于在与其他外部网元之间进行收发信息过程中，信号的接收和发送；The first network interface is configured to receive and send signals during the process of transmitting and receiving information with other external network elements;

所述第一存储器，用于存储能够在第一处理器上运行的计算机程序；The first memory is configured to store a computer program capable of running on the first processor;

所述第一处理器，用于在运行所述计算机程序时，执行第一方面所述方法的步骤。The first processor is configured to perform the steps of the method of the first aspect when the computer program is run.

第五方面，本发明实施例提供了一种烹饪设备的控制方法，所述方法应用于服务器，所述方法包括：In a fifth aspect, an embodiment of the present invention provides a method for controlling a cooking device, where the method is applied to a server, and the method includes:

接收烹饪设备发送的所述烹饪设备内待烹饪食材的图像； Receiving an image of the food item to be cooked in the cooking device sent by the cooking device;

基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；Identifying the image of the food item to be cooked, and obtaining a recognition result of the food item to be cooked;

根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令；Generating a cooking control instruction corresponding to the food item to be cooked according to the recognition result and the reference information at the time of cooking;

将所述烹饪控制指令发送至所述烹饪设备。The cooking control command is sent to the cooking device.

获取所述待烹饪食材的图像特征值；Obtaining an image feature value of the food to be cooked;

将所述待烹饪食材的图像特征值与图像特征库中的特征值进行匹配，并将所述图像特征库中与所述图像特征值之间匹配度最高的特征值所对应的食材，确定为所述待烹饪食材的的识别结果。Matching the image feature value of the food to be cooked with the feature value in the image feature library, and determining the food material corresponding to the feature value having the highest matching degree between the image feature value and the image feature value as The recognition result of the food to be cooked.

在上述方案中，在所述根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令之前，还包括：In the above aspect, before the generating the cooking control instruction corresponding to the food item to be cooked according to the identification result and the reference information during cooking, the method further includes:

接收所述烹饪设备发送的用户习惯信息和当前地理位置信息。Receiving user habit information and current geographic location information sent by the cooking device.

在上述方案中，所述根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令，包括：In the above aspect, the generating, according to the identification result and the reference information during cooking, generating a cooking control instruction corresponding to the to-be-cooked foodstuff, comprising:

根据所述识别结果以及用户习惯信息和当前地理位置信息，生成所述待烹饪食材的候选烹饪菜谱；Generating, according to the recognition result, the user habit information and the current geographical location information, a candidate cooking recipe of the food to be cooked;

将所述候选烹饪菜谱发送至所述烹饪设备；Sending the candidate cooking recipe to the cooking device;

接收所述烹饪设备发送的针对所述候选烹饪菜谱进行选定的烹饪菜谱；Receiving a cooking recipe selected by the cooking device for the candidate cooking recipe;

根据所述选定的烹饪菜谱生成对应的烹饪控制指令。Corresponding cooking control instructions are generated based on the selected cooking recipe.

第六方面，本发明实施例提供了一种服务器，包括：接收单元、第三处理单元、第四处理单元、发送单元；其中，In a sixth aspect, an embodiment of the present invention provides a server, including: a receiving unit, a third processing unit, a fourth processing unit, and a sending unit;

所述接收单元，用于接收烹饪设备发送的所述烹饪设备内待烹饪食材的图像；The receiving unit is configured to receive the ingredients to be cooked in the cooking device sent by the cooking device Image;

所述第三处理单元，用于基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；The third processing unit is configured to perform recognition based on the image of the food to be cooked, and obtain a recognition result of the food to be cooked;

所述第四处理单元，用于根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令；The fourth processing unit is configured to generate a cooking control instruction corresponding to the to-be-cooked food material according to the recognition result and reference information during cooking;

所述发送单元，用于将所述烹饪控制指令发送至所述烹饪设备。The sending unit is configured to send the cooking control instruction to the cooking device.

在上述方案中，所述第三处理单元，具体用于：In the above solution, the third processing unit is specifically configured to:

在上述方案中，所述接收单元，还用于接收所述烹饪设备发送的用户习惯信息和当前地理位置信息。In the above solution, the receiving unit is further configured to receive user habit information and current geographic location information sent by the cooking device.

在上述方案中，所述第四处理单元，包括：第三处理子单元、第四发送子单元、第五接收子单元；其中，In the above solution, the fourth processing unit includes: a third processing subunit, a fourth transmitting subunit, and a fifth receiving subunit; wherein

所述第三处理子单元，用于根据所述识别结果以及用户习惯信息和当前地理位置信息，生成所述待烹饪食材的候选烹饪菜谱；The third processing sub-unit is configured to generate a candidate cooking recipe of the to-be-cooked food material according to the recognition result, the user habit information, and current geographic location information;

所述第四发送子单元，用于将所述候选烹饪菜谱发送至所述烹饪设备；The fourth sending subunit is configured to send the candidate cooking recipe to the cooking device;

所述第五接收子单元，用于接收所述烹饪设备发送的针对所述候选烹饪菜谱进行选定的烹饪菜谱；The fifth receiving subunit is configured to receive a cooking recipe selected by the cooking device for the candidate cooking recipe;

所述第三处理子单元，还用于根据所述选定的烹饪菜谱生成对应的烹饪控制指令。The third processing subunit is further configured to generate a corresponding cooking control instruction according to the selected cooking recipe.

第七方面，本发明实施例提供了一种计算机存储介质，所述计算机存储介质中存储有烹饪设备的控制程序，所述烹饪设备的控制程序被处理器执行时实现如第五方面所述方法的步骤。 In a seventh aspect, an embodiment of the present invention provides a computer storage medium, where the computer storage medium stores a control program of a cooking device, and when the control program of the cooking device is executed by the processor, the method as described in the fifth aspect is implemented. A step of.

第八方面，本发明实施例提供了一种服务器，包括：第二网络接口、第二存储器和第二处理器；In an eighth aspect, an embodiment of the present invention provides a server, including: a second network interface, a second memory, and a second processor;

其中，所述第二网络接口，用于在与其他外部网元之间进行收发信息过程中，信号的接收和发送；The second network interface is configured to receive and send signals during the process of transmitting and receiving information with other external network elements;

所述第二存储器，用于存储能够在第二处理器上运行的计算机程序；The second memory is configured to store a computer program capable of running on the second processor;

所述第二处理器，用于在运行所述计算机程序时，执行第五方面所述方法的步骤。The second processor is configured to perform the steps of the method of the fifth aspect when the computer program is run.

第九方面，本发明实施例提供了一种烹饪设备的控制***，所述***包括：烹饪设备和服务器；其中，A ninth aspect, an embodiment of the present invention provides a control system for a cooking device, where the system includes: a cooking device and a server;

所述烹饪设备，配置为：采集烹饪设备内待烹饪食材的图像；以及，The cooking device is configured to: collect an image of the food to be cooked in the cooking device;

基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；以及，Identifying the image of the food to be cooked based on the image of the food to be cooked, and obtaining the recognition result of the food to be cooked;

根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令；以及，Obtaining a cooking control instruction corresponding to the food item to be cooked according to the recognition result and reference information at the time of cooking; and

按照所述烹饪控制指令对所述待烹饪食材进行烹饪；Cooking the food to be cooked according to the cooking control instruction;

所述服务器，配置为：接收所述烹饪设备发送的所述烹饪设备内待烹饪食材的图像；以及The server is configured to: receive an image of the food item to be cooked in the cooking device sent by the cooking device;

根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令；以及，Generating a cooking control instruction corresponding to the food item to be cooked according to the recognition result and reference information at the time of cooking;

本发明实施例提供了一种烹饪设备的控制方法、装置及计算机存储介质和***；通过采集到的待烹饪食材的图像来获得针对待烹饪食材的识别结果，随后根据识别结果获得针对待烹饪食材的烹饪控制指令，最后按照烹饪控制指令对待烹饪食材进行烹饪；从而能够通过对待烹饪食材的识别，实现对整体烹饪控制过程的精细化控制，提升整体烹饪效果。Embodiments of the present invention provide a control method and apparatus for a cooking apparatus, and a computer storage medium and system; obtaining an identification result for an item to be cooked by collecting an image of the item to be cooked, and then obtaining an item for cooking according to the recognition result Cooking control instructions, and finally follow The cooking control instruction cooks the cooking ingredients; thereby enabling the fine control of the overall cooking control process and the overall cooking effect by recognizing the ingredients to be cooked.

本发明实施例的其它特征和优点将在随后的说明书中阐述，并且，部分地从说明书中变得显而易见，或者通过实施本发明而了解。本发明的目的和其他优点可通过在说明书、权利要求书以及附图中所特别指出的结构来实现和获得。Other features and advantages of the embodiments of the invention will be set forth in the description in the description which The objectives and other advantages of the invention may be realized and obtained by means of the structure particularly pointed in the appended claims.

附图说明DRAWINGS

附图用来提供对本发明技术方案的进一步理解，并且构成说明书的一部分，与本申请的实施例一起用于解释本发明的技术方案，并不构成对本发明技术方案的限制。The drawings are used to provide a further understanding of the technical solutions of the present invention, and constitute a part of the specification, which together with the embodiments of the present application are used to explain the technical solutions of the present invention, and do not constitute a limitation of the technical solutions of the present invention.

图1为本发明实施例提供的一种烹饪设备的控制方法的流程示意图；1 is a schematic flow chart of a method for controlling a cooking device according to an embodiment of the present invention;

图2为本发明实施例提供的另一种烹饪设备的控制方法的流程示意图；2 is a schematic flow chart of another method for controlling a cooking device according to an embodiment of the present invention;

图3为本发明实施例提供的一种服务器的结构示意图；FIG. 3 is a schematic structural diagram of a server according to an embodiment of the present disclosure;

图4为本发明实施例提供的一种烹饪设备的控制方法的具体流程示意图；4 is a schematic flowchart of a method for controlling a cooking device according to an embodiment of the present invention;

图5为本发明实施例提供的另一种烹饪设备的控制方法的具体流程示意图；FIG. 5 is a schematic flowchart of another method for controlling a cooking device according to an embodiment of the present invention; FIG.

图6为本发明实施例提供的一种烹饪设备的硬件结构示意图；6 is a schematic structural diagram of hardware of a cooking device according to an embodiment of the present invention;

图7为本发明实施例提供的一种服务器的硬件结构示意图；FIG. 7 is a schematic structural diagram of a hardware of a server according to an embodiment of the present disclosure;

图8为本发明实施例提供的一种烹饪设备的控制装置的结构示意图；FIG. 8 is a schematic structural diagram of a control device of a cooking device according to an embodiment of the present invention; FIG.

图9为本发明实施例提供的一种服务器的结构示意图；FIG. 9 is a schematic structural diagram of a server according to an embodiment of the present disclosure;

图10为本发明实施例提供的一种烹饪设备的控制***的结构示意图。FIG. 10 is a schematic structural diagram of a control system of a cooking apparatus according to an embodiment of the present invention.

具体实施方式Detailed ways

应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to The invention is defined.

实施例一Embodiment 1

参见图1，其示出了本发明实施例提供的一种烹饪设备的控制方法，所述方法可以应用于烹饪设备，所述方法可以包括：Referring to FIG. 1 , a method for controlling a cooking device according to an embodiment of the present invention is illustrated. The method may be applied to a cooking device, and the method may include:

S101：采集烹饪设备内待烹饪食材的图像；S101: collecting an image of the food to be cooked in the cooking device;

S102：基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；S102: Identifying an image of the food to be cooked, and obtaining a recognition result of the food to be cooked;

S103：根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令；S103: Acquire, according to the recognition result and reference information during cooking, a cooking control instruction corresponding to the to-be-cooked food material;

S104：按照烹饪控制指令对所述待烹饪食材进行烹饪。S104: Cooking the food to be cooked according to a cooking control instruction.

通过图1所示的技术方案，烹饪设备通过采集到的待烹饪食材的图像来获得针对待烹饪食材的识别结果，随后根据该识别结果获得针对待烹饪食材的烹饪控制指令，最后按照烹饪控制指令对待烹饪食材进行烹饪；从而能够通过对待烹饪食材的识别，实现对整体烹饪控制过程的精细化控制，提升整体烹饪效果。Through the technical solution shown in FIG. 1 , the cooking device obtains the recognition result for the food to be cooked through the collected image of the food to be cooked, and then obtains a cooking control instruction for the food to be cooked according to the recognition result, and finally according to the cooking control instruction. Cooking ingredients are cooked; thus, by recognizing the ingredients to be cooked, fine control of the overall cooking control process is achieved, and the overall cooking effect is improved.

在本发明实施例中，烹饪控制指令可以用于对烹饪过程的各阶段进行控制，比如控制各烹饪阶段对应的烹饪温度、烹饪时间等，具体可以表现为针对待烹饪食材的烹饪曲线，本实施例及后续实施例对此不做赘述。In the embodiment of the present invention, the cooking control instruction may be used to control various stages of the cooking process, such as controlling the cooking temperature, the cooking time, and the like corresponding to each cooking stage, and may specifically be expressed as a cooking curve for the food to be cooked. The examples and subsequent embodiments do not describe this.

对于图1所示的技术方案，可以在烹饪设备内设置图像采集装置，例如摄像头等，具体可以设置在烹饪设备的上盖内侧，从而可以采集到烹饪设备内胆中所盛放的待烹饪食材的图像。需要说明的是，在采集到待烹饪食材的图像后，还可以通过图像处理装置对待烹饪食材的图像进行去噪等预处理，以使得进行识别的待烹饪食材的图像更加清晰。For the technical solution shown in FIG. 1 , an image collecting device, such as a camera or the like, may be disposed in the cooking device, and specifically may be disposed inside the upper cover of the cooking device, so that the ingredients to be cooked contained in the inner casing of the cooking device can be collected. Image. It should be noted that, after the image of the food to be cooked is collected, the image of the food to be cooked may be subjected to pre-processing such as denoising by the image processing device, so that the image of the to-be-cooked food to be identified is more clear.

对于图1所示的技术方案，在一种可能的实现方式中，所述基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果，包括： For the technical solution shown in FIG. 1 , in a possible implementation manner, the identifying the image of the food to be cooked based on the image of the food to be cooked, and obtaining the recognition result of the food to be cooked, includes:

需要说明的是，目前随着智能家电设备的发展，烹饪设备均具有网络接入功能，不仅可以接入到家庭的无线仿真(WIFI，Wireless Fidelity)网络，还可以通过WIFI连接智能终端，并通过智能终端中相应的应用程序APP实现与外部服务器之间的连接。此外，烹饪设备还可以通过接入蜂窝移动网络来实现与外部服务器之间的连接。因此，当烹饪设备处于网络接入状态时，烹饪设备可以将待烹饪食材的图像发送至外部服务器，通过外部服务器对待烹饪食材的图像进行识别，从而得到识别结果，比如，待烹饪食材的名称等。It should be noted that with the development of smart home appliances, cooking devices all have network access functions, which can not only access the wireless wireless (WIFI) network of the home, but also connect the smart terminals through WIFI and pass The corresponding application APP in the smart terminal implements a connection with an external server. In addition, the cooking device can also implement a connection with an external server by accessing a cellular mobile network. Therefore, when the cooking device is in the network access state, the cooking device can send an image of the food to be cooked to an external server, and the image of the cooked food is recognized by the external server, thereby obtaining a recognition result, for example, the name of the ingredient to be cooked, and the like. .

对于图1所示的技术方案，在一种可能的实现方式中，所述基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果，包括：For the technical solution shown in FIG. 1 , in a possible implementation manner, the identifying the image of the food to be cooked based on the image of the food to be cooked, and obtaining the recognition result of the food to be cooked, includes:

需要说明的是，烹饪设备内部可以设置有存储单元，用于存储本地图像库，并且在烹饪设备接入网络的时候可以从外部服务器对本地图像库进行升级和更新。从而使得当烹饪设备无法接入网络的时候，能够通过本地图像库来对待烹饪食材的图像进行识别，获取所述识别结果，比如，待烹饪食材的名称等。It should be noted that the cooking device may be internally provided with a storage unit for storing the local image library, and the local image library may be upgraded and updated from the external server when the cooking device accesses the network. Thereby, when the cooking device cannot access the network, the image of the cooking ingredient can be identified by the local image library, and the recognition result, for example, the name of the item to be cooked, and the like can be obtained.

这里，所述根据本地图像库对所述待烹饪食材的图像进行识别，获取所述识别结果，包括：Here, the identifying the image of the food to be cooked according to the local image library, and acquiring the recognition result includes:

根据所述第一特征值以及所述本地图像库中各图像的第二特征值，计算所述待烹饪食材的图像与所述本地图像库中各图像之间的相似度值； Calculating a similarity value between the image of the item to be cooked and each image in the local image library according to the first feature value and the second feature value of each image in the local image library;

按照设定相似度阈值，从本地图像库中选取至少一个备选食材的图像；Selecting an image of at least one candidate food item from a local image library according to a set similarity threshold;

将备选食材的图像所对应的备选食材名称进行展示；Displaying the name of the alternative ingredient corresponding to the image of the alternative ingredient;

接收针对备选食材名称的选择指令，并将所述选择指令所指示备选食材名称作为所述待烹饪食材的名称；或，当展示时间大于或等于设定时间阈值时，将所述备选食材名称中与待烹饪食材的图像之间的相似度值最大的备选食材名称作为所述待烹饪食材的名称。Receiving a selection instruction for the name of the alternative food item, and using the name of the alternative food item indicated by the selection instruction as the name of the item to be cooked; or, when the presentation time is greater than or equal to the set time threshold, the alternative is The name of the alternative food item having the highest similarity value between the item name and the image of the item to be cooked is used as the name of the item to be cooked.

由于本地图像库的存储空间有限，因此，通过本地图像库进行识别的准确率要低于通过服务器进行识别的准确率，但是由于不需要与服务器进行交互，通过本地图像库进行识别的速度比通过服务器进行识别的速度要快。Due to the limited storage space of the local image library, the accuracy of recognition through the local image library is lower than the accuracy of recognition by the server, but because it does not need to interact with the server, the recognition speed through the local image library is faster than The server recognizes it faster.

上述过程描述了针对待烹饪食材的图像进行识别的具体过程，不仅可以应用在烹饪设备中，也可以在服务器中根据上述过程进行识别，本实施例对此不做赘述。The above process describes a specific process for identifying an image of the food to be cooked, which can be applied not only in the cooking device but also in the server according to the above process, which is not described in this embodiment.

对于图1所示的技术方案，在一种可能的实现方式中，所述根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令，包括：For the technical solution shown in FIG. 1 , in a possible implementation manner, the obtaining the cooking control instruction corresponding to the to-be-cooked food material according to the recognition result and the reference information during cooking comprises:

可以理解地，当烹饪设备的功能比较单一，并且待烹饪食材种类比较单一时，具体的烹饪手段也比较单一，比如当烹饪设备为电饭煲，而待烹饪食材为大米时，通常的烹饪手段是煮饭，因此，服务器可以根据识别结果来得到唯一的烹饪控制指令，并发送至烹饪设备，从而烹饪设备可以根据烹饪控制指令进行烹饪。 Understandably, when the function of the cooking device is relatively simple, and the type of the food to be cooked is relatively simple, the specific cooking means is relatively simple. For example, when the cooking device is a rice cooker and the food to be cooked is rice, the usual cooking method is cooking. The meal, therefore, the server can obtain a unique cooking control command based on the recognition result and send it to the cooking device so that the cooking device can cook according to the cooking control instruction.

接收针对所述候选烹饪菜谱的选择指令，确定选定的烹饪菜谱；Receiving a selection instruction for the candidate cooking recipe to determine a selected cooking recipe;

可以理解地，当待烹饪食材较多，烹饪设备的功能也较多时，例如烹饪设备对肉、青菜和香菇进行烹饪时，可以有不同的烹饪手法，例如炒、焖、蒸、煮等，那么服务器无法给出唯一的烹饪控制指令，因此，服务器可以将潜在的候选烹饪菜谱返回至烹饪设备，并通过用户进行选择，当用户从候选烹饪菜谱中选定烹饪菜谱后，服务器就可以根据选定的烹饪菜谱返回对应的烹饪控制指令，从而烹饪设备可以根据烹饪控制指令来进行烹饪。Understandably, when there are many ingredients to be cooked and the functions of the cooking equipment are also large, for example, the cooking equipment can have different cooking techniques when cooking meat, vegetables and mushrooms, such as frying, simmering, steaming, boiling, etc. The server is unable to give a unique cooking control instruction, so the server can return the potential candidate cooking recipe to the cooking device and make a selection by the user. When the user selects the cooking recipe from the candidate cooking recipe, the server can select according to the selection. The cooking recipe returns a corresponding cooking control command so that the cooking device can cook according to the cooking control instructions.

通过上述实施例，可以看出，通过采集到的待烹饪食材图像来获得针对待烹饪食材的识别结果，随后根据识别结果获得针对待烹饪食材的烹饪控制指令，最后按照烹饪控制指令对待烹饪食材进行烹饪；从而能够通过对待烹饪食材的识别，实现对整体烹饪控制过程的精细化控制，提升整体烹饪效果。Through the above embodiment, it can be seen that the recognition result for the food to be cooked is obtained by the collected image of the food to be cooked, and then the cooking control instruction for the food to be cooked is obtained according to the recognition result, and finally the cooking ingredients are processed according to the cooking control instruction. Cooking; thus, through the identification of the ingredients to be cooked, the fine control of the overall cooking control process is achieved, and the overall cooking effect is improved.

实施例二Embodiment 2

基于前述实施例相同的发明构思，参见图2，其示出了本发明实施例提供的一种烹饪设备的控制方法，该方法可以应用于服务器，所述方法可以包括：Based on the same inventive concept of the foregoing embodiment, referring to FIG. 2, a control method of a cooking device provided by an embodiment of the present invention is shown, which may be applied to a server, and the method may be include:

S201：接收烹饪设备发送的所述烹饪设备内待烹饪食材的图像；S201: receiving an image of the food to be cooked in the cooking device sent by the cooking device;

S202：基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；S202: Identifying an image of the food to be cooked, and obtaining a recognition result of the food to be cooked;

S203：根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令；S203: generate a cooking control instruction corresponding to the to-be-cooked food material according to the recognition result and the reference information during cooking;

S204：将所述烹饪控制指令发送至所述烹饪设备。S204: Send the cooking control instruction to the cooking device.

通过图2所示的技术方案，服务器对接收到的待烹饪食材的图像进行识别，从而获得识别结果，并根据识别结果与烹饪时的参考信息来生成针对待烹饪食材的烹饪控制指令，从而实现对整体烹饪控制过程的精细化控制，提升整体烹饪效果。Through the technical solution shown in FIG. 2, the server identifies the received image of the food to be cooked, thereby obtaining the recognition result, and generating a cooking control instruction for the food to be cooked according to the recognition result and the reference information during cooking, thereby realizing Fine control of the overall cooking control process to enhance overall cooking results.

具体来说，参见图3，服务器中可以包括深度学***台可以包括图片训练库、深度学习框架以及识别引擎；详细来说，图片训练库收集大量的食材图片，深度学习框架利用卷积神经网络(CNN，Convolutional Neural Network)进行深度学习，根据大量的食材图片进行训练并且提取各食材图片的特征值，而且将食材图片的特征值与食材标签之间建立对应关系，保存在图像特征库中，以备识别引擎进行识别时使用。当服务器接收到待烹饪食材的图像后，获取待烹饪食材的图像特征值，并将待烹饪食材的图像特征值与图像特征库中的特征值进行匹配，从图像特征库的特征值中获取匹配度最高的特征值所对应的食材，则是服务器所识别到的识别结果。Specifically, referring to FIG. 3, the server may include a deep learning platform, which may include a picture training library, a deep learning framework, and a recognition engine; in detail, the picture training library collects a large number of food pictures, and the deep learning framework utilizes convolution. The neural network (CNN, Convolutional Neural Network) conducts deep learning, trains according to a large number of food images and extracts the feature values of each food image, and establishes a correspondence between the feature values of the food image and the food label, and saves it in the image feature database. Used in the identification engine for identification. After the server receives the image of the food to be cooked, obtains the image feature value of the food to be cooked, and matches the image feature value of the food to be cooked with the feature value in the image feature library, and obtains a match from the feature value of the image feature library. The food material corresponding to the highest eigenvalue is the recognition result recognized by the server.

对于图2所示的技术方案，在一种可能的实现方式中，在所述根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令之前，还包括：For the technical solution shown in FIG. 2, in a possible implementation, before the generating the cooking control instruction corresponding to the to-be-cooked food item according to the identification result and the reference information during cooking, the method further includes:

接收所述烹饪设备发送的用户习惯信息和当前地理位置信息。 Receiving user habit information and current geographic location information sent by the cooking device.

相应地，所述根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令，包括：Correspondingly, the generating, according to the identification result and the reference information during cooking, generating a cooking control instruction corresponding to the to-be-cooked foodstuff, comprising:

可以理解地，当待烹饪食材的图像识别结果包括多种待烹饪食材时，服务器无法得到唯一的烹饪控制指令，因此，服务器会根据用户习惯信息和当前地理位置信息这些烹饪时的参考信息，针对这些待烹饪食材确定多个候选烹饪菜谱并将候选烹饪菜谱发送至烹饪设备供用户选择，当服务器接收到针对所述候选烹饪菜谱进行选定的烹饪菜谱后，就可以将选定的烹饪菜谱所对应的烹饪控制指令返回至烹饪设备，以供烹饪设备执行烹饪控制指令来对待烹饪食材进行烹饪。It can be understood that when the image recognition result of the food to be cooked includes a plurality of ingredients to be cooked, the server cannot obtain a unique cooking control instruction, and therefore, the server may refer to the cooking reference information according to the user habit information and the current geographical location information. The ingredients to be cooked determine a plurality of candidate cooking recipes and send the candidate cooking recipes to the cooking device for selection by the user. When the server receives the selected cooking recipe for the candidate cooking recipe, the selected cooking recipes can be selected. The corresponding cooking control command is returned to the cooking device for the cooking device to execute cooking control instructions to cook the cooking ingredients.

具体来说，参见图3，服务器中还可以包括烹饪控制***，具体包括：食材烹饪数据库，菜谱数据库，与食材菜谱相关的地域、节气的数据库，用户***台识别食材后，通过推理机模型来实现向用户推送合适的候选烹饪菜谱。输入推理机的参数包含但不限于：食材数据、用户所在的地域数据、当时所处的时间参数(比如季节)和用户习惯数据等。根据以上参数推理出多种候选烹饪菜谱，给用户选择。Specifically, referring to FIG. 3, the server may further include a cooking control system, specifically including: a food cooking database, a recipe database, a region related to the food recipe, a database of solar terms, a user habit database, and an inference engine. After the deep learning platform recognizes the ingredients, the inference engine model is used to push the appropriate candidate cooking recipes to the user. The parameters of the input inference engine include but are not limited to: the food data, the geographical data of the user, the time parameters (such as the season) and the user habit data. According to the above parameters, a plurality of candidate cooking recipes are inferred and selected for the user.

可以理解地，图3中所示的服务器的各组成部分可以通过云服务器或分布式服务器来实现，本实施例对此不做赘述。It can be understood that the components of the server shown in FIG. 3 can be implemented by using a cloud server or a distributed server, which is not described in this embodiment.

实施例三Embodiment 3

基于前述实施例相同的发明构思，本实施例通过若干具体示例对前述实施例的技术方案进行详细说明。Based on the same inventive concept of the foregoing embodiment, the present embodiment has the foregoing The technical solutions of the embodiments are described in detail.

具体示例一Specific example one

在本具体示例中，烹饪设备为电饭煲、待烹饪食材为大米，参见图4，本具体示例的流程可以包括：In this specific example, the cooking device is a rice cooker, and the food to be cooked is rice. Referring to FIG. 4, the flow of the specific example may include:

S401：用户在电饭煲内胆放入大米后，电饭煲上盖内侧的摄像头采集大米的图像；S401: After the user puts the rice in the rice cooker liner, the camera on the inner side of the rice cooker upper cover collects the image of the rice;

可以理解地，在采集到图像后，还可以通过去噪等预处理手段，使得采集的图像更加清晰。It can be understood that after the image is acquired, the acquired image can be made clearer by preprocessing means such as denoising.

S402：电饭煲判断当前是否连接网络；若是，则转至S403；否则转至S406；S402: The rice cooker determines whether the network is currently connected; if yes, the process goes to S403; otherwise, the process goes to S406;

S403：电饭煲将采集到的大米图像发送至服务器；S403: The rice cooker sends the collected rice image to the server;

S404：服务器根据大米图像进行识别，通过对比图像特征库中的标签信息获得大米的多个备选米种以及各备选米种对应的相似度值。S404: The server identifies the image according to the rice, and obtains a plurality of candidate rice species of the rice and a similarity value corresponding to each of the alternative rice species by comparing the label information in the image feature database.

详细来说，服务器可以将接收到的大米图像与图像特征库中的图像进行比对，并根据图像特征所对应的标签信息获得大米的多个备选米种及各备选米种对应的相似度值，这就是针对大米图像进行识别后的识别结果。例如，大米的多个备选米种是东北米的相似度值为80％、是丝苗米的相似度值为10％、是五常米的相似度值为10％。In detail, the server may compare the received rice image with the image in the image feature library, and obtain a plurality of alternative rice species and similarities of each alternative rice species according to the label information corresponding to the image feature. Degree value, which is the recognition result after recognition of the rice image. For example, a plurality of alternative rice varieties of rice are a similarity value of 80% for northeast rice, a similarity value of 10% for silk seedling rice, and a similarity value of 10% for five-meter rice.

S405：服务器将大米的多个备选米种以及各备选米种对应的相似度值发送至烹饪设备，并转至S407；S405: The server sends the plurality of alternative rice species of the rice and the similarity values corresponding to each of the alternative rice species to the cooking device, and proceeds to S407;

S406：电饭煲根据本地图像库对大米图像进行识别，得到大米的多个备选种以及各备选米种对应的相似度值，并转至S407；S406: the rice cooker identifies the rice image according to the local image library, and obtains a plurality of alternative species of rice and similarity values corresponding to each of the alternative rice species, and proceeds to S407;

S407：电饭煲展示大米的多个备选米种以及各备选米种对应的相似度值，并将大米的目标米种以及用户习惯信息和当前地理位置信息发送至服务器； S407: The rice cooker displays the plurality of alternative rice species of the rice and the similarity values of the respective rice varieties, and sends the target rice species of the rice, the user habit information and the current geographical location information to the server;

这里，所述大米的目标米种可以是电饭煲根据接收到的选择指令中所指示的目标米种而确定的，比如选择指令中可指示东北米为大米的目标米种；此外，当电饭煲在一段时间内未接收到指示目标米种的选择指令时，可自动将大米的多个备选米种中具有最大相似度值的备选米种作为大米的目标米种。Here, the target rice species of the rice may be determined by the rice cooker according to the target rice species indicated in the received selection instruction, such as the target rice species indicating the northeast rice as the rice in the selection instruction; in addition, when the rice cooker is in a section When the selection instruction indicating the target rice type is not received within the time, the alternative rice species having the largest similarity value among the plurality of rice varieties of the rice can be automatically used as the target rice species of rice.

需要说明的是，不同米种的大米对应不同的烹饪过程，从而会产生不同的烹饪控制指令，而且用户习惯信息和当前地理位置信息对于烹饪控制指令的生成具有参考作用，例如，在南方，通常米饭煮熟后，会再焖一段时间；而且当用户习惯吃软米饭的时候，为了保持米饭中的水分，会缩短煮饭时间和焖饭时间等，这些地理位置信息以及用户习惯信息能够对烹饪控制指令的生成起到很大的参考作用。It should be noted that rice of different rice types corresponds to different cooking processes, thereby generating different cooking control instructions, and user habit information and current geographical location information have reference functions for the generation of cooking control instructions, for example, in the south, usually After the rice is cooked, it will be cooked for a while; and when the user is used to eating soft rice, in order to maintain the moisture in the rice, the cooking time and the meal time will be shortened. These geographical information and user habit information can be cooked. The generation of control instructions plays a large reference role.

S408：服务器根据大米的目标米种并参考用户习惯信息和当前地理位置信息与大米烹饪曲线进行匹配，获取烹饪曲线对应的烹饪控制指令；S408: The server matches the rice cooking curve according to the target rice type of the rice and refers to the user habit information and the current geographical location information, and obtains a cooking control instruction corresponding to the cooking curve;

S409：服务器将烹饪控制指令发送至电饭煲；S409: The server sends a cooking control instruction to the rice cooker;

S410：电饭煲在接收到烹饪控制指令后，按照烹饪控制指令对大米进行烹饪。S410: After receiving the cooking control command, the rice cooker cooks the rice according to the cooking control instruction.

通过上述过程可以看出，电饭煲采集到大米的图像后，通过自身的本地图像库或者通过服务器对大米的图像进行识别，获得大米的多个备选米种和各备选米种对应的相似度值；并且通过服务器根据大米的目标米种以及一些烹饪时的参考信息来确定烹饪控制指令，从而能够针对烹饪食材进行精细化的烹饪控制，提升了烹饪的效果。Through the above process, it can be seen that after the rice cooker collects the image of the rice, it recognizes the image of the rice through its own local image library or through the server, and obtains the similarity of the plurality of alternative rice species and the alternate rice species of the rice. The value is determined; and the cooking control command is determined by the server according to the target rice type of the rice and some reference information during cooking, so that the cooking control can be refined for the cooking ingredients, and the cooking effect is improved.

具体示例二Concrete example two

在本具体示例中，烹饪设备为具有联网功能的烹饪机、待烹饪食材为猪肉、青菜和香菇，参见图5，本具体示例的流程可以包括：In this specific example, the cooking device is a cooking machine having a networking function, and the food to be cooked is pork, green vegetables, and shiitake mushrooms. Referring to FIG. 5, the flow of the specific example may include:

S501：烹饪机采集待烹饪食材的图像； S501: The cooking machine collects an image of the food to be cooked;

S502：烹饪机将待烹饪食材的图像发送至服务器；S502: The cooking machine sends an image of the food to be cooked to the server;

S503：服务器基于待烹饪食材的图像识别出待烹饪食材的多个备选名称及各备选名称对应的相似度值；S503: the server identifies, according to the image of the food to be cooked, a plurality of alternative names of the food to be cooked and a similarity value corresponding to each alternative name;

具体来说，结合图3所示的服务器组成，烹饪机将待烹饪食材的图像发送至深度学习平台，从而使得识别出多个待烹饪食材的备选名称及每个备选名称对应的相似度值。Specifically, in combination with the server composition shown in FIG. 3, the cooking machine sends an image of the food to be cooked to the deep learning platform, so that the alternative names of the plurality of ingredients to be cooked and the similarity of each alternative name are identified. value.

S504：烹饪机向服务器发送当前地理位置及用户习惯参数；S504: The cooking machine sends the current geographic location and user habit parameters to the server;

S505：服务器根据待烹饪食材的多个备选名称和各备选名称对应的相似度值以及当前地理位置和用户习惯参数生成多个候选烹饪菜谱；S505: The server generates a plurality of candidate cooking recipes according to the plurality of alternative names of the ingredients to be cooked and the similarity values corresponding to the alternate names and the current geographic location and user habit parameters;

具体来说，结合图3所示的服务器组成，服务器的烹饪控制***根据待烹饪食材的多个备选名称和各备选名称对应的相似度值以及当前地理位置和用户习惯参数生成多个候选烹饪菜谱，以供用户进行选择。Specifically, in combination with the server composition shown in FIG. 3, the cooking control system of the server generates a plurality of candidates according to the plurality of alternative names of the ingredients to be cooked and the similarity values corresponding to the alternate names and the current geographic location and user habit parameters. Cooking recipes for the user to choose from.

这里，服务器的烹饪控制***根据待烹饪食材的多个备选名称和各备选名称对应的相似度值，可先将待烹饪食材的多个备选名称中具有最大相似度值的备选名称米种作为待烹饪食材的目标名称，然后再根据待烹饪食材的目标名称以及当前地理位置和用户习惯参数生成多个候选烹饪菜谱。Here, the cooking control system of the server may first select the alternative name having the largest similarity value among the plurality of alternative names of the food to be cooked according to the plurality of alternative names of the ingredients to be cooked and the similarity values corresponding to the alternate names. The rice species is used as the target name of the ingredients to be cooked, and then a plurality of candidate cooking recipes are generated according to the target name of the ingredients to be cooked and the current geographical location and user habit parameters.

S506：服务器将候选烹饪菜谱发送至烹饪机；S506: The server sends the candidate cooking recipe to the cooking machine;

S507：烹饪机展示候选烹饪菜谱并接收用户的选择指令，确定选定的烹饪菜谱；S507: the cooking machine displays the candidate cooking recipe and receives a user's selection instruction to determine the selected cooking recipe;

S508：烹饪机将选定的烹饪菜谱发送至服务器；S508: The cooking machine sends the selected cooking recipe to the server;

S509：服务器根据选定的烹饪菜谱生成烹饪控制指令；S509: The server generates a cooking control instruction according to the selected cooking recipe;

S510：服务器将烹饪控制指令发送至烹饪机；S510: The server sends a cooking control instruction to the cooking machine;

S511：烹饪机执行烹饪控制指令对待烹饪食材进行烹饪。S511: The cooking machine executes a cooking control instruction to cook the cooking ingredients.

通过以上两个具体示例对前述实施例的技术方案进行说明，可以得知，通过对待烹饪食材的图像识别，从而能够获得针对待烹饪食材的烹饪控制指令，实现对待烹饪食材的精细烹饪控制，提升整体烹饪效果。By explaining the technical solutions of the foregoing embodiments by the above two specific examples, it can be known that the cooking control of the ingredients to be cooked can be obtained by image recognition of the ingredients to be cooked. Instructions to achieve fine cooking control of the ingredients to be cooked and enhance the overall cooking effect.

实施例四Embodiment 4

基于前述实施例相同的技术构思，参见图6，其示出了本发明实施例提供的一种烹饪设备6，该烹饪设备6中包括：第一网络接口61、第一存储器62和第一处理器63；各个组件通过总线***64耦合在一起。可理解，总线***64用于实现这些组件之间的连接通信。总线***64除包括数据总线之外，还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见，在图6中将各种总线都标为总线***64。其中，Based on the same technical concept of the foregoing embodiment, referring to FIG. 6, a cooking device 6 according to an embodiment of the present invention is shown. The cooking device 6 includes: a first network interface 61, a first memory 62, and a first process. The components 63 are coupled together by a bus system 64. It will be appreciated that bus system 64 is used to implement connection communication between these components. The bus system 64 includes, in addition to the data bus, a power bus, a control bus, and a status signal bus. However, for clarity of description, various buses are labeled as bus system 64 in FIG. among them,

第一网络接口61，用于在与其他外部网元之间进行收发信息过程中，信号的接收和发送；The first network interface 61 is configured to receive and send signals during the process of transmitting and receiving information with other external network elements;

第一存储器62，用于存储能够在第一处理器63上运行的计算机程序；a first memory 62 for storing a computer program capable of running on the first processor 63;

第一处理器63，用于在运行所述计算机程序时，执行：The first processor 63 is configured to: when the computer program is executed, perform:

可以理解，本发明实施例中的第一存储器62可以是易失性存储器或非易失性存储器，或可包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(Read-Only Memory，ROM)、可编程只读存储器(Programmable ROM，PROM)、可擦除可编程只读存储器(Erasable PROM，EPROM)、电可擦除可编程只读存储器(Electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory，RAM)，其用作外部高速缓存。通过示例性但不是限制性说明，许多形式的RAM可用，例如静态随机存取存储器(Static RAM，SRAM)、动态随机存取存储器(Dynamic RAM，DRAM)、同步动态随机存取存储器(Synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM，DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(Synchlink DRAM，SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM，DRRAM)。本文描述的***和方法的第一存储器62旨在包括但不限于这些和任意其它适合类型的存储器。It is to be understood that the first memory 62 in the embodiments of the present invention may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be a read-only memory (ROM), a programmable read only memory (PROM), an erasable programmable read only memory (Erasable PROM, EPROM), or an electric Erase programmable read only memory (EEPROM) or flash memory. The volatile memory can be a Random Access Memory (RAM) that acts as an external cache. By way of illustration and not limitation, many forms of RAM may be For example, static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Synchronous Connection Dynamic Random Access Memory (SDRAM) and Direct Memory Bus Random Access Memory (Direct Rambus RAM, DRRAM). The first memory 62 of the systems and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.

而第一处理器63可能是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法的各步骤可以通过第一处理器63中的硬件的集成逻辑电路或者软件形式的指令完成。上述的第一处理器63可以是通用处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现场可编程门阵列(Field Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本发明实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本发明实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器，闪存、只读存储器，可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于第一存储器62，第一处理器63读取第一存储器62中的信息，结合其硬件完成上述方法的步骤。The first processor 63 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the foregoing method may be completed by an integrated logic circuit of hardware in the first processor 63 or an instruction in a form of software. The first processor 63 may be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA). Or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps, and logical block diagrams disclosed in the embodiments of the present invention may be implemented or carried out. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present invention may be directly implemented by the hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor. The software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like. The storage medium is located in the first memory 62, and the first processor 63 reads the information in the first memory 62 and completes the steps of the above method in combination with its hardware.

可以理解的是，本文描述的这些实施例可以用硬件、软件、固件、中间件、微码或其组合来实现。对于硬件实现，处理单元可以实现在一个或多个专用集成电路(Application Specific Integrated Circuits，ASIC)、数字信号处理器(Digital Signal Processing，DSP)、数字信号处理设备(DSP Device，DSPD)、可编程逻辑设备(Programmable Logic Device，PLD)、现场可编程门阵列(Field-Programmable Gate Array，FPGA)、通用处理器、控制器、微控制器、微处理器、用于执行本申请所述功能的其它电子单元或其组合中。It will be appreciated that the embodiments described herein can be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more Application Specific Integrated Circuits (ASICs), digital signals. Digital Signal Processing (DSP), Digital Signal Processing Equipment (DSP Device, DSPD), Programmable Logic Device (PLD), Field-Programmable Gate Array (FPGA), General Purpose A processor, controller, microcontroller, microprocessor, other electronic unit for performing the functions described herein, or a combination thereof.

对于软件实现，可通过执行本文所述功能的模块(例如过程、函数等)来实现本文所述的技术。软件代码可存储在存储器中并通过处理器执行。存储器可以在处理器中或在处理器外部实现。For a software implementation, the techniques described herein can be implemented by modules (eg, procedures, functions, and so on) that perform the functions described herein. The software code can be stored in memory and executed by the processor. The memory can be implemented in the processor or external to the processor.

具体来说，烹饪设备6中的第一处理器61还配置为运行所述计算机程序时，执行前述实施例一中所述的方法步骤，这里不再进行赘述。Specifically, when the first processor 61 in the cooking device 6 is further configured to run the computer program, the method steps described in the foregoing Embodiment 1 are performed, and details are not described herein.

此外，本发明实施例还提供了一种计算机存储介质，所述计算机存储介质存储有计算机可执行指令，所述计算机可执行指令被执行时实施前述实施例一中所述的方法步骤。In addition, an embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores computer executable instructions, and when the computer executable instructions are executed, the method steps described in the foregoing Embodiment 1 are implemented.

而前述的计算机存储介质可以包括：U盘、移动硬盘、只读存储器(ROM，Read Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。The foregoing computer storage medium may include: a U disk, a mobile hard disk, a read only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and the like, which can store program codes. medium.

实施例五Embodiment 5

基于前述实施例相同的技术构思，参见图7，其示出了本发明实施例提供的一种服务器7的结构，可以包括：第二网络接口71、第二存储器72和第二处理器73；各个组件通过总线***74耦合在一起。可理解，总线***74用于实现这些组件之间的连接通信。总线***74除包括数据总线之外，还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见，在图7中将各种总线都标为总线***74。其中，The structure of the server 7 provided by the embodiment of the present invention may include: a second network interface 71, a second memory 72, and a second processor 73, based on the same technical concept of the foregoing embodiment, see FIG. The various components are coupled together by a bus system 74. It will be appreciated that bus system 74 is used to implement connection communication between these components. The bus system 74 includes, in addition to the data bus, a power bus, a control bus, and a status signal bus. However, for clarity of description, various buses are labeled as bus system 74 in FIG. among them,

其中，所述第二网络接口71，用于在与其他外部网元之间进行收发信息过程中，信号的接收和发送；The second network interface 71 is configured to receive and send signals during the process of transmitting and receiving information with other external network elements.

第二存储器72，用于存储能够在第二处理器73上运行的计算机程序； a second memory 72 for storing a computer program executable on the second processor 73;

第二处理器73，用于在运行所述计算机程序时，执行：The second processor 73 is configured to execute when the computer program is executed:

接收烹饪设备发送的所述烹饪设备内待烹饪食材的图像；Receiving an image of the food item to be cooked in the cooking device sent by the cooking device;

可以理解，本发明实施例中的第二存储器72可以是易失性存储器或非易失性存储器，或可包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(Read-Only Memory，ROM)、可编程只读存储器(Programmable ROM，PROM)、可擦除可编程只读存储器(Erasable PROM，EPROM)、电可擦除可编程只读存储器(Electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory，RAM)，其用作外部高速缓存。通过示例性但不是限制性说明，许多形式的RAM可用，例如静态随机存取存储器(Static RAM，SRAM)、动态随机存取存储器(Dynamic RAM，DRAM)、同步动态随机存取存储器(Synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM，DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(Synchlink DRAM，SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM，DRRAM)。本文描述的***和方法的第二存储器72旨在包括但不限于这些和任意其它适合类型的存储器。It is to be understood that the second memory 72 in the embodiments of the present invention may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be a read-only memory (ROM), a programmable read only memory (PROM), an erasable programmable read only memory (Erasable PROM, EPROM), or an electric Erase programmable read only memory (EEPROM) or flash memory. The volatile memory can be a Random Access Memory (RAM) that acts as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (Synchronous DRAM). SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Synchronous Connection Dynamic Random Access Memory (SDRAM) And direct memory bus random access memory (DRRAM). The second memory 72 of the systems and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.

而第二处理器73可能是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法的各步骤可以通过第二处理器73中的硬件的集成逻辑电路或者软件形式的指令完成。上述的第二处理器73可以是通用处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现场可编程门阵列(Field Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本发明实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本发明实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器，闪存、只读存储器，可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于第二存储器72，第二处理器73读取第二存储器72中的信息，结合其硬件完成上述方法的步骤。The second processor 73 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the second processor 73 or an instruction in a form of software. The second processor 73 described above may be a general purpose processor, Digital Signal Processor (DSP), Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device , separate hardware components. The methods, steps, and logical block diagrams disclosed in the embodiments of the present invention may be implemented or carried out. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present invention may be directly implemented by the hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor. The software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like. The storage medium is located in the second memory 72, and the second processor 73 reads the information in the second memory 72 and completes the steps of the above method in combination with its hardware.

可以理解的是，本文描述的这些实施例可以用硬件、软件、固件、中间件、微码或其组合来实现。对于硬件实现，处理单元可以实现在一个或多个专用集成电路(Application Specific Integrated Circuits，ASIC)、数字信号处理器(Digital Signal Processing，DSP)、数字信号处理设备(DSP Device，DSPD)、可编程逻辑设备(Programmable Logic Device，PLD)、现场可编程门阵列(Field-Programmable Gate Array，FPGA)、通用处理器、控制器、微控制器、微处理器、用于执行本申请所述功能的其它电子单元或其组合中。It will be appreciated that the embodiments described herein can be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processing (DSP), Digital Signal Processing Equipment (DSP Device, DSPD), programmable Programmable Logic Device (PLD), Field-Programmable Gate Array (FPGA), general purpose processor, controller, microcontroller, microprocessor, other for performing the functions described herein In an electronic unit or a combination thereof.

具体来说，服务器7中的第二处理器71还配置为运行所述计算机程序时，执行前述实施例二中所述的方法步骤，这里不再进行赘述。Specifically, when the second processor 71 in the server 7 is configured to run the computer program, the method steps described in the foregoing Embodiment 2 are performed, and details are not described herein.

此外，本发明实施例还提供了一种计算机存储介质，所述计算机存储介质存储有计算机可执行指令，所述计算机可执行指令被执行时实施前述实施例一中所述的方法步骤。In addition, an embodiment of the present invention further provides a computer storage medium storing computer executable instructions, which are implemented when the computer executable instructions are executed The method steps described in Example 1.

实施例六 Embodiment 6

基于前述实施例相同的技术构思，参见图8，其示出了本发明实施例提供的一种烹饪设备的控制装置8的结构，可以包括：采集单元81、第一处理单元82、第二处理单元83、控制单元84；其中，The structure of the control device 8 of the cooking device provided by the embodiment of the present invention may include: an acquisition unit 81, a first processing unit 82, and a second process, based on the same technical concept of the foregoing embodiment. Unit 83, control unit 84; wherein

所述采集单元81，用于采集烹饪设备内待烹饪食材的图像；The collecting unit 81 is configured to collect an image of the food to be cooked in the cooking device;

所述第一处理单元82，用于基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；The first processing unit 82 is configured to perform recognition based on the image of the food to be cooked, and obtain a recognition result of the food to be cooked;

所述第二处理单元83，用于根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令；The second processing unit 83 is configured to acquire a cooking control instruction corresponding to the to-be-cooked food material according to the recognition result and the reference information during cooking;

所述控制单元84，用于按照所述烹饪控制指令对所述待烹饪食材进行烹饪。The control unit 84 is configured to cook the food to be cooked according to the cooking control instruction.

对于图8所示的技术方案，在一种可能的实现方式中，所述第一处理单元82可以包括：第一发送子单元821和第一接收子单元822；其中，For the technical solution shown in FIG. 8, in a possible implementation manner, the first processing unit 82 may include: a first sending subunit 821 and a first receiving subunit 822;

所述第一发送子单元821，用于当所述烹饪设备处于网络接入状态时，将所述待烹饪食材的图像发送至服务器；The first sending subunit 821 is configured to send an image of the food to be cooked to a server when the cooking device is in a network access state;

所述第一接收子单元822，用于接收由所述服务器根据所述待烹饪食材的图像所返回的识别结果。The first receiving subunit 822 is configured to receive a recognition result returned by the server according to the image of the item to be cooked.

对于图8所示的技术方案，在一种可能的实现方式中，所述第一处理单元82，具体用于：当所述烹饪设备处于离线状态时，根据本地图像库对所述待烹饪食材的图像进行识别，获取所述识别结果。For the technical solution shown in FIG. 8 , in a possible implementation, the first processing unit 82 is specifically configured to: when the cooking device is in an offline state, the food to be cooked according to a local image library; The image is identified to obtain the recognition result.

对于图8所示的技术方案，在一种可能的实现方式中，所述第二处理单83，可以包括：第二发送子单元831、第二接收子单元832；其中，For the technical solution shown in FIG. 8, in a possible implementation manner, the second processing The single 83 may include: a second sending subunit 831 and a second receiving subunit 832; wherein

所述第二发送子单元831，用于将所述识别结果以及用户习惯信息和当前地理位置信息发送至服务器；The second sending subunit 831 is configured to send the identification result, user habit information, and current geographic location information to a server;

所述第二接收子单元832，用于接收由所述服务器根据所述识别结果、所述用户习惯信息和所述当前地理位置返回的烹饪控制指令。The second receiving subunit 832 is configured to receive a cooking control instruction returned by the server according to the identification result, the user habit information, and the current geographic location.

对于图8所示的技术方案，在一种可能的实现方式中，所述第二处理单元83，可以包括：第三发送子单元833和第三接收子单元834；其中，For the technical solution shown in FIG. 8, in a possible implementation manner, the second processing unit 83 may include: a third sending subunit 833 and a third receiving subunit 834;

所述第三发送子单元833，用于将所述识别结果以及用户习惯信息和当前地理位置信息发送至服务器；The third sending subunit 833 is configured to send the identification result and user habit information and current geographic location information to a server;

所述第三接收子单元834，用于接收由所述服务器根据所述识别结果、所述用户习惯信息和所述当前地理位置返回的候选烹饪菜谱；以及，接收针对所述候选烹饪菜谱的选择指令，确定选定的烹饪菜谱；The third receiving subunit 834 is configured to receive a candidate cooking recipe returned by the server according to the identification result, the user habit information, and the current geographic location; and receive a selection for the candidate cooking recipe Instructions to determine the selected cooking recipe;

所述第三发送子单元833，还用于将所述选定的烹饪菜谱发送至所述服务器；The third sending subunit 833 is further configured to send the selected cooking recipe to the server;

所述第三接收子单元834，还用于接收由所述服务器根据所述选定的烹饪菜谱所返回的烹饪控制指令。The third receiving subunit 834 is further configured to receive a cooking control instruction returned by the server according to the selected cooking recipe.

对于图8所示的技术方案，在一种可能的实现方式中，所述第一处理单元81，可以包括：第一处理子单元823、第二处理子单元824、第四接收子单元825；其中，For the technical solution shown in FIG. 8, in a possible implementation manner, the first processing unit 81 may include: a first processing subunit 823, a second processing subunit 824, and a fourth receiving subunit 825; among them,

所述第一处理子单元823，用于提取所述待烹饪食材的图像的第一特征值；以及，根据所述第一特征值以及所述本地图像库中各图像的第二特征值，计算所述待烹饪食材的图像与所述本地图像库中各图像之间的相似度值；The first processing sub-unit 823 is configured to extract a first feature value of the image of the food item to be cooked; and calculate, according to the first feature value and the second feature value of each image in the local image library a similarity value between the image of the item to be cooked and each image in the local image library;

所述第二处理子单元824，用于按照设定相似度阈值，从所述本地图像库中选取至少一个备选食材的图像；以及，将所述备选食材的图像所对应的备选食材名称进行展示；The second processing sub-unit 824 is configured to select an image of at least one candidate food material from the local image library according to a set similarity threshold; and corresponding to an image of the candidate food material The name of the alternative ingredient is displayed;

第四接收子单元825，用于接收针对备选食材名称的选择指令；a fourth receiving subunit 825, configured to receive a selection instruction for an alternate food item name;

所述第二处理子单元824，还用于将所述选择指令所指示的备选食材名称作为所述待烹饪食材的名称；或，当展示时间大于或等于设定时间阈值时，将所述备选食材名称中与所述待烹饪食材的图像之间的相似度值最大的备选食材名称作为所述待烹饪食材的名称。The second processing sub-unit 824 is further configured to use an alternate food material name indicated by the selection instruction as a name of the food item to be cooked; or, when the display time is greater than or equal to a set time threshold, The name of the alternative food item having the highest similarity value between the alternative ingredient name and the image of the item to be cooked is used as the name of the item to be cooked.

实施例七Example 7

基于前述实施例相同的发明构思，参见图9，其示出了本发明实施例提供的一种服务器9的结构，可以包括：接收单元91、第三处理单元92、第四处理单元93、发送单元94；其中，Based on the same inventive concept of the foregoing embodiment, referring to FIG. 9, a structure of a server 9 according to an embodiment of the present invention is shown, which may include: a receiving unit 91, a third processing unit 92, a fourth processing unit 93, and a sending Unit 94; wherein

所述接收单元91，用于接收烹饪设备发送的所述烹饪设备内待烹饪食材的图像；The receiving unit 91 is configured to receive an image of the food to be cooked in the cooking device sent by the cooking device;

所述第三处理单元92，用于基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；The third processing unit 92 is configured to perform recognition based on the image of the food to be cooked, and obtain a recognition result of the food to be cooked;

所述第四处理单元93，用于根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令；The fourth processing unit 93 is configured to generate a cooking control instruction corresponding to the to-be-cooked food material according to the recognition result and the reference information during cooking;

所述发送单元94，用于将所述烹饪控制指令发送至所述烹饪设备。The sending unit 94 is configured to send the cooking control instruction to the cooking device.

对于图9所示的技术方案，在一种可能的实现方式中，所述第三处理单元92，具体用于：For the technical solution shown in FIG. 9, in a possible implementation manner, the third processing unit 92 is specifically configured to:

对于图9所示的技术方案，在一种可能的实现方式中，所述接收单元91，还用于接收所述烹饪设备发送的用户习惯信息和当前地理位置信息。 For the technical solution shown in FIG. 9, in a possible implementation manner, the receiving unit 91 is further configured to receive user habit information and current geographic location information sent by the cooking device.

对于图9所示的技术方案，在一种可能的实现方式中，所述第四处理单元93，可以包括：第三处理子单元931、第四发送子单元932、第五接收子单元933；其中，For the technical solution shown in FIG. 9, in a possible implementation manner, the fourth processing unit 93 may include: a third processing subunit 931, a fourth transmitting subunit 932, and a fifth receiving subunit 933; among them,

所述第三处理子单元931，用于根据所述识别结果以及用户习惯信息和当前地理位置信息，生成所述待烹饪食材的候选烹饪菜谱；The third processing sub-unit 931 is configured to generate a candidate cooking recipe of the to-be-cooked food material according to the recognition result, the user habit information, and current geographic location information;

所述第四发送子单元932，用于将所述候选烹饪菜谱发送至所述烹饪设备；The fourth sending subunit 932 is configured to send the candidate cooking recipe to the cooking device;

所述第五接收子单元933，用于接收所述烹饪设备发送的针对所述候选烹饪菜谱进行选定的烹饪菜谱；The fifth receiving subunit 933 is configured to receive a cooking recipe selected by the cooking device for the candidate cooking recipe;

所述第三处理子单元931，还用于根据所述选定的烹饪菜谱生成对应的烹饪控制指令。The third processing sub-unit 931 is further configured to generate a corresponding cooking control instruction according to the selected cooking recipe.

实施例八Example eight

基于前述实施例相同的发明构思，参见图10，其示出了本发明实施例提供的一种烹饪设备的控制***10，所述***10包括烹饪设备6和服务器7；其中，Based on the same inventive concept of the foregoing embodiment, referring to FIG. 10, a control system 10 of a cooking apparatus provided by an embodiment of the present invention is shown. The system 10 includes a cooking apparatus 6 and a server 7;

所述烹饪设备6，配置为：采集烹饪设备6内待烹饪食材的图像；以及，The cooking device 6 is configured to: collect an image of the food to be cooked in the cooking device 6;

所述服务器7，配置为：接收所述烹饪设备6发送的所述烹饪设备内待烹饪食材的图像；以及The server 7 is configured to receive an image of the food item to be cooked in the cooking device sent by the cooking device 6;

基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；以及， Identifying the image of the food to be cooked based on the image of the food to be cooked, and obtaining the recognition result of the food to be cooked;

将所述烹饪控制指令发送至所述烹饪设备6。The cooking control command is sent to the cooking device 6.

以上所述，仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围。凡在本发明的精神和范围之内所作的任何修改、等同替换和改进等，均包含在本发明的保护范围之内。The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and scope of the present invention are included in the scope of the present invention.

需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

上述本发明实施例序号仅仅为了描述，不代表实施例的优劣。The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

以上仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

工业实用性Industrial applicability

本实施例中，通过采集到的待烹饪食材的图像来获得针对待烹饪食材的识别结果，随后根据识别结果获得针对待烹饪食材的烹饪控制指令，最后按照烹饪控制指令对待烹饪食材进行烹饪；从而能够通过对待烹饪食材的识别，实现对整体烹饪控制过程的精细化控制，提升整体烹饪效果。 In this embodiment, the recognition result for the food to be cooked is obtained by the collected image of the food to be cooked, and then the cooking control instruction for the food to be cooked is obtained according to the recognition result, and finally the cooking ingredient is cooked according to the cooking control instruction; Through the identification of the ingredients to be cooked, the fine control of the overall cooking control process can be achieved, and the overall cooking effect can be improved.

Claims

一种烹饪设备的控制方法，应用于烹饪设备，其特征在于，所述方法包括：A method of controlling a cooking device, applied to a cooking device, characterized in that the method comprises:

采集烹饪设备内待烹饪食材的图像；Collecting images of the ingredients to be cooked in the cooking device;

基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；Identifying the image of the food item to be cooked, and obtaining a recognition result of the food item to be cooked;

根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令；Obtaining a cooking control instruction corresponding to the to-be-cooked food material according to the recognition result and reference information at the time of cooking;

按照所述烹饪控制指令对所述待烹饪食材进行烹饪。The food to be cooked is cooked according to the cooking control instruction.
根据权利要求1所述的方法，其特征在于，所述基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果，包括：The method according to claim 1, wherein the identifying the image of the food to be cooked based on the image of the food to be cooked, and obtaining the recognition result of the food to be cooked comprises:

当所述烹饪设备处于网络接入状态时，将所述待烹饪食材的图像发送至服务器；Sending an image of the food to be cooked to a server when the cooking device is in a network access state;

接收由所述服务器根据所述待烹饪食材的图像所返回的识别结果。Receiving a recognition result returned by the server according to the image of the item to be cooked.
根据权利要求1所述的方法，其特征在于，所述基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果，包括：The method according to claim 1, wherein the identifying the image of the food to be cooked based on the image of the food to be cooked, and obtaining the recognition result of the food to be cooked comprises:

当所述烹饪设备处于离线状态时，根据本地图像库对所述待烹饪食材的图像进行识别，获取所述识别结果。When the cooking device is in an offline state, the image of the to-be-cooked food material is identified according to a local image library, and the recognition result is obtained.
根据权利要求1所述的方法，其特征在于，所述根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令，包括：The method according to claim 1, wherein the obtaining the cooking control instruction corresponding to the food item to be cooked according to the recognition result and the reference information during cooking comprises:

将所述识别结果以及用户习惯信息和当前地理位置信息发送至服务器；Sending the identification result and user habit information and current geographical location information to the server;

接收由所述服务器根据所述识别结果、所述用户习惯信息和所述当前地理位置返回的烹饪控制指令。 A cooking control instruction returned by the server based on the recognition result, the user habit information, and the current geographic location is received.
根据权利要求1所述的方法，其特征在于，所述根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令，包括：The method according to claim 1, wherein the obtaining the cooking control instruction corresponding to the food item to be cooked according to the recognition result and the reference information during cooking comprises:

将所述识别结果以及用户习惯信息和当前地理位置信息发送至服务器；Sending the identification result and user habit information and current geographical location information to the server;

接收由所述服务器根据所述识别结果、所述用户习惯信息和所述当前地理位置返回的候选烹饪菜谱；Receiving a candidate cooking recipe returned by the server according to the recognition result, the user habit information, and the current geographic location;

接收针对所述候选烹饪菜谱的选择指令，确定选定的烹饪菜谱；Receiving a selection instruction for the candidate cooking recipe to determine a selected cooking recipe;

将所述选定的烹饪菜谱发送至所述服务器；Sending the selected cooking recipe to the server;

接收由所述服务器根据所述选定的烹饪菜谱所返回的烹饪控制指令。A cooking control command returned by the server in accordance with the selected cooking recipe is received.
根据权利要求3所述的方法，其特征在于，所述根据本地图像库对所述待烹饪食材的图像进行识别，获取所述识别结果，包括：The method according to claim 3, wherein the identifying the image of the item to be cooked according to the local image library, and obtaining the recognition result comprises:

提取所述待烹饪食材的图像的第一特征值；Extracting a first characteristic value of the image of the food item to be cooked;

根据所述第一特征值以及所述本地图像库中各图像的第二特征值，计算所述待烹饪食材的图像与所述本地图像库中各图像之间的相似度值；Calculating a similarity value between the image of the item to be cooked and each image in the local image library according to the first feature value and the second feature value of each image in the local image library;

按照设定相似度阈值，从所述本地图像库中选取至少一个备选食材的图像；Selecting an image of at least one candidate food item from the local image library according to a set similarity threshold;

将备选食材的图像所对应的备选食材名称进行展示；Displaying the name of the alternative ingredient corresponding to the image of the alternative ingredient;

接收针对备选食材名称的选择指令，并将所述选择指令所指示的备选食材名称作为所述待烹饪食材的名称；或，当展示时间大于或等于设定时间阈值时，将所述备选食材名称中与所述待烹饪食材的图像之间的相似度值最大的备选食材名称作为所述待烹饪食材的名称。Receiving a selection instruction for the name of the alternative food item, and using the name of the alternative food item indicated by the selection instruction as the name of the item to be cooked; or, when the display time is greater than or equal to the set time threshold, the preparation The name of the alternative food item having the highest similarity value between the food item name and the image of the food item to be cooked is selected as the name of the food item to be cooked.
一种烹饪设备的控制装置，其特征在于，所述装置包括：采集单元、第一处理单元、第二处理单元、控制单元；其中，A control device for a cooking device, comprising: an acquisition unit, a first processing unit, a second processing unit, and a control unit;

所述采集单元，用于采集烹饪设备内待烹饪食材的图像； The collecting unit is configured to collect an image of the food to be cooked in the cooking device;

所述第一处理单元，用于基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；The first processing unit is configured to perform recognition based on the image of the food to be cooked, and obtain a recognition result of the food to be cooked;

所述第二处理单元，用于根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令；The second processing unit is configured to acquire a cooking control instruction corresponding to the to-be-cooked food material according to the recognition result and reference information during cooking;

所述控制单元，用于按照所述烹饪控制指令对所述待烹饪食材进行烹饪。The control unit is configured to cook the food to be cooked according to the cooking control instruction.
根据权利要求7所述的装置，其特征在于，所述第一处理单元包括：第一发送子单元和第一接收子单元；其中，The apparatus according to claim 7, wherein the first processing unit comprises: a first transmitting subunit and a first receiving subunit; wherein

所述第一发送子单元，用于当所述烹饪设备处于网络接入状态时，将所述待烹饪食材的图像发送至服务器；The first sending subunit is configured to send an image of the food to be cooked to a server when the cooking device is in a network access state;

所述第一接收子单元，用于接收由所述服务器根据所述待烹饪食材的图像所返回的识别结果。The first receiving subunit is configured to receive a recognition result returned by the server according to the image of the food item to be cooked.
根据权利要求7所述的装置，其特征在于，所述第一处理单元，具体用于：The device according to claim 7, wherein the first processing unit is specifically configured to:

当所述烹饪设备处于离线状态时，根据本地图像库对所述待烹饪食材的图像进行识别，获取所述识别结果。When the cooking device is in an offline state, the image of the to-be-cooked food material is identified according to a local image library, and the recognition result is obtained.
根据权利要求7所述的装置，其特征在于，所述第二处理单元，包括：第二发送子单元、第二接收子单元；其中，The apparatus according to claim 7, wherein the second processing unit comprises: a second sending subunit and a second receiving subunit; wherein

所述第二发送子单元，用于将所述识别结果以及用户习惯信息和当前地理位置信息发送至服务器；The second sending subunit is configured to send the identification result, user habit information, and current geographic location information to a server;

所述第二接收子单元，用于接收由所述服务器根据所述识别结果、所述用户习惯信息和所述当前地理位置返回的烹饪控制指令。The second receiving subunit is configured to receive a cooking control instruction returned by the server according to the identification result, the user habit information, and the current geographic location.
根据权利要求7所述的装置，其特征在于，所述第二处理单元，包括：第三发送子单元和第三接收子单元；其中，The apparatus according to claim 7, wherein the second processing unit comprises: a third sending subunit and a third receiving subunit; wherein

所述第三发送子单元，用于将所述识别结果以及用户习惯信息和当前地理位置信息发送至服务器；The third sending subunit is configured to use the identification result and user habit information and current Geographic location information is sent to the server;

所述第三接收子单元，用于接收由所述服务器根据所述识别结果、所述用户习惯信息和所述当前地理位置返回的候选烹饪菜谱；以及，接收针对所述候选烹饪菜谱的选择指令，确定选定的烹饪菜谱；The third receiving subunit is configured to receive a candidate cooking recipe returned by the server according to the recognition result, the user habit information, and the current geographic location; and receive a selection instruction for the candidate cooking recipe , determining the selected cooking recipe;

所述第三发送子单元，还用于将所述选定的烹饪菜谱发送至所述服务器；The third sending subunit is further configured to send the selected cooking recipe to the server;

所述第三接收子单元，还用于接收由所述服务器根据所述选定的烹饪菜谱所返回的烹饪控制指令。The third receiving subunit is further configured to receive a cooking control instruction returned by the server according to the selected cooking recipe.
根据权利要求9所述的装置，其特征在于，所述第一处理单元包括：第一处理子单元、第二处理子单元、第四接收子单元；其中，The apparatus according to claim 9, wherein the first processing unit comprises: a first processing subunit, a second processing subunit, and a fourth receiving subunit; wherein

所述第一处理子单元，用于提取所述待烹饪食材的图像的第一特征值；以及，根据所述第一特征值以及所述本地图像库中各图像的第二特征值，计算所述待烹饪食材的图像与所述本地图像库中各图像之间的相似度值；The first processing subunit is configured to extract a first feature value of the image of the food item to be cooked; and, according to the first feature value and the second feature value of each image in the local image library, calculate the Determining a similarity value between the image of the cooked food material and each image in the local image library;

所述第二处理子单元，用于按照设定相似度阈值，从所述本地图像库中选取至少一个备选食材的图像；以及，将所述备选食材的图像所对应的备选食材名称进行展示；The second processing sub-unit is configured to select an image of the at least one candidate food material from the local image library according to a set similarity threshold; and select an alternate food material name corresponding to the image of the candidate food material Display

第四接收子单元，用于接收针对备选食材名称的选择指令；a fourth receiving subunit, configured to receive a selection instruction for the name of the alternative food item;

所述第二处理子单元，还用于将所述选择指令所指示的备选食材名称作为所述待烹饪食材的名称；或，当展示时间大于或等于设定时间阈值时，将所述备选食材名称中与所述待烹饪食材的图像之间的相似度值最大的备选食材名称作为所述待烹饪食材的名称。The second processing sub-unit is further configured to use the name of the alternative food material indicated by the selection instruction as the name of the food item to be cooked; or, when the display time is greater than or equal to the set time threshold, the preparation The name of the alternative food item having the highest similarity value between the food item name and the image of the food item to be cooked is selected as the name of the food item to be cooked.
一种计算机存储介质，所述计算机存储介质中存储有烹饪设备的控制程序，其特征在于，所述烹饪设备的控制程序被处理器执行时实现如权利要求1至6中任一项所述方法的步骤。A computer storage medium storing a control program of a cooking device, wherein the control program of the cooking device is executed by a processor to implement the method of any one of claims 1 to A step of.
一种烹饪设备，其特征在于，所述烹饪设备包括：第一网络接口、第一存储器和第一处理器；其中，A cooking apparatus, characterized in that the cooking apparatus comprises: a first network interface, a first memory and a first processor; wherein

所述第一网络接口，用于在与其他外部网元之间进行收发信息过程中，信号的接收和发送；The first network interface is configured to receive and send signals during the process of transmitting and receiving information with other external network elements;

所述第一存储器，用于存储能够在第一处理器上运行的计算机程序；The first memory is configured to store a computer program capable of running on the first processor;

所述第一处理器，用于在运行所述计算机程序时，执行权利要求1至6任一项所述方法的步骤。The first processor is configured to perform the steps of the method of any one of claims 1 to 6 when the computer program is run.
一种烹饪设备的控制方法，应用于服务器，其特征在于，所述方法包括：A method of controlling a cooking device, applied to a server, wherein the method comprises:

接收烹饪设备发送的所述烹饪设备内待烹饪食材的图像；Receiving an image of the food item to be cooked in the cooking device sent by the cooking device;

基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；Identifying the image of the food item to be cooked, and obtaining a recognition result of the food item to be cooked;

根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令；Generating a cooking control instruction corresponding to the food item to be cooked according to the recognition result and the reference information at the time of cooking;

将所述烹饪控制指令发送至所述烹饪设备。The cooking control command is sent to the cooking device.
根据权利要求15所述的方法，其特征在于，所述基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果，包括：The method according to claim 15, wherein the identifying the image of the food to be cooked based on the image of the food to be cooked, and obtaining the recognition result of the food to be cooked comprises:

获取所述待烹饪食材的图像特征值；Obtaining an image feature value of the food to be cooked;

将所述待烹饪食材的图像特征值与图像特征库中的特征值进行匹配，并将所述图像特征库中与所述图像特征值之间匹配度最高的特征值所对应的食材，确定为所述待烹饪食材的的识别结果。Matching the image feature value of the food to be cooked with the feature value in the image feature library, and determining the food material corresponding to the feature value having the highest matching degree between the image feature value and the image feature value as The recognition result of the food to be cooked.
根据权利要求15所述的方法，其特征在于，在所述根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令之前，还包括：The method according to claim 15, wherein before the generating the cooking control instruction corresponding to the food item to be cooked according to the identification result and the reference information during cooking, the method further comprises:

接收所述烹饪设备发送的用户习惯信息和当前地理位置信息。Receiving user habit information and current geographic location information sent by the cooking device.
根据权利要求17所述的方法，其特征在于，所述根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令，包括：The method of claim 17 wherein said identifying said And a reference information during cooking, and generating cooking control instructions corresponding to the food to be cooked, including:

根据所述识别结果以及用户习惯信息和当前地理位置信息，生成所述待烹饪食材的候选烹饪菜谱；Generating, according to the recognition result, the user habit information and the current geographical location information, a candidate cooking recipe of the food to be cooked;

将所述候选烹饪菜谱发送至所述烹饪设备；Sending the candidate cooking recipe to the cooking device;

接收所述烹饪设备发送的针对所述候选烹饪菜谱进行选定的烹饪菜谱；Receiving a cooking recipe selected by the cooking device for the candidate cooking recipe;

根据所述选定的烹饪菜谱生成对应的烹饪控制指令。Corresponding cooking control instructions are generated based on the selected cooking recipe.
一种烹饪设备的控制装置，其特征在于，所述装置包括：接收单元、第三处理单元、第四处理单元、发送单元；其中，A control device for a cooking device, comprising: a receiving unit, a third processing unit, a fourth processing unit, and a transmitting unit; wherein

所述接收单元，用于接收烹饪设备发送的所述烹饪设备内待烹饪食材的图像；The receiving unit is configured to receive an image of the food item to be cooked in the cooking device sent by the cooking device;

所述第三处理单元，用于基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；The third processing unit is configured to perform recognition based on the image of the food to be cooked, and obtain a recognition result of the food to be cooked;

所述第四处理单元，用于根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令；The fourth processing unit is configured to generate a cooking control instruction corresponding to the to-be-cooked food material according to the recognition result and reference information during cooking;

所述发送单元，用于将所述烹饪控制指令发送至所述烹饪设备。The sending unit is configured to send the cooking control instruction to the cooking device.
根据权利要求19所述的装置，其特征在于，所述第三处理单元，具体用于：The device according to claim 19, wherein the third processing unit is specifically configured to:

获取所述待烹饪食材的图像特征值；Obtaining an image feature value of the food to be cooked;

将所述待烹饪食材的图像特征值与图像特征库中的特征值进行匹配，并将所述图像特征库中与所述图像特征值之间匹配度最高的特征值所对应的食材，确定为所述待烹饪食材的的识别结果。Matching the image feature value of the food to be cooked with the feature value in the image feature library, and determining the food material corresponding to the feature value having the highest matching degree between the image feature value and the image feature value as The recognition result of the food to be cooked.
根据权利要求19所述的装置，其特征在于，The device according to claim 19, characterized in that

所述接收单元，还用于接收所述烹饪设备发送的用户习惯信息和当前地理位置信息。The receiving unit is further configured to receive user habit information and current information sent by the cooking device Location information.
根据权利要求21所述的装置，其特征在于，所述第四处理单元，包括：第三处理子单元、第四发送子单元、第五接收子单元；其中，The apparatus according to claim 21, wherein the fourth processing unit comprises: a third processing subunit, a fourth transmitting subunit, and a fifth receiving subunit; wherein

所述第三处理子单元，用于根据所述识别结果以及用户习惯信息和当前地理位置信息，生成所述待烹饪食材的候选烹饪菜谱；The third processing sub-unit is configured to generate a candidate cooking recipe of the to-be-cooked food material according to the recognition result, the user habit information, and current geographic location information;

所述第四发送子单元，用于将所述候选烹饪菜谱发送至所述烹饪设备；The fourth sending subunit is configured to send the candidate cooking recipe to the cooking device;

所述第五接收子单元，用于接收所述烹饪设备发送的针对所述候选烹饪菜谱进行选定的烹饪菜谱；The fifth receiving subunit is configured to receive a cooking recipe selected by the cooking device for the candidate cooking recipe;

所述第三处理子单元，还用于根据所述选定的烹饪菜谱生成对应的烹饪控制指令。The third processing subunit is further configured to generate a corresponding cooking control instruction according to the selected cooking recipe.
一种计算机存储介质，其特征在于，所述计算机存储介质中存储有烹饪设备的控制程序，其特征在于，所述烹饪设备的控制程序被处理器执行时实现如权利要求15至18中任一项所述方法的步骤。A computer storage medium, characterized in that the computer storage medium stores a control program of the cooking device, wherein the control program of the cooking device is executed by the processor to implement any one of claims 15 to 18 The steps of the method described.
一种服务器，其特征在于，所述服务器包括：第二网络接口、第二存储器和第二处理器；其中，A server, comprising: a second network interface, a second memory, and a second processor; wherein

所述第二网络接口，用于在与其他外部网元之间进行收发信息过程中，信号的接收和发送；The second network interface is configured to receive and send signals during the process of transmitting and receiving information with other external network elements;

所述第二存储器，用于存储能够在第二处理器上运行的计算机程序；The second memory is configured to store a computer program capable of running on the second processor;

所述第二处理器，用于在运行所述计算机程序时，执行权利要求15至18任一项所述方法的步骤。The second processor is configured to perform the steps of the method of any one of claims 15 to 18 when the computer program is run.
一种烹饪设备的控制***，其特征在于，所述***包括：烹饪设备和服务器；其中，A control system for a cooking apparatus, characterized in that the system comprises: a cooking device and a server; wherein

所述烹饪设备，配置为：采集烹饪设备内待烹饪食材的图像；以及，The cooking device is configured to: collect an image of the food to be cooked in the cooking device;

基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；以及， Identifying the image of the food to be cooked based on the image of the food to be cooked, and obtaining the recognition result of the food to be cooked;

根据所述识别结果以及烹饪时的参考信息，获取与所述待烹饪食材对应的烹饪控制指令；以及，Obtaining a cooking control instruction corresponding to the food item to be cooked according to the recognition result and reference information at the time of cooking; and

按照所述烹饪控制指令对所述待烹饪食材进行烹饪；Cooking the food to be cooked according to the cooking control instruction;

所述服务器，配置为：接收所述烹饪设备发送的所述烹饪设备内待烹饪食材的图像；以及The server is configured to: receive an image of the food item to be cooked in the cooking device sent by the cooking device;

基于所述待烹饪食材的图像进行识别，获取所述待烹饪食材的识别结果；以及，Identifying the image of the food to be cooked based on the image of the food to be cooked, and obtaining the recognition result of the food to be cooked;

根据所述识别结果以及烹饪时的参考信息，生成与所述待烹饪食材对应的烹饪控制指令；以及，Generating a cooking control instruction corresponding to the food item to be cooked according to the recognition result and reference information at the time of cooking;

将所述烹饪控制指令发送至所述烹饪设备。 The cooking control command is sent to the cooking device.