WO2014146430A1 - 一种冰箱内食品存储位置记录方法、装置、终端及冰箱 - Google Patents
一种冰箱内食品存储位置记录方法、装置、终端及冰箱 Download PDFInfo
- Publication number
- WO2014146430A1 WO2014146430A1 PCT/CN2013/086186 CN2013086186W WO2014146430A1 WO 2014146430 A1 WO2014146430 A1 WO 2014146430A1 CN 2013086186 W CN2013086186 W CN 2013086186W WO 2014146430 A1 WO2014146430 A1 WO 2014146430A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- food
- storage location
- image
- identified
- refrigerator
- Prior art date
Links
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
Definitions
- the invention relates to the technical field of smart home appliances, in particular to a method, a device, a terminal and a refrigerator for recording a food storage location in a refrigerator.
- some smart refrigerators are loaded with an intelligent control terminal, such as a tablet computer, on the basis of a conventional refrigerator.
- the user inputs the names of the foods stored in the refrigerator in the intelligent control terminal by manual input.
- the intelligent control terminal records the storage location of each food, and carries out subsequent management.
- the method of manually inputting the name of the food and the storage location in the refrigerator can only operate for one food at a time.
- the refrigerator stores more food, it needs manual operation for a long time, and information is entered. It is less efficient and it is difficult to guarantee the accuracy of manual operations.
- the embodiment of the invention provides a method, a device, a terminal and a refrigerator for recording a food storage location in a refrigerator, which are used to solve the problem of low efficiency of food storage location information entry in the prior art.
- the embodiment of the invention provides a method for recording a food storage location in a refrigerator, comprising:
- the identified food item is recorded in a storage location in the refrigerator characterized by the storage location mark.
- the embodiment of the invention provides a food storage location recording device in a refrigerator, comprising:
- An obtaining unit configured to obtain a food collection image obtained by photographing an internal storage space of the refrigerator
- a determining unit configured to determine a storage location mark existing in the food collection image, and a region range corresponding to the storage location mark in the food collection image
- a recognition unit configured to identify a food present in a region corresponding to the storage location mark
- a recording unit configured to record the identified storage location of the food stored in the refrigerator in the storage location mark.
- the embodiment of the invention further provides an intelligent control terminal, comprising the food storage location recording device in the refrigerator.
- the embodiment of the invention further provides a refrigerator, comprising the above intelligent control terminal.
- the storage location included in the storage space of the refrigerator is provided with a storage location mark, and the internal storage space of the refrigerator is directly photographed to obtain a food collection image, and the area corresponding to the storage location mark in the food collection image is determined. Scope, further identifying the foods existing in the area, that is, determining the storage location of each food in the refrigerator while determining the name of each stored food, and recording, so that manual input is not required, and the food can be improved. The entry efficiency of the location information is stored, and the accuracy of the information is guaranteed.
- FIG. 1 is a flowchart of a method for recording a food storage location in a refrigerator according to an embodiment of the present invention
- FIG. 2 is a flowchart of a method for recording a food storage location in a refrigerator according to Embodiment 1 of the present invention
- FIG. 3 is a flowchart of a food identification method according to Embodiment 1 of the present invention.
- FIG. 4 is a flowchart of a method for recording a food storage location in a refrigerator according to Embodiment 2 of the present invention.
- FIG. 5 is a schematic structural diagram of a food storage location recording apparatus in a refrigerator according to Embodiment 3 of the present invention.
- the present invention provides a method, a device, and a refrigerator for recording a food storage location in a refrigerator.
- the preferred embodiment of the present invention is described below with reference to the accompanying drawings.
- the preferred embodiments described herein are for illustrative purposes only and are not intended to limit the invention. And in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.
- An embodiment of the present invention provides a method for recording a food storage location in a refrigerator, as shown in FIG. 1 , including:
- Step 101 Obtain a food collection image obtained by photographing an internal storage space of the refrigerator.
- Step 102 Determine a storage location mark existing in the food collection image, and a region range corresponding to the storage location mark in the food collection image.
- Step 103 Identify the food present in the area corresponding to the storage location mark.
- Step 104 Record the identified food item in a storage location in the refrigerator that is represented by the storage location mark.
- the storage space in the refrigerator is first divided into a plurality of subspaces, and a storage location flag indicating a storage location is set in each subspace, that is, a subspace is A storage space corresponding to a storage location.
- a subspace is A storage space corresponding to a storage location.
- any terminal having a shooting function can be used.
- the intelligent control terminal with a shooting function loaded on the refrigerator can be directly used.
- the storage location indications present in the food collection image may be one or more based on different shooting modes of the user; the area corresponding to the storage location mark in the food collection image may be the entire area of the food collection image. It may also be a partial area of the food collection image.
- the food identification method in step 103 may adopt image recognition, barcode recognition, etc., and preferably combines image recognition and barcode recognition according to the embodiment of the present invention, which can improve the accuracy and recognition of food identification. rate.
- the user only photographs a subspace, that is, a storage space corresponding to a storage location, and may capture all of the subspace, or may capture a part of the subspace, but the sub-space must be captured.
- Storage location sign for space.
- Embodiment 1 of the present invention is a flowchart of a method for recording a food storage location in a refrigerator according to Embodiment 1 of the present invention, which specifically includes:
- Step 201 Acquire a photographed food collection image.
- Step 202 Determine a storage location identifier existing in the food collection image, and determine a region range corresponding to the storage location identifier as all regions in the food collection image.
- the specific form of the storage location mark may be various, and preferably, a barcode may be employed. Further, in order to distinguish the one-dimensional barcode carried on the food in the refrigerator, the storage location mark may adopt a two-dimensional barcode.
- Step 203 Identify foods present in the food collection image.
- Step 204 Record the identified food item in a storage location in the refrigerator that is represented by the storage location mark.
- the user may also display the food icon corresponding to the stored food in the refrigerator and its storage location in the refrigerator.
- the enhanced display technology may be employed to improve the user experience.
- FIG. 3 is a flowchart of a food identification method according to Embodiment 1 of the present invention, which specifically includes:
- Step 301 Determine an image of the food to be identified that exists in a region range corresponding to the storage location mark.
- the step includes pre-processing the area range corresponding to the storage location mark in the food collection image, performing contour detection and background segmentation of the food to be identified, etc. This part is prior art, and therefore will not be described in detail herein.
- Step 302 Determine whether a food identification barcode exists in the image of the food to be identified.
- step 303 When the food identification barcode is present in the food image to be identified, the process proceeds to step 303; when the food identification barcode is not present in the food image to be identified, the process proceeds to step 304.
- Step 303 Determine that the food in the food image to be identified is a food characterized by a food identification barcode, and end the food identification process.
- the food can be identified by the food identification barcode without performing subsequent steps.
- Step 304 Extract a feature vector of the food image to be identified.
- the method for extracting the food image feature vector to be identified in this step corresponds to the method for establishing the correspondence between the food and the feature vector.
- the correspondence between the preset food and the feature vector may be as follows. set up:
- the sample image of the plurality of samples of the food may be determined first.
- the average of the color feature values, the average of the shape feature values of the sample images of the plurality of samples of the food, and the average of the texture feature values of the sample images of the plurality of samples of the food; the average of the color feature values The average value of the shape feature values and the average value of the texture feature values directly as the components of the feature vector constitute the feature vector corresponding to the food.
- the color feature value interval corresponding to the food image of the plurality of samples of the food product is first determined, and the shape characteristic value of the sample image of the plurality of samples of the food product is used to determine the corresponding food product.
- the method when extracting the feature vector of the food image to be identified, the method includes the following steps:
- the color feature value, the shape feature value, and the texture of the food image to be identified may be specifically The feature value directly serves as a component of the feature vector, and constitutes a feature vector of the food image to be identified.
- the color feature value preset interval of the color feature value of the food image to be identified is determined first, and the shape feature value preset interval of the shape feature value of the food image to be identified and the texture feature value of the food image to be identified are determined.
- the texture feature value preset interval is set; and the feature vector of the food image to be identified is determined based on the color feature value preset interval, the shape feature value preset interval, and the texture feature value preset interval.
- Step 305 Determine, among the plurality of feature vectors corresponding to the different foods, whether there is a feature vector whose correlation degree with the feature vector of the food image to be identified is greater than a preset value.
- step 306 when a plurality of feature vectors respectively corresponding to different foods are preset, if there is a feature vector whose correlation degree with the feature vector of the food image to be identified is greater than a preset value, the process proceeds to step 306; when the preset corresponds to different foods respectively When there is no feature vector between the plurality of feature vectors and the feature vector of the food image to be identified that is greater than the preset value, it is determined that the food cannot be identified, and the food identification process is ended.
- Step 306 Select, from the preset plurality of feature vectors respectively corresponding to different foods, a feature vector having the greatest correlation with the feature vector of the food image to be identified as the matched feature vector.
- Step 307 Determine that the food in the food image to be identified is a food corresponding to the matching feature vector.
- the food identification method described above combines bar code recognition and image recognition, and prioritizes bar code recognition.
- the first embodiment of the present invention may also adopt a scheme of priority image recognition, or adopt a scheme of bar code recognition and image recognition simultaneously, based on respective identifications.
- the results determine the final food identification results.
- the user photographs a plurality of subspaces, that is, a storage space corresponding to a plurality of storage locations, and may capture all of the plurality of subspaces, or may capture a part of the plurality of subspaces.
- Embodiment 4 is a flowchart of a method for recording a food storage location in a refrigerator according to Embodiment 2 of the present invention, which specifically includes:
- Step 401 Acquire a photographed food collection image.
- Step 402 Determine a plurality of storage location markers existing in the food collection image, and a region range corresponding to the plurality of storage location markers in the food collection image.
- the storage location mark is a two-dimensional barcode.
- the specified range based on the storage location flag in the food collection image may be determined as the region range corresponding to the storage location flag.
- the specified range is specifically related to the position of the storage location indicated in the storage space corresponding to the storage location.
- the storage location indication when the storage location indication is located at the center of the storage space corresponding to the storage location, it may be determined at this time that the region corresponding to the storage location marker is specified to be extended to the periphery around the storage location marker in the food collection image.
- the size of the specified range is positively correlated with the size of the storage location mark in the food collection image.
- the specified range is larger; when the storage location mark is smaller in the food collection image, the specified range is smaller.
- Step 403 Identify food products existing in a range corresponding to the plurality of storage location markers.
- the food identification method in the step 203 of the above embodiment 1 can also be used in this step, as shown in FIG. 3, and will not be described in detail herein.
- Step 404 Record the identified food items stored in the storage location indicated by the corresponding storage location mark in the refrigerator.
- the user may also display the food icon corresponding to the stored food in the refrigerator and its storage location in the refrigerator.
- the enhanced display technology may be employed to improve the user experience.
- the food storage location recording method in the refrigerator avoids manual manual input of the food storage location, can improve the input efficiency of the food storage location information, and ensures the accuracy of the information.
- the food storage location recording method in the refrigerator according to the above embodiment of the present invention correspondingly, the third embodiment of the present invention further provides a food storage location recording device in the refrigerator, the structure of which is shown in FIG. Specifically include:
- the obtaining unit 501 is configured to acquire a food collection image obtained by photographing an internal storage space of the refrigerator;
- a determining unit 502 configured to determine a storage location identifier existing in the food collection image, and a region range corresponding to the storage location identifier in the food collection image;
- the identifying unit 503 is configured to identify a food present in a region corresponding to the storage location mark;
- the recording unit 504 is configured to record the identified storage location of the food stored in the refrigerator and characterized by the storage location mark.
- the obtaining unit 501 is specifically configured to acquire a food collection image obtained by capturing a storage space corresponding to a storage location inside the refrigerator;
- the determining unit 502 is specifically configured to determine a storage location identifier existing in the food collection image, and determine a region range corresponding to the storage location identifier as all regions in the food collection image.
- the determining unit 502 is specifically configured to determine a plurality of storage location markers present in the food collection image, and a region range corresponding to the plurality of storage location markers in the food collection image.
- the determining unit 502 is specifically configured to determine, for each of the plurality of storage location markers, a region range corresponding to the storage location identifier as the storage location identifier in the food collection image A specified range of the reference, wherein the size of the specified range is positively correlated with the size of the storage location mark in the food collection image.
- the identifying unit 503 is specifically configured to determine an image of the food to be identified that exists in the area corresponding to the storage location mark; and when there is a food identification barcode in the image of the food to be identified, determine the food in the image of the food to be identified a food product characterized by a bar code for the food; when there is no food identification bar code in the image of the food to be identified, extracting a feature vector of the image of the food to be identified; and selecting and selecting a plurality of feature vectors corresponding to different foods respectively
- the correlation between the feature vectors of the food image to be identified is greater than a preset value, and the feature vector having the greatest correlation with the feature vector of the food image to be identified is used as a matching feature vector; determining the image of the food to be identified
- the food in the food is the food corresponding to the matching feature vector.
- the identifying unit 503 is specifically configured to extract a color feature value, a shape feature value, and a texture feature value of the food image to be identified; and determine, according to the color feature value, the shape feature value, and the texture feature value of the food image to be identified. a feature vector of the food image to be identified;
- the identification unit 503 is further configured to extract color feature values, shape feature values, and texture feature values of sample images of the plurality of samples of the same food product; color feature values and shapes of the sample images of the plurality of samples based on the same food product.
- the feature value and the texture feature value determine a feature vector corresponding to the food.
- Embodiment 4 of the present invention further provides an intelligent control terminal, which comprises the food storage location recording device in the refrigerator as shown in FIG. 5.
- Embodiment 5 of the present invention further provides a refrigerator, including the above intelligent control terminal.
- the solution provided by the embodiment of the present invention includes: acquiring a food collection image obtained by photographing an internal storage space of the refrigerator; determining a storage location mark existing in the food collection image, and storing the storage in the food collection image. a range of areas corresponding to the object position mark; identifying a food item existing in the area corresponding to the storage position mark; recording the identified food item stored in the refrigerator in the storage position indicated by the storage position mark.
- the food storage location recording device in the refrigerator provided by the embodiment of the present application can be realized by a computer program.
- Those skilled in the art should be able to understand that the unit division manner described above is only one of a plurality of unit division manners. If the division into other units or non-divided units, as long as the food storage location recording device in the refrigerator has the above functions, it should be in this Within the scope of protection of the application.
- the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
- the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
- These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
- the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
一种冰箱内食品存储位置记录方法、装置、终端及冰箱。该记录方法包括获取拍摄冰箱内部存储空间所得到的食品采集图像；确定该食品采集图像中存在的储物位置标志，以及在该食品采集图像中该储物位置标志对应的区域范围；识别该储物位置标志对应的区域范围内存在的食品；记录识别出的该食品存储在冰箱中该储物位置标志表征的储物位置。采用该记录方法能够提高冰箱内食品存储位置信息的录入效率。
Description
本申请要求了申请日为2013年03月18日，申请号为201310086447.0，发明名称为“一种冰箱内食品存储位置记录方法、装置、终端及冰箱”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
【技术领域】
本发明涉及智能家电技术领域，尤其涉及一种冰箱内食品存储位置记录方法、装置、终端及冰箱。
【背景技术】
随着科技的发展，人们生活水平的不断提高，能够进行食品管理的智能冰箱正在走进越来越多的家庭。目前的一些智能冰箱，多是在传统冰箱的基础上加载了一个智能控制终端，例如平板电脑等，使用者通过手动输入的方式在该智能控制终端中录入存储于冰箱内的各食品的名称，以及各食品在冰箱中的存储位置，智能控制终端记录各食品存储位置，并进行后续的管理。
然而，现有技术中采用人工操作录入食品名称及其在冰箱内存储位置的方法，每次只能针对一个食品进行操作，当冰箱存储的食品较多时，则需要人工操作很长时间，信息录入效率较低，并且也很难保证人工操作的准确性。
【发明内容】
本发明实施例提供一种冰箱内食品存储位置记录方法、装置、终端及冰箱，用以解决现有技术中食品存储位置信息录入效率较低的问题。
本发明实施例提供一种冰箱内食品存储位置记录方法，包括：
获取拍摄冰箱内部存储空间所得到的食品采集图像；
确定所述食品采集图像中存在的储物位置标志，以及在所述食品采集图像中所述储物位置标志对应的区域范围；
识别所述储物位置标志对应的区域范围内存在的食品；
记录识别出的所述食品存储在冰箱中所述储物位置标志表征的储物位置。
本发明实施例提供一种冰箱内食品存储位置记录装置，包括：
获取单元，用于获取拍摄冰箱内部存储空间所得到的食品采集图像；
确定单元，用于确定所述食品采集图像中存在的储物位置标志，以及在所述食品采集图像中所述储物位置标志对应的区域范围；
识别单元，用于识别所述储物位置标志对应的区域范围内存在的食品；
记录单元，用于记录识别出的所述食品存储在冰箱中所述储物位置标志表征的储物位置。
本发明实施例还提供了一种智能控制终端，包括上述冰箱内食品存储位置记录装置。
本发明实施例还提供了一种冰箱，包括上述智能控制终端。
本发明实施例提供的方案中，冰箱内部存储空间包括的储物位置设有储物位置标志，直接拍摄冰箱内部存储空间得到食品采集图像，确定在该食品采集图像中储物位置标志对应的区域范围，再进一步识别该区域范围内存在的食品，即可以在确定存储的各食品的名称的同时确定各食品在冰箱中的存储位置，并进行记录，因此不需要人工进行手动输入，可以提高食品存储位置信息的录入效率，并且保证了信息的准确性。
【附图说明】
附图用来提供对本发明的进一步理解，并且构成说明书的一部分，与本发明实施例一起用于解释本发明，并不构成对本发明的限制。在附图中：
图1为本发明实施例提供的冰箱内食品存储位置记录方法的流程图；
图2为本发明实施例1提供的冰箱内食品存储位置记录方法的流程图；
图3为本发明实施例1提供的食品识别方法的流程图；
图4为本发明实施例2提供的冰箱内食品存储位置记录方法的流程图；
图5为本发明实施例3提供的冰箱内食品存储位置记录装置的结构示意图。
【具体实施方式】
为了给出提高食品存储位置信息录入效率的实现方案，本发明实施例提供了一种冰箱内食品存储位置记录方法、装置、及冰箱，以下结合说明书附图对本发明的优选实施例进行说明，应当理解，此处所描述的优选实施例仅用于说明和解释本发明，并不用于限定本发明。并且在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。
本发明实施例提供一种冰箱内食品存储位置记录方法，如图1所示，包括：
步骤101、获取拍摄冰箱内部存储空间所得到的食品采集图像。
步骤102、确定该食品采集图像中存在的储物位置标志，以及在该食品采集图像中该储物位置标志对应的区域范围。
步骤103、识别该储物位置标志对应的区域范围内存在的食品。
步骤104、记录识别出的该食品存储在冰箱中该储物位置标志表征的储物位置。
采用本发明实施例提供的冰箱内食品存储位置记录方法，需要先将冰箱内的存储空间划分为多个子空间，并在每个子空间设置表征储物位置的储物位置标志，即一个子空间为一个储物位置对应的存储空间。用户在拍摄冰箱内部存储空间时，可以拍摄一个或多个完整的子空间，也可以拍摄一个或者多个不完整的子空间，但是，拍摄的存储空间内必须存在至少一个储物位置标志。
用户在进行拍摄时，可采用任意具备拍摄功能的终端，较佳的，可直接采用加载在冰箱上的具备拍摄功能的智能控制终端。
基于用户不同的拍摄方式，食品采集图像中存在的储物位置标示可能为一个，也可能为多个；在该食品采集图像中与储物位置标志对应的区域范围可能是食品采集图像的全部区域，也可能是食品采集图像的部分区域。
进一步的，步骤103中的食品识别方法可采用图像识别、条码识别等，较佳的也可采用本发明实施例提出的图像识别和条码识别相结合的方法，能够提高食品识别的准确性及识别率。
下面基于用户不同的拍摄方式，结合附图，用具体实施例对本发明实施例提供的冰箱内食品存储位置记录方法进行详细描述。
实施例1：
在本发明实施例1中，用户仅针对一个子空间，即一个储物位置对应的存储空间进行拍摄，可以拍摄该子空间的全部，也可以拍摄该子空间的一部分，但是必须拍摄到该子空间的储物位置标志。
图2所示为本发明实施例1提供的冰箱内食品存储位置记录方法的流程图，具体包括：
步骤201、获取拍摄的食品采集图像。
步骤202、确定该食品采集图像中存在的一个储物位置标志，以及确定该储物位置标志对应的区域范围为食品采集图像中的全部区域。
储物位置标志的具体形式可以有多种，较佳的，可采用条码。进一步的，为区分冰箱内食品上携带的一维条码，储物位置标志可采用二维条码。
步骤203、识别该食品采集图像中存在的食品。
本发明实施例1提供的食品识别方法的详细流程如图3所示，后文进行详细说明。
步骤204、记录识别出的食品存储在冰箱中该储物位置标志表征的储物位置。
各食品存储位置被记录后，还可以向用户显示冰箱中已存储食品对应的食品图标及其在冰箱中的存储位置示意图，较佳的，可采用增强显示技术，以提高用户体验。
图3所示为本发明实施例1提供的食品识别方法的流程图，具体包括：
步骤301、确定储物位置标志对应的区域范围内存在的待识别食品图像。
该步骤包括对食品采集图像中储物位置标志对应的区域范围进行预处理，进行待识别食品的轮廓检测及背景分割等，此部分为现有技术，故在此不再详述。
步骤302、判断待识别食品图像中是否存在食品标识条码。
当待识别食品图像中存在食品标识条码时，进入步骤303；当待识别食品图像中不存在食品标识条码时，进入步骤304。
步骤303、确定待识别食品图像中的食品为食品标识条码表征的食品，结束该食品识别流程。
对于一些携带食品标识条码且条码完整无损够能识别的食品，例如从超市购得的食品，通过食品标识条码便可识别该食品，无需执行后续步骤。
而对于一些不携带食品标识条码或者携带破损条码的食品，例如从市场购得的食品，主要通过以下步骤进行识别。
步骤304、提取待识别食品图像的特征向量。
该步骤待识别食品图像特征向量的提取方法应和预设的食品和特征向量的对应关系的建立方法对应，在本发明实施例1中，预设的食品和特征向量的对应关系可采用如下方式建立：
提取同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值；基于同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值，确定该食品对应的特征向量。
其中，在基于同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值，确定该食品对应的特征向量时，具体可以先确定该食品的多个样品的样品图像的颜色特征值的平均值，该食品的多个样品的样品图像的形状特征值的平均值，以及该食品的多个样品的样品图像的纹理特征值的平均值；将该颜色特征值的平均值、形状特征值的平均值和纹理特征值的平均值直接作为特征向量的各分量，构成该食品对应的特征向量。
较佳的，还可以先基于该食品的多个样品的样品图像的颜色特征值确定该食品对应的颜色特征值区间，基于该食品的多个样品的样品图像的形状特征值确定该食品对应的形状特征值区间，以及基于该食品的多个样品的样品图像的纹理特征值确定该食品对应的纹理特征值区间；再基于该食品对应的颜色特征值区间、形状特征值区间和纹理特征值区间，确定该食品对应的特征向量。
相应的，在提取待识别食品图像的特征向量时，具体包括如下步骤：
提取待识别食品图像的颜色特征值、形状特征值和纹理特征值；基于待识别食品图像的颜色特征值、形状特征值和纹理特征值，确定该待识别食品图像的特征向量。
其中，在基于待识别食品图像的颜色特征值、形状特征值和纹理特征值，确定该待识别食品图像的特征向量时，具体可以将该待识别食品图像的颜色特征值、形状特征值和纹理特征值直接作为特征向量的分量，构成该待识别食品图像的特征向量。
较佳的，还可以先确定待识别食品图像的颜色特征值所在的颜色特征值预设区间，待识别食品图像的形状特征值所在的形状特征值预设区间和待识别食品图像的纹理特征值所在的纹理特征值预设区间；再基于颜色特征值预设区间、形状特征值预设区间和纹理特征值预设区间，确定待识别食品图像的特征向量。
步骤305、判断预设的分别对应不同食品的多个特征向量中，是否存在与待识别食品图像的特征向量之间的相关度大于预设值的特征向量。
当预设的分别对应不同食品的多个特征向量中，存在与待识别食品图像的特征向量之间的相关度大于预设值的特征向量时，进入步骤306；当预设的分别对应不同食品的多个特征向量中，不存在与待识别食品图像的特征向量之间的相关度大于预设值的特征向量时，则确定无法识别该食品，结束该食品识别流程。
步骤306、从预设的分别对应不同食品的多个特征向量中，选择与待识别食品图像的特征向量之间的相关度最大的特征向量，作为相匹配特征向量。
相关度越大，食品识别结果的可靠性越高。
步骤307、确定待识别食品图像中的食品为相匹配特征向量对应的食品。
上述食品识别方法结合了条码识别和图像识别，并且优先条码识别，相应的，本发明实施例1也可以采用优先图像识别的方案，或者采用条码识别和图像识别同时进行的方案，基于各自的识别结果确定最终的食品识别结果。
实施例2：
在本发明实施例2中，用户针对多个子空间，即多个储物位置对应的存储空间进行拍摄，可以拍摄该多个子空间的全部，也可以拍摄该多个子空间的一部分。
图4所示为本发明实施例2提供的冰箱内食品存储位置记录方法的流程图，具体包括：
步骤401、获取拍摄的食品采集图像。
步骤402、确定该食品采集图像中存在的多个储物位置标志，以及在该食品采集图像中该多个储物位置标志分别对应的区域范围。
较佳的，该储物位置标志为二维条码。
其中，在针对每个储物位置标志确定其对应的区域范围时，可以将在食品采集图像中以该储物位置标志为基准的指定范围确定为该储物位置标志对应的区域范围。该指定范围具体和储物位置标示在储物位置对应的存储空间中的位置有关。
例如，当储物位置标示位于储物位置对应的存储空间的中心时，此时可以确定该储物位置标志对应的区域范围为在食品采集图像中以该储物位置标志为中心向四周扩展指定长度和宽度的一个区域范围。
并且，指定范围的大小和食品采集图像中该储物位置标志的大小正相关。当食品采集图像中该储物位置标志越大时，指定范围越大；当食品采集图像中该储物位置标志越小时，指定范围越小。
步骤403、识别该多个储物位置标志分别对应的区域范围内存在的食品。
该步骤具体也可采用上述实施例1步骤203中的食品识别方法，图3所示，在此不再详述。
步骤404、记录识别出的食品存储在冰箱中对应的储物位置标志表征的储物位置。
各食品存储位置被记录后，还可以向用户显示冰箱中已存储食品对应的食品图标及其在冰箱中的存储位置示意图，较佳的，可采用增强显示技术，以提高用户体验。
可见，采用本发明实施例提供的冰箱内食品存储位置记录方法，避免了人工进行手动输入食品存储位置，可以提高食品存储位置信息的录入效率，并且保证了信息的准确性。
实施例3：
基于同一发明构思，根据本发明上述实施例提供的冰箱内食品存储位置记录方法，相应地，本发明实施例3还提供一种冰箱内食品存储位置记录装置，其结构示意图如图5所示，具体包括：
获取单元501，用于获取拍摄冰箱内部存储空间所得到的食品采集图像；
确定单元502，用于确定该食品采集图像中存在的储物位置标志，以及在该食品采集图像中该储物位置标志对应的区域范围；
识别单元503，用于识别该储物位置标志对应的区域范围内存在的食品；
记录单元504，用于记录识别出的该食品存储在冰箱中该储物位置标志表征的储物位置。
进一步的，获取单元501，具体用于获取拍摄冰箱内部一个储物位置对应的存储空间所得到的食品采集图像；
确定单元502，具体用于确定该食品采集图像中存在的一个储物位置标志，以及确定该储物位置标志对应的区域范围为该食品采集图像中的全部区域。
进一步的，确定单元502，具体用于确定该食品采集图像中存在的多个储物位置标志，以及在该食品采集图像中该多个储物位置标志分别对应的区域范围。
进一步的，确定单元502，具体用于针对该多个储物位置标志中的每个储物位置标志，确定该储物位置标志对应的区域范围为在该食品采集图像中以该储物位置标志为基准的指定范围，其中，该指定范围的大小和该食品采集图像中该储物位置标志的大小正相关。
进一步的，识别单元503，具体用于确定该储物位置标志对应的区域范围内存在的待识别食品图像；当该待识别食品图像中存在食品标识条码时，确定该待识别食品图像中的食品为该食品标识条码表征的食品；当该待识别食品图像中不存在食品标识条码时，提取该待识别食品图像的特征向量；从预设的分别对应不同食品的多个特征向量中，选择与该待识别食品图像的特征向量之间的相关度大于预设值，且与该待识别食品图像的特征向量之间的相关度最大的特征向量，作为相匹配特征向量；确定该待识别食品图像中的食品为该相匹配特征向量对应的食品。
进一步的，识别单元503，具体用于提取该待识别食品图像的颜色特征值、形状特征值和纹理特征值；基于该待识别食品图像的颜色特征值、形状特征值和该纹理特征值，确定该待识别食品图像的特征向量；
识别单元503，具体还用于提取同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值；基于该同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值，确定该食品对应的特征向量。
上述各单元的功能可对应于图1-4所示流程中的相应处理步骤，在此不再赘述。
实施例4：
本发明实施例4还提供一种智能控制终端，包括如图5所示的冰箱内食品存储位置记录装置。
实施例5：
本发明实施例5还提供一种冰箱，包括上述智能控制终端。
并且，冰箱内部设有储物位置标志。
综上所述，本发明实施例提供的方案，包括：获取拍摄冰箱内部存储空间所得到的食品采集图像；确定该食品采集图像中存在的储物位置标志，以及在该食品采集图像中该储物位置标志对应的区域范围；识别该储物位置标志对应的区域范围内存在的食品；记录识别出的该食品存储在冰箱中该储物位置标志表征的储物位置。采用本发明实施例提供的方案，能够提高冰箱内食品存储位置信息的录入效率。
本申请的实施例所提供的冰箱内食品存储位置记录装置可通过计算机程序实现。本领域技术人员应该能够理解，上述的单元划分方式仅是众多单元划分方式中的一种，如果划分为其他单元或不划分单元，只要冰箱内食品存储位置记录装置具有上述功能，都应该在本申请的保护范围之内。
本申请是参照根据本申请实施例的方法、设备（***）、和计算机程序产品的流程图和／或方框图来描述的。应理解可由计算机程序指令实现流程图和／或方框图中的每一流程和／或方框、以及流程图和／或方框图中的流程和／或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和／或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和／或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和／或方框图一个方框或多个方框中指定的功能的步骤。
显然，本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样，倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内，则本发明也意图包含这些改动和变型在内。
Claims (14)
- 一种冰箱内食品存储位置记录方法，其特征在于，包括：获取拍摄冰箱内部存储空间所得到的食品采集图像；确定所述食品采集图像中存在的储物位置标志，以及在所述食品采集图像中所述储物位置标志对应的区域范围；识别所述储物位置标志对应的区域范围内存在的食品；记录识别出的所述食品存储在冰箱中所述储物位置标志表征的储物位置。
- 如权利要求1所述的方法，其特征在于，获取拍摄冰箱内部存储空间所得到的食品采集图像，具体为：获取拍摄冰箱内部一个储物位置对应的存储空间所得到的食品采集图像；确定所述食品采集图像中存在的储物位置标志，以及在所述食品采集图像中所述储物位置标志对应的区域范围，具体为：确定所述食品采集图像中存在的一个储物位置标志，以及确定所述储物位置标志对应的区域范围为所述食品采集图像中的全部区域。
- 如权利要求1所述的方法，其特征在于，确定所述食品采集图像中存在的储物位置标志，以及在所述食品采集图像中所述储物位置标志对应的区域范围，具体为：确定所述食品采集图像中存在的多个储物位置标志，以及在所述食品采集图像中所述多个储物位置标志分别对应的区域范围。
- 如权利要求3所述的方法，其特征在于，确定在所述食品采集图像中所述多个储物位置标志分别对应的区域范围，具体为：针对所述多个储物位置标志中的每个储物位置标志，确定该储物位置标志对应的区域范围为在所述食品采集图像中以该储物位置标志为基准的指定范围，其中，所述指定范围的大小和所述食品采集图像中该储物位置标志的大小正相关。
- 如权利要求1所述的方法，其特征在于，识别所述储物位置标志对应的区域范围内存在的食品，具体为：确定所述储物位置标志对应的区域范围内存在的待识别食品图像；当所述待识别食品图像中存在食品标识条码时，确定所述待识别食品图像中的食品为所述食品标识条码表征的食品；当所述待识别食品图像中不存在食品标识条码时，提取所述待识别食品图像的特征向量；从预设的分别对应不同食品的多个特征向量中，选择与所述待识别食品图像的特征向量之间的相关度大于预设值，且与所述待识别食品图像的特征向量之间的相关度最大的特征向量，作为相匹配特征向量；确定所述待识别食品图像中的食品为所述相匹配特征向量对应的食品。
- 如权利要求5所述的方法，其特征在于，提取所述待识别食品图像的特征向量，具体为：提取所述待识别食品图像的颜色特征值、形状特征值和纹理特征值；基于所述待识别食品图像的颜色特征值、形状特征值和纹理特征值，确定所述待识别食品图像的特征向量；食品与特征向量的对应关系，具体采用如下方式建立：提取同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值；基于所述同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值，确定该食品对应的特征向量。
- 一种冰箱内食品存储位置记录装置，其特征在于，包括：获取单元，用于获取拍摄冰箱内部存储空间所得到的食品采集图像；确定单元，用于确定所述食品采集图像中存在的储物位置标志，以及在所述食品采集图像中所述储物位置标志对应的区域范围；识别单元，用于识别所述储物位置标志对应的区域范围内存在的食品；记录单元，用于记录识别出的所述食品存储在冰箱中所述储物位置标志表征的储物位置。
- 如权利要求7所述的装置，其特征在于，所述获取单元，具体用于获取拍摄冰箱内部一个储物位置对应的存储空间所得到的食品采集图像；所述确定单元，具体用于确定所述食品采集图像中存在的一个储物位置标志，以及确定所述储物位置标志对应的区域范围为所述食品采集图像中的全部区域。
- 如权利要求7所述的装置，其特征在于，所述确定单元，具体用于确定所述食品采集图像中存在的多个储物位置标志，以及在所述食品采集图像中所述多个储物位置标志分别对应的区域范围。
- 如权利要求9所述的装置，其特征在于，所述确定单元，具体用于针对所述多个储物位置标志中的每个储物位置标志，确定该储物位置标志对应的区域范围为在所述食品采集图像中以该储物位置标志为基准的指定范围，其中，所述指定范围的大小和所述食品采集图像中该储物位置标志的大小正相关。
- 如权利要求7所述的装置，其特征在于，所述识别单元，具体用于确定所述储物位置标志对应的区域范围内存在的待识别食品图像；当所述待识别食品图像中存在食品标识条码时，确定所述待识别食品图像中的食品为所述食品标识条码表征的食品；当所述待识别食品图像中不存在食品标识条码时，提取所述待识别食品图像的特征向量；从预设的分别对应不同食品的多个特征向量中，选择与所述待识别食品图像的特征向量之间的相关度大于预设值，且与所述待识别食品图像的特征向量之间的相关度最大的特征向量，作为相匹配特征向量；确定所述待识别食品图像中的食品为所述相匹配特征向量对应的食品。
- 如权利要求11所述的装置，其特征在于，所述识别单元，具体用于提取所述待识别食品图像的颜色特征值、形状特征值和纹理特征值；基于所述待识别食品图像的颜色特征值、形状特征值和纹理特征值，确定所述待识别食品图像的特征向量；所述识别单元，具体还用于提取同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值；基于所述同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值，确定该食品对应的特征向量。
- 一种智能控制终端，其特征在于，包括如权利要求7-12任一所述的冰箱内食品存储位置记录装置。
- 一种冰箱，其特征在于，包括如权利要求13所述的智能控制终端。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310086447.0 | 2013-03-18 | ||
| CN201310086447 | 2013-03-18 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2014146430A1 true WO2014146430A1 (zh) | 2014-09-25 |
Family
ID=51549585
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2013/086186 WO2014146430A1 (zh) | 2013-03-18 | 2013-10-30 | 一种冰箱内食品存储位置记录方法、装置、终端及冰箱 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104061749B (zh) |
| WO (1) | WO2014146430A1 (zh) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106326302A (zh) * | 2015-06-30 | 2017-01-11 | 深圳市九洲电器有限公司 | 书籍管理方法及*** |
| CN105184231B (zh) * | 2015-08-14 | 2018-11-23 | 北京京东尚科信息技术有限公司 | 一种储物空间的图像采集***及方法 |
| CN105758108B (zh) * | 2016-03-09 | 2018-12-28 | 北京京东尚科信息技术有限公司 | 用于智能冷藏设备的信息反馈方法和装置 |
| CN107886028A (zh) * | 2016-09-29 | 2018-04-06 | 九阳股份有限公司 | 一种冰箱的食材录入方法及食材录入装置 |
| CN107885425A (zh) * | 2016-09-29 | 2018-04-06 | 九阳股份有限公司 | 一种冰箱食材录入方法 |
| CN107144087A (zh) * | 2017-05-11 | 2017-09-08 | 海尔优家智能科技（北京）有限公司 | 一种智能物品管理方法、设备及存储介质 |
| CN107525342B (zh) * | 2017-07-26 | 2020-04-21 | 合肥美的智能科技有限公司 | 物品信息录入方法、***和冰箱 |
| CN107477971B (zh) * | 2017-08-04 | 2020-09-18 | 三星电子（中国）研发中心 | 一种对冰箱内食物的管理方法和设备 |
| CN108170781A (zh) * | 2017-12-26 | 2018-06-15 | 中山大学 | 一种家居仓储物品的精确定位方法及*** |
| CN109028746A (zh) * | 2018-06-20 | 2018-12-18 | 合肥美的电冰箱有限公司 | 移动装置、冰箱及其控制方法、可读存储介质 |
| CN110762943B (zh) * | 2018-07-26 | 2020-11-10 | 珠海格力电器股份有限公司 | 物品的展示方法、装置以及家电设备 |
| CN110966834A (zh) * | 2018-09-30 | 2020-04-07 | 青岛海尔智能技术研发有限公司 | 识别冰箱内食材种类的方法与冰箱 |
| CN111310586A (zh) * | 2020-01-19 | 2020-06-19 | 合肥美的电冰箱有限公司 | 冰箱内食物的管理方法、管理装置及冰箱 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7716935B2 (en) * | 2005-05-27 | 2010-05-18 | Lg Electronics Inc. | Refrigerator for managing food by using RFID |
| CN101802532A (zh) * | 2007-09-13 | 2010-08-11 | Lg电子株式会社 | 冰箱 |
| CN102538379A (zh) * | 2011-12-19 | 2012-07-04 | 四川长虹电器股份有限公司 | 一种冰箱食品信息管理装置及方法 |
| KR20120097683A (ko) * | 2011-02-25 | 2012-09-05 | 삼성전자주식회사 | 냉장고 |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20080030173A (ko) * | 2006-09-29 | 2008-04-04 | 엘지전자 주식회사 | 냉장고의 내용물 감지장치 및 그 방법 |
| CN101498539B (zh) * | 2008-01-30 | 2011-11-16 | 技嘉科技股份有限公司 | 节能电冰箱及其节能方法 |
| US9041508B2 (en) * | 2008-08-08 | 2015-05-26 | Snap-On Incorporated | Image-based inventory control system and method |
| JP2011209064A (ja) * | 2010-03-29 | 2011-10-20 | Fuji Xerox Co Ltd | 物品認識装置及びこれを用いた物品処理装置 |
| JP2012193873A (ja) * | 2011-03-15 | 2012-10-11 | Nikon Corp | 収納装置 |
| CN202719829U (zh) * | 2012-07-31 | 2013-02-06 | 合肥美菱股份有限公司 | 一种冰箱用食品管理*** |
-
2013
- 2013-06-28 CN CN201310271701.4A patent/CN104061749B/zh active Active
- 2013-10-30 WO PCT/CN2013/086186 patent/WO2014146430A1/zh active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7716935B2 (en) * | 2005-05-27 | 2010-05-18 | Lg Electronics Inc. | Refrigerator for managing food by using RFID |
| CN101802532A (zh) * | 2007-09-13 | 2010-08-11 | Lg电子株式会社 | 冰箱 |
| KR20120097683A (ko) * | 2011-02-25 | 2012-09-05 | 삼성전자주식회사 | 냉장고 |
| CN102538379A (zh) * | 2011-12-19 | 2012-07-04 | 四川长虹电器股份有限公司 | 一种冰箱食品信息管理装置及方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104061749A (zh) | 2014-09-24 |
| CN104061749B (zh) | 2017-02-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2014146430A1 (zh) | 一种冰箱内食品存储位置记录方法、装置、终端及冰箱 | |
| WO2014146431A1 (zh) | 一种冰箱内食品存储位置记录方法、装置、终端及冰箱 | |
| WO2017204596A1 (ko) | 얼굴 윤곽 보정 방법 및 장치 | |
| WO2014168265A1 (ko) | 영상 인식을 이용한 냉장고의 보관 품목 관리 방법 및 그 냉장고 | |
| CN110837580A (zh) | 一种行人图片标注方法、装置、存储介质和智能设备 | |
| JP2010213090A5 (zh) | ||
| CN105659279B (zh) | 信息处理设备和信息处理方法 | |
| WO2015126060A1 (ko) | 이미지를 처리하기 위한 전자 장치 및 방법 | |
| WO2014190870A1 (zh) | 一种识别用户活动类型的方法及*** | |
| CN106295511A (zh) | 人脸跟踪方法及装置 | |
| WO2010041836A2 (en) | Method of detecting skin-colored area using variable skin color model | |
| JP2000259832A (ja) | 画像特徴量生成装置、画像検索装置、並びにその生成方法及び検索方法 | |
| CN112650882A (zh) | 一种视频采集方法、装置及*** | |
| CN113066195A (zh) | 电力设备巡检方法、装置、ar眼镜和存储介质 | |
| JP2019032685A (ja) | 配電設備点検システム | |
| WO2019168264A1 (ko) | 전자 장치 및 그 제어 방법 | |
| CN112131976B (zh) | 一种自适应人像温度匹配和口罩识别方法及装置 | |
| CN113522770A (zh) | 一种基于3d视觉的高精度在线检测*** | |
| JP2006134008A (ja) | 営業店システム | |
| CN108090982A (zh) | 一种签到方法、***及终端设备 | |
| WO2014148691A1 (en) | Mobile device and method for controlling the same | |
| EP3929804A1 (en) | Method and device for identifying face, computer program, and computer-readable storage medium | |
| CN104173108A (zh) | 健康检测仪器显示屏识别数据采集***及方法 | |
| CN112633204A (zh) | 一种精准客流统计方法、装置、设备和介质 | |
| CN114463779A (zh) | 吸烟识别方法、装置、设备及存储介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13878836 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 13878836 Country of ref document: EP Kind code of ref document: A1 |