CN101189868A - Image capturing apparatus, image capturing method, and program - Google Patents

Abstract

There is provided an image capturing apparatus that automatically registers a taken object. The image capturing apparatus according to the present invention includes an object extracting section that extracts an object included in a captured image, a characteristic amount computing section that computes an amount of characteristic of the object based on the image with the object extracted from the object extracting section, a characteristic amount storing section that stores the amount of characteristic of the object computed from the characteristic amount computing section in association with object identification information identifying the object, a characteristic amount comparing section that compares an amount of characteristic of an object included in an image newly taken by an image capturing section and the amount of characteristic of the object stored on the characteristic amount storing section to compute a degree of coincidence of the objects, and an object identification information storing section that stores the object identification information stored on the characteristic amount storing section in association with the image newly taken by the image capturing section when it is judged that the degree of coincidence of the objects computed from the characteristic amount comparing section is not less than a predetermined reference value.

Description

Image capture device, image capture method and program

Technical field

The present invention relates to image capture device, image capture method and program.More specifically, the present invention relates to be used for the image capture device and the image capture method of pickup image, and the program that is used for image capture device.The present invention requires the priority of the Japanese patent application 2006-072434 that submits in Japan in the Japanese patent application 2005-130525 that submitted in Japan on April 27th, 2005 and on March 16th, 2006, and its full content is attached to here as a reference.

Background technology

In the prior art, known a kind of image processing apparatus, each scene for appointment in the motion image data, its generation comprises the scene characteristic information of image feature amount of part, severity level and the key frame of key frame in the scene, scene, and, with moving image explicitly, on memory, store scene characteristic information.Such image processing apparatus can be carried out summary and reset, and it is based on scene characteristic information, by retrieving similar images to key frame, and the major part of the designated movement view data of only resetting or the motion image data that retrieval is wanted.

For example, when the user appreciated the image of making by the record sports tournament, the user can specify the sportsman who likes to appreciate effectively the scene of this sportsman's appearance.But according to the disclosed technology of Japanese Patent Application Publication 2000-299829, the user can not appreciate the scene of the particular topic that comprises user's appointment effectively.

Summary of the invention

The problem to be solved in the present invention

But it is also inadvisable manually to import the theme of specifying each scene by the user, because this has caused burden to the user.And, in recent years,, might write down a large amount of view data along with the increase of the memory space of on digital camera, Digital Video etc., installing.But, a problem is arranged, be exactly its time of having wasted the user from the great amount of images data, to search for the image that particular topic occurred.

Therefore, the object of the present invention is to provide a kind of image capture device, image capture method and program, it can solve the above problems.Can obtain above-mentioned by the combination of in independent claims, describing and other purpose.Dependent claims defines further advantage of the present invention and example combination.

The mode of dealing with problems

According to a first aspect of the invention, provide a kind of image capture device.This device comprises: picture catching part, its pickup image; The object extraction part, it extracts the object that comprises in the image that is partly absorbed by described picture catching; The feature value calculation unit branch, it calculates from the characteristic quantity of the object of described object extraction extracting section based on having from the image of the object of described object extraction extracting section; The characteristic quantity storage compartment, it is associated with and is used for identifying the object id information of object and stores the characteristic quantity of the object that calculates from described feature value calculation unit branch; And the object id information storage compartment, it is associated with the image that described picture catching part absorbed and stores and be used for identifying the object id information that is included in the object in the image.

Described image capture device can further comprise: characteristic amount comparison section, the characteristic quantity and the characteristic quantity that is stored in the object on the described characteristic quantity storage compartment of the object that comprises in the image of its comparison by the up-to-date picked-up of described picture catching part are with the conforming degree of calculating object; And consistency judgment part, whether its judgement is not less than predetermined reference value from the degree of the object consistency that described characteristic amount comparison section calculates, and when the conforming degree of judging the object that calculates from described characteristic amount comparison section when described consistency judgment part was not less than predetermined reference value, described object id information storage compartment can be associated with the image of the up-to-date picked-up of described picture catching part and be stored in the object id information that stores on the described characteristic quantity storage compartment.

Described feature value calculation unit branch can calculate color from the object of described object extraction extracting section as characteristic quantity, described characteristic quantity storage compartment can be associated with object id information and store the color of the object that calculates from described feature value calculation unit branch, the color of the object that described characteristic amount comparison section can relatively comprise in the image of the up-to-date picked-up of described picture catching part and the color that is stored in the object on the described characteristic quantity storage compartment, with the conforming degree of calculating object, and described consistency judgment part can judge whether the degree of the object consistency that calculates from described characteristic amount comparison section is not less than predetermined reference value.

Described image capture device can further comprise: object id information is selected part, and it selects an object id information based on the instruction from user's input a plurality of object id information on being stored in described object id information storage compartment; Image extracts part, and it is associated with by the object id information of described object id information selection portion component selections and extracts at least one image that is stored on the described object id information storage compartment; And the display part, it shows at least one image that extracts extracting section from described image.

Described object id information storage compartment can be associated with and be used for identifying the group of objects identification information of group of objects and store a plurality of object id information, and described object id information selection part can be based on the instruction from user's input, select a group of objects identification information a plurality of group of objects identification informations on being stored in described object id information storage compartment, then based on instruction, be associated with selected group of objects identification information and select an object id information a plurality of object id information on being stored in described object id information storage compartment from user input.

Described image capture device can further comprise the model selection part, this mode selection part component selections enrollment mode or picture catching pattern, this enrollment mode is the pattern that is used to absorb object, make described feature value calculation unit branch calculated characteristics amount so that described characteristic quantity storage compartment preservative feature amount, this picture catching pattern be used to absorb be stored in described object id information storage compartment on the pattern of the image that is associated of object id information, when described mode selection part component selections enrollment mode, described characteristic quantity storage compartment can be associated with object id information and store the characteristic quantity of the object that calculates from described feature value calculation unit branch, the characteristic quantity of the object that described characteristic amount comparison section can be more described comprises in the image that absorbs when described mode selection part component selections picture catching pattern of picture catching part and the characteristic quantity that is stored in the object on the described characteristic quantity storage compartment when the described mode selection part component selections enrollment mode, with the conforming degree of calculating object, described consistency judgment part can judge whether the degree of the object consistency that calculates from described characteristic amount comparison section is not less than predetermined reference value, and, when the degree of judging the object consistency that calculates from described characteristic amount comparison section when described consistency judgment part was not less than predetermined reference value, described object id information storage compartment can be associated with the image of the up-to-date picked-up of described picture catching part and store the object id information that is stored on the described characteristic quantity storage compartment when described mode selection part component selections enrollment mode.

Described image capture device can further comprise: the display part, and it shows the picture catching district of described picture catching part; And mark display control section, add and show the mark in expression one zone in the picture catching district of its described picture catching part in described display part, should in this zone, absorb object, make described feature value calculation unit branch calculated characteristics amount so that described characteristic quantity storage compartment preservative feature amount, and described feature value calculation unit branch can calculate the characteristic quantity of the object in the zone shown in the mark, this mark is included in the image that is partly absorbed by described picture catching and by described mark display control section and shows, and described characteristic quantity storage compartment can be associated with and be used for identifying the object id information of object and store the characteristic quantity of the object that calculates from described feature value calculation unit branch.

Described image capture device can further comprise focal zone extraction part, the extracting section focal zone is extracted in this focal zone, this focal zone is the zone that focuses in the image that is partly absorbed by described picture catching, described object extraction part can be extracted in from described focal zone extracts the object that comprises in the focal zone of extracting the part, and, described feature value calculation unit branch can calculate the characteristic quantity of the object that is extracted from the focal zone by described object extraction part based on the image with the object that is extracted from the focal zone by described object extraction part.

Described picture catching part can be absorbed moving image, described object extraction part can be extracted in the object that comprises in each frame of the moving image that is partly absorbed by described picture catching, and described object id information storage compartment can be associated with each frame of the moving image that described picture catching partly absorbs and store the object id information that is used for being identified at the object that comprises in each frame.

Described image capture device can further comprise: object id information is selected part, and it selects an object id information based on the instruction from user's input a plurality of object id information on being stored in described object id information storage compartment; Frame extracts part, and it is associated with by described object id information selection portion and divides selected object id information and extract at least one frame that is stored on the described object id information storage compartment; And the display part, it shows at least one image that extracts extraction the part from described frame.

Described object id information storage compartment can be embedded into the object id information that is used for being identified at the object that comprises in the image in the view data of the image that described picture catching partly absorbs as digital watermark information.

According to a second aspect of the invention, provide a kind of image capture method.This method comprises: image capture step is used for pickup image; The object extraction step is used for being extracted in the object that comprises in the image that described image capture step absorbs; The characteristic quantity calculation procedure is used for based on the image with the object that extracts in described object extraction step, calculates the characteristic quantity of the object that extracts in described object extraction step; The characteristic quantity storing step is used for being associated with and is used for identifying the object id information of object and is stored in the characteristic quantity of the object that described characteristic quantity calculation procedure calculates; And the object id information storing step, be used for being associated with the image that absorbs in described image capture step and store and be used for identifying the object id information that is included in the object in the image.

According to a third aspect of the invention we, provide a kind of program that is used for the image capture device of pickup image.This program makes image capture device play following effect: picture catching part, its pickup image; The object extraction part, it extracts the object that comprises in the image that is partly absorbed by described picture catching; The feature value calculation unit branch, it calculates from the characteristic quantity of the object of described object extraction extracting section based on having from the image of the object of described object extraction extracting section; The characteristic quantity storage compartment, it is associated with and is used for identifying the object id information of object and stores the characteristic quantity of the object that calculates from described feature value calculation unit branch; And the object id information storage compartment, it is associated with the image that described picture catching part absorbed and stores and be used for identifying the object id information that is included in the object in the image.

According to a forth aspect of the invention, provide a kind of image capture device.This device comprises: picture catching part, its pickup image; The object judgment part, it judges in the image that described picture catching part is absorbed whether comprise predetermined special object; Identification information obtains part, and it is judged in described object judgment part and obtains the identification information that is associated with object in advance when comprising predetermined special object in the image that described picture catching part is absorbed; And the identification information recording part, its identification information that described identification information acquisition unit branch is obtained is embedded in the view data of the image that is partly absorbed by described picture catching as digital watermark information.

Described identification information recording part can be embedded into the identification information that described identification information acquisition unit branch obtains in the whole image data zone of the image that is partly absorbed by described picture catching as digital watermark information.

When described object judgment part is judged when comprising predetermined special object in the image that described picture catching is partly absorbed, described identification information obtains part can extract digital watermark information from the view data of the image-region of object, to obtain by the shown information of the digital watermark information that is extracted as identification information, and described identification information recording part can be embedded into the identification information that described identification information acquisition unit branch obtains in the view data of the image that is partly absorbed by described picture catching as digital watermark information.

In the bit stream of the view data that is used to illustrate the image that is partly absorbed by described picture catching, described identification information recording part can be embedded into the identification information that described identification information acquisition unit branch obtains to be obtained part with the described identification information of cause and therefrom extracts in the bit stream bit in addition of digital watermark information as digital watermark information.

In the bit stream of the view data that is used to illustrate the image that is partly absorbed by described picture catching, described identification information recording part can be embedded into the identification information that described identification information acquisition unit branch obtains to illustrate to be obtained part with the described identification information of cause and therefrom extracts in the bit of the shown color component of bit color component in addition of digital watermark information as digital watermark information.

Described image capture device can further comprise the additional information recording section, and this additional information recording section will be embedded into by the pull-in time that described picture catching is partly absorbed in the view data of the image that is partly absorbed by described picture catching as digital watermark information.

Described image capture device can further comprise the additional information recording section, and this additional information recording section will be embedded into by the catching position that described picture catching is partly absorbed in the view data of the image that is partly absorbed by described picture catching as digital watermark information.

Described identification information recording part can be better than other information of embedding with its embedment strength and embed identification information that described identification information acquisition unit branch obtains as digital watermark information as the mode of the embedment strength of digital watermark information.

In the bit stream of the view data that is used to illustrate the image that described picture catching partly absorbs, described identification information recording part can more embed identification information that described identification information acquisition unit branch obtains in the bit of high-order as digital watermark information as the bit of digital watermark information than wherein having embedded other information.

In the bit stream of the view data that is used to illustrate the image that described picture catching partly absorbs, described identification information recording part can be by means of the more color component of color component than the digital watermarking that is used to embed other information, embeds the digital watermarking of the identification information that described identification information acquisition unit branch obtains.

According to a fifth aspect of the invention, provide a kind of image capture method.This method comprises: image capture step is used for pickup image; The object determining step is used for judging whether comprise predetermined special object in the image that described image capture step is absorbed; The identification information obtaining step is used for judging at described object determining step and obtains the identification information that is associated with object in advance when comprising predetermined special object in the image that absorbs in described image capture step; And the identification information recording step, be used for the identification information that described identification information obtaining step obtains is embedded in the view data of the image that absorbs in described image capture step as digital watermark information.

According to a sixth aspect of the invention, provide a kind of program that is used for image capture device.This program makes image capture device play following effect: picture catching part, its pickup image; The object judgment part, it judges in the image that described picture catching part is absorbed whether comprise predetermined special object; Identification information obtains part, and it is judged in described object judgment part and obtains the identification information that is associated with object in advance when comprising predetermined special object in the image that described picture catching part is absorbed; And the identification information recording part, its identification information that described identification information acquisition unit branch is obtained is embedded in the view data of the image that is partly absorbed by described picture catching as digital watermark information.

The summary of the invention part needn't be described the feature that is necessary of the present invention.The present invention also can be the recombinant of above-mentioned feature.

The invention effect

According to the present invention, a kind of image capture device might be provided, it automatically registers the object that is absorbed.

Description of drawings

Fig. 1 is the exemplary plot that the environment for use of image capture system is shown.

Fig. 2 is the exemplary plot that the block configuration of image capture device is shown.

Fig. 3 is that the form that illustrates with table is stored in the exemplary plot that object id information is selected the data on the part.

Fig. 4 illustrates the exemplary plot that is stored in the data on the characteristic quantity storage compartment with the form of table.

Fig. 5 is the exemplary plot that the operating process of image capture device is shown.

Fig. 6 is the exemplary plot that the structure of image capture device is shown.

Fig. 7 is the exemplary plot that another environment for use of image capture system is shown.

Fig. 8 is the exemplary plot that the block configuration of image capture device is shown.

Fig. 9 is the exemplary plot that the picture catching flow process is shown.

Figure 10 is the exemplary plot that digital watermark information is shown.

Figure 11 is the exemplary plot that the color rendition district is shown.

Figure 12 is the exemplary plot that illustrates according to the hardware configuration of the computer of image capture device.

Embodiment

To describe the present invention based on preferred embodiment now, it is not intended to limit the scope of the invention, but demonstration the present invention.All features of Miao Shuing and combination thereof are not absolutely necessary for the present invention in an embodiment.

Fig. 1 is the exemplary plot that illustrates according to the environment for use of the image capture system 170 of the embodiment of the invention.Image capture system 170 comprises image capture device 100 and personal computer 110.Image capture device 100 has operator scheme, such as the enrollment mode that is used to absorb the picture catching pattern of theme and be used for registration theme when absorbing this theme.When with enrollment mode picked-up theme, the specific characteristic of image capture device 100 these themes of record and this theme.Then, when with picture catching pattern picked-up theme, the identical theme of specific characteristic of retrieval and the theme that absorbs in the theme that image capture device 100 writes down from enrollment mode, with record retrieval to theme and the image that in the picture catching pattern, absorbs.

And image capture device 100 is illustrated in the topic list that writes down in the enrollment mode to user 180, so that user 180 selects theme.Then, image capture device 100 makes display device (such as the monitor screen of image capture device 100) show the image that comprises selected theme.

Personal computer 110 is via receiving image and the theme that image capture device 100 is absorbed such as the order wire 150 of internet or such as the recording medium of semiconductor memory.Then, personal computer 110 makes the title of the theme that user 180 input write down by image capture device 100 in enrollment mode, so that write down this title.Then, personal computer 110 makes user 180 select the user to want the theme that shows to the name list that user 180 illustrates the theme of record.Then, personal computer 110 makes the image that comprises selected theme such as the output equipment output of display and printer.In addition, personal computer 110 can be made album data according to a plurality of images that comprise user's 180 selected themes, and the output album data is to output equipment.In addition, personal computer 110 can be HDTV (High-Definition Television), electron album or electronic photo station etc.

In addition, image capture device 100 can receive the title of theme via order wire 150 from personal computer 110.And image capture device 100 can be digital static camera or video camera, perhaps can be personal digital assistant, such as the portable phone that is equipped with camera, the PDA with image capture function.

According to above-mentioned image capture device 100, might in image, automatically write down the title of the theme that comprises in the image of being caught.Then, user 180 can easily select to comprise the image of the theme of wanting by image capture device 100 and personal computer 110.

Fig. 2 is the exemplary plot that the block configuration of image capture device 100 is shown.Image capture device 100 comprises picture catching part 202, image storage part 204, object extraction part 206, feature value calculation unit divides 208, characteristic quantity storage compartment 210, object id information storage compartment 212, characteristic amount comparison section 214, consistency judgment part 218, object id information is selected part 220, image extracts part 222, display part 224, model selection part 230, mark display control section 232, part 234 is extracted in the focal zone, and frame extracts part 236.

Picture catching part 202 pickup images.The image that image storage part 204 stores by 202 picked-ups of picture catching part.Specifically, image storage part 204 store images are caught the image of part 202 picked-ups and the image I D of identification image.In addition, the image in the present embodiment comprises rest image and moving image.

The focal zone is extracted part 234 and is extracted the focal zone, and this focal zone is the zone that focuses in the image that picture catching part 202 is absorbed.The focal zone is extracted the contrast of the image that part 234 can be absorbed from picture catching part 202 and is judged the focal zone.And the focal zone can be a predetermined regional area in the image-region that picture catching part 202 is absorbed.

Object extraction part 206 is extracted in the object that comprises in the image that picture catching part 202 absorbed.In addition, object extraction part 206 can be extracted the object that is included in from the focal zone that focal zone extraction part 234 is extracted.Object id information storage compartment 212, with the image of picture catching part 202 picked-up explicitly, store the object id information that is used for identifying the object that is included in image.

Feature value calculation unit divides 208 based on having from the image of the object of object extraction part 206 extractions, calculates from the characteristic quantity of the object of object extraction part 206 extractions.In addition, feature value calculation unit is divided 208 can be based on the image with object that object extraction part 206 extracts from the focal zone, and calculating object extracts the characteristic quantity of the object that part 206 extracts from the focal zone.Then, characteristic quantity storage compartment 210 stores the characteristic quantity that divides 208 objects that calculate from feature value calculation unit, is associated with the object id information that is used to identify object.

Characteristic amount comparison section 214 relatively is included in the characteristic quantity and the characteristic quantity that is stored in the object on the characteristic quantity storage compartment 210 by the object in the image of picture catching part 202 up-to-date picked-ups, with the conforming degree of calculating object.Then, consistency judgment part 218 judges that whether the degree of the object consistency that calculates from characteristic amount comparison section 214 is less than predetermined reference value.

When consistency judgment part 218 judges that the degree of the object consistency that calculates from characteristic amount comparison section 214 is not less than predetermined reference value, object id information storage compartment 212 is stored in the object id information that stores on the characteristic quantity storage compartment 210, is associated with the image of picture catching part 202 up-to-date picked-ups.Thus, image capture device 100 can automatically write down the object in the image that is included in up-to-date picked-up.

In addition, feature value calculation unit divides 208 can calculate the color of the object that extracts from object extraction part 206 as characteristic quantity.In the case, characteristic quantity storage compartment 210 stores the color that divides 208 objects that calculate from feature value calculation unit, is associated with object id information.Then, characteristic amount comparison section 214 relatively is included in the color of the color of the object that comprises in the image by the 202 up-to-date picked-ups of picture catching part and the object that stores on characteristic quantity storage compartment 210, with the conforming degree of calculating object.Then, consistency judgment part 218 judges that whether the degree of the object consistency that calculates from characteristic amount comparison section 214 is less than predetermined reference value.

Object id information selects part 220 based on the instruction by user's 180 inputs, selects an object id information a plurality of object id information on being stored in object id information storage compartment 212.Then, image extracts part 222 and extracts at least one image that stores on the object id information storage compartments 212, and selects part 220 selected object id information to be associated by object id information.Specifically, image extracts part 222 and is chosen at least one the image I D that stores on the object id information storage compartment 212, be associated with select part 220 selected object id information by object id information, and be extracted in the image that stores on the image storage part 204 explicitly with image I D.Then, display part 224 shows at least one image that extracts extraction the part 222 from image.Thus, user 180 can make image capture device 100 easily show to comprise user 180 to want the image of the object that shows.

In addition, object id information storage compartment 212 stores a plurality of object id information, is associated with the group of objects identification information that is used for identifying a group objects.Then, object id information selects part 220 based on the instruction by user's 180 inputs, select a group of objects identification information a plurality of group of objects identification informations on being stored in object id information storage compartment 212, then based on instruction by user's 180 inputs, select an object id information a plurality of object id information on being stored in object id information storage compartment 212, be associated with selected group of objects identification information.Like this, because image capture device 100 at first makes user 180 select a group objects, user 180 can select the object that will show fast.

Model selection part 230 is selected enrollment mode, this pattern is used to absorb object, make feature value calculation unit divide 208 calculated characteristics amounts so that characteristic quantity storage compartment 210 preservative feature amounts, perhaps, model selection part 230 is selected the picture catching patterns, this pattern be used to absorb be stored in object id information storage compartment 212 on the image that is associated of object id information.Then, when model selection part 230 was selected enrollment mode, characteristic quantity storage compartment 210 stored the characteristic quantity that divides 208 objects that calculate from feature value calculation unit, is associated with object id information.

Then, the characteristic quantity of the object that comprises in characteristic amount comparison section 214 image that relatively picture catching part 202 is absorbed when model selection part 230 is selected the picture catching pattern and the characteristic quantity that is stored in the object on the characteristic quantity storage compartment 210 when model selection part 230 is selected enrollment mode are so that the conforming degree of calculating object.Then, consistency judgment part 218 judges whether the degree of the object consistency that calculates is not less than predetermined reference value from characteristic amount comparison section 214.Then, when consistency judgment part 218 judges that the degree of the object consistency that calculates is not less than predetermined reference value from characteristic amount comparison section 214, object id information storage compartment 212 is stored in the object id information that stores on the characteristic quantity storage compartment 210, and the image by the 202 up-to-date picked-ups of picture catching part when selecting enrollment mode with model selection part 230 is associated.Thus, user 180 can make the object that image capture device 100 prior registrations will be write down.Then, when the prior registered object of up-to-date picked-up, image capture device 100 can automatically write down the object that is included in the image.

Display part 224 display images are caught the picture catching district of part 202.In addition, image capture device 100 can further have display mode except enrollment mode and picture catching pattern, is used to make display part 224 to show from image and extracts at least one image that part 222 is extracted.Then, model selection part 230 can be provided with image capture device 100 according to the instruction from user 180 and be in enrollment mode, picture catching pattern or the display mode any one.

Mark display control section 232 adds in the picture catching district of the picture catching part 202 on the display part 224 and shows the mark that is used to illustrate some zones, makes feature value calculation unit divide 208 calculated characteristics amounts so that the object of characteristic quantity storage compartment 210 preservative feature amounts should be ingested in this zone.Then, feature value calculation unit is divided 208 characteristic quantities that calculate the object exist in the shown zone of the mark that shows by mark display control section 232, and this zone is included in the image that is absorbed by picture catching part 202.Then, characteristic quantity storage compartment 210 stores the characteristic quantity that divides 208 objects that calculate from feature value calculation unit, is associated with the object id information that is used for identifying object.

For example, display part 224 can be a monitor screen, and such as the static camera of number, it illustrates zone and the image capture conditions that picture catching part 202 is absorbed to user 180.Then, when image capture device 100 is set to enrollment mode, add on the image of image capture device 100 in the picture catching district that picture catching part 202 is absorbed and show some zones, the object of characteristic quantity storage compartment 210 preservative feature amounts should be ingested in this zone.Thus, user 180 can easily specify the object that will register by mark being added to the user want the object of registering in image capture device 100.

In addition, when picture catching part 202 picked-up moving images, object extraction part 206 is extracted the object in each frame that is included in the moving image that is absorbed by picture catching part 202.Then, object id information storage compartment 212 stores and is used for identifying the object id information that is included in each frame, is associated with each frame of the moving image of picture catching part 202 picked-ups.

Then, object id information selects part 220 based on the instruction by user's 180 inputs, selects an object id information a plurality of object id information on being stored in object id information storage compartment 212.Then, frame extracts part 236 and extracts at least one frame that is stored on the object id information storage compartment 212, selects part 220 selected object id information to be associated with object id information.Then, display part 224 shows at least one image that extracts part 236 extractions from frame.Specifically, display part 224 demonstrations are extracted at least one image of part 236 extractions as moving image from frame.

In addition, object id information storage compartment 212 can in the view data of the image that picture catching part 202 is absorbed, embed be used for identifying be included in the object in this image object id information as digital watermark information.

According to above-mentioned image capture device 100, picked-up in advance is the registration theme also, and wherein, when absorbing this theme once more, user 180 can be to comprising the effect of this theme in the interesting image that captures and the image that is recorded in seizure automatically.Thus, because user 180 does not need the artificially to import the subject information that is included in the image when pickup image, the user can be absorbed in the picture catching activity that utilizes image capture device.And then user 180 can be easily classify and the Pareto diagram picture by each theme by image capture device 100, and selects effectively to comprise that the user wants the image of the theme appreciated, thereby appreciates this image.

Fig. 3 is that the form that illustrates with table is stored in the exemplary plot that object id information is selected the data on the part 220.The group of objects ID that object id information is selected part 220 to store to be used for identifying each group of objects, to the group of objects title of each group of objects name, be used for identifying the object ID of each object, to the object title of each object naming, the representative image ID that the image I D of the image that comprises object is shown and the representative image of object is shown.

In addition, can be by providing the object title by user's 180 artificial inputs.And object id information storage compartment 212 can store and be used for being identified at one or more image I D of the image that absorbs when image capture device 100 is set to enrollment mode as representative image ID.In addition, the object id information in the present embodiment can be an object ID.Replacedly, object id information can be the object title, perhaps can be the representative image ID that is used to be illustrated in the image that absorbs when being set to enrollment mode.

In addition, group of objects title and the object title that is stored in the data on the object id information storage compartment 212 can be by user 180 by personal computer 110 and artificial input.For example, during with image capture device 100 pickup images, image capture device 100 will distribute object ID.Then, personal computer 110 can obtain data from object id information storage compartment 212, with the storage object title by artificial input of the user 180.And, the artificial input that personal computer 110 can be by user 180 and storage object group heading.

In addition, a plurality of object id information that object id information storage compartment 212 can store based on being associated with identical image, to be higher than the ratio of estimated rate, be extracted in a group objects identification information of the object that occurs in the identical image, thereby be associated with the same object group identity information and store this group objects identification information of extraction.Like this, image capture device 100 can write down suitable group of objects identification information automatically, and does not make user 180 be each object appointed object group identity information.

In addition, personal computer 110 can obtain data from object id information storage compartment 212 and image storage part 204, and to user 180 object id information that is stored on the object id information storage compartment 212 is shown, so that the user selects.For example, personal computer 110 is on the display device such as display, be associated with the representative image ID that is stored in each object ID on the object id information storage compartment 212, show the image list be stored on the image storage part 204, so that user 180 is selected by the operation of mouse etc.Then, personal computer 110 can show to have the image of user's 180 selected images as representative image ID on such as the display device of display.

And object id information storage compartment 212 can the record object id information embed information as electronics in the view data of the image that picture catching part 202 is absorbed.Like this, because object id information storage compartment 212 degree of depth ground coded object identification information and carry out record in view data self, object id information is recorded in the view data self.Like this, the loss of the object id information that causes as the label information of image of the label information that might prevent owing to rewriteeing image relatively in advance with the record object id information.

Fig. 4 illustrates the exemplary plot that is stored in the data on the characteristic quantity storage compartment 210 with the form of table.Characteristic quantity storage compartment 210 storage object ID and characteristic quantities.In addition, when to as if during the personage, characteristic quantity is facial shape profile, the perhaps shape of differentiated part in the face, the position of each part or the position between each several part relation in the entire face, wherein, these parts are eyes, nose, mouth.And, when to as if during animal, characteristic quantity can be the shape profile such as hand and pin or trunk.And, when to as if during artifact, such as wedding dress or ship, characteristic quantity storage compartment 210 can store the shape profile of whole object as characteristic quantity.And characteristic quantity storage compartment 210 can extract the unique color in the differentiated part of object, such as the color of face, the color of personage's eyes, the color of animal trunk, thereby stores one or more colors of extracting as characteristic quantity.

In addition, characteristic amount comparison section 214 compares about the object that comprises in the image of up-to-date picked-up and divides 208 characteristic quantities that calculate and be stored in the characteristic quantity of each object ID on the characteristic quantity storage compartment 210 from feature value calculation unit, thereby calculates the conforming degree between them.In addition, for example, when the profile that is stored in the differentiated part on the characteristic quantity storage compartment 210 of the profile of the differentiated part of extracting from the object of up-to-date picked-up and each object mated, conforming degree can be the area of overlapping region and the ratio of the area shown in the whole profile.And conforming degree can be, in the unique color that from the object of up-to-date picked-up, extracts, and the ratio of the number of colors that comprises in the identical color space of the unique color with on being stored in characteristic quantity storage compartment 210 of each object ID.

Fig. 5 is the exemplary plot that the operating process of image capture device 100 is shown.Image capture device 100 is by being begun operation (S302) by user's 180 opening power buttons.Then, image capture device 100 acceptance are from user 180 the appointment to operator scheme (S304).For example, image capture device 100 can be accepted the appointment to operator scheme from user 180 by the operator scheme order button of being pressed the indication operator scheme by user 180.Then, at S304, when enrollment mode was appointed as in the operation of user 180 operator scheme order button, image capture device 100 setting operation patterns were enrollment mode (S312).Then, object extraction part 206 is extracted object (S314) from the image by 202 picked-ups of picture catching part.Then, the characteristic quantity of image capture device 100 storage object on characteristic quantity storage compartment 210, and on object id information storage compartment 212 storage object identification information (S316).

In addition, when image capture device 100 is set to enrollment mode, by the image of picture catching part 202 picked-ups, image capture device 100 can make feature value calculation unit divide the characteristic quantity of 208 computed image so that characteristic quantity storage compartment 210 stores this characteristic quantity for.For example, image capture device 100 can make the image of user 180 on being stored in image storage part 204 and select image, accepts the instruction that is used to illustrate enrollment mode from user 180 then, with for selected image processing step S314 and S316.In the case, object id information storage compartment 212 can select to comprise the image I D of a certain object, the characteristic quantity of this object characteristic quantity with the object of up-to-date registration in S316 when the degree of consistency surpasses reference value is identical, and stores the object ID of the object of up-to-date registration explicitly with image I D.

And at S304, when user 180 passed through the operation specify image trap mode of operator scheme order button, image capture device 100 setting operation patterns were picture catching pattern (S322).Then, object extraction part 206 is extracted object (S324) from the image of picture catching part 202 picked-ups.Then, object id information storage compartment 212 store images ID are associated with the object ID of object, wherein, when consistency judgment part 218 judges that the degree of consistency surpasses reference value, characteristic quantity identical (S326).

And at S304, when user 180 specified display mode by the operation of operator scheme order button, image capture device 100 setting operation patterns were display mode (S332).Then, image capture device 100 makes user 180 select a group objects (S334).Then, image capture device 100 makes and select the object (S336) that will show in the object in the group objects that user 180 selects from is included in S334.Then, image extracts part 222 and extracts the image that is included in the object of appointment among the S336, to show this image (S338) on display part 224.

In addition, when picture catching part 202 picked-up new images, conforming degree is not calculated in consistency judgment part 218, characteristic quantity storage compartment 210 can distribute the temporary object identification information to give the object that extracts from object extraction part 206, and is associated with this temporary object identification information and the preservative feature amount.Then, when image capture device 100 is set to display mode, image capture device 100 can be when the degree of consistency surpasses reference value, retrieval another object id information identical the object id information on being stored in characteristic quantity storage compartment 210 with the characteristic quantity of user's 180 selected objects, thus the image that comprises the shown object of object id information that retrieves on display part 224, shown.In the case, because whether image capture device 100 does not need retrieval character amount storage compartment 210 to come the judging characteristic amount identical mutually when pickup image, user 180 can continue the picture catching activity, and need not wait for the processing time of consistency judgment part 218.

In addition, in each operator scheme, comprise enrollment mode, picture catching pattern and display mode, image capture device 100 can have wait state, is used for waiting for the operation from user 180.For example, when continuing the scheduled time from user 180 operation, image capture device 100 shut-down operation and forward wait state in each operator scheme.Then, when image capture device 100 turns to wait state, image capture device 100 can be retrieved another object id information from the object id information on being stored in characteristic quantity storage compartment 210, its characteristic quantity when the degree of consistency surpasses reference value be stored in characteristic quantity storage compartment 210 on characteristic quantity identical, be associated with the temporary object identification information, thereby store images on object id information storage compartment 212 is associated with the object id information that retrieves.Thus, because when user's 180 undos, image capture device 100 can be carried out the judgment processing of the degree of consistency by consistency judgment part 218, user 180 can continue pickup image, and need not wait for the processing time of consistency judgment part 218.

In addition, when the operation among step S316, S326 and the S338 stops, judge whether to carry out power-off operation (S340).When S340 does not carry out power-off operation, handle and forward S304 to, when when S340 has carried out power-off operation, handle stopping.

Fig. 6 is the exemplary plot that the structure of image capture device 100 is shown.Image capture device 100 comprises release-push 602, operator scheme selector button 604 and movable button 606.Picture catching part 202 is obtained the image of picked-up when user 180 presses release-push 602.

In addition, operator scheme selector button 604 is examples of operator scheme order button.When user's 180 push mode buttons 604, image capture device 100 switching operation modes any one in enrollment mode, picture catching pattern or the display mode.In addition, the operator scheme order button can be a release-push 602.For example, when user 180 half pressed release-push 602, image capture device 100 can forward enrollment mode to, extracted object the image that obtains when partly pressing with preservative feature amount on characteristic quantity storage compartment 210.

When image capture device 100 was set to enrollment mode by model selection part 230, mark display control section 232 is show tags 610 on the viewing area of display part 224.Subsequently, user 180 adds the mark on the viewing area of display part 224 610 on the object that the user wishes to register to, thereby specifies the object that will register in image capture device 100.In addition, mark display control section 232 can be gone up show tags 610 in presumptive area (such as the central area in the viewing area of display part 224).In addition, mark display control section 232 can be according to the operation of 180 pairs of movable buttons 606 of user, and in the viewing area of display part 224 display position of movement indicia 610.

And when image capture device 100 was set to enrollment mode by model selection part 230, mark display control section 232 can show the mark 612 that is provided to show the frame that place the object of wanting therein on the viewing area of display part 224.Then, the object that user 180 can be on the viewing area of display part 224 wants the user to register is placed in the frame shown in the mark 612, thereby specifies the object that will register in image capture device 100.In addition, mark display control section 232 can come the display position of movement indicia 612 in the viewing area of display part 224 by the operation of 180 pairs of movable buttons 606 of user.

In addition, when image capture device 100 was set to display mode, object id information selected part 220 to make display part 224 show a plurality of object id information that are stored on the object id information storage compartment 212, to illustrate to user 180.Then, user 180 can select the user to want the object id information of the object that shows by using movable button 606 to carry out that cursor moves from a plurality of object id information that illustrate.

According to above-mentioned image capture device 100, might write down the object that is included in the image that captures together with image, and the hand that can not bother user 180.Thus, user 180 can select easily to comprise that the user wants the image of the object that shows by image capture device 100 and/or personal computer 110.Therefore, user 180 can easily arrange the image of each theme, perhaps easily selects to be included in the image that the user who has absorbed when appreciating image wants the theme appreciated.

Fig. 7 is the exemplary plot that illustrates according to the environment for use of the image capture system 170 of another embodiment.For example, image capture system 170 is used for building is taken pictures, and building record and job schedule that picked-up is used to build after finishing are confirmed data.Image capture device 100 picked-up building photos are comprising the blackboard 700 that is used to build photo.The image of Huo Deing is used for differentiating that this building is regular building like this.Write down architecture information being used to build on the blackboard 700 of photo, such as building title, technological process and builder, image capture device 100 picked-up building yards are comprising the blackboard 700 that is used to build photo, in recording medium 760 photo that absorbs is recorded as image.

At this moment, image capture device 100 extracts the image area of the blackboard 700 that is used to build photo from the image that captures.Then, image capture device 100 extracts the bar code 710 that is used for identifying building from the image area that extracts.For example, bar code 710 is to be used for identifying the numeral of building and carrying out the builder of this building, and is associated with building sign ID and builder ID in advance.Then, image capture device 100 obtains building sign ID and the builder ID that joins with the digital correlation shown in the bar code 710.

In addition, as described in top embodiment, when picked-up in the enrollment mode at registering object when being used to build the blackboard 700 of photo, image capture device 100 can write down in advance as object title etc. and the building sign ID of input and the value shown in builder ID and the bar code 710.Then, when the image of building the blackboard 700 of photo when being used for of absorbing from image capture device 100 the picture catching pattern detects bar code 710, image capture device 100 obtains building sign ID and the builder ID that is associated with the numeral shown in the bar code 710 in advance and writes down, these ID are embedded in the image that image capture device 100 absorbed.At this moment, image capture device 100 will be built sign ID and builder ID and be embedded in the entire image district as digital watermark information.

In addition, building sign ID and builder ID can be associated with the numeral shown in the bar code 710 and be recorded in advance in the recording medium 760.And building sign ID and builder ID can be encoded and be associated with the numeral shown in the bar code 710 and be recorded in the recording medium 760.And this recording medium 760 can provide with the government office department of bar code 710 by the management building.And, can be associated with bar code 710 and record building sign ID and builder ID with the database of image capture device 100 communications.Then, image capture device 100 can be associated with the numeral shown in the bar code 710 and obtain building sign ID and the builder ID that is stored on the database.Image capture device 100 can obtain building sign ID and builder ID from database via the order wire such as the internet.In addition, the value shown in the bar code 710 self also can illustrate building sign ID and builder ID.

And the information that is used for identifying building sign ID and builder ID can be embedded into and be used for building the blackboard 700 of photo as watermark.Then, image capture device 100 can be from obtaining building sign ID and builder ID by analyzing from the information that the detected watermark of image of having absorbed the blackboard 700 that is used for building photo is extracted, thereby the building that record obtains in the image that captures sign ID and builder ID are as digital watermarking.According to above-mentioned image capture device 100,, might improve anti-ability of distorting to the building photo owing to be used for identifying zone that the information of building is recorded in whole building photo as digital watermarking.

Fig. 8 is the exemplary plot that the block configuration of image capture device 100 is shown.Image capture device 100 comprises that picture catching part 802, object extraction part 806, object judgment part 818, identification information obtain part 820, identification information recording part 812, additional information recording section 814, time and obtain part 830 and position acquisition section 840.For example, image capture device 100 can be the image capture device such as static camera of number or digital video video camera.

Picture catching part 802 pickup images.For example, picture catching part 802 is by receiving light and pickup image with photodetector (such as CCD) from object.Object judgment part 818 judges whether comprise predetermined special object in the image that picture catching part 802 is absorbed.Then, when 818 judgements of object judgment part comprised predetermined special object in the image that picture catching part 802 is absorbed, identification information obtained part 820 and obtains the identification information that is associated with object in advance.Then, identification information recording part 812 obtains in the view data that identification information that part 820 obtained is embedded into the image that picture catching part 802 absorbed identification information as digital watermark information.In addition, identification information recording part 812 is obtained identification information that part 820 obtained with identification information and is embedded in the whole image data zone of the image that picture catching part 802 absorbed as digital watermark information.Like this, might improve building the anti-ability of distorting of photo and image.

In addition, when 818 judgements of object judgment part comprise predetermined special object in the image of picture catching part 802 picked-ups, identification information obtains part 820 and extract digital watermark information from the view data of the image area of object, with the information shown in the digital watermark information that obtains extraction as identification information.Then, identification information recording part 812 is obtained identification information embedded images that part 820 obtained with identification information and is caught in the view data of image of part 802 picked-ups as digital watermark information.

And, in the bit stream of the view data of the image that is provided to show picture catching part 802 picked-up, identification information recording part 812 is obtained identification information that part 820 obtains with identification information and is embedded into identification information and obtains in the bit outside the bit stream that part 820 is used for extracting digital watermark information as digital watermark information.And, in the bit stream of the view data of the image that is used to illustrate 802 picked-ups of picture catching part, identification information recording part 812 is obtained identification information that part 820 obtained with identification information and is embedded into and is provided to show in the bit that identification information obtains the color component outside the color component shown in the bit that part 820 is used for extracting digital watermark information as digital watermark information.Thus, image capture device 100 can write down watermark information and the identification information in the theme that is embedded in the identical image.Therefore, might further improve anti-ability of distorting to image.

Additional information recording section 814 will be embedded into the view data of the image that is used for 802 picked-ups of picture catching part as digital watermark information by the time that captures of picture catching part 802 picked-ups.And additional information recording section 814 is embedded into the view data of the image that is used for 802 picked-ups of picture catching part as digital watermark information with the position that captures of picture catching part 802 picked-ups.In addition, additional information recording section 814 is embedded in the entire image district time and the location of capture of catching as digital watermark information.Like this, because image capture device 100 has been embedded in the image position that captures and time of capturing as digital watermark information, might use image self (if necessary) to check whether the building photo is rational.And identification information recording part 812 is obtained the identification information that part 820 obtains with identification information and is embedded as digital watermark information, and embedment strength is better than other information that embed as digital watermark information.Thus, can lose prior identification information hardly, such as builder ID.

And, as the other method that is used for changing embedment strength, in the bit stream of the view data of the image that is provided to show picture catching part 802 picked-up, identification information recording part 812 identification information can be obtained identification information that part 820 obtains be embedded into than wherein embedded as the bit of other information of digital watermark information more in the bit of high-order as digital watermark information.And, in the bit stream of the view data of the image that is provided to show picture catching part 802 picked-up, by the more color component of color component than the digital watermarking that is used to embed other information, identification information recording part 812 can embed the digital watermarking that identification information obtains the identification information that part 820 obtains.

Fig. 9 is the exemplary plot that the picture catching flow process of image capture device 100 is shown.Picture catching part 802 pickup images (S902).Then, object extraction part 806 is extracted in the object that comprises in the image that absorbs among the step S902.Then, object judgment part 818 judges whether the object that extracts is the blackboard (S904) that is used to build photo.Object judgment part 818 can store Rule of judgment, such as predetermined shape and the color that is used to build the blackboard of photo, and judges based on Rule of judgment whether the object that extracts is the blackboard that is used to build photo.

At S904, when judge extraction to as if when being used to build the blackboard of photo, identification information obtains part 820 and judges whether comprise bar code (S906) in the object.Then, when judging at S906 when comprising bar code, identification information obtains part 802 and obtains building ID and the builder ID (S908) that is associated with the value shown in the bar code that extracts.Then, will be embedded in the entire image district that S902 catches as digital watermarking (S910) at building ID and the builder ID that S908 obtains.

In addition, not to be used to build the blackboard of photo or to judge when not comprising bar code when judging the object that extracts at S904 at S906, device is notified the user make a mistake (S920) and termination.

Figure 10 is the exemplary plot that the digital watermark information of image capture device 100 embeddings is shown.After this, will describe about digital watermarking is embedded into 3 pixels that comprise image 1000 ^*Situation during the image area 1001 of 3 pixels.For each color component R, B, G, have the digital bit plane (for example, eight are used for 8 bits) of bit number in the image-region 1001, thus, image capture device 100 tracer signal intensity.Here, bit-planes is the bit- planes 1011,1012,1013 of color component R ..., the bit- planes 1021,1022,1023 of color component B ..., the bit- planes 1031,1032,1033 of color component G ...Then, can in a bit-planes (for example, bit-planes 1011) of a color component, embed nine bit informations.

Identification information recording part 812 will be built sign ID and builder ID and will be embedded in the bit-planes from the 3rd bit of Least significant bit.For example, identification information recording part 812 will be built sign ID and builder ID and will be embedded into bit- planes 1012,1013,1022 from the 3rd bit of the Least significant bit of color component R and B.And, additional information recording section 814 will be embedded in the bit-planes 1032 such as the additional information of time, location of capture, individual camera ID and the anti-tamper code of catching, this bit-planes is the bit-planes in the bit stream of color component G, and is than the low bit-planes of bit-planes that embeds building sign ID and builder ID.In addition, identification information recording part 812 or additional information recording section 814 information that can be embedded in the bit-planes of lower-order bit is embedded in the bit-planes of color component G.

In addition, identification information recording part 812 and additional information recording section 814 can be embedded into digital watermark information in the bit-planes with various pixel units except that above-mentioned 3*3 bit-planes.And much less, identification information recording part 812 can be embedded into an information (bit-depth is different mutually, color component is different mutually or the mutual different bit-planes of image area) in a plurality of bit-planes.And much less, identification information recording part 812 can embed an information by the information that comprises a plurality of bit-planes.And, when obtaining part 820, for example from bit-planes 1011, extracts when being embedded into the watermark information of the blackboard that is used to build identification information, identification information recording part 812 can be obtained identification information the identification information that part 820 obtains and be embedded in another bit-planes (for example, bit-planes 1012 or bit-planes 1021) in identical image district.

And identification information recording part 812 can be embedded into digital watermarking in the image by the method outside above-mentioned.For example, identification information recording part 812 can embed the information of a bit by the brightness of the amplitude of the brightness of second pixel being changed into first pixel in the first mutually contiguous pixel and second pixel.For example, when embedding for the moment, identification information recording part 812 increases the brightness of second pixel than the brightness of first pixel, when embedding zero, reduces the brightness of second pixel than the brightness of first pixel.Like this, because the brightness of neighbor generally is identical, might embed information and not viewed person perceives in most applications.

Figure 11 is the exemplary plot that the color rendition district is shown.Figure 11 illustrates the color rendition district of printer and the color rendition district of image capture device 100.And, illustrate as a reference based on the color rendition district of sRGB.Then, when object judgment part 818 is judged when comprising predetermined special object in the image of picture catching part 802 picked-up, identification information obtains part 820 can the view data that is used for colour gamut (color gamut) from the object images district extract watermark information, thereby the shown information of the watermark information that obtains extraction is as identification information, and this colour gamut is outside the color rendition district of printer and within the color rendition district in picture catching part 802.For example, identification information obtains part 820 and can be from the color rendition district extracts watermark information in the colour gamut of x=0.2～0.3 and y=0.6～0.7.And identification information recording part 812 can write down the digital watermark information of the view data that is used for colour gamut, and this colour gamut is outside the color rendition district of printer and within the color rendition district in picture catching part 802.Like this, might improve anti-ability of distorting, printer printed is used to build the image of the blackboard of photo to be used for absorbing.

Figure 12 is the exemplary plot that illustrates according to the hardware configuration of the computer 1500 of the image capture device 100 of present embodiment.Computer 1500 comprises: CPU peripheral hardware part, have CPU 1505, RAM 1520, graphics controller 1575 and display unit 1580, and they are connected to each other by console controller 1582; Input has communication interface 1530, hard disk drive 1540 and CD-ROM drive 1560, and they are connected to console controller 1582 by IOC 1584; And traditional input, having ROM 1510, floppy disk 1550 and I/O chip 1570, they are connected to IOC 1584.

Console controller 1582 is connected to CPU 1505 and graphics controller 1575 with RAM 1520, is used for high transfer rate visit RAM 1520.CPU 1505 comes work based on the program that is stored on ROM1510 and the RAM 1520, so that control each part.Obtain the view data that generates by CPU 1505 on the frame buffer that graphics controller 1575 provides in RAM 1520, video data on display unit 1580.Replacedly, graphics controller 1575 can comprise frame buffer therein, is used for storing the view data that generates from CPU 1505.

IOC 1584 is connected to hard disk drive 1540, communication interface 1530 and CD-ROM drive 1560 with console controller 1582, and they are fast relatively input/output units.Hard disk drive 1540 stores will be by the program and the data of CPU 5105 uses in the calculator 1500.Communication interface 1530 is communicated by letter with image capture device 100 via network, and provides program and data to image capture device 100.CD-ROM drive 1560 is from CD-ROM1595 fetch program or data, and provides program or data via RAM 1520 to hard disk drive 1540 and communication interface 1530.

And, be connected to IOC 1584 as ROM 1510, floppy disk 1550 and the I/O chip 1570 of relatively at a slow speed input/output unit.The program of the boot that ROM 1510 storages will be carried out during starting computer 1500, the hardware that is subordinated to computer 1500 etc.Floppy disk 1550 is fetch program or data from diskette 1 590, and provide program or data via RAM 150 to hard disk drive 1540 and communication interface 1530.I/O chip 1570 is via floppy disk 1550 or parallel port, serial port, keyboard port, mouse port and connect various types of input/output units.

The program that offers communication interface 1530 via RAM 1520 is stored on the recording medium such as diskette 1 590, CD-ROM 1595 or IC-card, so that provided by the user.Fetch program from recording medium offers communication interface 1530 via RAM 1520, sends to image capture device 100 via network.In image capture device 100, install and carry out the program that sends to image capture device 100.

The program that will install in image capture device 100 and carry out makes image capture device 100 play picture catching part 202, image storage part 204, object extraction part 206, feature value calculation unit divides 208, characteristic quantity storage compartment 210, object id information storage compartment 212, characteristic amount comparison section 214, consistency judgment part 218, object id information is selected part 220, image extracts part 222, display part 224, model selection part 230, mark display control section 232, the effect that part 234 is extracted in the focal zone and frame extracts part 236 is described in Fig. 1 to 6.And, the program that will install in image capture device 100 and carry out makes image capture device 100 play picture catching part 802, object extraction part 806, object judgment part 818, identification information and obtains the effect that part 820, identification information recording part 812, additional information recording section 814, time are obtained part 830 and position acquisition section 840, described in Fig. 7 to 11.

Above-mentioned program can be stored on the exterior storage medium.Except that diskette 1 590 and CD-ROM1595, storage medium can also comprise the optical record medium such as DVD or PD, and such as the Magnetooptic recording medium of MD, tape-shaped medium's is such as the semiconductor memory of IC-card.And, also can be used as recording medium such as the memory device of hard disk that provides in the server system that is connected to dedicated communications network or internet or RAM, and, can program be offered computer via network.

Although the present invention describes by example embodiment, should be appreciated that those skilled in the art may make many changes and replacement, and can not deviate from the spirit and scope of the present invention.Qualification according to claims it should be apparent that, the embodiment with such modification also belongs to scope of the present invention.

Industrial usability

According to the present invention, might provide the picture catching of the object that a kind of automatic registration absorbs Device.

Claims (25)

1. image capture device comprises:

The picture catching part, its pickup image;

The object extraction part, it extracts the object that comprises in the image that is partly absorbed by described picture catching;

The feature value calculation unit branch, it calculates from the characteristic quantity of the object of described object extraction extracting section based on having from the image of the object of described object extraction extracting section;

The characteristic quantity storage compartment, it is associated with and is used for identifying the object id information of object and stores the characteristic quantity of the object that calculates from described feature value calculation unit branch; And

The object id information storage compartment, it is associated with the image that described picture catching part absorbed and stores and be used for identifying the object id information that is included in the object in the image.

2. image capture device as claimed in claim 1, wherein

Image capture device further comprises:

Characteristic amount comparison section, the characteristic quantity and the characteristic quantity that is stored in the object on the described characteristic quantity storage compartment of the object that comprises in the image of its comparison by the up-to-date picked-up of described picture catching part are with the conforming degree of calculating object; And

The consistency judgment part, whether its judgement is not less than predetermined reference value from the degree of the object consistency that described characteristic amount comparison section calculates, and

When the conforming degree of judging the object that calculates from described characteristic amount comparison section when described consistency judgment part was not less than predetermined reference value, described object id information storage compartment was associated with the image of the up-to-date picked-up of described picture catching part and is stored in the object id information that stores on the described characteristic quantity storage compartment.

3. image capture device as claimed in claim 2, wherein

Described feature value calculation unit divides the color that calculates from the object of described object extraction extracting section as characteristic quantity,

Described characteristic quantity storage compartment is associated with object id information and stores the color of the object that calculates from described feature value calculation unit branch,

The color of the object that described characteristic amount comparison section comparison comprises in the image of the up-to-date picked-up of described picture catching part and the color that is stored in the object on the described characteristic quantity storage compartment, with the conforming degree of calculating object, and

Whether the judgement of described consistency judgment part is not less than predetermined reference value from the degree of the object consistency that described characteristic amount comparison section calculates.

4. image capture device as claimed in claim 1 further comprises:

Object id information is selected part, and it selects an object id information based on the instruction from user's input a plurality of object id information on being stored in described object id information storage compartment;

Image extracts part, and it is associated with by the object id information of described object id information selection portion component selections and extracts at least one image that is stored on the described object id information storage compartment; And

The display part, it shows at least one image that extracts extracting section from described image.

5. image capture device as claimed in claim 4, wherein

Described object id information storage compartment is associated with and is used for identifying the group of objects identification information of group of objects and stores a plurality of object id information, and

Described object id information selects part based on the instruction from user's input, select a group of objects identification information a plurality of group of objects identification informations on being stored in described object id information storage compartment, then based on instruction from user's input, be associated with selected group of objects identification information, and select an object id information a plurality of object id information on being stored in described object id information storage compartment.

6. image capture device as claimed in claim 2, wherein

Image capture device further comprises the model selection part, this mode selection part component selections enrollment mode or picture catching pattern, this enrollment mode is the pattern that is used to absorb object, make described feature value calculation unit branch calculated characteristics amount so that described characteristic quantity storage compartment preservative feature amount, this picture catching pattern be used to absorb be stored in described object id information storage compartment on the pattern of the image that is associated of object id information

When described mode selection part component selections enrollment mode, described characteristic quantity storage compartment is associated with object id information and stores the characteristic quantity of the object that calculates from described feature value calculation unit branch,

The characteristic quantity of the object that comprises in the image that the more described picture catching of described characteristic amount comparison section part is absorbed when described mode selection part component selections picture catching pattern and the characteristic quantity that is stored in the object on the described characteristic quantity storage compartment when the described mode selection part component selections enrollment mode, with the conforming degree of calculating object

Whether the judgement of described consistency judgment part is not less than predetermined reference value from the degree of the object consistency that described characteristic amount comparison section calculates, and

When the degree of judging the object consistency that calculates from described characteristic amount comparison section when described consistency judgment part was not less than predetermined reference value, described object id information storage compartment was associated with the image of the up-to-date picked-up of described picture catching part and stores the object id information that is stored on the described characteristic quantity storage compartment when described mode selection part component selections enrollment mode.

7. image capture device as claimed in claim 1, wherein

Image capture device further comprises:

The display part, it shows the picture catching district of described picture catching part; And

The mark display control section, add and show the mark in expression one zone in the picture catching district of its described picture catching part in described display part, should in this zone, absorb object, make described feature value calculation unit branch calculated characteristics amount so that described characteristic quantity storage compartment preservative feature amount, and

Described feature value calculation unit is divided the characteristic quantity that calculates the object in the zone shown in the mark, and this mark is included in the image that is partly absorbed by described picture catching and by described mark display control section and shows, and

Described characteristic quantity storage compartment is associated with and is used for identifying the object id information of object and stores the characteristic quantity of the object that calculates from described feature value calculation unit branch.

8. image capture device as claimed in claim 1, wherein

Image capture device further comprises focal zone extraction part, and extracting section focal zone is extracted in this focal zone, and this focal zone is the zone that focuses in the image that is partly absorbed by described picture catching,

Described object extraction extracting section is being extracted the object that comprises in the focal zone of extracting the part from described focal zone, and

Described feature value calculation unit is divided based on the image with the object that is extracted from the focal zone by described object extraction part, calculates the characteristic quantity of the object that is extracted from the focal zone by described object extraction part.

9. image capture device as claimed in claim 1, wherein

Moving image is partly absorbed in described picture catching,

The object that described object extraction extracting section comprises in each frame of the moving image that is partly absorbed by described picture catching, and

Described object id information storage compartment is associated with each frame of the moving image that described picture catching partly absorbs and stores the object id information that is used for being identified at the object that comprises in each frame.

10. image capture device as claimed in claim 9 further comprises:

Object id information is selected part, and it selects an object id information based on the instruction from user's input a plurality of object id information on being stored in described object id information storage compartment;

Frame extracts part, and it is associated with by described object id information selection portion and divides selected object id information and extract at least one frame that is stored on the described object id information storage compartment; And

The display part, it shows at least one image that extracts extraction the part from described frame.

11. image capture device as claimed in claim 1, wherein said object id information storage compartment will be used for being identified in the view data that the object id information of the object that comprises in the image is embedded into the image that described picture catching partly absorbs as digital watermark information.

12. an image capture method comprises:

Image capture step is used for pickup image;

The object extraction step is used for being extracted in the object that comprises in the image that described image capture step absorbs;

The characteristic quantity calculation procedure is used for based on the image with the object that extracts in described object extraction step, calculates the characteristic quantity of the object that extracts in described object extraction step;

The characteristic quantity storing step is used for being associated with and is used for identifying the object id information of object and is stored in the characteristic quantity of the object that described characteristic quantity calculation procedure calculates; And

The object id information storing step is used for being associated with the image that absorbs in described image capture step and stores and is used for identifying the object id information that is included in the object in the image.

13. a program that is used for the image capture device of pickup image, this program make image capture device play following effect:

The picture catching part, its pickup image;

The object extraction part, it extracts the object that comprises in the image that is partly absorbed by described picture catching;

The feature value calculation unit branch, it calculates from the characteristic quantity of the object of described object extraction extracting section based on having from the image of the object of described object extraction extracting section;

The characteristic quantity storage compartment, it is associated with and is used for identifying the object id information of object and stores the characteristic quantity of the object that calculates from described feature value calculation unit branch; And

The object id information storage compartment, it is associated with the image that described picture catching part absorbed and stores and be used for identifying the object id information that is included in the object in the image.

14. an image capture device comprises:

The picture catching part, its pickup image;

The object judgment part, it judges in the image that described picture catching part is absorbed whether comprise predetermined special object;

Identification information obtains part, and it is judged in described object judgment part and obtains the identification information that is associated with object in advance when comprising predetermined special object in the image that described picture catching part is absorbed; And

Identification information recording part, its identification information that described identification information acquisition unit branch is obtained are embedded in the view data of the image that is partly absorbed by described picture catching as digital watermark information.

15. image capture device as claimed in claim 14, the identification information that wherein said identification information recording part is obtained described identification information acquisition unit branch are embedded in the whole image data zone of the image that is partly absorbed by described picture catching as digital watermark information.

16. image capture device as claimed in claim 14, wherein

When described object judgment part is judged when comprising predetermined special object in the image that described picture catching is partly absorbed, described identification information obtains part and extract digital watermark information from the view data of the image-region of object, obtaining by the shown information of the digital watermark information that is extracted as identification information, and

The identification information that described identification information recording part is obtained described identification information acquisition unit branch is embedded in the view data of the image that is partly absorbed by described picture catching as digital watermark information.

17. image capture device as claimed in claim 16, wherein, in the bit stream of the view data that is used to illustrate the image that is partly absorbed by described picture catching, the identification information that described identification information recording part is obtained described identification information acquisition unit branch is embedded into and obtains part with the described identification information of cause and therefrom extract in the bit stream bit in addition of digital watermark information as digital watermark information.

18. image capture device as claimed in claim 16, wherein, in the bit stream of the view data that is used to illustrate the image that is partly absorbed by described picture catching, the identification information that described identification information recording part is obtained described identification information acquisition unit branch is embedded into to illustrate and obtains part with the described identification information of cause and therefrom extract in the bit of the shown color component of bit color component in addition of digital watermark information as digital watermark information.

19. image capture device as claimed in claim 16, further comprise the additional information recording section, this additional information recording section will be embedded into by the pull-in time that described picture catching is partly absorbed in the view data of the image that is partly absorbed by described picture catching as digital watermark information.

20. image capture device as claimed in claim 16, further comprise the additional information recording section, this additional information recording section will be embedded into by the catching position that described picture catching is partly absorbed in the view data of the image that is partly absorbed by described picture catching as digital watermark information.

21. image capture device as claimed in claim 16, wherein said identification information recording part is better than other information of embedding with its embedment strength and embeds identification information that described identification information acquisition unit branch obtains as digital watermark information as the mode of the embedment strength of digital watermark information.

22. image capture device as claimed in claim 21, wherein, in the bit stream of the view data that is used to illustrate the image that described picture catching partly absorbs, described identification information recording part is more embedding identification information that described identification information acquisition unit branch obtains in the bit of high-order as digital watermark information than wherein having embedded other information as the bit of digital watermark information.

23. image capture device as claimed in claim 21, wherein, in the bit stream of the view data that is used to illustrate the image that described picture catching partly absorbs, described identification information recording part is by means of the more color component of color component than the digital watermarking that is used to embed other information, embeds the digital watermarking of the identification information that described identification information acquisition unit branch obtains.

24. an image capture method comprises:

Image capture step is used for pickup image;

The object determining step is used for judging whether comprise predetermined special object in the image that described image capture step is absorbed;

The identification information obtaining step is used for judging at described object determining step and obtains the identification information that is associated with object in advance when comprising predetermined special object in the image that absorbs in described image capture step; And

The identification information recording step is used for the identification information that described identification information obtaining step obtains is embedded in the view data of the image that absorbs in described image capture step as digital watermark information.

25. a program that is used for image capture device, this program make image capture device play following effect:

The picture catching part, its pickup image;

The object judgment part, it judges in the image that described picture catching part is absorbed whether comprise predetermined special object;

Identification information obtains part, and it is judged in described object judgment part and obtains the identification information that is associated with object in advance when comprising predetermined special object in the image that described picture catching part is absorbed; And

Identification information recording part, its identification information that described identification information acquisition unit branch is obtained are embedded in the view data of the image that is partly absorbed by described picture catching as digital watermark information.

Images