The application requires to be submitted to the 10-2007-0083004 korean patent application of Korea S Department of Intellectual Property and to be submitted to the rights and interests of the 10-2008-0057017 korean patent application of Korea S Department of Intellectual Property on June 17th, 2008 on August 17th, 2007, and these full contents of applying for each are contained in this by reference.
Summary of the invention
The invention provides a kind of method and photo-printing system of print image and the digital camera that is suitable for this method, method by this print image, can print area be set based on the position-adjustable of the facial zone that on image, detects, thereby the facial zone on the image can be printed, can be owing to not being sheared as matching between the standard size of the ratio of width to height of the image of print entry and printed material.
According to embodiments of the invention, provide a kind of method that is stored in the image in the image memory device by photo printer output.Described method comprises: on printed image interim print area is set; Determine whether to have selected full paper Printing Qptions; If selected full paper Printing Qptions, then the facial zone on the detected image; Determine whether the facial zone that detects is included in the print area; Adjust print area according to definite result, make facial zone to be included in the print area.
The step of adjusting print area can comprise: determine whether the ratio of width to height of image and the ratio of width to height of printed material differ from one another; According to determining mobile print zone as a result.
In the step in mobile print zone, if the ratio of width to height of image less than the ratio of width to height of printed material, then can move up or down print area; If the ratio of width to height of image is greater than the ratio of width to height of printed material, if and the facial zone in the only side in image left side and the right side is present in outside the print area, then can with print area to the left direction or to the right direction move, make facial zone be included in the print area; If the ratio of width to height of image is greater than the ratio of width to height of printed material, and if first facial zone and second facial zone on image left side and the right side be present in outside the print area, then zone and the alert message of getting rid of outside printing can be shown to the user.
In the step that print area is moved up or down, print area can be moved up, make the top and second vertical height (Py2) of print area mate, second vertical height (Py2) obtains according to distance (h1) and the weight (α) between first vertical height (Py1), eye zone and the mouth zone in the eye zone from the facial zone of image detection, wherein, Py2=Py1+h1 * α.
In the step that print area is moved to the left or to the right, print area can be positioned at a side shifting outside the print area to facial zone.
Alert message is being shown in user's the step, can print area be set according to user's input.
In detecting the step of facial zone, can and read information from the Exif information extraction that appends to image about the position of facial zone, perhaps can extract facial zone by image processing.
According to another embodiment of the present invention, provide a kind of system that comprises image memory device and output device, the image that described system print receives from image memory device.Image memory device comprises: the facial zone extraction unit, detect the facial zone that is present on the image; Print area appropriateness determining unit determines whether the facial zone that detects is included in the print area; Controller is adjusted print area according to the output of print area appropriateness determining unit, makes facial zone to be included in the print area.
Described system also can comprise: image/material the ratio of width to height comparing unit, the ratio of width to height of image and the ratio of width to height of printed material are compared, and wherein, controller is adjusted print area based on the output of image/material the ratio of width to height comparing unit.
If the ratio of width to height of image is less than the ratio of width to height of printed material, then controller can move up or down print area; If the ratio of width to height of image is greater than the ratio of width to height of printed material, if and the facial zone in the only side in image left side and the right side is present in outside the print area, then controller can with print area to the left direction or to the right direction move, make facial zone be included in the print area; If the ratio of width to height of image is greater than the ratio of width to height of printed material, and if first facial zone and second facial zone on image left side and the right side be present in outside the print area, then controller can show zone and the alert message of eliminating outside printing.
Output device can be a photo printer, and image memory device can be a digital camera, described digital camera has the image that is used to catch object and the image of catching is stored as the structure of view data, and digital camera is sent to photo printer with the image of storage.
Output device can be mounted in common location and the photograph washer of print service is provided, and image memory device can be user's terminal, and described terminal sends to the photograph washer by internet communications network with the image of storage.
Output device can be mounted in common location and the photograph washer of print service is provided, and image memory device can be the web server, and the image that described web server has been uploaded the user and stored by internet communications network sends to the photograph washer.
According to another embodiment of the present invention, provide a kind of system that comprises image memory device and output device, the data that described system print receives from image memory device.Output device comprises: the facial zone extraction unit, detect the facial zone that is present on the image; Print area appropriateness determining unit determines whether the facial zone that detects is included in the print area; Controller is adjusted print area according to the output of print area appropriateness determining unit, makes facial zone to be included in the print area.
Described system also can comprise: image/material the ratio of width to height comparing unit, the ratio of width to height of image and the ratio of width to height of printed material are compared, and wherein, controller is adjusted print area based on the output of image/material the ratio of width to height comparing unit.
If the ratio of width to height of image is less than the ratio of width to height of printed material, then controller can move up or down print area; If the ratio of width to height of image is greater than the ratio of width to height of printed material, if and the facial zone in the only side in image left side and the right side is present in outside the print area, then controller can with print area to the left direction or to the right direction move, make facial zone be included in the print area; If the ratio of width to height of image is greater than the ratio of width to height of printed material, and if first facial zone and second facial zone on image left side and the right side be present in outside the print area, then controller can show zone and the alert message of eliminating outside printing.
Output device can be a photo printer, and image memory device can be a digital camera, described digital camera has the image that is used to catch object and the image of catching is stored as the structure of view data, and digital camera is sent to photo printer with the image of storage.
Output device can be a photo printer, and image memory device can be the small-sized storage device that is connected to photo printer and the image of storage is sent to photo printer.
Output device can be mounted in common location and the photograph washer of print service is provided, and image memory device can be user's terminal, and described terminal sends to the photograph washer by internet communications network with the image of storage.
Output device can be mounted in common location and the photograph washer of print service is provided, and image memory device can be the web server, and the image that described web server has been uploaded the user and stored by internet communications network sends to the photograph washer.
Output device can be mounted in common location and the photograph washer of print service is provided, and image memory device can be the portable detachable memory that is connected to the photograph washer and the image of storage is sent to the photograph washer.
According to another embodiment of the present invention, provide a kind of digital camera, the image that is used for storing for print job sends to output device, and adjusts print area, makes the facial zone of catching on image not be sheared.Described digital camera comprises: the facial zone extraction unit, detect the facial zone that is present on the image; Print area appropriateness determining unit determines whether the facial zone that detects is included in the print area; Controller is adjusted print area according to the output of print area appropriateness determining unit, makes facial zone to be included in the print area.
Described digital camera also can comprise: image/material the ratio of width to height comparing unit, the ratio of width to height of image and the ratio of width to height of printed material are compared, and wherein, controller is adjusted print area based on the output of image/material the ratio of width to height comparing unit.
If the ratio of width to height of image is less than the ratio of width to height of printed material, then controller can move up or down print area; If the ratio of width to height of image is greater than the ratio of width to height of printed material, if and the facial zone in the only side in image left side and the right side is present in outside the print area, then controller can with print area to the left direction or to the right direction move, make facial zone be included in the print area; If the ratio of width to height of image is greater than the ratio of width to height of printed material, and if first facial zone and second facial zone on image left side and the right side be present in outside the print area, then controller can show zone and the alert message of eliminating outside printing.
Embodiment
More fully describe according to the method and the photo-printing system of print image of the present invention and the digital camera that is suitable for this method, exemplary embodiment of the present invention shown in the drawings now with reference to accompanying drawing.
As shown in fig. 1, comprise according to the example of the photo-printing system 100 of the embodiment of the invention: photo printer 110, as output device; Digital camera 120 is as the image memory device of storage with printed image.In order to communicate with one another, photo printer 110 and digital camera 120 are connected to each other by the communication link 150 such as USB (USB) cable.In this case, owing to also can consider wireless connections (such as bluetooth, Wi-Fi and WLAN (wireless local area network) (LAN)) are used for the connection between photo printer 110 and the digital camera 120, so independent communication link 150 is optional.Simultaneously, communication link 150 can be formed the communication network such as the Internet, and photo printer 110 and digital camera 120 can send and receive predetermined data by this communication network.
Fig. 2 is the block diagram that illustrates according to the example of the functional structure of photo printer 110 shown in Fig. 1 of the embodiment of the invention and digital camera 120.With reference to Fig. 2, the printer digital signal processor (DSP) 115 that photo printer 110 consists essentially of communication control unit 111, key input unit 113, memory cell 118, print unit 119 and is used for controlling fully these unit.
Communication control unit 111 is the communication interfaces that are connected with digital camera 120, reconciles the transmission and the reception of the control command between photo printer 110 and the digital camera 120 and is selected as transmission with the view data of printed image.Communication control unit 111 can provide USB port or card reader port, and communication control unit 111 can comprise USB Setup Controller that is used for the USB connection and/or the wireless communication module that is used for radio communication.
The print data that memory cell 118 interim storages receive from digital camera 120, and according to print procedure, the print data that memory cell 118 will be stored in wherein is sent to print unit 119, carries out cushioning effect thus.
Print unit 119 is carried out the print job that is present in the reservation in the memory cell 118 according to print command.Print unit 119 can be implemented as by the color material on the printed material optionally being heated the thermal transfer imaging mechanism that presents predetermined image, perhaps can be implemented as the electronic imaging mechanism that uses the electrical potential difference that is formed on the electrostatic latent image on the photoelectric conducting drum, perhaps can be implemented as the ink-jet imaging mechanism of ink droplet jet on printed material, perhaps can use other mechanism.Key input unit 113 produces predetermined order according to user's operation, and this order is sent to printer DSP 115.Key input unit 113 can comprise: power key is used to turn on and off power supply; Print stop key, be used to stop print job; Mode switching key is set, is used to be provided with print conditions.
Simultaneously, digital camera 120 comprises: communication control unit 121, as the communication interface that is connected with photo printer 110; User interface 123 is as user input unit; Display floater 124 is as input/output device; Memory cell 131, memory image; Exif information process unit 122 extracts the additional information that is included in the image; Facial zone extraction unit 128 extracts the zone of taking the face that the people is arranged from image; Print area appropriateness determining unit 127 determines whether facial zone is sheared; Image/material the ratio of width to height comparing unit 126 provides the reference about the print area of how resetting; Camera digital signal processor (DSP) 125 is used for controlling fully these unit.In addition, digital camera 120 also comprises image acquisition units 132, image acquisition units 132 comprises optical unit (OPC), photoelectric conversion unit (such as charge-coupled device (CCD) or complementary metal oxide semiconductors (CMOS) (CMOS)), analogue-to-digital converters (ADC) and the signal processing circuit that is formed by a plurality of optical lenses, handle thus from the signal of optical unit (OPC) output, to obtain DID.
125 pairs of photo printing processes of camera DSP are carried out control comprehensively.More particularly, camera DSP 125 shows the image that is stored in the memory cell 131 on screen, guide user's input to select printed image thus.Then, camera DSP125 will treat that printed image is converted to can be by the print data of photo printer 110 recognition data forms, and print data is sent to photo printer 110.Specifically, camera DSP125 carries out a series of processing that are used to adjust print area under predetermined condition, thereby image can be printed, and all or part of of the face-image of catching on image is not sheared.In other words, when the full paper Printing Qptions having selected not blank on printed material, very possiblely be, image is printed, and all or part of of face-image is sheared.For this reason, camera DSP125 is identified in the face-image of catching on the image, and the print area of mobile image, thereby the face-image of identification can be comprised.
Facial zone extraction unit 128 extracts the zone of taking the face that the people is arranged from input picture by carrying out face recognition algorithm, and will offer camera DSP125 about the positional information of the facial zone that extracts.For example, by use from input picture remove high frequency noise components low-pass filtering, the RGB colouring information is converted to the color space conversion in YCrCb space and the brightness calibration (calibration) that compensates the difference of facial discrimination with respect to the variation the lightness environment, facial zone extraction unit 128 is carried out the preliminary treatment that is used to improve discrimination, can extract facial image easily so that input picture is converted to.Then, extract marginal information from pretreated image, facial recognition techniques is applied to marginal information, thus detected characteristics element (comprising facial outline line, eye, nose and mouth).According to the characteristic element that detects detection faces portion zone usually.Therefore, the facial zone that detects in facial zone extraction unit 128 can be shown as by rectangle frame on image and center on.
Print area appropriateness determining unit 127 determines whether be positioned within the print area of initial setting up from the facial zone that image extracts, will determine that then the result outputs to camera DSP125, allow camera DSP125 to determine whether to adjust print area thus.That is, be positioned at outside the print area if determine the facial zone of identification, then camera DSP125 begins the adjustment operation of print area.Print area is adjusted in output according to image/material the ratio of width to height comparing unit 126.The standard size of the screen width high ratio of image/material the ratio of width to height comparing unit 126 check image (width: height ratio) and printed material (width: the relation ratio highly), and the result outputed to camera DSP125.The data of output provide important references how to adjust the print area on the image about camera DSP125, and this will be described in detail subsequently.
Simultaneously, the view data that is stored in the jpeg format in the memory cell 131 comprises the Exif header.Exif information can comprise color space information (such as brightness, saturation or color etc.) and about shooting date, about whether the flash of light operation being arranged or about the photographing information of picture size.Specifically, face recognition information can be registered as an Exif information related to the present invention.By the face recognition information of service recorder,, can accurately discern the position and the size of facial zone although do not carry out other image processing.In other words, when Exif information process unit 122 is operated the Exif information that reads, when extracting the information that whether exists about facial zone and outputing to camera DSP125 about the information of the position of facial zone or size and with these information, camera DSP125 can be provided with suitable print area, thereby face-image can not be sheared.Simultaneously, user interface 123 can comprise a plurality of action buttons, and these action buttons comprise: mode selecting key is used to switch the pattern of digital camera 120; 4 direction function keys are used for order viewing area or cursor and move, or the order print area moves; And the selection acknowledgement key, be used to select menu item by the cursor indication that activates.
To explain method now according to the print image of the embodiment of the invention.At first explanation is applied to know-why of the present invention.Fig. 3 and Fig. 4 are the schematic diagrames that is illustrated in the example of the layout that is transferred the image (Im) on printed material (Pa) in the full paper Printing Qptions.In these two accompanying drawings, Fig. 3 shows when with the screen width high ratio of image (Im) (width: highly) with the ratio of width to height (width: when highly) comparing of the standard of printed material (Pa), the screen width high ratio of image (Im) (for example, 4: 3) less than the situation of the ratio of width to height (for example, 3: 2) of printed material (Pa).As shown in Figure 3, be arranged in traditional prints method on the same line at the center line (C) of the center line (C) of image (Im) and printed material (Pa), the top of image (Im) is positioned at outside the printed material (Pa), and when printing, the top of people's image is sheared.This is the result who is positioned at the common print procedure on the same line according to the center of the center of image (Im) and printed material (Pa).By printed material (Pa) is moved up with respect to image (Im), can print people's entire image.In this case, with respect to the adjusting range of printed material (Pa), can be by the degree of determining with reference to the vertical range (h1) between the predetermined characteristic element that in being represented as the facial zone of rectangle frame (F), obtains to adjust.For example, printed material (Pa) moves up (promptly, the center line of printed material (Pa) moves to C ' from C), thereby the top of printed material (Pa) is consistent with second vertical height (Py2) that obtains from following equation 1, equation 1 has distance (h1) and the weight (α) between regional first vertical height (Py1) of eye, eye zone and the mouth zone
Py2=Py1+h1×α(1)
Vertical range between the top of the vertical range between eye and the mouth and eye and head can consider that common face shape is set to 1 with weight (α) when identical.
In case suitable print area ((Pa) is corresponding for this print area and printed material) is set, make facial zone (F) not to be sheared, then the part that is positioned at outside the print area of entire image is pruned, have only print area to be extracted and be sent to photo printer 110, thus the beginning print job.When being provided with print area as shown in Figure 3 and Figure 4, have only with can be along screen the angular direction is defined as starting point (5,0) relevant with the print area of end point (395, a 260) part can be extracted, and can be sent to photo printer 110.Perhaps, can be transmitted to photo printer 110 about the data of entire image and about the area information of print area.Therefore, the area information about print area can comprise coordinate figure (pX, pY, pW, pH)=(5,0,390,260), this coordinate figure have print area starting point (pX, pY) and print area based on this starting point (pX, width pY) and the height (pW, pH).
Simultaneously, Fig. 4 shows when with the screen width high ratio of image (Im) (width: highly) with the ratio of width to height (width: when highly) comparing of the standard of printed material (Pa), the screen width high ratio of image (Im) (for example, 16: 9) greater than the situation of the ratio of width to height (for example, 3: 2) of printed material (Pa).When having selected full paper to print, the left side of image (Im) and/or right side are positioned at outside the printed material (Pa) and are sheared.In this case, by printed material (Pa) is moved to the left or to the right, can print people's entire image.More particularly, whether the facial zone (F) of determining to be represented as rectangle frame is positioned within the printed material (Pa), if having only the left part of facial zone (F) and any side of right part to be sheared, then printed material (Pa) can be moved to the left or to the right.If the left side and the right side of facial zone (F) all are sheared, then the program according to input in advance can not automatically perform moving of printed material (Pa).In this case, alert message is exported to the user, simultaneously, shows the zone that is excluded outside printing.Thus, can carry out print procedure according to user's input.
Simultaneously, according to example of the present invention, with printed image by image processing extracting facial zone, and when facial identifying information is registered as the Exif information that appends to the printed image data, this information is read, thus the position of the face that accurately exists in the recognition image.In other words, it is optional to be used to extract the image processing of facial zone.As shown in Figure 5, the example of the view data of jpeg format can have a kind of like this data structure, and this data structure comprises Exif head region (Exif), thumbnail image data zone (thumbnail image data), raw image data zone (raw image data) and screen breviary (screennail) view data zone (screen thumbnail image data).Here, in the Exif head region, can write down each attributes of images information.Specifically, in the present invention, can write down facial identifying information.
Fig. 6 has enumerated each data item in the face recognition information that is recorded in Exif and has been stored in data value in the data item.The quantity of " Face_Num " face that indication is taken in each image.The facial starting point coordinate position on screen plane of " Face_Start_Pt " indication, (X1, Y1) or (X2, Y2) indication with based on each the starting point corresponding horizontal coordinate figure in the screen coordinate system of pixel arrangement and the combination of vertical coordinate value.The size of " Face_Size " indication facial zone, (A1, B1) or (A2, B2) horizontal length that calculates from each facial starting point of indication and the combination of vertical length.In addition, " Face_Name ", " Face_Mobile_Num " and " Face_Email_Addr " item are indicated respectively and the facial people's who is taken the corresponding every details of name, Mobile Directory Number and e-mail address.
Fig. 7 schematically shows according to the photo printer 110 of the cooperation print image of the embodiment of the invention and the example of the communication details between the digital camera 120.At first, carry out the attended operation between photo printer 110 and the digital camera 120, exchange control information transmission, and initialize communications setting.Then, sensing is from digital camera 120 request of user's the printing request information about the various Printing Qptionses supported by photo printer 110.The size that can comprise the printed material of being supported by corresponding photo printer 110 about the information of Printing Qptions (for example, A3, A4, A5), the type of printed material (for example, common paper, photo paper) and about being called as the content of 2-up, 3-up etc., wherein, the printed material of one page can be split into 2 or 3 parts and be used as several pages printing amount.The digital camera 120 that has obtained the option information of photo printer 110 shows the information that is obtained on display floater, guide user's selective printing option thus.In this case, can be limited to the scope of supporting by photo printer 110 by the option that the user selects, and comprise the size of printed material and the type of printed material etc.Specifically, digital camera 120 shows the options menu that full images related to the present invention is printed or full paper is printed, and boot options is selected thus.
Then, photo printer 110 can be imported according to the user and call a plurality of images that are stored in the memory cell 131, and can be on display floater 124 according to the form display image of downscaled images.But user's query image, and can be with printed image with all images or a part of image setting.After having finished about the setting with printed image, digital camera 120 is provided with suitable print area, makes that face-image can be from not being sheared printed image.More particularly, in full images was printed, the Printing Qptions according to the user selects did not need to consider the shearing of face-image, and therefore according to general method, print area is provided so that the center of image overlaps each other with the center of print area.In addition, when the size of having selected full paper printing and size of images and printed material is consistent each other, do not need to consider the shearing of face-image, print area is set up according to general method.Yet, print and simultaneously with the size of the printed material of the size of printed image and Set For Current when inconsistent each other when having selected full paper, digital camera 120 is carried out the face recognition processing of extracting facial zone from image, and the suitable print area of the facial zone that comprises extraction is set.For example, digital camera 120 can show the print area that synthesizes with synthetic except the print area that will also be set up the printed image and dotted line etc. on screen, and the agreement that can ask the user.In addition, the digital camera 120 of the final print command of sensing user can only extract the part of the image that is set to print area, and can send photo printer 110 to being positioned at outside the print area print data that part pruned, perhaps can send all images as additional to print data about the information of print area.In this case, about the information of print area can comprise coordinate figure (pX, pY, pW, pH), this coordinate figure have print area starting point (pX, pY) and print area based on this starting point (pX, width pY) and height (pW, pH).At last, having obtained the photo printer 110 of print data from digital camera 120 can be according to the data that obtain or with reference to carrying out printing about the additional information of print area.
Fig. 8 is the flow chart that illustrates according to the example of the method for the print image of the embodiment of the invention, and show the algorithm of mainly being carried out by the camera DSP125 in the print system, this print system comprises as the photo printer 110 of output device with as the digital camera 120 of image memory device.At first, at operation S10, if the power supply that is used to operate is provided for photo printer 110, then at operation S11, printer DSP115 can carry out initialization, and can export the initial screen of the mode of operation of display photograph printer 110 on display window.Then, at operation S12, if sense the visit of 120 pairs of photo printers 110 of digital camera, then at operation S13, printer DSP115 and digital camera 120 exchange control information transmissions, and initialize communications setting.
Simultaneously, before or after being connected to photo printer 110, the digital camera 120 that is connected to photo printer 110 enters printing model, and can receive in a plurality of images of user from be stored in memory cell 131 selection with printed image.In other words, digital camera 120 can call the image that is stored in the memory cell 131 at operation S14 also can be according to the thumbnail image format display image on display floater 124, and can move the cursor of activation along a plurality of images that are presented on the display floater 124 according to user's operation, with guiding user's selection.At operation S15, if imported the signal of indication with the selection of printed image, then camera DSP125 prepares the view data of image is sent to photo printer 110.
Then, at operation S16, camera DSP125 shows the options menu that full images is printed or full paper is printed on menu screen, and receives user's selection.If being full paper, prints the option that the user selects, and the size of printed material (A3, A4, A5 etc.) is with inconsistent each other with the size of printed image, then at operation S17, camera DSP 125 keeps the ratio of width to height (width: the ratio of height), and according to the size of printed material corresponding image is carried out adjusted size of images.In this case, at operation S 18, the initial print zone is provided so that the same position that is centered close to of the center of image and print area.
Fig. 9 illustrates the flow chart that is used to confirm or adjust the example of the operation of the interim print area that is provided with on the image.At first, camera DSP125 checks the Printing Qptions of selecting at operation S20, and carries out various process according to check result.That is,, then do not need to consider the shearing of facial zone if selected the full images Printing Qptions, therefore, according to operation S21, the print area of initial setting up is identified, then, if imported final print command from the user, then the print job according to this order is performed.
If selected full paper Printing Qptions, then at operation S22, camera DSP 125 compares screen width high ratio (width: the ratio of height hereinafter is called the ratio of width to height) and the ratio of width to height of printed material of image.If the comparative result indication has selected the ratio of width to height of full paper Printing Qptions and image and the ratio of width to height of printed material in fact to match each other, then do not need to consider the shearing of facial zone, therefore, according to operation S21, the print area of initial setting up is identified, then, if imported final print command from the user, then the print job according to this order is performed.But if selected full paper Printing Qptions, and the ratio of width to height of image is different with the ratio of width to height of printed material, for example, if with the ratio of width to height of printed image is 4: 3, and the ratio of width to height of printed material is 3: 2, then begin to carry out the face recognition processing of explained later at operation S23.
Face recognition processing (operation S23)
At first, camera DSP125 operation Exif information process unit 122 extracts face recognition information thus from the Exif head of view data.For example, Exif information process unit 122 is from the face recognition information extraction data relevant with facial zone (for example, the coordinate figure (X1 of starting point, Y1, A1, B1), the horizontal length and the vertical length of facial zone), and these data are outputed to camera DSP125.(A1 B1) can be based on the X and Y coordinates on the screen on the basis of pixel arrangement for X1, Y1 for coordinate figure.Coordinate (X1, Y1) the starting point position of indication facial zone, coordinate (A1, B1) indication with from starting point (X1, Y1) width of the facial zone of Ji Suaning and being worth highly accordingly.
If face recognition information is not recorded in the Exif head, for example, if obtained coordinate figure (X1 from Exif information process unit 122, Y1, A1, B1)=(0,0,0,0) (the NULL state that does not have the input of coordinate figure), then camera DSP125 is sent to facial zone extraction unit 128 with image.The facial zone extraction unit 128 that has received view data is carried out preliminary treatment, and extracts border element based on the distribution that appears at the luminance signal on the pretreated image.Then, by the edge image that facial recognition techniques is applied to extract like this, facial characteristic element (such as profile, eye, nose and the mouth of face) is detected.According to detected characteristic element detection faces portion zone usually.For example, in facial recognition techniques, compare by the edge image that will extract and model based on shape research, can detect facial characteristic element, and determine whether to obtain facial zone according to testing result (for example, according to whether obtaining an eye zone and a mouth zone).In this case, also can detect a plurality of facial zones from a screen picture.Can produce data from the facial zone that is provided with, for example (A1 B1), horizontal width and vertical width, and can indicate the facial zone of setting by the facial zone that is centered on by rectangle frame on screen for X1, Y1 as the coordinate figure of the starting point of facial zone.
As mentioned above, can perhaps, realize face recognition by extracting face recognition information from Exif head with printed image by carrying out face recognition algorithm to extract facial zone from image.Yet technical scope of the present invention is not limited to aforesaid example, also can realize face recognition by the known the whole bag of tricks in the conventional art.
Then, S24 determines whether detect effective facial zone in face recognition processing (S23) in operation, if and do not detect facial zone, then do not need to consider the shearing of facial zone, therefore, according to operation S21, camera DSP125 can confirm the print area and the execution print procedure subsequently of initial setting up.Yet if obtain effective facial zone in face recognition processing (S23), at operation S25, camera DSP125 compares the facial zone of acquisition and the print area of initial setting up, checks thus whether facial zone is included in the print area.For example, print area appropriateness determining unit 127 is with the coordinate figure (X1 of the starting point of facial zone, Y1, A1, B1), coordinate figure value (pX, pY, the pW of the starting point of horizontal width and vertical width and print area, pH), horizontal width and vertical width compare, and can confirm whether facial zone is included in the print area.
According to check result, if facial zone is present within the print area of initial setting up, then confirm print area according to operation S21, and if imported user's final print command, then correspondingly carry out print job.Yet,, carry out the adjustment of print area if determine that facial zone is not included in the print area.At first, in operation S26, the relation between the ratio of width to height of camera DSP125 check image and the ratio of width to height of printed material.The operation S27 to S33 that is described below, according to check result, camera DSP125 adjusts print area according to diverse ways.
The adjustment (S27 to S33) of print area
1) if the ratio of width to height of image less than the ratio of width to height of printed material, for example, if the ratio of width to height of image is 4: 3, the ratio of width to height of printed material is 3: 2, then according to operation S27, print area is moved predetermined degree up and down.In this case, with respect to moving direction, print area moves up and down towards the direction that has the facial zone outside the print area, and can determine the adjusting range of print area with reference to the distance between the characteristic element that obtains in facial zone.Promptly, as described above with reference to Figure 3, camera DSP125 can be arranged in the entire image of printing the facial zone that comprises the people on second vertical height (Py2) by the top side with print area, (Py2=Py1+h1 * α) obtains second vertical height (Py2), and equation 1 comes from distance (h1) and weight (α) between first vertical height (Py1), eye zone and the mouth zone in eye zone from equation 1.If according to the research based on ordinary people's shape, distance between eye and the mouth and the distance between the eye and the crown are approximate, and then weight (α) can be set to 1.
2) if the ratio of width to height of image greater than the ratio of width to height of printed material, for example, if the ratio of width to height of image is 16: 9, the ratio of width to height of printed material is 3: 2, then according to operation S28, camera DSP125 determines whether have the face that is positioned at outside the print area on the left side and the right side of image at operation S28.Promptly, be present in both sides if determine first facial zone and second facial zone on image, discerned, promptly, the left side of image and right side, and these two facial zones are positioned at outside the print area, and then camera DSP125 can not be left at random adjusts print area on direction and any one direction in right.Therefore, at operation S29, showing zone and the alert message of getting rid of outside printing on the display floater 124.Then, if sense user's the input that is used for the mobile print zone (for example, sensing the operation of 4 direction function keys), then at operation S30, camera DSP125 comes the mobile print zone according to user's input, and process subsequently is performed.
Yet, at operation S31, if facial zone is present in outside the print area in any side in left side and right side, for example, if determining the left side of facial zone is positioned at outside the print area, then, adjust print area by print area being moved to the left, thereby the entire face zone can be included in the print area with a part that is positioned at outside the print area that comprises facial zone at operation S32.In addition, if S31 determines that the right side of facial zone is positioned at outside the print area in operation, then at operation S33, adjust print area by print area is moved right with a part that is positioned at outside the print area that comprises facial zone, thereby the entire face zone can be included in the print area.
Figure 10 is the flow chart that is illustrated in the example of having confirmed after the print area printing that will be performed.If sense user's final print command at operation S34, then at operation S35, have only being extracted with printed image with the corresponding part of print area, and being converted into can be by the print data of photo printer 110 recognition data forms, and data converted is sent to photo printer 110.In this case, as the data that will be sent to photo printer 110, have only the corresponding part of print area with being provided with of image to be extracted and to send, perhaps entire image also can be sent out the area information of specifying print area to append to.
Then, along with receiving print data, the print job of photo printer 110 begins (S36).More particularly, printer DSP115 will be stored in the memory cell 118 from the print data that digital camera 120 receives temporarily, and the commencing signal of output print simultaneously operate print unit 119 thus, thereby the print data in the memory cell 118 can be output on the printed material.
Simultaneously, the image memory device that is implemented as digital camera 120 has the memory function of memory image, self operation controlled function (DSP function) and Presentation Function.The example of image memory device is digital camera and digital TV.Yet know-why in fact of the present invention also can be applied to the situation of small-sized storage device as image memory device comparably, and small-sized storage device does not have cpu function and the Presentation Function of himself, for example detachable memory.Shown in Figure 11 according to this structure of whole photo-printing system of using example.
The photo-printing system 200 that illustrates consists essentially of as the photo printer 210 of print out equipment with as the storage device 220 of image memory device.Photo printer 210 and storage device 220 can be connected to each other by the communication link such as USB.Figure 12 is the block diagram according to the functional structure of photo printer 210 shown in Figure 11 of the embodiment of the invention and storage device 220.With reference to Figure 12, concentrate on the function that is used to store and form storage device 220, and storage device 220 has storage control 225, memory cell 228 and communication control unit 221 printed image.
Photo printer 210 comprises communication control unit 211, Exif information process unit 212, image/material the ratio of width to height comparing unit 218, print area appropriateness determining unit 217, facial zone extraction unit 216, print data memory cell 231, print unit 232 and the printer DSP215 that is used to control these unit.Photo printer 210 can comprise display floater 214, and display floater 214 is stored in image in the storage device 220 by demonstration, is provided for receiving the user to the graphics environment with the selection of printed image.In addition, photo printer 210 can have user interface 213 as user input unit.
A series of print processing of carrying out by photo-printing system identical with shown in the example of Fig. 8 to Figure 10, but be that according to the difference of the method for current embodiment great majority are operated and carried out by printer DSP215.More particularly, if the power supply that is used to operate at operation S10 is provided for photo printer 210, then printer DSP215 carries out initialization.Then, at operation S12, if sense the visit of 220 pairs of communication interfaces of storage device (such as USB port or card reader), then in operation S13, the communications setting of printer DSP215 initialization and storage device 220.In this case, by showing and data storage device 220 corresponding folder icons that on display floater 214 printer DSP215 can show connection status.
Then, if imported the signal that is used to select with storage device 220 corresponding folder icons from user interface 213, then at operation S15, printer DSP215 calls the image that is stored in the storage device 220 and image is presented on the display floater 214, receives the user's input that is used to select with printed image thus.In addition, at operation S16, printer DSP215 shows on display floater 214 and is used to be provided with the options menu of print conditions, and meets the user and receive input to full images is printed or full paper printing is selected.In addition, at operation S18, printer DSP215 is provided with first print area, makes the center that is centered close to image of this print area.
Then, printer DSP215 carries out the operation that is used to confirm or be adjusted at the interim print area that is provided with on the image, as shown in Figure 9.At first, at operation S20, printer DSP215 checks the print area of selecting.If selected the full images Printing Qptions, then do not need to consider the shearing of facial zone, therefore confirm the print area of initial setting up, and carry out print job according to user's final print command according to operating S21 and operation subsequently.
If selected full paper Printing Qptions, then at operation S22, printer DSP215 compares the ratio of width to height of printed material and the ratio of width to height with printed image.If selected full paper Printing Qptions, and the ratio of width to height of comparative result indicating image and the ratio of width to height of printed material match each other, then do not need to consider the shearing of facial zone, therefore confirm the print area of initial setting up at operation S21, and carry out print job according to user's final print command.Yet, if selected full paper Printing Qptions, and the ratio of width to height of image is different with the ratio of width to height of printed material, then at operation S23, based on detecting facial zone from the face recognition information of Exif information process unit 212 acquisitions or the information that obtains from facial zone extraction unit 216, determine whether to exist facial zone at operation S24 then, and check at operation S25 whether detected facial zone is included in the print area of initial setting up.According to check result, print area is identified at operation S21, perhaps carries out the adjustment of print area, makes facial zone not be sheared.
In order to adjust print area, the relation between the ratio of width to height of printer DSP215 check image and the ratio of width to height of printed material.If the ratio of width to height of image less than the ratio of width to height of printed material, then moves up or down print area according to operation S27, and can determine mobile degree according to the result of calculation of equation 1.In addition, at operation S28, if the ratio of width to height of image greater than the ratio of width to height of printed material, and is present in the left side and first facial zone and second facial zone on right side is positioned at outside the print area, then at operation S29 and S30, print area is set according to user's selection.In addition, at operation S28, if the facial zone of the side in left side and the right side is positioned at outside the print area, then at operation S32 and S33, with print area to the left or the right side move.
Be provided with print area with after comprising facial zone, print command according to the user in operation S34, printer DSP215 produces the print data of the print area be used to be provided with at operation S35, and print data is outputed on the printed material by operation print unit 232 at operation S36.
As mentioned above, be the output device of example and be that the image memory device of example has constituted interconnective environment with photo printer 110, and print area is set adaptively according to the position of facial zone with digital camera 120 or storage device 220.But technical scope of the present invention is not limited to the feature of photo printer 110 and digital camera 120, but can be applicable to various other systems.When output device with the appropriate configuration that is used for printout and the image memory device with the appropriate configuration that is used for memory image file interconnect when visiting each other each other, can be according to using technical spirit of the present invention with the same or similar mode of previous description.
Illustrated among Figure 13 by using the photograph washer to realize example of the present invention, the photograph washer is installed in common location (such as school, bank, department store, mass market, airport and hotel etc.), is used to provide the photo printing service.As shown in figure 13, be connected to each other with visit each other by internet communications network as the photograph washer 310 of output device with as the web server 320 of image memory device.The user of request printout is by photograph washer 310 visit web servers 320, to download the image of being uploaded and being stored by him.The image processing algorithm that the photograph washer 310 that obtains images from web server 320 can move embedding with carry out a series of processing (such as from the image detection facial zone and suitable print area is set), make detected facial zone not be sheared.
Figure 14 schematically shows the example of the communication details between photograph washer and the web server, and photograph washer and web server are connected to each other by internet communications network.With reference to Figure 14, the photograph washer 310 that photo printing service is provided to obtain view data, is provided with communications status according to the path access web server 320 of user's appointment, and the authentication information with user's input is sent to web server 320 then.Then, web server 320 is checked the authentication information that receives with the return authentication result, and allows authentic user access server memory.The user can inquire about the image of having been uploaded and having been stored by him, and can select printed image.The web server 320 that photograph washer 310 can ask to have stored image sends printed image, and web server 320 sends the image of corresponding storage according to the request of photograph washer 310.Obtained the photograph washer 310 of printed image can be received the option selection that the user prints full images or full paper is printed, and first print area can be set, made the center of image overlap with the center of print area.In this case, when having selected the full images Printing Qptions or having selected full paper Printing Qptions, and when the ratio of width to height of printed material and the ratio of width to height of image coupling, do not need to consider the shearing of facial zone, therefore, the interim print area that is provided with is identified on the image, and print job is performed.Yet, when having selected full paper Printing Qptions, and the ratio of width to height of printed material and the ratio of width to height of image are not simultaneously, carry out face recognition processing to extract facial zone from image, and check whether the facial zone that extracts is included in the print area of initial setting up, thus up and down and left and move right, to adjust print area and finally to carry out print job with the print area of initial setting up.
Be used for from the image detection facial zone and print area be set, the photograph that 320 management of web server are uploaded by the user of authentication so that a series of images Processing Algorithm that facial zone is not sheared can be carried out by photograph washer 310 or web server 320.Carried out by web server 320 under the situation of a series of images Processing Algorithm, photograph washer 310 can only be carried out output operation to printed material according to the suitable print area that web server 320 is provided with, such example shown in Figure 15.Shown in the example among Figure 15, photograph washer 310, is provided with communications status, and the authentication information of user's input is sent to web server 320 to obtain view data according to user's specified path visit web server 320.Therefore, web server 320 is checked the authentication information that receives with the return authentication result, and allows authentic user access server memory.The user can inquire about the image of having been uploaded and having been stored by him, can be provided with printed image, and can select Printing Qptions about full images is printed or full paper is printed.Then, web server 320 is provided with suitable print area according to the Printing Qptions that is provided with, and makes facial zone not be sheared.The option information that web server 320 request users are provided with (full images/full paper).The web server 320 that has obtained option information is provided with first print area on image, make the center of image overlap with the center of this print area.In this case, when having selected the full images Printing Qptions or selected full paper Printing Qptions, and during the ratio of width to height of the ratio of width to height of printed material and image coupling, do not need to consider the shearing of face-image, therefore, the interim print area that is provided with is identified on the image.Yet, when having selected full paper Printing Qptions, and the ratio of width to height of printed material and the ratio of width to height of image are not simultaneously, carry out face recognition processing to extract facial zone from image, and check whether the facial zone that extracts is included in the print area of initial setting up, thus up and down and left and move right, to adjust print area and finally to carry out print job with the print area of initial setting up.
The web server 320 of having confirmed print area can produce print data (in this print data, have only a part that is included in the print area to be extracted with printed image, part outside print area is pruned), send to photograph washer 310 with the print data that will produce, perhaps can send the entire image that appends to the area information of specifying print area.At last, the photograph washer 310 beginning printouts of print data have been obtained.
Simultaneously, as shown in the example of Figure 16, the photograph washer 410 that is arranged in various common location fully by management server 415 controls with distributing.The user of request printout uses and is positioned at the photograph washer 410 of regional area as terminal, be connected to the web server 420 of internet communications network by management server 415 visits, downloading the image uploaded and stored by him, and the management server 415 runs image processing algorithms that obtained image are to be provided with suitable print area.From the image detection facial zone and suitable print area is set so that the process that the facial zone that detects is not sheared is with described above identical, for example, photograph washer 410 can only be carried out output operation with reference to the suitable print area that management server 415 is provided with.
Simultaneously, as shown in the example of Figure 17, the user of request printout can visit his terminal 520 that is positioned at the distant place by the photograph washer 510 that use is arranged in common location, and can send to photograph washer 510 by the image that internet communications network will be stored in the terminal 520, and photograph washer 510 can be carried out output operation as printing target by using the image that sends.In such application, photograph washer 510 is output devices, user's terminal 520 is image memory devices, storage in photograph washer 510 and the terminal 520 a suitable print area that the shearing that facial zone does not take place can be set of image processing algorithm, and photograph washer 510 can be carried out print job according to the print area that is provided with.
Simultaneously, as shown in the example of Figure 18, the user of request printout can use photograph washer 610 as output device, his detachable memory 620 visit photograph washers 610 can be allowed, and the image that is stored in the detachable memory 620 photograph washer 610 can be sent to.In such application, for example, memory bank 611 is formed on the front portion of photograph washer 610, and detachable memory 620 is inserted in the groove 611, and the function that provides the image memory device of printed image is provided thus.The photograph washer 610 that has received image from detachable memory 620 can move the image processing algorithm of embedding, and the print area of the shearing that facial zone does not take place can be set.
According to the present invention, whether be included in the print area according to detected facial zone on image, check and whether adjust print area, and according to specific print conditions, print area is provided with changeably, make the face-image that exists on the image to be printed, can be owing to matching between the ratio of width to height of the ratio of width to height of printed image and printed material is not sheared.Therefore, no matter whether the ratio of width to height of printed image and the ratio of width to height of printed material are mated, also no matter Printing Qptions how, is guaranteed the printing of entire face image.
Though specifically shown and described the present invention with reference to exemplary embodiment of the present invention, but it should be understood by one skilled in the art that, under the situation that does not break away from the spirit and scope of the present invention that are defined by the claims, can carry out the various changes of form and details to it.Preferred embodiment should be understood that it only is descriptive meaning, rather than the purpose of restriction.Therefore, scope of the present invention is not to be limited by detailed description of the present invention, but is defined by the claims, and all difference that fall in the described scope should be interpreted as comprising in the present invention.