CN102426574B - Information processor, information processing method - Google Patents

Abstract

The invention provides information processor, information processing method and program.Image processing apparatus includes: view data input block, for receiving moving pictures and the data of rest image；Image grouped element, for by moving image and rest image Classified into groups；Image dissector, for the moving image classified by group analysis and rest image, and obtains the analysis information of image and about the information of the relation between moving image and rest image；Two field picture extractor, for according at least one in the information of analysis and relation information, extracts two field picture from moving image；Layout determines unit, for according at least one in the information of analysis and relation information, determining the layout of rest image and two field picture；And graphical arrangement unit, for according to layout arrangement rest image and two field picture.

Description

Information processor, information processing method

Technical field

The present invention relates to image processing apparatus, image processing method and program, at following image Reason device, image processing method and program: wherein, according between rest image (hereinafter referred to as two field picture) and moving image Relation, the moving image from the data comprising rest image and moving image extracts rest image, and arranges rest image And moving image.

Background technology

Along with the performance of recent digital camera is strengthened, some digital cameras on market are currently capable of recording high-resolution Rate moving image.Accordingly, there exist and print the two field picture sheared from moving image to not only printing rest image or incite somebody to action Rest image or two field picture are positioned over the requirement in photograph album.For such background, make about rest image and frame figure The layout being prone to viewing of picture and the various proposals of list.

Such as, JP 2009-118060A describes a kind of such image display device: by from rest image or motion The view data of image is extracted rest image and obtains characteristic quantity, determine that rest image is in viewing area with feature based amount Layout in position, and show in the form of a list in viewing area and obtain by reducing the size of rest image Image for display.The document also describes in the case of the view data of moving image comprises multiple content, will motion The view data of image is divided into event (event) or fragment, represents the quiet of moving image to extract from its noise free portion Stop image and rest image be arranged in close to each other.

JP 2009-246887A describes and extracts and to determined number from each motion pictures files being stored in storage medium The corresponding frame image information of two field picture, and determine in following this mode and put in order: can be given according to meeting The order of condition arrange the thumbnail corresponding with the frame image information extracted and with the static figure read from storage medium As the thumbnail that file is corresponding.

JP 2009-246897A describes to print and comprises the thumbnail extracted from motion pictures files and from static The situation of the list of the image of the thumbnail extracted in image file, this patent documentation describes the size of correction thumbnail Be consistent with the fixed reference feature amount with dimension information, the color of correction thumbnail with print before the fixed reference feature of colouring information Amount is consistent so that the list that prints of image has in the thumbnail produced according to motion pictures files and static picture document Vision uniformity.

Summary of the invention

But, when having begun to pass through the previous appointment time from extraction moving image as in JP 2009-118060 A Moment at extract rest image from moving image, in order to extract in the case of noise free portion, or for rest image Extract and in the case of analyzing the noise in the view data of moving image, the rest image extracted from moving image must be Represent the rest image of moving image, but be not necessarily user's expectation and print to rest image or the figure of the material as photograph album Picture.

It addition, as in JP 2009-246887A and JP 2009-246897A, extracting moving image and rest image Afterwards, in the case of determining arrangement condition and carrying out the image rectification uniformity with offer layout, it is not necessary to can extract Be suitable for print image, or the most not necessarily can use be included in moving image image (its when in use Uniformity can be provided and without image rectification).It addition, as printed article, photograph album, electron album etc., show in only list Image may give impression dull, irksome.

The present invention aims at image processing apparatus, image processing method and the program providing following: it is used for leading to Cross according to by moving image and rest image Classified into groups and analyze these images and the relation that obtains produces layout, produce more Attracting graphical arrangement data.

To achieve these goals, the invention provides a kind of image processing apparatus for generating image layout, its bag Include:

View data input block, for receiving moving pictures and the data of rest image,

Image grouped element, is used for moving image and rest image Classified into groups according to specified criteria,

Image dissector, for the moving image classified by group analysis and rest image, and obtain analysis information with And relation information, wherein, this analysis information obtains, this relation information table by analyzing moving image and rest image Show the relation between moving image and rest image,

Two field picture extractor, for according at least one in the information of analysis and relation information, determining by group will be from every width The quantity of the two field picture extracted in moving image, and extract the two field picture of quantification,

Layout determines unit, for according at least one in the information of analysis and relation information, determining rest image by group With the layout of two field picture, and

Graphical arrangement unit, for according to layout, by group arrangement rest image and two field picture.

Additionally, the invention provides a kind of image processing method for generating image layout, comprising:

View data input step, for receiving moving pictures and the data of rest image,

Image packet step, is used under prescribed conditions by moving image and rest image Classified into groups,

Image analysis step, for the moving image classified by group analysis and rest image, and obtains analysis information And relation information, wherein, this analysis information obtains, this relation information table by analyzing moving image and rest image Show the relation between moving image and rest image,

Two field picture extraction step, for according at least one in the information of analysis and relation information, determining by group will be from often The quantity of the two field picture extracted in width moving image, and extract the two field picture of quantification,

Layout determines step, for according at least one in the information of analysis and relation information, determining rest image by group With the layout of two field picture, and

Graphical arrangement step, for according to layout, by group arrangement rest image and two field picture.

Additionally, the invention provides a kind of non-transitory computer-readable medium, it is above-mentioned that its storage is used for making computer perform Manufacture the computer program of the image processing method of the layout of image.

The invention allows to produce and arrange rest image and most preferably according to the relation between moving image and rest image The arrangement data of two field picture, even and if when material data comprises the motion image data and Still image data that are mixed therein User is selected to expect the two field picture used from image without laborious.

Accompanying drawing explanation

Figure 1A to Fig. 1 C is for the classification according to the present invention and the view of two field picture extraction thought are described；

Fig. 2 is the block diagram of the structure example of the image processing apparatus illustrating the image processing method for realizing the present invention.

Fig. 3 is the flow chart of the example of the flow process of the image processing method illustrating the present invention.

Fig. 4 A is the view for classification example is described；Fig. 4 B is to achieve, for explanation, the classification example that two field picture extracts View.

Fig. 5 is the view of the example for the efficient layout relevant to same object is described.

Fig. 6 is to comprise both rest image and moving image and rest image and moving image height phase for explanation The view of the example closed.

Fig. 7 is the view of the example being extracted two field picture for explanation from moving image.

Fig. 8 is to comprise both rest image and moving image and rest image and moving image height phase for explanation The view of the example of the layout closed.

Fig. 9 is to comprise both rest image and moving image and rest image and moving image height phase for explanation The view of another example of the layout closed.

Figure 10 A and Figure 10 B is all to comprise both rest image and moving image and rest image and fortune for explanation The view of the example of the layout that motion video degree of correlation is low.

Figure 11 A to Figure 11 C is all regarding of the layout example for illustrating only to arrange the two field picture extracted from moving image Figure.

Figure 12 A is the view illustrating the example realizing the state before classification for explanation；Figure 12 B is to illustrate for explanation The view of the example of the state after realization classification；Figure 12 C is the view of the example having arranged image for explanation；Figure 12 D is For being described as follows the view of example: it illustrates the template example of the page having inputted restructuring directive for reconstruct.

Figure 13 is for explanation regarding from the example of the moving image and rest image extraction recommendation image being categorized into event Figure.

Figure 14 A is the view for illustrating to classify by similar Scene realization and determine and extract the example recommending image. Figure 14 B is the view realizing classifying and determining and extract the example recommending image for explanation for designated person.

Figure 15 is for the view at the layout example detected before face and end point is described.

Figure 16 is the view for illustrating to use the facial layout example realizing layout with end point.

Figure 17 A and Figure 17 B is for extraction being described and arranging the change shown on face direction in given directions The exemplary view of two field picture.

Figure 18 is for illustrating that another image of superposition is not to hide the view of the layout example of main object.

Figure 19 is to guarantee to be positioned on the facial direction of object, for explanation, the layout that given space do not exists other images to show Example view.

Figure 20 A is for illustrating to identify the face of target person but its eye is not towards the view of the layout example of camera； Figure 20 B is for illustrating that the eye of target person is towards camera and the view of the layout example observing smile.

Figure 21 is the view automatically extracting the example recommending image for explanation from moving image.

Figure 22 is the view for the layout example for shuffling printing (shuffle print) is described.

Figure 23 is to arrange optimal photo (shot) to show the layout example of movement for explanation in chronological sequence order View.

Figure 24 is the view of the example producing high-resolution two field picture for explanation from several two field pictures.

Figure 25 is the view of the example extracting the image illustrating given personage for explanation from the group of multiple image.

Figure 26 is the view of the example for registration and classification process are described.

Figure 27 is the view of another example for registration and classification process are described.

Figure 28 is the view for the layout example in photograph album is described.

Figure 29 is the view for another layout example in photograph album is described.

Figure 30 is the view of the example adding character for explanation in the margin region of photograph album.

Figure 31 is the example adding character for explanation in white space and the region in addition to the facial zone of photograph album View.

Figure 32 is the view of the example that the colouring information selection background template according to selected image is described.

Figure 33 is that the view for by the composition example of four width graphical arrangement template in a page is described.

Figure 34 is to illustrate how that the group that total number of images exceedes graphic based quantity is divided into more than two for explanation The view of example.

Figure 35 is for the line (boundary line) showing the result classifying the image as group with the benchmark quantity representing image is described The view of example screens.

Figure 36 is the view of the example images being classified into first group to the 5th group for explanation.

Figure 37 is to illustrate how only to consider the example that graphic based quantity extracts two field picture from moving image View.

Figure 38 A and Figure 38 B respectively shows how that the page quantity according to the photograph album specified by user increases the number of two field picture Measure and how to split the image shown in Figure 38 A and distribute to 7 pages.

Figure 39 is the view of the layout example amplifying and being positioned at page center for instruction sheet two field picture content.

Figure 40 is to illustrate how the quantity of two field picture increases to four and reduces the display chi of each image for explanation The view of very little example.

Figure 41 A to Figure 41 C be shown respectively comprise child and rabbit moving image, how before face moves and in face Portion moves and extracts the given area of the face comprising child afterwards as two field picture.

Figure 42 A explanation illustrates the rest image of child and rabbit.Figure 42 B be for explanation illustrate how from comprise child and The moving image of rabbit extracts and comprises the given area of child and rabbit (both belong to same group) respectively as two field picture.

Detailed description of the invention

Below based on the preferred embodiment detailed description shown in accompanying drawing for realizing the image processing method of the present invention The image processing apparatus of the present invention.

First, will describe with reference to Fig. 1 and be used for moving image and rest image being classified and carrying from moving image The method taking the present invention of two field picture.

Fig. 1 is for the classification according to the present invention and the view of two field picture extraction concept are described.First, when such as Figure 1A institute When showing the view data that input comprises moving image and rest image, by event or press shooting time as shown in Figure 1B to motion Image and rest image are classified.Then, the moving image often organized by group analysis and rest image, transported by analysis to obtain Motion video and rest image and the analysis information that obtains and the information about the relation between moving image and rest image.With After, the quantity of the two field picture to extract is determined from every width moving image according to analysis information and/or relation information, predetermined to extract The two field picture of quantity.In the example shown in Fig. 1 C, such as, from the moving image being categorized as first group, extract three width frame figures Picture；Two width two field pictures are extracted from the moving image being categorized as second group.Therefore, by believing according to the information of analysis and/or relation Breath extracts two field picture and extracts suitable two field picture.

Fig. 2 is the reality of the structure of the image processing apparatus of the present invention illustrating the image processing method for realizing the present invention Execute the block diagram of example.

Image processing apparatus 10 shown in Fig. 2 includes view data input block 12, image display 14, operating unit 16, scanner-recorder 18, image grouped element 19, image processor 20, layout determine unit 26 and graphical arrangement unit 28, with Above all connected by bus 30.Image processor 20 includes image dissector 22 and two field picture extractor 24.In this embodiment In, description is used for making the example of photograph album.

View data input block 12 has an external interface, and receive to be used for making photograph album motion image data and Still image data (moving image/Still image data).The view data being supplied to view data input block 12 is not had Body limits, and can be to include that user utilizes moving image/Still image data that digital camera or digital camera obtain And the various view data of the moving image/Still image data from network download.External interface includes USB (general serial Bus), storage card reader, CD and wired and WLAN (LAN).It is supplied to the figure of view data input block 12 As data are exported as material image data (moving image/Still image data).

Image display 14 shows the editing pictures of image procossing application program, the figure run in image processing apparatus 10 As being arranged the data of (such as, the arrangement image in photograph album), user perform the operation screen etc. of various operation.

There is provided operating unit 16 to perform the various operations of image processing apparatus 10.Operating unit 16 is not particularly restricted, And any one in various known operation device, such as, keyboard, mouse and touch panel can be used.

Scanner-recorder 18 records material image data (moving image/Still image data), the two field picture number inputted According to, rest image and the topology data of two field picture, the arrangement data etc. representing arrangement image.Scanner-recorder 18 can be such as DRAM (dynamic random access memory) and the semiconductor memory of flash memory or the magnetic recording of such as HDD (hard disk drive) Medium.

Material image data (the moving image/static that image grouped element 19 will be inputted according to specified criteria (event) View data) Classified into groups.Such as, specified criteria can be shooting time, the shooting obtained by GPS (global positioning system) Position etc., object towards direction or the movement of object.Classification results can be added to material image as classification information In data, and can use the form being provided separately in scanner-recorder 18 that classification results is managed.

Image dissector 22 includes static image analysis device 22a and movement image analysis device 22b.Image dissector 22 is carried out Analyze, the most all comprise moving image and rest image to determine often to organize, i.e. the most mixedly comprise moving image and static figure Picture.

Static image analysis device 22a is for the classified each group analysis Still image data of image grouped element 19, to obtain Can extract from moving image two field picture maximum quantity (hereinafter referred to as maximum can extract quantity), by analysis static Image and the analysis information that obtains and information (the hereinafter referred to as relation about the relation between moving image and rest image Information).Such as, maximum can extract quantity can be that the predetermined benchmark quantity by the image included in same group deducts quiet The only quantity of image and the quantity that obtains.

The benchmark quantity of the image included in same group is can be by the maximum quantity of the image of group arrangement.Such as when inciting somebody to action When the image often organized distributes to a page of photograph album, the benchmark quantity of image is can be arranged in a page of photograph album The maximum quantity of image.

Such as when using for the template by the layout (predetermined candidate layout) of graphical arrangement predeterminated position in the page Time, the benchmark quantity of image is the maximum quantity of the image that can use (arrangement) in this template.Such as when using Figure 33 institute During the template shown, can arrange four width images, therefore, the benchmark quantity of image is four.When using template, the base value of image Amount changes along with the template used.

On the other hand, when graphical arrangement optional position in the page is not used existing template (free surface jet) Time, image processing apparatus has contemplated that the convenience of viewing arranges the maximum quantity of the image can being arranged in one page wherein. Therefore, in the case of free surface jet, the benchmark quantity of image is default in image processing apparatus 10 " can be arranged in one The maximum quantity of the image in the page ".

Analysis information can be at least one in such as the following: the facial recognition result of object, face direction, right The quantity of elephant, the size of object, the position of object, object towards direction, the human facial expression recognition of object, shooting time, bat Act as regent put, the composition (composition) of entire image, end point, color, brightness, the vividness of entire image, the mark of personage Knowledge, shooting condition, the resolution of image, the aspect ratio of image and screening-mode.

Therefore, for relation information, representative value can be by comparing the analysis information about moving image and static The analysis information of image and the above-mentioned information that obtains are weighted and obtain, and representative value is 100 and lower limit is 0 in the upper limit In the range of.Alternatively, the information of analysis can be used as relation information.Composition is to represent that the landscape of personage, building, sky etc. is Example；Screening-mode with normal photographing mode, panorama photographing mode, feature (close-up) pattern and personage's screening-mode is Example.

Being similar to static image analysis device 22a, movement image analysis device 22b is classified respectively for image grouped element 19 Group analyzes motion image data, to obtain analysis information and relation information.Analysis information can also is that mobile detection information and Camera amount of movement (distant take the photograph, tilt).

Moving image that two field picture extractor 24 is obtained according to image dissector 22 and the analysis information of rest image and/ Or relation information, the amount of images (it can extract quantity less than maximum) to extract from moving image is determined by group, and Extract the two field picture of quantification.Such as, when extracting two field picture based on shooting time, make form as shown in table 1 in advance, And determine extraction quantity based on this form, to extract two field picture from moving image.Data (the frame of two field picture that will be extracted View data) it is stored in scanner-recorder 18.

Table 1

Such as when using " face direction ", the change in face direction can be remained fixed value and come instead of using table Lattice.Such as, when face direction changes more than 15 degree from given position, two field picture can be extracted.It addition, when based on shooting mould When formula extracts two field picture, if rest image is close-up image, then can extract the frame close to close-up image from moving image Image.

Two field picture extractor 24 can be according to about the imaging time (recovery time) in the analysis information of moving image, pass Image content in the analysis information of moving image and/or relation information, extraction two field picture from moving image, and without Consider the benchmark quantity of image.

When the sum of the rest image in group and two field picture exceedes the benchmark quantity of image, according to about rest image The analysis information of (including being extracted from image), extracts from the two field picture extracted and recommends two field picture (two field picture extracts Device 24 is judged as preferred two field picture) and it is less than the benchmark quantity of image.In such a case, it is possible to such as with by balloon score This mode giving the image giving the face that vast scale illustrates personage utilizes mark to define the level each in two field picture, and Can use and be given the two field picture of balloon score and be less than the benchmark quantity of image.

Alternatively, the group of the benchmark quantity that the total quantity of image can exceed image is divided into more than two.Assume After extracting two field picture by group from moving image, in the first to three group as shown in figure 34, rest image and two field picture Sum more than four (the benchmark quantity of image).It should be noted that and in Figure 34, two field picture is numbered.First group comprises altogether Eight width images；Second group comprises five width image altogether；3rd group comprises six width image altogether.In this case, first to In in three groups each group, the 5th and subsequent rest image and two field picture are divided into other groups.

Alternatively, user can consider that the benchmark quantity of image determines the frame that can extract from every width moving image The optional quantity of image.As shown in figure 35, screen shows the result dividing the image into group and the benchmark quantity representing image Line (boundary line).Such as, owing to the 3rd group comprises single moving image, therefore, it can at most extract four width two field pictures.Correspondingly, User can select the quantity of two field picture to be extracted from the scope of to four.

Alternatively, do not consider that the benchmark quantity of image is so that can carrying from five two field pictures selected above as user Peek amount, and when the total quantity of rest image in group and two field picture exceedes benchmark quantity, this group can be divided into two groups Above.

Two field picture extractor 24 can determine can carry from every width moving image according to the page quantity specified by user The quantity of the two field picture taken.

Such as assume that the image that user specifies use to be categorized into first group to the 5th group as shown in figure 36 makes and comprise seven The photograph album of the individual page.Moreover, it is assumed that the benchmark quantity of image is four.Then, when simply just considering the benchmark quantity of image, The page quantity of photograph album is five, this is because as shown in figure 37, extracts a width two field picture from first group of moving image, and from Second group of moving image extracts two width two field pictures.

Therefore, increase the quantity of the two field picture extracted from every width moving image according to the page quantity specified by user, Make such as to extract from first group of moving image two width two field pictures, and from second group of moving image, extract five width frame figures Picture, as shown in fig. 38 a.Then, as shown in fig. 38b, first group is divided into comprise two width two field pictures one group and comprises three width Another group of rest image, is divided into second group simultaneously and comprises two width rest images and one group of two width two field pictures and comprise Another group of three width two field pictures.Thus, photograph album has seven pages specified by user.

The page quantity that benchmark quantity according to image and user specify, can be suitably to appoint in admissible scope Meaning mode determines the quantity of the two field picture to extract from every width moving image and how to divide and comprise more than graphic based number The group of the amount of images of amount.

Layout determines that unit 26, based on analysis information and/or relation information, is determined the cloth of two field picture and rest image by group Office, and produce and output layout data.Such as, when photograph album to be made, by one page of every component dispensing, and based on dividing Analysis information and/or relation information determine page layout.Topology data is stored in scanner-recorder 18.

Graphical arrangement unit 28 reads frame image data and Still image data based on topology data from scanner-recorder 18, Arrange these images, and produce and export arrangement data.Arrangement data are stored in scanner-recorder 18.

It follows that description to be realized the operation of the image processing apparatus 10 of the present invention of the image processing method of the present invention.

Fig. 3 is the flow chart of the flow example of the image processing method illustrating the present invention.

First, the data (moving image/quiet of material moving image and rest image is inputted from view data input block 12 Only view data) (step S10).Using moving image/static diagram data of being inputted as material image data record at image In recorder 18 once.

Image grouped element 19 reads material image data (moving image/Still image data) from scanner-recorder 18, And according to specified criteria (event) by this material image data Classified into groups (step S12).

Such as, as shown in Figure 4 A, in the case of image being classified by shooting date, will be February 11 from 10:00 The width moving image and the six width rest images that photograph to 12:00 are categorized into first group；Will be on the same day from 12:00 to 15: The 00 two width rest images photographed and a width moving image are categorized into second group；To shoot from 15:00 to 17:00 on the same day To a width moving image be categorized into the 3rd group；By in the two width rest image classification photographed from 17:00 to 24:00 on the same day Become the 4th group；And the three width rest images photographed at second day are categorized into the 5th group.

It follows that image dissector 22 is classified groups of moving image/Still image data by group analysis, to determine it In whether be mixed with moving image and rest image (step S14).Respectively with the situation (step of hybrid motion image and rest image " mixing " in rapid S14), the situation (" only moving image " in step S14) that only comprises moving image and only comprise static Mode specific to the situation (" only rest image " in step S14) of image performs process.

In the example shown in Fig. 4 A, first group and second group comprises moving image and the rest image (step of mixing " mixing " in S14)；3rd group only comprises moving image (" only moving image " in step S14)；And the 4th group and Five groups only comprise rest image (" only rest image " in step S14).Correspondingly, process is performed independently for each group.

In the case of mixedly comprising moving image and rest image (" mixing " in step S14), rest image divides Parser 22a analyzes the Still image data included in this group, to obtain static image analysis information, and can be from motion with calculating The maximum quantity of the two field picture extracted in image.

It follows that movement image analysis device 22b analyzes the motion image data included in this group, to obtain about motion The analysis information of image.Static image analysis device 22a and/or movement image analysis device 22b compares their analysis information, to obtain Obtain relation information.It addition, by analysis information is weighted calculating the representative value of each relation information.

Subsequently, two field picture extractor 24 is based on the information of analysis and/or relation information, and determining will be from every width moving image Extract and can extract not over the maximum of two field picture the quantity of the two field picture of quantity, and extract the two field picture of predetermined quantity. Rest image and moving image included in same group (event) likely represent Same Scene, it is therefore preferred that extract Two field pictures different on the direction of object, scene, composition etc. from rest image as far as possible.

Such as, in the example shown in Fig. 4 B, premised on the maximum quantity of the image of first group is 8, analyze first group The Still image data of six width rest images, and first, the maximum quantity calculating two field picture is 2.At six width images all In the case of being shown without the front of object, it is thus achieved that there is not the analysis information of the image representing object front and lack representative The relation information of the image in object front.

Then, according to the relation information of the image lacking the direct picture representing object, according to the length of moving image, with The quantity (that is, the maximum of two field picture can extract quantity) being 2 to the maximum extracts the two field picture (step of direct picture representing object S16).Therefore, when moving image is long, extracts quantity and can extract the two field picture that quantity is identical with maximum, but when as in Fig. 4 B institute In the case of second group shown, the length of moving image is in short-term, according to the information of analysis and relation information (such as, scene quantity, inspection The number of times of the movement measured), in maximum can extract quantity, only extract three width images, therefore, in some cases it may extract The most only five width images including rest image.The analysis information about moving image can be carried in the two field picture extracted And relation information.

Can extract and represent Same Scene (composition) and same target but the object surface towards slightly different directions is shown Portion or the two field picture of health, so that when arranging these images, they will illustrate movement as shown in Figure 5.In possible situation Under illustrate that this arrangement of movement is efficient layout.

In another example, as in the case of second shown in Fig. 6 group, when rest image 40 illustrates personage A and transports When motion video 42 illustrates personage A, can illustrate with the personage A shown in rest image 40 not by advantage distillation from moving image 42 The two field picture of same personage A.Alternatively, it is possible to use positional information (such as, using the information of the acquisitions such as GPS) extracts and replaces Illustrate personage A image, consider camera site (shooting place) two field picture.Exist furthermore it is possible to extract with rest image 40 The two field picture of the upper different expression scene such as composition, color.

Alternatively, it may be considered that the resolution of image extracts two field picture.

When the width moving image included in group (such as, the 3rd shown in Fig. 6 group) only extracts a width two field picture Time, such as, obtained layout is layout as shown in figure 39, and wherein, a width two field picture is exaggerated and is positioned at the center of the page Place.In this case, when the two field picture extracted from moving image has high-resolution, any problem will not be caused.When Two field picture is the frame extracted from the low resolution moving image using camera function set such as portable phone to obtain During image, the printout produced from this portable phone will have poor picture quality.Therefore, when moving image, there is ratio Rest image included in resolution that given resolution is low and group and the sum of two field picture than to determined number little time, preferably Ground, is adjusted by the quantity increasing the two field picture to extract from moving image so that in view of the figure of printout Picture element amount, the display size of piece image is less than intended size.Such as, as shown in figure 40, when the quantity of two field picture is increased to When four, the size of each image reduces, and this necessarily improves the picture quality of obtained printout.

Alternatively, it may be considered that quantity and the size of target figure extract two field picture.

Even if such as comprising the size of the personage included in many personages or moving image in motion when moving image When only comprising the least during minority personage in image, if extracting a large amount of two field picture from moving image, then each image is aobvious Show that size is less, thus be difficult to personage.When being smaller in size than intended size of the personage included in moving image, preferably Ground, is adjusted by reducing the quantity of two field picture extracted from moving image so that with not less than intended size Size display personage, thus easily identify personage.

Alternatively, it may be considered that the aspect ratio of image extracts two field picture.

The aspect ratio of moving image (high is drawn according to the mode (vertically or horizontally) of such as fixed camera and screening-mode Matter 1920 × 1080；VGA 640 × 480) and change.Consequently, preferably increase vertical from have required for image layout The quantity of the two field picture extracted in the moving image of horizontal ratio, wants according to the condition reduction being used for making photograph album or electron album simultaneously The quantity of the two field picture extracted from other moving images.Such as when needing the two field picture in terms of many portraits, increase will be from The quantity of the two field picture that the moving image in terms of portrait extracts, reduces the frame figure to extract from the moving image in terms of landscape simultaneously The quantity of picture.

Alternatively, replace extracting the frame figure that size is corresponding with the whole region of moving image shown on screen Picture, it may be determined that the region of two field picture to be extracted, shown on screen moving image or a part, and can to really Fixed extracted region two field picture.

The face such as comprising child and rabbit and child when moving image carries out king-sized shifting as shown in figure 41 Time dynamic (that is, the direction of face changes bigger), the given area including the face of child can be defined as from moving image Extract the region of image so that extract include face mobile before child face, by the institute of the dotted line in Figure 41 B around give Region as two field picture 1, and extract include face mobile after child face, by the dotted line in Figure 41 C around to Determine region as two field picture 2.

When the rest image in such as same group as shown in Figure 42 A comprise child and rabbit and as shown in Figure 42 B same When moving image in group also includes child and rabbit, can be true by the given area each comprising the face of child and rabbit It is set to the region for extracting image from moving image, to extract the given area of the face including child and to include the face of rabbit The given area in portion (in Figure 42 B each given area all by dotted line around) as two field picture.

When the moving image completed from group extracts two field picture, by moving image and the representative of the relation information of two field picture Value compares (step S18) with the representative value of the relation information of rest image.When moving image and the relation information of two field picture And there is proximity relation (such as, the difference between their representative value less than positive 10 or bears 10) between the relation information of rest image Time when " there is relation " () in step S18, it is contemplated that this relation and determine layout, and output layout data.By cloth inning According to record in scanner-recorder 18 and in input picture arrangement units 28, wherein, by topology data and two field picture and static Image synthesizes, to produce and to export arrangement data (step S20).By the arrangement data record that exported at scanner-recorder 18 In.

In second group shown in that be given as examples, Fig. 7, by the relation information of rest image 44 and two field picture 46, The relation information of 48 and 50 compares, and when determine exist between rest image 44 and two field picture 46,48 and 50 close During relation, layout can be made as shown in Figure 8, wherein two field picture 46,48 and 50 can be arranged in big rest image 44 it Under.

In another layout example, layout can be that two field picture 58 is in chronological sequence arranged sequentially rest image 56 weeks Enclose, layout 54 as shown in Figure 9.

When relation between moving image and the relation information of two field picture and the relation information of rest image in step S18 When keeping off (such as, the difference between their representative value is more than positive 10 or bears 10) (" it doesn't matter " in step S18), output Topology data so that rest image 44 and two field picture 46,48 and 50 arrange simply and without consider relation information (as figure Shown in 10A), or the layout 64 that output rest image 44 is positioned in a page, simultaneously as layout 66, two field picture 46, 48 and 50 are arranged in another page (as shown in Figure 10 B).

By topology data record in scanner-recorder 18 and in input picture arrangement units 28, wherein, by cloth inning According to synthesizing to produce with two field picture and rest image and exporting arrangement data (step S22).The arrangement data record that will be exported In scanner-recorder 18.

In the case of judging " only moving image " in step S14, movement image analysis device 22b analyzes moving image Data, to obtain analysis information.Two field picture extractor 24 based on analyze information, extract quantity less than be first group predetermined The maximum optimum frame image (step S24) that can extract quantity.

Such as, the 3rd shown in Fig. 4 A group only comprises a width moving image, and movement image analysis device 22b analyzes motion View data is to obtain analysis information.Now, such as when user's input extracts the instruction of a width two field picture for a scene, And assuming that the 3rd group comprises the moving image that can be divided into six scenes by composition, then extract a frame of each scene.Cause And, as shown in Figure 4 B, extract six width two field pictures.

It is aligned to layout 68 (wherein, two field picture as shown in Figure 11 A with the two field picture that such as given interval is extracted 70 arrangements equably), and export the topology data of correspondence.When moving image comprises close-up section, may be made that following cloth Office 72, wherein with another width then, two field picture 74 (width represents the image reduced) represents that the graphical arrangement of amplification becomes and covers each other Lid, as shown in Figure 11 B.When the two field picture extracted illustrates child or similar object continuously, the frame figure that can will be extracted As 78 are arranged in its arrangement layout 76 in given directions.

In the case of making " it doesn't matter " judgement in step S18, by topology data record at scanner-recorder 18 In and input picture arrangement units 28 in, wherein, by the synthesis of topology data and two field picture to produce and to export arrangement data (step Rapid S22).By the arrangement data record of output in scanner-recorder 18.

When making " only rest image " in step S14 and judging, static image analysis device 22a analyzes Still image data To obtain analysis information.Layout determines that unit 26 produces and export rest image topology data based on static image analysis information. By topology data record in scanner-recorder 18 and in input picture arrangement units 28, wherein, by topology data with static Image synthesis is to produce and to export arrangement data (step S26).By the arrangement data record that exported in scanner-recorder 18.

It follows that with reference to Figure 12, we will be described in after having produced arrangement data and reconstruct the number of permutations according to user instruction According to situation.

There may be the arrangement of the such as photograph album that user wants reconstruct to be made by the image processing method of the present invention The situation of some pages of data.Now, we will consider following situation: such as, by the image of one group of image shown in Figure 12 A Data are categorized into the group shown in Figure 12 B, to be produced the number of permutations of the photograph album shown in Figure 12 C by the image processing method of the present invention According to.Assuming that multiple two field pictures that user wants autokinesis image in the future add in second page 80, then user is to operating unit 16 operate, to provide the restructuring directive of reconstruct second page 80.Thus, operating unit 16 exports restructuring directive.

Restructuring directive is inputted layout and determines unit 26 and (user selects cloth from this image display at image display 14 Office) upper show the most multiple layout candidates (template 82,84), and export for again extract be suitable for selected layout frame figure The instruction of picture.

To again extract in instruction incoming frame image extractor 24, and extract the two field picture being suitable for selected new layout, It is deposited with in image depositor 18 and in input picture arrangement units 28, to produce and to export reconstruction page (second page 80) arrangement data.By the arrangement data record of output in scanner-recorder 18.

The reconstruct of the page realizes not only by the stencil-chosen of user, and can realize by this way: User specifies the quantity of the two field picture to extract from moving image so that automatically carry out template choosing according to the quantity of two field picture Select.

Printer (not shown) print image processing means 10 produced arrangement data, and binding apparatus (not shown) The binding printed page, to make photograph album.

It follows that the image processing method of the present invention will be described with reference to a particular example.

Example 1

Figure 13 and Figure 14 illustrates and extracts the example recommending image by event (group).

First, as shown in figure 13, by moving image and rest image Classified into groups (event A, event B and event C).? In this case, from moving image, two field picture is extracted according to the information of analysis and/or relation information.

It follows that according to the information of analysis (such as, such as amount of images in event, the quantity of target figure, object Size, the brightness of whole image and the vividness of whole image), recommend image from being categorized in the middle of the image of event to extract.

In extracting the example recommending image, classify by the scene illustrating personage, and as shown in Figure 14 A, according to The size of the position center of image (whether towards) of the face of personage and face (proportional to whole image etc.) select recommendation Image.

It addition, as shown in Figure 14B, can extract as follows, wherein realize classification according to designated person, and Position, the size of his/her face, the facial expression such as smiled and the brightness (briliancy) of the face according to personage determine and push away Recommend image.

The recommendation image (two field picture or rest image) extracted be according to analysis information and/or with pushing away that other are extracted Recommend what the relation (that is, analyzing information and/or relation information according to corresponding) of image arranged.

Example 2

Figure 15 to Figure 19 is shown with facial and end point detection and realizes the example of layout.

As shown in figure 15, such as, rest image is that select from the image of Classified into groups and that be positioned at photograph album two Relatively launching the center of the page, two field picture is arranged in around rest image simultaneously.But, the layout shown in Figure 15 does not accounts for The content of image, thus facial direction 90 and the end point 92 in each width image is inconsistent, thus, layout differs generally Cause.

When the relation letter in the analysis information of facial direction, end point and the rest image and two field picture that use object When breath makes layout, obtained layout has the degree of depth in center, and based on end point 92 as shown in figure 16 and face Image, in view of the directivity of image, is centrally disposed image peripheral by direction 94.In such layout, with good balance Arrangement image.

In other examples, as shown in Figure 17 A and Figure 17 B, detection face from moving image, and use analysis information With the facial direction in relation information, the two field picture of the change in face direction is shown with extraction and the graphical arrangement extracted is existed On assigned direction.In such layout, image is aligned to illustrate the change in the facial direction of object.

In another example, as shown in figure 18, the main object 100 in group detected, and use analysis information and pass It is that in information, other images of superposition are carried out in the position of main object, not hide main object 100.In obtained layout, not Hide main object 100 and superposition image effectively.

It addition, as shown in figure 19, it is possible to use in analysis information and relation information, layout is made in the facial direction of object, Other images are not located in the space 102 on the facial direction 103 of object.In obtained layout, not figure Picture is close to the facial of object and locates in the direction, thus image does not results in sense of depression.

Example 3

Figure 20 to Figure 24 shows the example extracting two field picture from moving image.Example shown in Figure 20 to Figure 24 is shown Go out the situation extracting optimal two field picture.Unless otherwise described, otherwise after two field picture extracts, layout, and frame are i.e. completed Image is similar to the situation arrangement of example 1 and example 2.

When identify the face 104 of target person as shown in FIG. 20 A but its eye not towards camera time, they are not to manage most Think.Therefore, as shown in fig. 20b, moving image is analyzed to extract the smile 108,110 illustrating target person from which (wherein, Their eye is towards camera) two field picture, as optimal image.

In other examples, as shown in figure 21, from moving image, automatically extract recommendation two field picture (extract optimal figure Picture), as shown in figure 22, the optimal image extracted from moving image is randomly arranged in and shuffles in printing layout, and such as Shown in Figure 23, in chronological sequence order arranges optimal image, to illustrate movement.

It addition, as shown in figure 24, extract the two field picture of shooting at time A, B and C respectively, make similarity and judge with really Determine and the similarity of reference frame image (time A), and carry out image synthesis to produce single high-resolution from several two field pictures Image.

Example 4

Figure 25 to Figure 27 is shown in the classification in the case of existing about the change of the in chronological sequence order of same personage Example.

Such as can there is following situation: extract from great amount of images illustrate personage from his/her childhood through childhood to The image grown up.But, utilize current facial recognition techniques, be difficult to when the biggest change of face experience utilize the children at object During Nian shooting image and judge from childhood to the image of adult shooting；Such as, even if during registered baby Facial time, it is also difficult to the person recognition in the image that will shoot before childhood is same personage.Therefore, when as shown in figure 26 by quiet Only view data 116 uploads to personal computer 114 (hereinafter referred to as PC) from digital camera 112, and uses image procossing to answer When using Classified into groups, editing screen 118 is given outbound message 119, the most there is not the face that the face illustrated and register personage is identical The image in portion.

Although when together but still being given with registration figure picture with the personage uploaded to representated by the Still image data 116 in PC During message 119, newly register the personage represented by Still image data 116, identify that judgement processes with reconstruct.When the most another Outer registration personage facial time, do not occur mistake judgement and need not at present additionally register, and along with people grow up, the most occasionally You need to register the Still image data 120 of some images.When the feature of the face of people does not change too many after he/her grows up Time, it is not required that additionally register.

Therefore, even if when there is the change of in chronological sequence order of same personage, only during each growth of Registered Representative Some face-images of phase be enough to Classified into groups and there is not the probability of false judgment.

Example 5

Figure 28 and Figure 29 illustrates and utilizes rest image and two field picture carry out facial recognition and are automatically obtained the layout of image Example with arrangement.Image zooming-out is carried out: such as, as in the case of above-mentioned example 3, from carrying in following this mode Take from and the two field picture of moving image and rest image extracts optimal image.

As shown in figure 28, such as when photograph album to be made is as the present to the grand parents of grandson, layout to be made can With about grandson.When photograph album to be made is watched for kinsfolk, make layout so that the most equably Kinsfolk (father, mother and child) and landscape are shown.It addition, using the phase of the image of shooting during travelling with friend In Ce, the layout most probable of user includes the image illustrating user, simultaneously making photograph album as during to the present of friend, and user Layout most probable include the image that illustrates friend.

Example 6

Figure 30 and Figure 31 is shown with the extracted region on main object, sky and ground to determine showing of character synthesis region Example.Image zooming-out is carried out: be similar to above-mentioned example, from the frame extracting from moving image and rest image in following this mode Image extracts optimal image.

Figure 30 illustrates character adding situation on the margin region (i.e., wherein not comprising the region of image) of photograph album. On the other hand, Figure 31 is shown below situation: in photograph album left hand page, selects white space 122 in layout, and by character It is superimposed upon on white space 122.On the right on the page, layout selects facial zone 124, and character adding is not being had Have on the region of facial zone 124.

Therefore, character be positioned at the region as represented sky and ground or do not have personage face region in, with make Attracting photograph album.

Example 7

Figure 32 illustrates that the colouring information according to selected image (primary picture) selects the example of background template.With following this The mode of kind realizes image zooming-out: such as, be similar to above-mentioned example 3, from the two field picture extracting from moving image and rest image Extract optimal image.

Figure 32 is shown as the situation of the margin part designated color (background color, background template) of photograph album.When for photograph album During margin part designated color, from the page, first extract primary picture 126.Main object herein refers to centrally located And there is the image of big display size.

It follows that analyze primary picture 126 to make color with the most use to determine.In the example shown in Figure 32, background In blue sky represent the big region in primary picture 126, then extract such as " blue ".According to the color extracted (" blue ") determines background color (background image).When extracting such as " blue ", by more shallow than " blue " in primary picture Blue it is set to background color so that the sharpness of border between blue sky in margin region 128 and primary picture.Cause This, be set to background template by blue background color.

In the examples described above, employ color background, but the invention is not restricted to this；The background image that can will previously provide Or the image obtained by the image in process layout to be placed in is used as background image.

Thus, background color (background image) specific to each page is set and creates the print that image between the page is unified As such that it is able to make more attracting photograph album.

As it has been described above, the image processing apparatus of the present invention and image processing method make it possible to produce arrangement data, wherein, Relation according to the information of analysis with rest image arranges rest image and optimum frame image, even and if when material data (file) When comprising the motion image data and Still image data that are mixed therein, user is selected to want to make from image without laborious Two field picture.It addition, the image processing apparatus of the present invention and image processing method make it possible to according to arrangement data creating print Brush thing, photograph album or electron album.

Assuming that use the present invention to make printed article, the type of the output for making printed article is not limited to any mode, and And include such as silver halide photographic art and inkjet printing.It is possible not only to make printed article as a photo, and can be all As made printed article on the commodity of various cards, calendar, cup, T-shirt etc..

Although as premise, the two field picture extracted from moving image has the resolution identical with moving image and in length and breadth Ratio, but can be by synthesizing from multiple two field pictures of moving image to make layout, to make and to arrange panoramic picture also Produce corresponding arrangement data.

Institute's steps taken in above-mentioned image processing method can be disposed for make computer perform above-mentioned image show Show the image processing program of the step of method, or can institute's steps taken in above-mentioned image processing method is configured to as follows Image processing program: it can make computer be used as to perform the device of each step of image processing method or above-mentioned for constituting The device of the parts of image processing apparatus.

Furthermore it is possible to configure above-mentioned image procossing journey with the form of computer readable medium or computer-readable memory Sequence.

Although the image processing apparatus according to the present invention described in detail above, image processing method and program, but this Invention is not limited to above-described embodiment, and can carry out various amendment without departing from the spirit and scope of the present invention.

Claims (33)

1. for generating an image processing apparatus for image layout, comprising:

View data input block, for receiving moving pictures and the data of rest image,

Image grouped element, for the described moving image that described view data input block received according to specified criteria and Described rest image Classified into groups,

Image dissector, for the described moving image classified by group analysis and described rest image, and obtains analysis letter Breath and relation information, wherein, described analysis information obtains by analyzing described moving image and described rest image, Described relation information represents the relation between described moving image and described rest image,

Two field picture extractor, for according at least one in described analysis information and described relation information, determining by group will be from The quantity of the two field picture extracted in moving image described in every width, and extract the two field picture of quantification,

Layout determines unit, for according at least one in described analysis information and described relation information, determining described by group Rest image and the layout of the described two field picture by the extraction of described two field picture extractor, and

Graphical arrangement unit, for according to described layout, arranges described rest image and described two field picture by group.

Image processing apparatus the most according to claim 1, wherein, described specified criteria be shooting time, camera site and At least one in object.

Image processing apparatus the most according to claim 1, wherein, described relation information is for about described motion diagram The information that the analysis information of picture and the analysis information about described rest image compare.

Image processing apparatus the most according to claim 1, wherein, described relation information is described analysis information.

Image processing apparatus the most according to claim 1, wherein, described analysis information uses in the project including following item At least one: the facial recognition of subjects face, the quantity of object, the size of object, the position of object, object towards side To, the direction of subjects face, the identification of facial expression of object, the detection of movement, the shooting time of entire image, shooting position Put, composition, end point, color, brightness, the vividness of entire image, the mark of personage, camera amount of movement, shooting condition, image Resolution, the aspect ratio of image and screening-mode.

Image processing apparatus the most according to claim 3, wherein, described relation information also includes by about described fortune The representative value that each analysis information of motion video and described rest image is weighted and calculates, and wherein, to each described generation Tabular value compares, to judge whether there is relation between described two field picture and described rest image.

Image processing apparatus the most according to claim 1, wherein, described image dissector determines by from the benchmark of image Quantity deducts the quantity of the rest image in same group and the quantity that obtains, as the maximum number of the described two field picture that can extract Amount, wherein, the benchmark quantity of described image is can be by the maximum quantity of the image of group arrangement.

Image processing apparatus the most according to claim 1, wherein, described layout determines that unit selectes described two field picture on time Between sequencing be arranged in the layout around described rest image.

Image processing apparatus the most according to claim 5, wherein, described layout determines that unit is according to described at least two points Analysis information determines described rest image and the layout of described two field picture.

Image processing apparatus the most according to claim 1, wherein, described layout determines that unit selectes other rest images Or two field picture is arranged in the layout having around the rest image of the degree of depth or two field picture according to end point or image direction.

11. image processing apparatus according to claim 5, wherein, described two field picture extractor extracts and illustrates face direction The described two field picture how to change according to the direction of subjects face described in described analysis information and described relation information, and

Wherein, described layout determine unit selected wherein extracted show that the two field picture how face direction changes is arranged in Layout on assigned direction.

12. image processing apparatus according to claim 5, wherein, described layout determines that unit selectes following layout: other Rest image and two field picture be superimposed upon according to the object's position in described analysis information and described relation information comprise the most right On the described rest image of elephant or described two field picture, described in not hiding included in described rest image or described two field picture Main object.

13. image processing apparatus according to claim 12, wherein, described layout determines that unit selectes other rest images Layout with the given space that two field picture is not arranged on the facial direction being positioned at described main object.

14. image processing apparatus according to claim 1, wherein, described two field picture extractor is according to described analysis information The two field picture for showing movement is extracted with described relation information, and

Wherein, described layout determines that the in chronological sequence order arrangement of the selected two field picture wherein extracted of unit is with performance movement Layout.

15. image processing apparatus according to claim 1, wherein, described two field picture extractor extracts described two field picture, and And produce frame by combining the reference frame image in the two field picture extracted with the two field picture being similar to described reference frame image Image.

16. image processing apparatus according to claim 5, wherein, described image dissector is by institute in described rest image The face of the personage comprised compares with the face of the personage registering its image each representing formative year, with by described Character recognition and label included in rest image is the personage in described analysis information.

17. image processing apparatus according to claim 1, wherein, described layout includes background template, and

Wherein, described layout determines that unit is according to determining as the rest image of primary picture or the colouring information of two field picture Background template.

18. image processing apparatus according to claim 1, wherein, when user's input is to the restructuring directive of the given page, Described layout determines that unit reconstructs layout according to described restructuring directive in the described given page.

19. image processing apparatus according to claim 1, also include that recorder and display, described recorder are used for remembering Record described moving image and the data of described rest image, the data of described two field picture, the data of described layout and by described The data of the arrangement that graphical arrangement unit is carried out, and described display is for showing the result of described arrangement.

20. image processing apparatus according to claim 19, wherein, described group is multiple groups, and when extracting described frame During image, the extraction result of the plurality of group is simultaneously displayed on described display.

21. image processing apparatus according to claim 1, wherein, when described moving image has lower than given resolution Resolution and described group in each group in described rest image and described two field picture sum less than to determined number time, Described two field picture extractor is adjusted by the quantity increasing the two field picture to extract from described moving image so that one The display size of width image is less than intended size.

22. image processing apparatus according to claim 1, wherein, the chi of the personage included in described moving image Very little less than intended size time, be adjusted by reducing the quantity of two field picture extracted from described moving image so that with Described personage is shown not less than the size of intended size.

23. image processing apparatus according to claim 1, wherein, described two field picture extractor increases described from having The quantity of the two field picture extracted in the moving image of the aspect ratio required by layout, and reduce and to carry from other moving images The quantity of the two field picture taken.

24. image processing apparatus according to claim 1, wherein, described two field picture extractor determines and described motion diagram The region that the part of the display screen of picture is corresponding, and utilize the extracted region two field picture determined.

25. image processing apparatus according to claim 1, wherein, described two field picture extractor is according to described moving image Recovery time, the image content of described moving image and described relation information at least one, determining will be from described motion The quantity of the two field picture extracted in image.

26. image processing apparatus according to claim 25, wherein, the described static figure in each group in described group When the sum of picture and described two field picture exceedes the benchmark quantity of image, described two field picture extractor according to described analysis information, Two field picture, wherein, described figure is recommended less than extracting from the two field picture extracted in the range of the reference quantity of described image The benchmark quantity of picture is to be arranged in the maximum quantity of the image in each group in described group.

27. image processing apparatus according to claim 25, wherein, the described static figure in each group in described group When the sum of picture and described two field picture exceedes the benchmark quantity of image, described sum is exceeded described base by described two field picture extractor The group of quasi-quantity is divided into more than two, and wherein, the benchmark quantity of described image is each group can be arranged in described group In the maximum quantity of image.

28. image processing apparatus according to claim 1, wherein, described two field picture extractor is according to the base value of image Amount extracts the multiple described two field picture selected by user from described moving image, and wherein, the benchmark quantity of described image is permissible The maximum quantity of the image being arranged in each group of described group.

29. image processing apparatus according to claim 1, wherein, described two field picture extractor is from described moving image Extract multiple described two field picture selected by user, and when the described rest image in each group of described group and two field picture When quantity exceedes the benchmark quantity of image, sum is exceeded the group of described benchmark quantity and is divided into two groups by described two field picture extractor Above, wherein, the benchmark quantity of described image is to be arranged in the maximum quantity of the image in each group of described group.

30. image processing apparatus according to claim 1, wherein, described two field picture extractor is according to set by user Page quantity determines the quantity of two field picture to be extracted.

31. 1 kinds of printed article manufacturing systems, including:

Image processing apparatus described in claim 1, and

Printing equipment, for printing the data of the arrangement carried out by described graphical arrangement unit.

32. 1 kinds of photograph album manufacturing systems, including:

Image processing apparatus described in claim 1,

Printing equipment, for printing the data of the arrangement carried out by described graphical arrangement unit, and

Binding apparatus, for binding printed paper.

33. 1 kinds of image processing methods being used for generating image layout, including:

View data input step, for receiving moving pictures and the data of rest image,

Image packet step, for the described motion diagram that will receive in described view data input step according to specified criteria Picture and described rest image Classified into groups,

Image analysis step, for the described moving image classified by group analysis and described rest image, and obtains analysis Information and relation information, wherein, described analysis information is to obtain by analyzing described moving image and described rest image , described relation information represents the relation between described moving image and described rest image,

Two field picture extraction step, for according at least one in described analysis information and relation information, determining by group will be from often The quantity of the two field picture extracted in moving image described in width, and extract the two field picture of quantification,

Layout determines step, for according at least one in described analysis information and described relation information, determining described by group Rest image and the layout of described two field picture extracted in described two field picture extraction step, and

Graphical arrangement step, for according to described layout, arranges described rest image and described two field picture by group.