CN101216948A - Cartoon animation fabrication method based on video extracting and reusing - Google Patents
Cartoon animation fabrication method based on video extracting and reusing Download PDFInfo
- Publication number
- CN101216948A CN101216948A CNA2008100591415A CN200810059141A CN101216948A CN 101216948 A CN101216948 A CN 101216948A CN A2008100591415 A CNA2008100591415 A CN A2008100591415A CN 200810059141 A CN200810059141 A CN 200810059141A CN 101216948 A CN101216948 A CN 101216948A
- Authority
- CN
- China
- Prior art keywords
- frame
- cartoon
- role
- rightarrow
- profile
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 24
- 238000004519 manufacturing process Methods 0.000 title claims description 12
- 239000011159 matrix material Substances 0.000 claims abstract description 25
- 230000003287 optical effect Effects 0.000 claims abstract description 17
- 238000000605 extraction Methods 0.000 claims abstract description 10
- 239000000284 extract Substances 0.000 claims description 34
- 238000006073 displacement reaction Methods 0.000 claims description 25
- 239000000203 mixture Substances 0.000 claims description 7
- 239000013598 vector Substances 0.000 claims description 7
- 230000008878 coupling Effects 0.000 claims description 5
- 238000010168 coupling process Methods 0.000 claims description 5
- 238000005859 coupling reaction Methods 0.000 claims description 5
- 230000000295 complement effect Effects 0.000 claims description 4
- 238000001914 filtration Methods 0.000 claims description 4
- 230000011218 segmentation Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 18
- 230000007704 transition Effects 0.000 description 11
- 238000004040 coloring Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 210000000988 bone and bone Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000008034 disappearance Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
Images
Landscapes
- Image Analysis (AREA)
Abstract
The invention discloses a cartoon animation producing method based on video extraction and reuse. The invention comprises the following steps of: firstly dividing a cartoon video into cartoon frames; next, extracting cartoon roles via the foreground dividing technique based on the boundary; then, calculating the distance between any two frame roles and obtaining a distance matrix via using the role similarity on the boundary; then constructing an undirected graph via using the manifold learning arithmetic according to the obtained distance matrix; finally, appointing any two points in the undirected graph and establishing the shortest path between the two points which comprises the frames to form a smooth cartoon frame sequence. The method has the advantages of: effectively extracting the cartoon roles from the complex background via designing a foreground extraction technique based on boundary; making the similarity between roles more accurately by calculating the movement attribute of the roles in every frame via optical flow tracking technique; and constructing a cartoon data reuse platform to facilitate a user to produce cartoon animations conveniently and rapidly via manifold learning.
Description
Technical field
The present invention relates to two-dimensional cartoon animation field, relate in particular to a kind of cartoon animation fabrication method that extracts and reuse based on video.
Background technology
The cartoon field that has a wide range of applications comprises education, advertisement, amusement etc.Traditional cartoon is made and is divided into: the recording of plot design, detailed design, sound, key frame drafting, transition frames drafting, background drafting etc.The tradition animation is time and the work that the drafting of loaded down with trivial details manufacturing process, especially a transition frames need consume animation Normal University amount.
The auxiliary animation system of current computer wishes to draw transition frames automatically based on key frame, alleviate animation teacher's workload, promptly set up corresponding relation at the various piece of adjacent two key frames, and generate transition frames by interpolation based on this corresponding relation, generate the color of transition frames again according to the color of each several part in the key frame.
Set up the corresponding relation of adjacent two key frames.Because 2 dimension images itself are not structurized data, therefore need carry out structuring to it.Just belong to this method such as " the Computer AidedInbetweening " that delivered in the NPAR meeting in 2002, the algorithm that this article proposes based on level is unit with the stroke with key frame, and image is carried out structuring.At first the stroke on the role will be divided into some stroke groups based on its connectedness in the frame, afterwards for the stroke group in two width of cloth key frames according to comprising of existing between them, adjacent and hierarchical relationship makes up corresponding relation.And for example " the Feature matching and affine transformation for 2D cell animation " that deliver on Journal of Visual Computer proposed a kind of algorithm of setting up transition frames automatically nineteen ninety-five, this method is at first determined a pair of similar key frame, on key frame border separately, determine unique point simultaneously, neighborhood pixels around it will have more than three or three and belongs to the role, in the unique point of two frames, choose the unique point of some mutual couplings, and set up affine transformation matrix between them, it will be very approaching then using this transformation matrix to be out of shape the result and another frame that obtain at one of them, utilize interpolation to make up transition frames between the frame that former key frame and conversion obtain.
The transition frames that obtains by interpolation only has profile, and does not have colouring information, and is that the transition frames colouring is a loaded down with trivial details job.Automatic colouring algorithm at transition frames is proposed in " Computer-assisted coloring by matching line drawings " literary composition of delivering on the Journal of Visual Computer in 2000.At first carry out repair, provide numbering at large area region among the role then, and mate, then mate according to syntople with large area region for the zone that area is less at role's profile.
Often there are two difficult problems in the computer animation aided design system that obtains based on traditional animation process.Therefore and be not suitable for amateurish animation fan the one, the key frame in these class methods still need be by animation Shi Jinhang design; The 2nd, the quality of the transition frames that the mode of employing interpolation generates can not be guaranteed.
Summary of the invention
The object of the present invention is to provide a kind of cartoon animation fabrication method that extracts and reuse based on video.
May further comprise the steps:
(1) based on the half-tone information in the image, the gradient of every frame and detect role's profile in the computed image, and profile adopted the pixel filling algorithm to obtain role's silhouette and extract the role from animation frame;
(2) to every frame, adopt the movement properties of optical flow tracking algorithm computation present frame, comprise direction of motion and speed;
(3) calculate similarity on the two frame profiles based on the role's profile that extracts, set weights then and calculate two frames, make up distance matrix in movement properties and borderline distance;
(4) according to the distance matrix that calculates in the step (3), adopt manifold learning arithmetic that the cartoon character that extracts is projected to lower dimensional space and sets up non-directed graph, appoint in non-directed graph by the user then and get at 2 as starting point and terminal point and make up shortest path, the composition cartoon frame sequence on the path.
Described based on the half-tone information in the image, the gradient of every frame and detect role's profile in the computed image, and profile adopted the pixel filling algorithm to obtain role's silhouette and extract the role from animation frame: the basic ideas of extracting profile are to calculate the second derivative of each pixel on gray scale one by one, and can obtain by Laplacian ofGaussian wave filter (LOG) is approximate, when wherein certain second derivative on a bit was zero, then this point was decided to be the some on border; Extract to such an extent that still there is a part of noise in boundary image, the mode of need employing convolution is removed the noise in the image, and the formula of denoising is:
Wherein, A is the image array that has noise, and F then is the matrix that is used to filter, and 0≤i<Ma+4,0≤j<Na+4; Obtain role's closed outline after the filtration, then adopt the pixel filling algorithm, promptly in profile, choose a point as starting point, and the traversal of utilizing eight logical figure whole profile to be carried out depth-first, when running into the border, then stop traversal and return last layer, all points that traversed are all as the point on the prospect during end; In conjunction with original image with through regional gray level image of filling, the role can be split from original image.
Described movement properties to every frame employing optical flow tracking algorithm computation present frame comprises direction of motion and speed; Can obtain the prospect role I of adjacent two frames in the video by foreground segmentation
iAnd I
I+1, at first adopt geometric mean to calculate two roles' barycenter C
iAnd C
I+1, so the computing formula of the relative displacement between the role is:
The displacement of camera lens can calculate by optical flow tracking based on adjacent two frames in the cartoon video, in order to find frame I
iMiddle pixel (x
0, y
0) at frame I
I+1On the position, at I
I+1Pixel (x
0, y
0) design a foursquare zone on every side and search for, when the maximization of degree of correlation coupling, think then and found corresponding position that computing formula is:
Wherein, W
iAnd W
I+1Be frame I
iAnd I
I+1On the square area that is used to mate; Two pixels that are complementary of foundation can calculate the motion vector of pixel, by average all locations of pixels vectors, can obtain the displacement that the integral image displacement is a camera, and the computing machine formula is:
By relative displacement that merges the role and direction of motion and the speed that the camera displacement can obtain the role, computing formula is again:
Described role's profile based on extraction calculates the similarity on the two frame profiles, set weights then and calculate two frames in movement properties and borderline distance, make up distance matrix: the profile that at first contrasts any two roles calculates the similarity on the profile, and computing formula is:
Wherein, E
iAnd E
jBe frame I
iAnd I
jBorder set, and h (E
i, E
j) be the Hausdorff distance of calculating between two set, computing formula is:
Wherein, P
aAnd P
bBe I
iAnd I
jThe border on any 2 points, ‖ p
a-p
b‖ is the Euclidean distance between these 2; By the distance that gap on the merging movement properties and borderline gap are calculated two frames, computing formula is:
D(I
i,I
j)=αD
H(I
i,I
j)+(1-α)D
M(I
i,I
j) 8
α is as the weight that merges usefulness, D
G(I
i, I
j) represent two frames in borderline gap, and D
M(I
i, I
j) gap of expression two frames on movement properties, computing formula is:
The distance matrix that described foundation calculates, adopt manifold learning arithmetic that the cartoon character frame that extracts is projected to lower dimensional space and sets up non-directed graph, appoint in non-directed graph by the user then and get at 2 as starting point and terminal point and make up shortest path, composition cartoon frame sequence on the path: at first determine that according to distance matrix the length of side between a bit any and the some neighbours' nodes is a shortest path on every side, wherein the number of neighbours' node is to determine in advance, constructs non-directed graph thus; Calculate shortest path between any 2 based on this non-directed graph then, obtain shortest path figure; Adopt the MDS algorithm to make up lower dimensional space at last; After obtaining this lower dimensional space, in the space, specify arbitrarily at 2 as starting point and terminal point by the user, the point that shortest path comprised between 2 is as newly-generated animation frame.
The useful effect that the present invention has is: by the border of Laplacian of Gaussian wave filter extraction, effectively avoided the situation of profile lines fractures, filling algorithm after making can carry out smoothly, this role's extraction algorithm based on the border is compared with other algorithm, can be more stable, and complete extraction role.Extract the movable information of role in each frame by optical flow tracking, and merge similarity between can more accurate measurement frame mutually with the borderline Hausdorff of role distance.By the cartoon frame is projected to lower dimensional space, and by starting point and terminal point in the animation teacher designated space, the point between 2 on the shortest path is formed the animation frame sequence.This method can effectively utilize existing cartoon data to generate new animation sequence, and is applicable to the user that those do not have the cartoon making experience.
Description of drawings
Fig. 1 is based on the process flow diagram of the cartoon animation fabrication method that video extracts and reuse;
Fig. 2 (a) is the cartoon character synoptic diagram that the present invention uses;
Fig. 2 (b) is the cartoon character synoptic diagram by Boundary Detection;
Fig. 2 (c) is the cartoon character synoptic diagram that obtains by denoising;
Fig. 2 (d) is the complete role border synoptic diagram that extracts;
Fig. 2 (e) fills the role's silhouette synoptic diagram that obtains by the role;
Fig. 2 (f) is the role's synoptic diagram that extracts;
The original image i synoptic diagram that Fig. 3 (a) is to use;
The original image j synoptic diagram that Fig. 3 (b) is to use;
Fig. 3 (c) is the displacement diagram of role in prospect;
Fig. 3 (d) is by the optical flow computation result schematic diagram;
Fig. 3 (e) is an optical flow computation result schematic diagram of removing prospect;
Fig. 3 (f) is a result of calculation synoptic diagram of following the tracks of the angle point light stream;
Fig. 3 (g) is the synthetic synoptic diagram of prospect and background motion;
Fig. 3 (h) is the role movement synoptic diagram that obtains;
Fig. 4 is the synoptic diagram that makes up shortest path among the present invention;
Fig. 5 is the comparison diagram between dimensionality reduction and the residual error among the present invention;
Fig. 6 is the synoptic diagram that generates animation sequence among the present invention.
Embodiment
The cartoon animation fabrication method that extracts and reuse based on video may further comprise the steps:
(1) based on the half-tone information in the image, the gradient of every frame and detect role's profile in the computed image, and profile adopted the pixel filling algorithm to obtain role's silhouette and extract the role from animation frame;
(2) to every frame, adopt the movement properties of optical flow tracking algorithm computation present frame, comprise direction of motion and speed;
(3) calculate similarity on the two frame profiles based on the role's profile that extracts, set weights then and calculate two frames, make up distance matrix in movement properties and borderline distance;
(4) according to the distance matrix that calculates in the step (3), adopt manifold learning arithmetic that the cartoon character that extracts is projected to lower dimensional space and sets up non-directed graph, appoint in non-directed graph by the user then and get at 2 as starting point and terminal point and make up shortest path, the composition cartoon frame sequence on the path.
Described based on the half-tone information in the image, the gradient of every frame and detect role's profile in the computed image, and profile adopted the pixel filling algorithm to obtain role's silhouette and extract the role from animation frame: the basic ideas of extracting profile are to calculate the second derivative of each pixel on gray scale one by one, and can obtain by Laplacian ofGaussian wave filter (LOG) is approximate, when wherein certain second derivative on a bit was zero, then this point was decided to be the some (seeing Fig. 2 (b)) on border; Extract to such an extent that still there is a part of noise in boundary image, the mode of need employing convolution is removed the noise (denoising result is seen Fig. 2 (c)) in the image, and the formula of denoising is:
Wherein, A is the image array that has noise, and F then is the matrix that is used to filter, and 0≤i<Ma+4,0≤j<Na+4; Obtain role's closed outline (seeing Fig. 2 (d)) after the filtration, then adopt the pixel filling algorithm, promptly in profile, choose a point as starting point, and the traversal of utilizing eight logical figure whole profile to be carried out depth-first, when running into the border, then stop traversal and return last layer, all points that traversed are all as the point on the prospect (seeing Fig. 2 (e)) during end; In conjunction with original image with through regional gray level image of filling, the role can be split (seeing Fig. 2 (f)) from original image.
Described movement properties to every frame employing optical flow tracking algorithm computation present frame comprises direction of motion and speed; Can obtain the prospect role I of adjacent two frames in the video by foreground segmentation
i(seeing Fig. 3 (a)) and I
I+1(seeing Fig. 3 (b)) at first adopts geometric mean to calculate two roles' barycenter C
iAnd C
I+1, so the computing formula of the relative displacement between the role (seeing Fig. 3 (c)) is:
The displacement of camera lens can calculate by optical flow tracking based on adjacent two frames in the cartoon video, in order to find frame I
iMiddle pixel (x
0, y
0) at frame I
I+1On the position, at I
I+1Pixel (x
0, y
0) design a foursquare zone on every side and search for, when the maximization of degree of correlation coupling, think then and found corresponding position that computing formula is:
Wherein, W
iAnd W
I+1Be frame I
iAnd I
I+1On the square area that is used to mate; Can calculate the motion vector (seeing Fig. 3 (d)) of pixel according to two pixels that are complementary, by deducting the optical flow computation result's (seeing Fig. 3 (e)) on the foreground point, and the optical flow computation on the extraction angle point (seeing Fig. 3 (f)), the displacement that can obtain image background is the displacement of camera (seeing Fig. 3 (g)), and the computing machine formula is:
By relative displacement that merges the role and direction of motion and the speed that the camera displacement can obtain the role, computing formula is again:
Described role's profile based on extraction calculates the similarity on the two frame profiles, set weights then and calculate two frames in movement properties and borderline distance, make up distance matrix: the profile that at first contrasts any two roles calculates the similarity on the profile, and computing formula is:
Wherein, E
iAnd E
jBe frame I
iAnd I
jBorder set, and h (E
i, E
j) be the Hausdorff distance of calculating between two set, computing formula is:
Wherein, P
aAnd P
bBe I
iAnd I
jThe border on any 2 points, ‖ p
a-p
b‖ is the Euclidean distance between these 2; By the distance that gap on the merging movement properties and borderline gap are calculated two frames, computing formula is:
D(I
i,I
j)=αD
H(I
i,I
j)+(1-α)D
M(I
i,I
j) 8
α is as the weight that merges usefulness, D
G(I
i, I
j) represent two frames in borderline gap, and D
M(I
i, I
j) gap of expression two frames on movement properties, computing formula is:
The distance matrix that described foundation calculates, adopt manifold learning arithmetic that the cartoon character frame that extracts is projected to lower dimensional space and sets up non-directed graph, appoint in non-directed graph by the user then and get at 2 as starting point and terminal point and make up shortest path (as shown in Figure 4), composition cartoon frame sequence on the path: at first determine that according to distance matrix the length of side between a bit any and the some neighbours' nodes is a shortest path on every side, wherein the number of neighbours' node is to determine in advance, constructs non-directed graph thus; Calculate shortest path between any 2 based on this non-directed graph then, obtain shortest path figure; Adopt the MDS algorithm to make up lower dimensional space at last; After obtaining this lower dimensional space, in the space, specify arbitrarily at 2 as starting point and terminal point by the user, the point that shortest path comprised between 2 is as newly-generated animation frame.Utilizing dimensionality reduction to set up in the process of lower dimensional space, the very important point is the selection of dimension behind the dimensionality reduction, if dimension is excessive, then causes the redundancy of information, and if dimension is too small, then cause the disappearance of information to influence the generation of animation sequence.Fig. 5 has provided a kind of method of judging dimension and has promptly judged by the variation of analyzing residual component, when residual component is not too many when changing, then is suitable dimension.
So far, extract by the role, distance calculation, lower dimensional space is set up and the user specifies these steps, and reusable existing cartoon data are set up new cartoon sequence.
Embodiment
The most famous in the homemade cartoon is the serial cartoon that is the theme of Journey to the West, comprise " creating a tremendous uproar ", " three dozens of White Bone Demons " etc., yet pass away along with the older generation is artistical, at present be difficult to produce and had the works of identical style with these classical cartoons.Reuse the step that frame in these cartoons obtains new animation sequence below in conjunction with foregoing concrete technical scheme, as follows:
(1) utilize previously described based on the half-tone information in the image, the gradient of every frame and detect role's profile in the computed image, and adopt the pixel filling algorithm to obtain role's silhouette to profile.Specifically, basic ideas for the profile of cartoon frame extraction arbitrarily are to calculate the second derivative of each pixel on gray scale one by one, and can obtain by Laplacian of Gaussian wave filter (LOG) is approximate, when wherein certain second derivative on a bit was zero, then this point was decided to be the some on border; Extract to such an extent that still there is a part of noise in boundary image, the mode of need employing convolution is removed the noise in the image, and the formula of denoising is:
Wherein, A is the image array that has noise, and F then is the matrix that is used to filter, and 0≤i<Ma+4,0≤j<Na+4; Obtain role's closed outline after the filtration, then adopt the pixel filling algorithm, promptly in profile, choose a point as starting point, and the traversal of utilizing eight logical figure whole profile to be carried out depth-first, when running into the border, then stop traversal and return last layer, all points that traversed are all as the point on the prospect during end; In conjunction with original image with through regional gray level image of filling, the role can be split from original image.
(2) movement properties of employing optical flow tracking algorithm computation present frame in every frame comprises direction of motion and speed; Can obtain the prospect role I of adjacent two frames in the video by foreground segmentation
iAnd I
I+1, at first adopt geometric mean to calculate two roles' barycenter C
iAnd C
I+1, so the computing formula of the relative displacement between the role is:
The displacement of camera lens can calculate by optical flow tracking based on adjacent two frames in the cartoon video, in order to find frame I
iMiddle pixel (x
0, y
0) at frame I
I+1On the position, at I
I+1Pixel (x
0, y
0) design a foursquare zone on every side and search for, when the maximization of degree of correlation coupling, think then and found corresponding position that computing formula is:
Wherein, W
iAnd W
I+1Be frame I
iAnd I
I+1On the square area that is used to mate; Two pixels that are complementary of foundation can calculate the motion vector of pixel, by average all locations of pixels vectors, can obtain the displacement that the integral image displacement is a camera, and the computing machine formula is:
By relative displacement that merges the role and direction of motion and the speed that the camera displacement can obtain the role, computing formula is again:
(3) calculate similarity on the two frame profiles at the role's profile that extracts, set rational weights then and take all factors into consideration two frames and calculate distance between them, and make up distance matrix in movement properties and borderline difference; The profile that at first contrasts any two roles calculates the similarity on the profile, and computing formula is:
Wherein, E
iAnd E
jBe frame I
iAnd I
jBorder set, and h (E
i, E
j) be the Hausdorff distance of calculating between two set, computing formula is:
Wherein, P
aAnd P
bBe I
iAnd I
jThe border on any 2 points, ‖ p
a-p
b‖ is the Euclidean distance between these 2; By the distance that gap on the merging movement properties and borderline gap are calculated two frames, computing formula is:
D(I
i,I
j)=αD
H(I
i,I
j)+(1-α)D
M(I
i,I
j)
Wherein, α is as the weight that merges usefulness, D
G(I
i, I
j) represent two frames in borderline gap, and D
M(I
i, I
j) gap of expression two frames on movement properties, computing formula is:
(4) adopt manifold learning arithmetic Isomap to make up lower dimensional space, at first according to the distance matrix that calculates, determine each node neighbouring node on every side, and set up undirected connected graph, because these sample points are on the stream shape, therefore any 2 distance can be that 2 shortest paths on stream shape calculate by geodesic distance, adopts the MDS algorithm to make up lower dimensional space at last; After obtaining this lower dimensional space, in the space, specify arbitrarily at 2 as starting point and terminal point by the user, the point that shortest path comprised between 2 is as newly-generated animation frame.
In the present embodiment, reuse existing animation frame, obtain level and smooth animation sequence by above step.Accompanying drawing 6 has shown the effect of a frame wherein.Among the figure two row is the animation sequence that reconstruct obtains, and following numbering is represented original frame number.
Claims (5)
1. cartoon animation fabrication method that extracts and reuse based on video is characterized in that may further comprise the steps:
(1) based on the half-tone information in the image, the gradient of every frame and detect role's profile in the computed image, and profile adopted the pixel filling algorithm to obtain role's silhouette and extract the role from animation frame;
(2) to every frame, adopt the movement properties of optical flow tracking algorithm computation present frame, comprise direction of motion and speed;
(3) calculate similarity on the two frame profiles based on the role's profile that extracts, set weights then and calculate two frames, make up distance matrix in movement properties and borderline distance;
(4) according to the distance matrix that calculates in the step (3), adopt manifold learning arithmetic that the cartoon character that extracts is projected to lower dimensional space and sets up non-directed graph, appoint in non-directed graph by the user then and get at 2 as starting point and terminal point and make up shortest path, the composition cartoon frame sequence on the path.
2. a kind of cartoon animation fabrication method that extracts and reuse based on video according to claim 1, it is characterized in that, described based on the half-tone information in the image, the gradient of every frame and detect role's profile in the computed image, and profile adopted the pixel filling algorithm to obtain role's silhouette and extract the role from animation frame: the basic ideas of extracting profile are to calculate the second derivative of each pixel on gray scale one by one, and can obtain by Laplacian of Gaussian wave filter (LOG) is approximate, when wherein certain second derivative on a bit was zero, then this point was decided to be the some on border; Extract to such an extent that still there is a part of noise in boundary image, the mode of need employing convolution is removed the noise in the image, and the formula of denoising is:
Wherein, A is the image array that has noise, and F then is the matrix that is used to filter, and 0≤i<Ma+4,0≤j<Na+4; Obtain role's closed outline after the filtration, then adopt the pixel filling algorithm, promptly in profile, choose a point as starting point, and the traversal of utilizing eight logical figure whole profile to be carried out depth-first, when running into the border, then stop traversal and return last layer, all points that traversed are all as the point on the prospect during end; In conjunction with original image with through regional gray level image of filling, the role can be split from original image.
3. a kind of cartoon animation fabrication method that extracts and reuse based on video according to claim 1 is characterized in that, described movement properties to every frame employing optical flow tracking algorithm computation present frame comprises direction of motion and speed; Can obtain the prospect role I of adjacent two frames in the video by foreground segmentation
iAnd I
I+1, at first adopt geometric mean to calculate two roles' barycenter C
iAnd C
I+1, so the computing formula of the relative displacement between the role is:
The displacement of camera lens can calculate by optical flow tracking based on adjacent two frames in the cartoon video, in order to find frame I
iMiddle pixel (x
0, y
0) at frame I
I+1On the position, at I
I+1Pixel (x
0, y
0) design a foursquare zone on every side and search for, when the maximization of degree of correlation coupling, think then and found corresponding position that computing formula is:
Wherein, W
iAnd W
I+1Be frame I
iAnd I
I+1On the square area that is used to mate; Two pixels that are complementary of foundation can calculate the motion vector of pixel, by average all locations of pixels vectors, can obtain the displacement that the integral image displacement is a camera, and the computing machine formula is:
By relative displacement that merges the role and direction of motion and the speed that the camera displacement can obtain the role, computing formula is again:
4. a kind of cartoon animation fabrication method that extracts and reuse based on video according to claim 1, it is characterized in that, described role's profile based on extraction calculates the similarity on the two frame profiles, set weights then and calculate two frames in movement properties and borderline distance, make up distance matrix: the profile that at first contrasts any two roles calculates the similarity on the profile, and computing formula is:
Wherein, E
iAnd E
jBe frame I
iAnd I
jBorder set, and h (E
i, E
j) be the Hausdorff distance of calculating between two set, computing formula is:
Wherein, P
aAnd P
bBe I
iAnd I
jThe border on any 2 points, ‖ p
a-p
b‖ is the Euclidean distance between these 2; By the distance that gap on the merging movement properties and borderline gap are calculated two frames, computing formula is:
D(I
i,I
j)=αD
H(I
i,I
j)+(1-α)D
M(I
i,I
j) 8
α is as the weight that merges usefulness, DG (I
i, I
j) represent two frames in borderline gap, and D
M(I
i, I
j) gap of expression two frames on movement properties, computing formula is:
5. a kind of cartoon animation fabrication method that extracts and reuse based on video according to claim 1, it is characterized in that, the distance matrix that described foundation calculates, adopt manifold learning arithmetic that the cartoon character frame that extracts is projected to lower dimensional space and sets up non-directed graph, appoint in non-directed graph by the user then and get at 2 as starting point and terminal point and make up shortest path, composition cartoon frame sequence on the path: at first determine that according to distance matrix the length of side between a bit any and the some neighbours' nodes is a shortest path on every side, wherein the number of neighbours' node is to determine in advance, constructs non-directed graph thus; Calculate shortest path between any 2 based on this non-directed graph then, obtain shortest path figure; Adopt the MDS algorithm to make up lower dimensional space at last; After obtaining this lower dimensional space, in the space, specify arbitrarily at 2 as starting point and terminal point by the user, the point that shortest path comprised between 2 is as newly-generated animation frame.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200810059141A CN100583158C (en) | 2008-01-14 | 2008-01-14 | Cartoon animation fabrication method based on video extracting and reusing |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN200810059141A CN100583158C (en) | 2008-01-14 | 2008-01-14 | Cartoon animation fabrication method based on video extracting and reusing |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101216948A true CN101216948A (en) | 2008-07-09 |
CN100583158C CN100583158C (en) | 2010-01-20 |
Family
ID=39623376
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN200810059141A Expired - Fee Related CN100583158C (en) | 2008-01-14 | 2008-01-14 | Cartoon animation fabrication method based on video extracting and reusing |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN100583158C (en) |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101799927A (en) * | 2010-03-23 | 2010-08-11 | 浙江大学 | Cartoon role contour tracing method based on key frame |
CN101807290A (en) * | 2010-03-26 | 2010-08-18 | 浙江大学 | Two-dimensional cartoon character deformation method |
CN101308576B (en) * | 2008-07-11 | 2011-04-06 | 北京中星微电子有限公司 | Motion direction detecting method and apparatus in road |
CN102129707A (en) * | 2011-02-28 | 2011-07-20 | 浙江大学 | Heterogeneous feature dimension reduction-based two-dimensional role cartoon generation method |
CN101436310B (en) * | 2008-11-28 | 2012-04-18 | 牡丹江新闻传媒集团有限公司 | Method for automatically generating middle frame during two-dimension cartoon making process |
CN101854466B (en) * | 2010-05-13 | 2012-05-30 | 北京英泰智软件技术发展有限公司 | Moving area detection method and device |
CN102542551A (en) * | 2010-12-13 | 2012-07-04 | 北京师范大学 | Automatic change detection technology for floating ice at edges of polar ice sheets |
CN102798383A (en) * | 2012-07-10 | 2012-11-28 | 中联重科股份有限公司 | Method, device and system for measuring tension of screen mesh of vibrating screen |
CN103021009A (en) * | 2012-12-14 | 2013-04-03 | 大连大学 | Motion diagram transition point selecting method based on nonlinearity manifold learning |
CN101676955B (en) * | 2008-09-19 | 2013-05-08 | 国际商业机器公司 | Method and device for transforming between dynamic diagram sequences shown by cartoons |
CN106971414A (en) * | 2017-03-10 | 2017-07-21 | 江西省杜达菲科技有限责任公司 | A kind of three-dimensional animation generation method based on deep-cycle neural network algorithm |
CN110930455A (en) * | 2019-11-29 | 2020-03-27 | 深圳市优必选科技股份有限公司 | Positioning method, positioning device, terminal equipment and storage medium |
CN111221598A (en) * | 2018-11-23 | 2020-06-02 | 北京金山云网络技术有限公司 | Method and device for dynamically displaying image and terminal equipment |
CN113516738A (en) * | 2020-04-09 | 2021-10-19 | 上海米哈游天命科技有限公司 | Animation processing method and device, storage medium and electronic equipment |
CN115618155A (en) * | 2022-12-20 | 2023-01-17 | 成都泰盟软件有限公司 | Method and device for generating animation, computer equipment and storage medium |
CN116886996A (en) * | 2023-09-06 | 2023-10-13 | 浙江富控创联技术有限公司 | Digital village multimedia display screen broadcasting system |
-
2008
- 2008-01-14 CN CN200810059141A patent/CN100583158C/en not_active Expired - Fee Related
Cited By (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101308576B (en) * | 2008-07-11 | 2011-04-06 | 北京中星微电子有限公司 | Motion direction detecting method and apparatus in road |
CN101676955B (en) * | 2008-09-19 | 2013-05-08 | 国际商业机器公司 | Method and device for transforming between dynamic diagram sequences shown by cartoons |
CN101436310B (en) * | 2008-11-28 | 2012-04-18 | 牡丹江新闻传媒集团有限公司 | Method for automatically generating middle frame during two-dimension cartoon making process |
CN101799927A (en) * | 2010-03-23 | 2010-08-11 | 浙江大学 | Cartoon role contour tracing method based on key frame |
CN101799927B (en) * | 2010-03-23 | 2012-05-09 | 浙江大学 | Cartoon role contour tracing method based on key frame |
CN101807290A (en) * | 2010-03-26 | 2010-08-18 | 浙江大学 | Two-dimensional cartoon character deformation method |
CN101854466B (en) * | 2010-05-13 | 2012-05-30 | 北京英泰智软件技术发展有限公司 | Moving area detection method and device |
CN102542551A (en) * | 2010-12-13 | 2012-07-04 | 北京师范大学 | Automatic change detection technology for floating ice at edges of polar ice sheets |
CN102542551B (en) * | 2010-12-13 | 2015-08-12 | 北京师范大学 | Automatic change detection technology for floating ice at edges of polar ice sheets |
CN102129707A (en) * | 2011-02-28 | 2011-07-20 | 浙江大学 | Heterogeneous feature dimension reduction-based two-dimensional role cartoon generation method |
CN102798383A (en) * | 2012-07-10 | 2012-11-28 | 中联重科股份有限公司 | Method, device and system for measuring tension of screen mesh of vibrating screen |
CN103021009A (en) * | 2012-12-14 | 2013-04-03 | 大连大学 | Motion diagram transition point selecting method based on nonlinearity manifold learning |
CN106971414A (en) * | 2017-03-10 | 2017-07-21 | 江西省杜达菲科技有限责任公司 | A kind of three-dimensional animation generation method based on deep-cycle neural network algorithm |
CN106971414B (en) * | 2017-03-10 | 2021-02-23 | 华东交通大学 | Three-dimensional animation generation method based on deep cycle neural network algorithm |
CN111221598A (en) * | 2018-11-23 | 2020-06-02 | 北京金山云网络技术有限公司 | Method and device for dynamically displaying image and terminal equipment |
CN111221598B (en) * | 2018-11-23 | 2023-09-15 | 北京金山云网络技术有限公司 | Method, device and terminal equipment for dynamically displaying image |
CN110930455A (en) * | 2019-11-29 | 2020-03-27 | 深圳市优必选科技股份有限公司 | Positioning method, positioning device, terminal equipment and storage medium |
CN110930455B (en) * | 2019-11-29 | 2023-12-29 | 深圳市优必选科技股份有限公司 | Positioning method, positioning device, terminal equipment and storage medium |
CN113516738A (en) * | 2020-04-09 | 2021-10-19 | 上海米哈游天命科技有限公司 | Animation processing method and device, storage medium and electronic equipment |
CN113516738B (en) * | 2020-04-09 | 2022-12-02 | 上海米哈游天命科技有限公司 | Animation processing method and device, storage medium and electronic equipment |
CN115618155A (en) * | 2022-12-20 | 2023-01-17 | 成都泰盟软件有限公司 | Method and device for generating animation, computer equipment and storage medium |
CN115618155B (en) * | 2022-12-20 | 2023-03-10 | 成都泰盟软件有限公司 | Method and device for generating animation, computer equipment and storage medium |
CN116886996A (en) * | 2023-09-06 | 2023-10-13 | 浙江富控创联技术有限公司 | Digital village multimedia display screen broadcasting system |
CN116886996B (en) * | 2023-09-06 | 2023-12-01 | 浙江富控创联技术有限公司 | Digital village multimedia display screen broadcasting system |
Also Published As
Publication number | Publication date |
---|---|
CN100583158C (en) | 2010-01-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN100583158C (en) | Cartoon animation fabrication method based on video extracting and reusing | |
CN103003846B (en) | Articulation region display device, joint area detecting device, joint area degree of membership calculation element, pass nodular region affiliation degree calculation element and joint area display packing | |
CN106780592A (en) | Kinect depth reconstruction algorithms based on camera motion and image light and shade | |
CN103871076A (en) | Moving object extraction method based on optical flow method and superpixel division | |
CN110189339A (en) | The active profile of depth map auxiliary scratches drawing method and system | |
CN105631932B (en) | A kind of three-dimensional model reconfiguration of contour line guidance makes method | |
Zhang et al. | Critical regularizations for neural surface reconstruction in the wild | |
CN102509333A (en) | Action-capture-data-driving-based two-dimensional cartoon expression animation production method | |
CN101329768B (en) | Method for synthesizing cartoon based on background view | |
CN104123747A (en) | Method and system for multimode touch three-dimensional modeling | |
CN103826032A (en) | Depth map post-processing method | |
CN110310351A (en) | A kind of 3 D human body skeleton cartoon automatic generation method based on sketch | |
CN108665530A (en) | Three-dimensional modeling implementation method based on single picture | |
CN107680154A (en) | Voxel geometric parameter extracting method based on view | |
Hu et al. | Geometric feature enhanced line segment extraction from large-scale point clouds with hierarchical topological optimization | |
CN102005061A (en) | Method for reusing cartoons based on layering/hole-filling | |
CN107424122A (en) | The image interpolation method that deformation aids under a kind of big displacement | |
Salzmann et al. | Physically valid shape parameterization for monocular 3-D deformable surface tracking | |
CN101504768B (en) | Color image fast partition method based on deformation contour model and graph cut | |
CN104517299A (en) | Method for restoring and resimulating physical video fluid driving model | |
Ghosh et al. | Evolving bayesian graph for three-dimensional vehicle model building from video | |
Wu et al. | Web based chinese calligraphy learning with 3-d visualization method | |
Shi et al. | Are all point clouds suitable for completion? weakly supervised quality evaluation network for point cloud completion | |
Liu et al. | 3D human pose and shape estimation from video | |
Shi et al. | Usr: Unsupervised separated 3d garment and human reconstruction via geometry and semantic consistency |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
C17 | Cessation of patent right | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100120 Termination date: 20140114 |