CN110012238A - Multimedia joining method, device, terminal and storage medium - Google Patents
Multimedia joining method, device, terminal and storage medium Download PDFInfo
- Publication number
- CN110012238A CN110012238A CN201910207603.1A CN201910207603A CN110012238A CN 110012238 A CN110012238 A CN 110012238A CN 201910207603 A CN201910207603 A CN 201910207603A CN 110012238 A CN110012238 A CN 110012238A
- Authority
- CN
- China
- Prior art keywords
- medium data
- segment
- spliced
- transition
- multimedia
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The embodiment of the invention discloses a kind of multimedia joining method, device, terminal and storage mediums, wherein method includes: to obtain multimedia collections to be spliced, it include at least two multi-medium datas in multimedia collections, multi-medium data includes initial segment, ending segment and segment to be spliced；At least two multi-medium datas in multimedia collections are arranged, multiple ordered sets are obtained；Calculate the splicing rationality metric of each ordered set of multiple ordered sets；The splicing rationality metric of multiple ordered sets is met into the ordered set of preset condition as goal ordering set；The segment to be spliced of each multi-medium data is spliced according to putting in order for the multi-medium data in goal ordering set；Preferably splicing multimedia data, raising it can splice the splicing rationality of obtained multi-medium data.
Description
Technical field
The present invention relates to field of computer technology more particularly to a kind of multimedia joining method, device, terminal and storage to be situated between
Matter.
Background technique
Multi-medium data is the synthesis of media data, generally comprises the medias shape such as text, sound and image
Formula.In the broadcasting application of multi-medium data, usually there are some broadcasting scenes and need excellent in multiple multi-medium datas
Fragment assembly gets up to form new multi-medium data.By taking multi-medium data is music as an example, usually in music album, musical string
Burning, music list etc. play under scene, need the wonderful in more songs to be stitched together to form new music, for
Family plays.In realizing process of the present invention, inventor has found the prior art, and there are the following problems, and most splicing is dependent on song
Bent label carries out splicing or designs connecting method by music speciality personnel.Therefore, it how preferably, seamlessly, smoothly spells
Connecing multi-medium data becomes research hotspot.
Summary of the invention
The embodiment of the invention provides a kind of multimedia joining method, device, terminal and storage mediums, can preferably splice
Multi-medium data improves the splicing rationality for the multi-medium data that splicing obtains.
On the one hand, the embodiment of the invention provides a kind of multimedia joining methods, comprising:
Multimedia collections to be spliced are obtained, include at least two multi-medium datas in the multimedia collections, it is described more
Media data includes initial segment, ending segment and segment to be spliced；
At least two multi-medium datas in the multimedia collections are arranged, obtain multiple ordered sets, arbitrarily
The difference that puts in order of multi-medium data in two ordered sets；
Calculate the splicing rationality metric of each ordered set of the multiple ordered set, each described sequence
The splicing rationality metric of set be according to the initial segment of multi-medium data adjacent in ordered set and ending segment it
Between similarity calculation obtain；
The ordered set that the splicing rationality metric of the multiple ordered set meets preset condition is arranged as target
Ordered sets；
According to putting in order to each multi-medium data wait spell for the multi-medium data in the goal ordering set
Tab segments are spliced.
On the other hand, the embodiment of the invention provides a kind of multimedia splicing apparatus, comprising:
Acquiring unit includes more than at least two matchmakers in the multimedia collections for obtaining multimedia collections to be spliced
Volume data, the multi-medium data include initial segment, ending segment and segment to be spliced；
Arrangement units obtain multiple for arranging at least two multi-medium datas in the multimedia collections
Ordered set, the difference that puts in order of the multi-medium data in any two ordered set；
Computing unit, the splicing rationality metric of each ordered set for calculating the multiple ordered set,
The splicing rationality metric of each ordered set is the initial sheets according to multi-medium data adjacent in ordered set
Similarity calculation between section and ending segment obtains；
Concatenation unit meets the sequence collection of preset condition for the splicing rationality metric by the multiple ordered set
Cooperation is goal ordering set；
The concatenation unit is also used to putting in order to described according to the multi-medium data in the goal ordering set
The segment to be spliced of each multi-medium data is spliced.
In another aspect, the embodiment of the present invention provides a kind of intelligent terminal, including processor, input equipment, output equipment and
Memory, the processor, input equipment, output equipment and memory are connected with each other, wherein the memory is based on storing
Calculation machine program, the computer program include program instruction, and the processor is configured for calling described program instruction, are executed
Following steps:
Multimedia collections to be spliced are obtained, include at least two multi-medium datas in the multimedia collections, it is described more
Media data includes initial segment, ending segment and segment to be spliced；
At least two multi-medium datas in the multimedia collections are arranged, obtain multiple ordered sets, arbitrarily
The difference that puts in order of multi-medium data in two ordered sets；
Calculate the splicing rationality metric of each ordered set of the multiple ordered set, each described sequence
The splicing rationality metric of set be according to the initial segment of multi-medium data adjacent in ordered set and ending segment it
Between similarity calculation obtain；
The ordered set that the splicing rationality metric of the multiple ordered set meets preset condition is arranged as target
Ordered sets；
According to putting in order to each multi-medium data wait spell for the multi-medium data in the goal ordering set
Tab segments are spliced.
In another aspect, the embodiment of the present invention provides a kind of computer storage medium, which is stored with meter
Calculation machine program instruction, the computer program instructions are performed for realizing above-mentioned multimedia joining method.
Multiple ordered sets corresponding to the available multimedia collections of the embodiment of the present invention, and according in multimedia collections
Each multi-medium data initial segment and ending the multiple ordered sets of fragment computations splicing rationality metric.According to each more
The splicing rationality metric that the initial segment and ending fragment computations of media data go out, can reflect each to a certain extent
The splicing rationality between segment to be spliced in multi-medium data.Goal ordering collection is chosen according to splicing rationality metric
It closes, and the segment to be spliced of each multi-medium data is spliced according to putting in order for goal ordering set, can to spell
The multi-medium data connect is more smooth, natural, smooth, improves user experience.
Detailed description of the invention
Technical solution in order to illustrate the embodiments of the present invention more clearly, below will be to needed in embodiment description
Attached drawing is briefly described, it should be apparent that, drawings in the following description are some embodiments of the invention, general for this field
For logical technical staff, without creative efforts, it is also possible to obtain other drawings based on these drawings.
Fig. 1 a is a kind of splicing schematic diagram of multimedia joining method provided in an embodiment of the present invention；
Fig. 1 b is a kind of application scenario diagram of multimedia joining method provided in an embodiment of the present invention；
Fig. 2 is a kind of flow diagram of multimedia joining method provided in an embodiment of the present invention；
Fig. 3 is a kind of structural schematic diagram of multi-medium data provided in an embodiment of the present invention；
Fig. 4 be another embodiment of the present invention provides a kind of multimedia joining method flow diagram；
Fig. 5 is the structural schematic diagram of another multi-medium data provided in an embodiment of the present invention；
Fig. 6 is a kind of schematic diagram of similarity calculating method provided in an embodiment of the present invention；
Fig. 7 is a kind of structural schematic diagram of transition multi-medium data provided in an embodiment of the present invention；
Fig. 8 is a kind of method schematic diagram of multimedia insertion provided in an embodiment of the present invention；
Fig. 9 is a kind of structural schematic diagram of multimedia splicing apparatus provided in an embodiment of the present invention；
Figure 10 is a kind of structural schematic diagram of intelligent terminal provided in an embodiment of the present invention.
Specific embodiment
It in embodiments of the present invention, include more than at least two in the multimedia collections for multimedia collections to be spliced
Media data, multi-medium data herein may include music and/or video, provide a kind of multimedia joining method to realize pair
Segment to be spliced in multiple multi-medium datas is spliced, the multi-medium data spliced, i.e. the multimedia number of the splicing
It may include the segment to be spliced of each multi-medium data in the multimedia collections in.Wherein, segment to be spliced can be
Refer to the segment being labeled to the Highlights in multi-medium data, the duration of the segment to be spliced in each multi-medium data can
With identical, can also be different；So-called Highlights may include at least one of following: clicking rate is highest in multi-medium data
Partially, the most part, etc. of frequency of occurrence in multi-medium data；For example, the total duration of multi-medium data A is 50 seconds, wherein
The frequency of occurrence of part between 30th second to the 40th second is most, then Highlights are the 30th second to the 40th second, then to the essence
Color part is labeled obtained segment to be spliced by the 30th second segment constituted by the 40th second in multi-medium data A.
When user plays multi-medium data under the application scenarios such as multimedia album, multimedia skewered or multimedia list, terminal
The multi-medium data of the splicing can be played, for user so that user appreciates the Highlights in each multi-medium data.
For example, including 4 multi-medium datas in multimedia data collection, it is respectively: multi-medium data 1, multimedia number
According to 2, multi-medium data 3 and multi-medium data 4, the segment to be spliced of 4 multi-medium datas in the multimedia collections is distinguished
It is: segment 1, segment to be spliced 2, segment to be spliced 3 and segment to be spliced 4 to be spliced.Terminal can be spliced using multimedia
Method carries out splicing to the segment to be spliced of this 4 multi-medium datas, the multi-medium data spliced, the splicing it is more
It include segment 1, segment to be spliced 2, segment to be spliced 3 and segment to be spliced 4 to be spliced in media data, such as Fig. 1 a institute
Show.User can click multimedia application in " multimedia skewered " menu, terminal detect user clicking operation it
Afterwards, the multi-medium data of the splicing can be played for user, as shown in Figure 1 b.
Based on the description above, the embodiment of the present invention proposes a kind of exemplary flow of multimedia joining method in Fig. 2
Figure.The method of the embodiment of the present invention can be realized by a terminal, such as the intelligent movables such as smart phone, tablet computer
Terminal and desktop computer etc. can also realize by running application program in the terminal, such as run in the terminal more
Play-back application of media, etc..For ease of description, the embodiment of the present invention executes the multimedia joining method with terminal and is
Example.
Terminal can obtain multimedia collections to be spliced when carrying out multimedia splicing in S201, the multimedia collection
It include at least two multi-medium datas in conjunction, which includes initial segment, ending segment and segment to be spliced；To
Splice segment can be located between initial segment and ending segment.Wherein, segment to be spliced refers to excellent in multi-medium data
The segment that part is labeled；Initial segment refer in multi-medium data be located at segment to be spliced before and with segment phase to be spliced
Adjacent or intersection segment；Ending segment refers to after segment to be spliced and adjacent with segment to be spliced in multi-medium data
Or the segment of intersection.By initial segment and ending segment intersect with segment to be spliced for, in multi-medium data A the 30th
It is the Highlights of multi-medium data A second by the 50th second, then segment to be spliced is the segment between the 30th second to the 50th second, just
Beginning segment can be the segment between the 25th second to the 35th second, and ending segment can be the segment between the 45th second to the 55th second,
As shown in Figure 3.
When obtaining multimedia collections to be spliced, for any one multi-medium data to be spliced, can mark first
Outpour the segment to be spliced of multi-medium data to be spliced.Secondly, can be determined respectively according to segment to be spliced to be spliced
The initial segment and ending segment of multi-medium data.It is then possible to which initial segment, segment to be spliced and ending piece will be determined
The multi-medium data to be spliced of section is added to multimedia collections to be spliced.In one embodiment, it can will determine
The multi-medium data to be spliced of initial segment, segment to be spliced and the segment that ends up is added directly to multimedia collection to be spliced
It closes, i.e., initial sheets can be comprised more than by the multi-medium data in the obtained multimedia collections to be spliced of the embodiment
Section, ending segment and segment to be spliced, can also include other segments, such as shown in Fig. 3 between 0th second to the 25th second
Segment between segment and the 55th second to the 60th second.In another embodiment, multimedia to be spliced can also be intercepted out
The initial segment of data, segment to be spliced and ending segment, using these three segments intercepted out as a multi-medium data
It is added in multimedia collections to be spliced, that is, passes through more matchmakers in the obtained multimedia collections to be spliced of the embodiment
Volume data only includes initial segment, ending segment and segment to be spliced.
It, can be in S202 to more than at least two in multimedia collections after getting multimedia collections to be spliced
Media data is arranged, and multiple ordered sets are obtained, and the multi-medium data in any two ordered set puts in order not
Together.Specifically, terminal is after getting multimedia collections, it can be to each multi-medium data in multimedia collections according to difference
Splicing sequence arranged, obtain multiple ordered sets；Arrangement herein can be random alignment, or fully intermeshing,
The embodiment of the present invention is not construed as limiting this.By taking fully intermeshing as an example, a total of 3 multi-medium datas in multimedia collections are respectively:
Multi-medium data a, multi-medium data b and multi-medium data c, then to 3 multi-medium datas according to different splicing sequences
Carry out fully intermeshing, available multiple ordered sets as shown in Table 1.
Table 1
After obtaining multiple ordered sets, each ordered set of multiple ordered sets can be calculated in S203
Splice rationality metric, the splicing rationality metric of each ordered set is according to multimedia adjacent in ordered set
Similarity calculation between the initial segment and ending segment of data obtains；So-called splicing rationality metric be one can be anti-
Reflect ordered set splicing sequence whether reasonable metric, splicing sequence whether rationally can be according to adjacent in ordered set
The segment to be spliced of multi-medium data embodied to user's bring vision difference or hearing difference.Adjacent multimedia number
According to segment to be spliced in playing process to user's bring vision difference or hearing difference it is smaller, the spelling of the ordered set
It is more reasonable to connect sequence.For example, the adjacent multi-medium data in ordered set 1 in table 1 includes multi-medium data a and multimedia
Segment to be spliced in data b, multi-medium data a is the classical music of slow rhythm, and the segment to be spliced of multi-medium data b is also
The classical music of slow rhythm, then to be spliced of the segment to be spliced and multi-medium data b that play in order multi-medium data a
It is smaller to user's bring hearing difference during section, at this time it is considered that the splicing sequence of the ordered set 1 is reasonable；For another example
Adjacent multi-medium data in table 1 in ordered set 5 includes multi-medium data c and multi-medium data a, multi-medium data c's
Segment to be spliced is allegro hip-hop music, and the segment to be spliced of multi-medium data a is the classical music of slow rhythm, then
It plays in order during the segment to be spliced of multi-medium data c and the segment to be spliced of multi-medium data a to user's bring
Hearing difference is larger, at this time it is considered that the splicing sequence of the ordered set 5 is unreasonable.
After the splicing rationality metric of multiple ordered sets is calculated, multiple sequences can be collected in S204
The splicing rationality metric of conjunction meets the ordered set of preset condition as goal ordering set.In one embodiment,
The splicing rationality metric of multiple ordered sets is met into the ordered set of preset condition as the specific of goal ordering set
Embodiment may is that determines maximum splicing rationality metric from the splicing rationality metric of multiple ordered sets；It will
Ordered set corresponding to maximum splicing rationality metric in multiple ordered sets is as goal ordering set.Another reality
It applies in mode, the splicing rationality metric of multiple ordered sets is met into the ordered set of preset condition as goal ordering collection
The specific embodiment of conjunction, which may is that, compares the splicing rationality metric of each ordered set and default rationality threshold value
Compared with；Rationality metric will be spliced and be greater than the ordered set of default rationality metric as candidate ordered set；From multiple times
A candidate ordered set is arbitrarily chosen in gather ordered sets as goal ordering set.
It, can be in S205 according to the multi-medium data in goal ordering set after determining goal ordering set
It puts in order and the segment to be spliced of each multi-medium data is spliced.The segment to be spliced of each multi-medium data is spelled
It connects, the multi-medium data of an available splicing.In one embodiment, if splicing multi-medium data in adjacent two
The similarity of a segment to be spliced is smaller, then terminal can also obtain transition multi-medium data, and transition multi-medium data is inserted into
To between lesser two segments to be spliced of similarity, to improve the remarkable fluency degree of the multi-medium data of splicing.Terminal is being examined
After measuring multimedia instruction, the multi-medium data of the splicing can be played for user.
Multiple ordered sets corresponding to the available multimedia collections of the embodiment of the present invention, and according in multimedia collections
Each multi-medium data initial segment and ending the multiple ordered sets of fragment computations splicing rationality metric.According to each more
The splicing rationality metric that the initial segment and ending fragment computations of media data go out, can reflect each to a certain extent
The splicing rationality between segment to be spliced in multi-medium data.Goal ordering collection is chosen according to splicing rationality metric
It closes, and the segment to be spliced of each multi-medium data is spliced according to putting in order for goal ordering set, can to spell
The multi-medium data connect is more smooth, natural, smooth, improves user experience.
In further embodiment, the embodiment of the present invention proposes the signal stream of another multimedia joining method in Fig. 4
Cheng Tu.The method of the embodiment of the present invention can be realized by a terminal, such as the mobile intelligence such as smart phone, tablet computer
Energy terminal and desktop computer etc., can also be realized, such as run in the terminal by running application program in the terminal
Multimedia play-back application, etc..For ease of description, the embodiment of the present invention executes the multimedia joining method with terminal
For.
Terminal can obtain multimedia collections to be spliced when carrying out multimedia splicing in S401, the multimedia collection
It include at least two multi-medium datas in conjunction, which includes initial segment, ending segment and segment to be spliced, to
Splice segment is located between initial segment and ending segment.During obtaining multimedia collections to be spliced: it is possible, firstly, to
Multi-medium data to be spliced is obtained, which includes segment to be spliced；The segment to be spliced can be
In advance multi-medium data to be spliced is labeled to obtain by professional mark personnel, is also possible to be obtained by terminal to be spliced
Multi-medium data in meet the part of mark condition and the part for meeting mark condition be labeled to obtain, mark herein
Condition can include but is not limited to: the most part, etc. of the highest part of clicking rate, frequency of occurrence.
Secondly, at the beginning of available preset time match parameter (being indicated with E) and segment to be spliced and tying
The beam moment；The time match parameter is one for carrying out the parameter of segment processing, time to multi-medium data to be spliced
The value of match parameter can be arranged based on experience value, such as E value is 10 seconds.Then according to start time, finish time and
Time match parameter determines the initial segment and ending segment of multi-medium data to be spliced；And it will determine initial segment, knot
The multi-medium data to be spliced of cauda section and segment to be spliced is added to multimedia collections to be spliced.
In one embodiment, if initial segment is to be located at segment to be spliced before and the piece adjacent with segment to be spliced
Section, ending segment be located at segment to be spliced after and the segment adjacent with segment to be spliced, then according to start time, at the end of
It carves and time match parameter, the specific embodiment of the initial segment and ending segment that determine multi-medium data to be spliced can be with
Be: choosing segment of the duration equal to time match parameter forward at the beginning of segment to be spliced as initial segment, to
The finish time of splice segment chooses segment of the duration equal to time match parameter as ending segment backward.Another embodiment party
In formula, if initial segment is segment intersect before the segment to be spliced and with segment to be spliced, ending segment be positioned to
The segment intersected after splice segment and with segment to be spliced, then according to start time, finish time and time match parameter, really
The initial segment of fixed multi-medium data to be spliced and the specific embodiment of ending segment may is that opening in segment to be spliced
Moment beginning chooses forward segment of the duration equal to time match parameter as the first sub-piece, and at the beginning of segment to be spliced
It carves and chooses segment of the duration equal to time match parameter backward as the second sub-piece, using the first sub-piece and the second sub-piece
Construct initial segment；Segment of the duration equal to time match parameter is chosen forward as third in the finish time of segment to be spliced
Sub-piece, and segment of the duration equal to time match parameter is chosen backward as the 4th sub-pieces in the finish time of segment to be spliced
Section, using third sub-piece and the 4th sub-piece building ending segment.For example, in multi-medium data to be spliced, from time C
The segment constituted to time D is segment F to be spliced, and time match parameter is E, then constituted from time C-E to time C
Segment G is the first sub-piece, and the segment H constituted from time C to time C+E is the second sub-piece, the first sub-piece and second
Sub-piece constitutes initial segment；The segment I constituted from time D-E to time D is third sub-piece, from time D to time D+E
The segment J constituted is the 4th sub-piece, and third sub-piece and the 4th sub-piece constitute ending segment, as shown in Figure 5.
After getting multimedia collections to be spliced, terminal can be in S402 at least two in multimedia collections
A multi-medium data is arranged, and multiple ordered sets are obtained.And each sequence of multiple ordered sets is calculated in S403
The splicing rationality metric of the splicing rationality metric of set, each ordered set is according to adjacent in ordered set
Similarity calculation between the initial segment and ending segment of multi-medium data obtains.It include with reference to sequence in multiple ordered sets
Set, this is with reference to any one ordered set that ordered set is in multiple ordered sets；Correspondingly, terminal is calculating multiple rows
It, can be according to multi-medium data each in reference ordered set when the splicing rationality metric of each ordered set of ordered sets
Initial segment and ending segment, calculate with reference to the similarity between the adjacent multi-medium data in ordered set.With reference to row
The similarity between adjacent multi-medium data in ordered sets includes: the knot with reference to the first multi-medium data in ordered set
Similarity between cauda section and the initial segment of the second multi-medium data, the first multi-medium data and the second multi-medium data exist
With reference to be in ordered set it is adjacent, i.e. the first multi-medium data and the second multi-medium data may make up adjacent multimedia number
According to；Seek referring to the sum of similarity between all adjacent multi-medium datas in ordered set as with reference to ordered set
Splice rationality metric.In other embodiments, it if business demand includes the multi-medium data of loop play splicing, is counting
The last one multimedia when calculating the splicing rationality metric of each ordered set of multiple ordered sets, in ordered set
Data and first multi-medium data are defined as adjacent multi-medium data, i.e. the splicing rationality metric packet of ordered set
Include the similarity between the last one multi-medium data and first multi-medium data.
In one embodiment, in the ending segment for calculating the first multi-medium data in adjacent multi-medium data and
When similarity between the initial segment of the second multi-medium data, adjacent more matchmakers can be first calculated using eigenmatrix algorithm
The eigenvectors matrix of the ending segment of the first multi-medium data in volume data and the initial segment of the second multi-medium data
Eigenvectors matrix, eigenmatrix algorithm herein can include but is not limited to: the videos such as Fourier transformation, constant Q transform
Convert machine learning algorithms such as audio frequency characteristics algorithm, the neural networks such as algorithm, mel cepstrum coefficients, etc..Then using similar
The initial segment of the eigenvectors matrix and the second multi-medium data of the ending segment of degree algorithm the first multi-medium data of calculating
Similarity between eigenvectors matrix, using the similarity being calculated as the ending segment of the first multi-medium data and second
Similarity between the initial segment of multi-medium data, similarity algorithm herein can include but is not limited to: cosine similarity
Machine learning algorithms such as algorithm, Euclidean distance algorithm, neural network, etc..For ease of description, mentioned by the embodiment of the present invention
Similarity can indicate that and B meets B>0 and B<1 with B.
In another embodiment, the initial segment of multi-medium data may include the first sub-piece and the second sub-piece,
Second sub-piece is the segment of the segment to be spliced of multi-medium data and the initial segment intersection of multi-medium data, multi-medium data
Ending segment include third sub-piece and the 4th sub-piece, third sub-piece be multi-medium data segment to be spliced and more matchmakers
The segment of the ending segment intersection of volume data.Correspondingly, the ending segment and second multi-medium data of the first multi-medium data
Similarity between initial segment is obtained according to the first similarity and the second similarity calculation；Wherein, the first similarity is
The similarity of first sub-piece of the third sub-piece and the second multi-medium data of the first multi-medium data, the second similarity are the
The similarity of second sub-piece of the 4th sub-piece and the second multi-medium data of one multi-medium data.So, adjacent in calculating
Multi-medium data in the ending segment of the first multi-medium data and the initial segment of the second multi-medium data between it is similar
When spending, the eigenvectors matrix and the 4th of the third sub-piece of the first multi-medium data can be calculated using eigenmatrix algorithm
The eigenvectors matrix and the second sub-piece of first sub-piece of the eigenvectors matrix of sub-piece and the second multi-medium data
Eigenvectors matrix；The eigenvectors matrix and the of the third sub-piece of the first multi-medium data is calculated using similarity algorithm
Of the first similarity and the first multi-medium data between the eigenvectors matrix of first sub-piece of two multi-medium datas
The second phase between the eigenvectors matrix of four sub-pieces and the eigenvectors matrix of the second sub-piece of the second multi-medium data
Like degree；Seek the sum of the first similarity and the second similarity ending segment and the second multimedia number as the first multi-medium data
According to initial segment between similarity.
As shown in fig. 6, indicate the first multi-medium data with K, then the feature of the third sub-piece of the first multi-medium data to
Moment matrix can be expressed as K.I, and the eigenvectors matrix of the 4th sub-piece can be expressed as K.J；The second multimedia number is indicated with L
According to, then the eigenvectors matrix of the first sub-piece of the second multi-medium data can be expressed as L.G, the feature of the second sub-piece to
Moment matrix can be expressed as L.H；So the first similarity can be expressed as B (K.I, L.G), and the second similarity can be expressed as B
(K.J, L.H), similarity M between the ending segment of the first multi-medium data and the initial segment of the second multi-medium data can be with
It indicates are as follows: M=B (K.I, L.G)+B (K.J, L.H).
After the splicing rationality metric of multiple ordered sets is calculated, multiple sequences can be collected in S404
The splicing rationality metric of conjunction meets the ordered set of preset condition as goal ordering set.Terminal can be according to multiple rows
The splicing rationality metric of ordered sets is chosen the maximum ordered set of splicing rationality metric from multiple ordered sets and is made
For goal ordering set.Then judge in S405 in goal ordering set with the presence or absence of adjacent third multi-medium data and the
Similarity between four multi-medium datas is less than preset threshold, which can based on experience value or practical business demand
Setting, such as preset threshold are set as 0.5.It should be noted that the first multi-medium data and third multi-medium data can be
The same multi-medium data, the second multi-medium data and the 4th multi-medium data can be the same multi-medium data.For example, if
Similarity between first multi-medium data and the second multi-medium data is less than preset threshold, then the first multi-medium data at this time
Identical as third multi-medium data, the second multi-medium data is identical as the 4th multi-medium data.
Practice have shown that if the similarity between adjacent third multi-medium data and the 4th multi-medium data is less than default threshold
Value, then illustrate similitude between the ending segment of the third multi-medium data and the initial segment of the 4th multi-medium data compared with
Low, i.e. remarkable fluency degree is lower.If at this time by the segment to be spliced of third multi-medium data and the 4th multi-medium data wait spell
Tab segments direct splicing can then bring biggish hearing difference or vision difference to user, cause user experience poor.Therefore
Available target transition multi-medium data is inserted between third multi-medium data and the 4th multi-medium data, to improve smoothness
Naturalness；If the similarity between adjacent third multi-medium data and the 4th multi-medium data is not less than preset threshold, say
Similitude between the ending segment of the bright third multi-medium data and the initial segment of the 4th multi-medium data is higher, i.e., smooth
Naturalness is higher, at this time can be directly by be spliced of the segment to be spliced of third multi-medium data and the 4th multi-medium data
Duan Jinhang splicing.
Therefore, and if it exists, target transition multi-medium data is then obtained in S406, and according to target transition multi-medium data
The segment to be spliced of each multi-medium data is spliced with putting in order for the multi-medium data of goal ordering set.If not depositing
Then according to be spliced to put in order to each multi-medium data of the multi-medium data in goal ordering set in S407
Duan Jinhang splicing.Specifically, can putting in order each multi-medium data according to the multi-medium data of goal ordering set
Segment to be spliced is spliced.
Wherein, the specific embodiment for target transition multi-medium data being obtained in step S406 may include following steps s11-
S14:
S11 obtains transition multimedia collections, includes at least two transition multi-medium datas in the transition multimedia collections,
Transition multi-medium data includes transition segment.In one embodiment, transition multi-medium data, which may also include, starts segment and knot
Beam segment.Wherein, starting segment can be before the transition segment and intersect with transition segment or adjacent segment, end piece
Section can be after the transition segment and intersect with transition segment or adjacent segment.
It is possible, firstly, to mark out the transition segment of transition multi-medium data；Secondly, can be determined respectively according to transition segment
The beginning segment and end fragment of transition multi-medium data out.In one embodiment, if starting segment is to be located at transition plate
Before section and the segment adjacent with transition segment, end fragment are to be located at transition segment later and the piece adjacent with transition segment
Section then determines that the beginning segment of transition multi-medium data and the specific embodiment of end fragment may is that according to transition segment
Preset time match duration (being indicated with e) is obtained, which is one for carrying out to transition multi-medium data
The value of the duration of segment processing, time match duration can be arranged based on experience value, such as e value is 10 seconds；In transition plate
Section at the beginning of choose forward duration equal to time match duration segment as start segment, transition segment at the end of
It carves and chooses segment of the duration equal to time match duration backward as end fragment.
In another embodiment, if starting segment is the segment intersected before transition segment and with transition segment,
End fragment is the segment intersected after transition segment and with transition segment, then determines transition multimedia according to transition segment
The beginning segment of data and the specific embodiment of end fragment, which may is that, obtains preset time match duration；In transition plate
Segment of the duration equal to time match duration is chosen at the beginning of section forward as the first matching segment, and in transition segment
Start time choose backward duration equal to time match duration segment as second matching segment, using first matching segment and
Second matching segment building starts segment；The piece that duration is equal to time match duration is chosen forward in the finish time of transition segment
Duan Zuowei third matches segment, and chooses duration backward in the finish time of transition segment and make equal to the segment of time match duration
For the 4th matching segment, segment is matched using third and the 4th matching segment constructs end fragment.For example, in transition multimedia number
In, the segment that is constituted from time e to time end-e is transition segment O, when time match a length of e, then from time 0-e
The segment P constituted to time e is the first matching segment, and the segment Q constituted from time e to time e+e is the second matching piece
Section, the first matching segment and the second matching segment constitute and start segment；The piece constituted from time end-e-e to time end-e
Section R is that third matches segment, and the segment S constituted from time end-e to time end is the 4th matching segment, and third matches piece
Section and the 4th matching segment constitute end fragment, as shown in Figure 7.
It is then possible to will determine that the transition multi-medium data for starting segment, transition segment and end fragment is added to
Transition multimedia collections.It should be noted that time match duration e can be identical with the value of above-mentioned time match parameter E,
It can also be different.If time match duration e is different from the above-mentioned value of time match parameter E, then calculating subsequent
Cheng Zhong can carry out segment to the multi-medium data in multimedia collections again according to time match duration e and segment to be spliced
It divides.For ease of description, the embodiment of the present invention is identical as the above-mentioned value of time match parameter E with time match duration e
For.
S12 determines candidate's transition according to third multi-medium data and the 4th multi-medium data from transition multimedia collections
Multimedia collections, candidate's transition multimedia collections include at least one candidate transition multi-medium data.
It include transition multi-medium data to be calculated in transition multimedia collections, which is
Any one transition multi-medium data in transition multimedia collections；Correspondingly, the transition multimedia to be calculated can be calculated
Third similarity and transition multi-medium data and the 4th multimedia number to be calculated between data and third multi-medium data
The 4th similarity between；If third similarity and the 4th similarity are all larger than preset threshold, by the transition to be calculated
Multi-medium data is as candidate transition multi-medium data and is added to candidate transition multimedia collections.
Wherein, the third similarity between transition multi-medium data and third multi-medium data to be calculated refers to: third
Similarity between the ending segment of multi-medium data and the beginning segment of transition multi-medium data to be calculated；Mistake to be calculated
The 4th similarity crossed between multi-medium data and the 4th multi-medium data refers to: the end of transition multi-medium data to be calculated
Similarity between segment and the initial segment of the 4th multi-medium data.In one embodiment, the more matchmakers of transition to be calculated
Third similarity between volume data and third multi-medium data refers to: the third sub-piece of third multi-medium data with it is to be calculated
Transition multi-medium data first matching segment between similarity and third multi-medium data the 4th sub-piece with to
The sum of similarity between second matching segment of the transition multi-medium data of calculating.Transition multi-medium data to be calculated and
The 4th similarity between four multi-medium datas refers to: the third matching segment and more than the 4th of transition multi-medium data to be calculated
4th matching segment of similarity and transition multi-medium data to be calculated between the first sub-piece of media data and the
The sum of similarity between second sub-piece of four multi-medium datas.
Each candidate transition multi-medium data in candidate transition multimedia collections is inserted into goal ordering set by s13
In third multi-medium data and the 4th multi-medium data between, obtain multiple insertion sort set.
Specifically, each candidate transition multi-medium data in candidate transition multimedia collections can be inserted into mesh respectively
It marks between the third multi-medium data and the 4th multi-medium data in ordered set, to obtain multiple insertion sort set.For example,
Include 3 candidate transition multi-medium datas in candidate transition multimedia collections, is candidate transition multi-medium data 1 respectively, candidate
Transition multi-medium data 2 and candidate transition multi-medium data 3；There are an adjacent third multimedias in goal ordering set
Similarity between data and the 4th multi-medium data is less than preset threshold, then by 3 candidate transition multi-medium data difference
It is inserted between third multi-medium data and the 4th multi-medium data, available 3 insertion sort set, is insertion row respectively
Ordered sets 1, insertion sort set 2 and insertion sort set 3, as shown in Figure 8.
S14 calculates the insertion rationality metric of each insertion sort set, and is closed according to the insertion of each insertion sort set
Reason degree metric determines target transition multi-medium data.
The insertion rationality metric of insertion sort set is according to the adjacent multi-medium data in goal ordering set
Between similarity, the similarity between the candidate transition multi-medium data in third multi-medium data and insertion sort set,
And the similarity calculation between the candidate multi-medium data and the 4th multi-medium data in insertion sort set obtains.In one kind
In embodiment, the insertion rationality metric of insertion sort set are as follows: all adjacent multimedias in goal ordering set
Similarity, third multi-medium data between data and similar between the candidate transition multi-medium data in insertion sort set
The summation of degree and the similarity between candidate multi-medium data and the 4th multi-medium data in insertion sort set.Further
In kind embodiment, the insertion rationality metric of insertion sort set are as follows: third multi-medium data is removed in goal ordering set
Similarity, third multi-medium data and insertion sort collection between the 4th adjacent multi-medium data other than multi-medium data
The candidate multi-medium data and the 4th in the similarity and insertion sort set between candidate transition multi-medium data in conjunction
The summation of similarity between multi-medium data.
Wherein, the similarity between the candidate transition multi-medium data in third multi-medium data and insertion sort set is
Refer to: the phase between the ending segment of third multi-medium data and the beginning segment of the transition multi-medium data in insertion sort set
Like degree；The similarity between candidate multi-medium data and the 4th multi-medium data in insertion sort set refers to: insertion sort
Similarity between the end fragment of transition multi-medium data in set and the initial segment of the 4th multi-medium data.In one kind
In embodiment, the similarity between candidate transition multi-medium data in third multi-medium data and insertion sort set is
Refer to: the third sub-piece of third multi-medium data with first of the transition multi-medium data in insertion sort set match segment it
Between similarity and third multi-medium data the 4th sub-piece and the transition multi-medium data in insertion sort set the
The sum of similarity between two matching segments.Between transition multi-medium data and the 4th multi-medium data in insertion sort set
Similarity refer to: the of the third of the transition multi-medium data in insertion sort set matching segment and the 4th multi-medium data
The 4th matching segment and more than the 4th of the transition multi-medium data in similarity and insertion sort set between one sub-piece
The sum of similarity between second sub-piece of media data.
After obtaining the insertion rationality metric of each insertion sort set, maximum insertion rationality can be chosen and measured
The corresponding insertion sort set of value is as target insertion sort set, and by the transition multimedia in target insertion sort set
Data are as target transition multi-medium data.Then according to the multimedia number of target transition multi-medium data and goal ordering set
According to put in order the segment to be spliced of each multi-medium data spliced.Specifically, can be first according to goal ordering set
Multi-medium data put in order by each multi-medium data (including third multi-medium data and the 4th multi-medium data) to
Splice segment is spliced, then by the transition segment in target transition multi-medium data be inserted into third multi-medium data to
Between splice segment and the segment to be spliced of the 4th multi-medium data.
Multiple ordered sets corresponding to the available multimedia collections of the embodiment of the present invention, and according in multimedia collections
Each multi-medium data initial segment and ending the multiple ordered sets of fragment computations splicing rationality metric.According to each more
The splicing rationality metric that the initial segment and ending fragment computations of media data go out, can reflect each to a certain extent
The splicing rationality between segment to be spliced in multi-medium data.Goal ordering collection is chosen according to splicing rationality metric
It closes, and the segment to be spliced of each multi-medium data is spliced according to putting in order for goal ordering set, can to spell
The multi-medium data connect is more smooth, natural, smooth, improves user experience.
Description based on above method embodiment, in one embodiment, the embodiment of the invention also provides a kind of such as Fig. 9
Shown in multimedia splicing apparatus structural schematic diagram.As shown in figure 9, the multimedia splicing apparatus in the embodiment of the present invention can wrap
It includes:
Acquiring unit 101 includes more than at least two in the multimedia collections for obtaining multimedia collections to be spliced
Media data, the multi-medium data include initial segment, ending segment and segment to be spliced；
Arrangement units 102 obtain more for arranging at least two multi-medium datas in the multimedia collections
A ordered set, the difference that puts in order of the multi-medium data in any two ordered set；
Computing unit 103 is measured for calculating the splicing rationality of each ordered set of the multiple ordered set
Value, the splicing rationality metric of each ordered set is according to the initial of multi-medium data adjacent in ordered set
Similarity calculation between segment and ending segment obtains；
Concatenation unit 104 meets the row of preset condition for the splicing rationality metric by the multiple ordered set
Ordered sets is as goal ordering set；
The concatenation unit 104 is also used to putting in order pair according to the multi-medium data in the goal ordering set
The segment to be spliced of each multi-medium data is spliced.
It in one embodiment, include referring to ordered set in the multiple ordered set, it is described to be with reference to ordered set
Any one ordered set in the multiple ordered set；Correspondingly, in each row for calculating the multiple ordered set
When the splicing rationality metric of ordered sets, computing unit 103 can be specifically used for: according to described with reference to each more matchmakers in ordered set
The initial segment and ending segment of volume data, calculate similar between the adjacent multi-medium data with reference in ordered set
Degree；The sum of similarity between all adjacent multi-medium datas with reference in ordered set is sought as described with reference to row
The splicing rationality metric of ordered sets.
In further embodiment, the initial segment of the multi-medium data includes the first sub-piece and the second sub-piece, institute
State the segment of the initial segment intersection of segment to be spliced and the multi-medium data that the second sub-piece is the multi-medium data；
The ending segment of the multi-medium data includes third sub-piece and the 4th sub-piece, and the third sub-piece is the multimedia
The segment of the ending segment intersection of the segment to be spliced and multi-medium data of data；The ending of first multi-medium data
Similarity between segment and the initial segment of second multi-medium data is according to the first similarity and the second similarity meter
It obtains；Similarity between the adjacent multi-medium data with reference in ordered set includes: described with reference to ordered set
In the ending segment of the first multi-medium data and the initial segment of the second multi-medium data between similarity, more than described first
Media data and second multi-medium data are described with reference to being adjacent in ordered set；Wherein, first similarity
It is described for the similarity of the first sub-piece of the third sub-piece and second multi-medium data of first multi-medium data
Second similarity is the 4th sub-piece of first multi-medium data and the second sub-piece of second multi-medium data
Similarity.
In further embodiment, in putting in order to described each according to the multi-medium data in the goal ordering set
When the segment to be spliced of multi-medium data is spliced, concatenation unit 104 can be specifically used for: judge in the goal ordering set
It is less than preset threshold with the presence or absence of the similarity between adjacent third multi-medium data and the 4th multi-medium data；If it exists,
Target transition multi-medium data is then obtained, and according to more in the target transition multi-medium data and the goal ordering set
The segment to be spliced of each multi-medium data is spliced in putting in order for media data；If it does not exist, then according to described
Putting in order for multi-medium data in goal ordering set splices the segment to be spliced of each multi-medium data.
In further embodiment, when obtaining target transition multi-medium data, concatenation unit 104 can be specifically used for: obtain
Transition multimedia collections include at least two transition multi-medium datas, the transition multimedia in the transition multimedia collections
Data include transition plate section；According to the third multi-medium data and the 4th multi-medium data from the transition multimedia collection
Determine that candidate's transition multimedia collections, candidate's transition multimedia collections include at least one candidate transition multimedia number in conjunction
According to；Each candidate transition multi-medium data in the candidate transition multimedia collections is inserted into the goal ordering set
The third multi-medium data and the 4th multi-medium data between, obtain multiple insertion sort set；Calculate each insertion
The insertion rationality metric of ordered set, and target is determined according to the insertion rationality metric of each insertion sort set
Transition multi-medium data.
In further embodiment, in the transition multimedia collections include transition multi-medium data to be calculated, it is described to
The transition multi-medium data of calculating is any one transition multi-medium data in the transition multimedia collections；Correspondingly,
Candidate's transition is determined from the transition multimedia collections according to the third multi-medium data and the 4th multi-medium data
When multimedia collections, concatenation unit 104 can be specifically used for: calculating the transition multi-medium data to be calculated and the third is more
Third similarity and the transition multi-medium data to be calculated between media data and the 4th multi-medium data it
Between the 4th similarity；If the third similarity and the 4th similarity are all larger than the preset threshold, will it is described to
The transition multi-medium data of calculating is as candidate transition multi-medium data and is added to candidate transition multimedia collections.
In further embodiment, the insertion rationality metric of the insertion sort set is according in goal ordering set
Adjacent multi-medium data between similarity, the candidate mistake in the third multi-medium data and the insertion sort set
Cross the similarity between multi-medium data and the candidate transition multi-medium data and the described 4th in the insertion sort set
Similarity calculation between multi-medium data obtains.
In further embodiment, when obtaining multimedia collections to be spliced, acquiring unit 101 can be specifically used for: obtain
At least two multi-medium datas to be spliced, the multi-medium data include segment to be spliced；Obtain preset time match ginseng
At the beginning of the several and described segment to be spliced and finish time；According to the start time, finish time and described
Time match parameter determines the initial segment and ending segment of the multi-medium data；It will determine the initial segment, described
The multi-medium data of ending segment and the segment to be spliced is added to multimedia collections to be spliced.
Multiple ordered sets corresponding to the available multimedia collections of the embodiment of the present invention, and according in multimedia collections
Each multi-medium data initial segment and ending the multiple ordered sets of fragment computations splicing rationality metric.According to each more
The splicing rationality metric that the initial segment and ending fragment computations of media data go out, can reflect each to a certain extent
The splicing rationality between segment to be spliced in multi-medium data.Goal ordering collection is chosen according to splicing rationality metric
It closes, and the segment to be spliced of each multi-medium data is spliced according to putting in order for goal ordering set, can to spell
The multi-medium data connect is more smooth, natural, smooth, improves user experience.
Referring to Figure 10, it is a kind of structural schematic diagram of intelligent terminal provided in an embodiment of the present invention.As shown in Figure 10
Intelligent terminal in the present embodiment may include: one or more processors 201；One or more input equipments 202, one or
Multiple output equipments 203 and memory 204.Above-mentioned processor 201, input equipment 202, output equipment 203 and memory 204 are logical
Cross the connection of bus 205.For memory 204 for storing computer program, the computer program includes program instruction, processor
201 for executing the program instruction of the storage of memory 204 to execute above-mentioned multimedia joining method.
In one embodiment, the processor 201 can be central processing unit (Central Processing Unit,
CPU), which can also be other general processors, i.e. microprocessor or any conventional processor.The memory
204 may include read-only memory and random access memory, and provide instruction and data to processor 201.Therefore, right at this
It is not construed as limiting in processor 201 and memory 204.
The embodiment of the present invention also provides a kind of computer storage medium, and the computer storage medium is stored with computer journey
Sequence instruction, is loaded by processor 201 and executes one stored in computer storage medium or one or more computer program refers to
It enables, to realize the corresponding steps of the method in above-mentioned corresponding embodiment；In the specific implementation, at least one in computer storage medium
Computer program instructions are loaded by processor 201 and execute following steps:
Multimedia collections to be spliced are obtained, include at least two multi-medium datas in the multimedia collections, it is described more
Media data includes initial segment, ending segment and segment to be spliced；
At least two multi-medium datas in the multimedia collections are arranged, obtain multiple ordered sets, arbitrarily
The difference that puts in order of multi-medium data in two ordered sets；
Calculate the splicing rationality metric of each ordered set of the multiple ordered set, each described sequence
The splicing rationality metric of set be according to the initial segment of multi-medium data adjacent in ordered set and ending segment it
Between similarity calculation obtain；
The ordered set that the splicing rationality metric of the multiple ordered set meets preset condition is arranged as target
Ordered sets；
According to putting in order to each multi-medium data wait spell for the multi-medium data in the goal ordering set
Tab segments are spliced.
It in one embodiment, include referring to ordered set in the multiple ordered set, it is described to be with reference to ordered set
Any one ordered set in the multiple ordered set；Correspondingly, in each row for calculating the multiple ordered set
When the splicing rationality metric of ordered sets, at least one computer program instructions can by the processor 201 load and it is specific
For executing: according to the initial segment with reference to multi-medium data each in ordered set and ending segment, calculating the reference
The similarity between adjacent multi-medium data in ordered set；It seeks described with reference to all adjacent more in ordered set
The sum of similarity between media data is as the splicing rationality metric with reference to ordered set.
In further embodiment, the initial segment of the multi-medium data includes the first sub-piece and the second sub-piece, institute
State the segment of the initial segment intersection of segment to be spliced and the multi-medium data that the second sub-piece is the multi-medium data；
The ending segment of the multi-medium data includes third sub-piece and the 4th sub-piece, and the third sub-piece is the multimedia
The segment of the ending segment intersection of the segment to be spliced and multi-medium data of data；The ending of first multi-medium data
Similarity between segment and the initial segment of second multi-medium data is according to the first similarity and the second similarity meter
It obtains；Similarity between the adjacent multi-medium data with reference in ordered set includes: described with reference to ordered set
In the ending segment of the first multi-medium data and the initial segment of the second multi-medium data between similarity, more than described first
Media data and second multi-medium data are described with reference to being adjacent in ordered set；Wherein, first similarity
It is described for the similarity of the first sub-piece of the third sub-piece and second multi-medium data of first multi-medium data
Second similarity is the 4th sub-piece of first multi-medium data and the second sub-piece of second multi-medium data
Similarity.
In further embodiment, in putting in order to described each according to the multi-medium data in the goal ordering set
When the segment to be spliced of multi-medium data is spliced, which can be loaded by the processor 201
And it is specifically used for executing: judges in the goal ordering set with the presence or absence of adjacent third multi-medium data and the 4th multimedia
Similarity between data is less than preset threshold；If it exists, then target transition multi-medium data is obtained, and according to the target mistake
Cross multi-medium data and the multi-medium data in the goal ordering set put in order to each multi-medium data to
Splice segment is spliced；If it does not exist, then putting in order to institute according to the multi-medium data in the goal ordering set
The segment to be spliced for stating each multi-medium data is spliced.
In further embodiment, when obtaining target transition multi-medium data, which can
It is loaded by the processor 201 and is specifically used for executing: obtaining transition multimedia collections, include extremely in the transition multimedia collections
Few two transition multi-medium datas, the transition multi-medium data includes transition segment；According to the third multi-medium data and
4th multi-medium data determines candidate's transition multimedia collections from the transition multimedia collections, and candidate's transition is more
Media collection includes at least one candidate transition multi-medium data；By each candidate mistake in the candidate transition multimedia collections
Cross the third multi-medium data and the 4th multi-medium data that multi-medium data is inserted into the goal ordering set
Between, obtain multiple insertion sort set；The insertion rationality metric of each insertion sort set is calculated, and according to described each slotting
The insertion rationality metric for entering ordered set determines target transition multi-medium data.
In further embodiment, in the transition multimedia collections include transition multi-medium data to be calculated, it is described to
The transition multi-medium data of calculating is any one transition multi-medium data in the transition multimedia collections；Correspondingly,
Candidate's transition is determined from the transition multimedia collections according to the third multi-medium data and the 4th multi-medium data
When multimedia collections, which can be loaded by the processor 201 and be specifically used for executing: calculate institute
State third similarity between transition multi-medium data and the third multi-medium data to be calculated and described to be calculated
The 4th similarity between transition multi-medium data and the 4th multi-medium data；If the third similarity and the described 4th
Similarity is all larger than the preset threshold, then using the transition multi-medium data to be calculated as candidate transition multi-medium data
And it is added to candidate transition multimedia collections.
In further embodiment, the insertion rationality metric of the insertion sort set is according in goal ordering set
Adjacent multi-medium data between similarity, the candidate mistake in the third multi-medium data and the insertion sort set
Cross the similarity between multi-medium data and the candidate transition multi-medium data and the described 4th in the insertion sort set
Similarity calculation between multi-medium data obtains.
In further embodiment, when obtaining multimedia collections to be spliced, which can
It is loaded by the processor 201 and is specifically used for executing: obtaining at least two multi-medium datas to be spliced, the multi-medium data
Including segment to be spliced；At the beginning of obtaining preset time match parameter and the segment to be spliced and finish time；
According to the start time, the finish time and the time match parameter, the initial segment of the multi-medium data is determined
With ending segment；The multi-medium data for determining the initial segment, the ending segment and the segment to be spliced is added
Add to multimedia collections to be spliced.
Multiple ordered sets corresponding to the available multimedia collections of the embodiment of the present invention, and according in multimedia collections
Each multi-medium data initial segment and ending the multiple ordered sets of fragment computations splicing rationality metric.According to each more
The splicing rationality metric that the initial segment and ending fragment computations of media data go out, can reflect each to a certain extent
The splicing rationality between segment to be spliced in multi-medium data.Goal ordering collection is chosen according to splicing rationality metric
It closes, and the segment to be spliced of each multi-medium data is spliced according to putting in order for goal ordering set, can to spell
The multi-medium data connect is more smooth, natural, smooth, improves user experience.
It should be noted that the terminal of foregoing description and the specific work process of unit, can refer to aforementioned each implementation
Associated description in example, details are not described herein.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the program can be stored in a computer-readable storage medium
In, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, the storage medium can be magnetic
Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access
Memory, RAM) etc..
Above disclosed is only section Example of the invention, cannot limit the right of the present invention with this certainly
Range, those skilled in the art can understand all or part of the processes for realizing the above embodiment, and according to right of the present invention
Equivalent variations made by it is required that, still belongs to the scope covered by the invention.
Claims (11)
1. a kind of multimedia joining method characterized by comprising
Multimedia collections to be spliced are obtained, include at least two multi-medium datas, the multimedia in the multimedia collections
Data include initial segment, ending segment and segment to be spliced；
At least two multi-medium datas in the multimedia collections are arranged, multiple ordered sets, any two are obtained
The difference that puts in order of multi-medium data in ordered set；
Calculate the splicing rationality metric of each ordered set of the multiple ordered set, each described ordered set
Splicing rationality metric be according between the initial segment of multi-medium data adjacent in ordered set and ending segment
Similarity calculation obtains；
The splicing rationality metric of the multiple ordered set is met into the ordered set of preset condition as goal ordering collection
It closes；
According to be spliced to put in order to each multi-medium data of the multi-medium data in the goal ordering set
Duan Jinhang splicing.
2. the method as described in claim 1, which is characterized in that include referring to ordered set, institute in the multiple ordered set
Stating with reference to ordered set is any one ordered set in the multiple ordered set；It is described to calculate the multiple ordered set
Each ordered set splicing rationality metric, comprising:
According to the initial segment with reference to multi-medium data each in ordered set and ending segment, calculate described with reference to sequence collection
The similarity between adjacent multi-medium data in conjunction；
It seeks the sum of similarity between all adjacent multi-medium datas with reference in ordered set and is used as the reference
The splicing rationality metric of ordered set.
3. method according to claim 2, which is characterized in that the initial segment of the multi-medium data includes the first sub-piece
With the second sub-piece, second sub-piece be the multi-medium data segment to be spliced and the multi-medium data it is initial
The segment of segment intersection；
The ending segment of the multi-medium data includes third sub-piece and the 4th sub-piece, and the third sub-piece is described more
The segment of the ending segment intersection of the segment to be spliced and multi-medium data of media data；
Similarity between the adjacent multi-medium data with reference in ordered set includes: described with reference in ordered set
Similarity between the ending segment of first multi-medium data and the initial segment of the second multi-medium data, first multimedia
Data and second multi-medium data are described with reference to being adjacent in ordered set；The ending of first multi-medium data
Similarity between segment and the initial segment of second multi-medium data is according to the first similarity and the second similarity meter
It obtains；
Wherein, first similarity is the third sub-piece and second multi-medium data of first multi-medium data
The similarity of first sub-piece, second similarity are the 4th sub-piece and described more than second of first multi-medium data
The similarity of second sub-piece of media data.
4. method as claimed in claim 3, which is characterized in that the multi-medium data according in the goal ordering set
Put in order the segment to be spliced of each multi-medium data spliced, comprising:
Judge in the goal ordering set with the presence or absence of between adjacent third multi-medium data and the 4th multi-medium data
Similarity is less than preset threshold；
If it exists, then target transition multi-medium data is obtained, and is arranged according to the target transition multi-medium data and the target
Putting in order for multi-medium data in ordered sets splices the segment to be spliced of each multi-medium data；
If it does not exist, then putting in order to each multi-medium data according to the multi-medium data in the goal ordering set
Segment to be spliced spliced.
5. method as claimed in claim 4, which is characterized in that the acquisition target transition multi-medium data, comprising:
Transition multimedia collections are obtained, include at least two transition multi-medium datas, the mistake in the transition multimedia collections
Crossing multi-medium data includes transition segment；
It is determined from the transition multimedia collections according to the third multi-medium data and the 4th multi-medium data candidate
Transition multimedia collections, candidate's transition multimedia collections include at least one candidate transition multi-medium data；
Each candidate transition multi-medium data in the candidate transition multimedia collections is inserted into the goal ordering set
In the third multi-medium data and the 4th multi-medium data between, obtain multiple insertion sort set；
The insertion rationality metric of each insertion sort set is calculated, and according to the insertion rationality of each insertion sort set
Metric determines target transition multi-medium data.
6. method as claimed in claim 5, which is characterized in that include that transition to be calculated is more in the transition multimedia collections
Media data, the transition multi-medium data to be calculated are any one transition multimedia in the transition multimedia collections
Data；It is described to be determined from the transition multimedia collections according to the third multi-medium data and the 4th multi-medium data
Candidate transition multimedia collections, comprising:
Calculate the third similarity between the transition multi-medium data to be calculated and the third multi-medium data, Yi Jisuo
State the 4th similarity between transition multi-medium data and the 4th multi-medium data to be calculated；
If the third similarity and the 4th similarity are all larger than the preset threshold, and the transition to be calculated is more
Media data is as candidate transition multi-medium data and is added to candidate transition multimedia collections.
7. method as claimed in claim 6, which is characterized in that the insertion rationality metric of the insertion sort set is root
It is arranged according to similarity, the third multi-medium data and the insertion between the adjacent multi-medium data in goal ordering set
The more matchmakers of candidate transition in the similarity and the insertion sort set between candidate transition multi-medium data in ordered sets
Similarity calculation between volume data and the 4th multi-medium data obtains.
8. the method as described in claim 1, which is characterized in that described to obtain multimedia collections to be spliced, comprising:
Multi-medium data to be spliced is obtained, the multi-medium data includes segment to be spliced；
At the beginning of obtaining preset time match parameter and the segment to be spliced and finish time；
According to the start time, the finish time and the time match parameter, the initial of the multi-medium data is determined
Segment and ending segment；
The multi-medium data for determining the initial segment, the ending segment and the segment to be spliced is added to wait spell
The multimedia collections connect.
9. a kind of multimedia splicing apparatus characterized by comprising
Acquiring unit includes at least two multimedia numbers in the multimedia collections for obtaining multimedia collections to be spliced
According to the multi-medium data includes initial segment, ending segment and segment to be spliced；
Arrangement units obtain multiple sequences for arranging at least two multi-medium datas in the multimedia collections
Gather, the difference that puts in order of the multi-medium data in any two ordered set；
Computing unit, the splicing rationality metric of each ordered set for calculating the multiple ordered set are described
The splicing rationality metric of each ordered set be according to the initial segment of multi-medium data adjacent in ordered set and
Similarity calculation between ending segment obtains；
Concatenation unit, the ordered set for the splicing rationality metric of the multiple ordered set to be met to preset condition are made
For goal ordering set；
The concatenation unit is also used to putting in order to described each more according to the multi-medium data in the goal ordering set
The segment to be spliced of media data is spliced.
10. a kind of intelligent terminal, which is characterized in that including processor, input equipment, output equipment and memory, the processing
Device, input equipment, output equipment and memory are connected with each other, wherein the memory is for storing computer program, the meter
Calculation machine program includes program instruction, and the processor is configured for calling described program instruction, executes claim 1-8 such as and appoints
Multimedia joining method described in one.
11. a kind of computer storage medium, which is characterized in that the computer storage medium is stored with computer program instructions,
The computer program instructions are suitable for being loaded by processor and being executed such as the described in any item multimedia splicing sides claim 1-8
Method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910207603.1A CN110012238B (en) | 2019-03-19 | 2019-03-19 | Multimedia splicing method, device, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910207603.1A CN110012238B (en) | 2019-03-19 | 2019-03-19 | Multimedia splicing method, device, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110012238A true CN110012238A (en) | 2019-07-12 |
| CN110012238B CN110012238B (en) | 2021-06-25 |
Family
ID=67167354
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910207603.1A Active CN110012238B (en) | 2019-03-19 | 2019-03-19 | Multimedia splicing method, device, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110012238B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113099313A (en) * | 2021-03-31 | 2021-07-09 | 杭州海康威视数字技术股份有限公司 | Video slicing method and device and electronic equipment |
| CN116320535A (en) * | 2023-04-14 | 2023-06-23 | 北京百度网讯科技有限公司 | Method, device, electronic equipment and storage medium for generating video |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104240211A (en) * | 2014-08-06 | 2014-12-24 | 中国船舶重工集团公司第七0九研究所 | Image brightness and color balancing method and system for video stitching |
| CN104967902A (en) * | 2014-09-17 | 2015-10-07 | 腾讯科技（北京）有限公司 | Video sharing method, apparatus and system |
| US20160156690A1 (en) * | 2008-11-12 | 2016-06-02 | Cxense Asa | Augmentation of streaming media |
| CN106507180A (en) * | 2016-11-24 | 2017-03-15 | 腾讯科技（深圳）有限公司 | A kind of method of Video processing and terminal |
| US20170368815A1 (en) * | 2016-06-28 | 2017-12-28 | The Boeing Company | Wrinkle Reduction in Formed Composite Laminates |
| US20180051326A1 (en) * | 2013-01-14 | 2018-02-22 | Peter Keith Rogan | METHODS OF DETERMINING AND PREDICTING MUTATED mRNA SPLICE ISOFORMS |
| CN107918927A (en) * | 2017-11-30 | 2018-04-17 | 武汉理工大学 | A kind of matching strategy fusion and the fast image splicing method of low error |
| CN108650510A (en) * | 2018-05-10 | 2018-10-12 | 中南大学 | The coding method of video and device, storage medium, electronic device |
| CN109446350A (en) * | 2018-11-09 | 2019-03-08 | 腾讯音乐娱乐科技（深圳）有限公司 | Multi-medium play method, device, terminal and storage medium |
-
2019
- 2019-03-19 CN CN201910207603.1A patent/CN110012238B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160156690A1 (en) * | 2008-11-12 | 2016-06-02 | Cxense Asa | Augmentation of streaming media |
| US20180051326A1 (en) * | 2013-01-14 | 2018-02-22 | Peter Keith Rogan | METHODS OF DETERMINING AND PREDICTING MUTATED mRNA SPLICE ISOFORMS |
| CN104240211A (en) * | 2014-08-06 | 2014-12-24 | 中国船舶重工集团公司第七0九研究所 | Image brightness and color balancing method and system for video stitching |
| CN104967902A (en) * | 2014-09-17 | 2015-10-07 | 腾讯科技（北京）有限公司 | Video sharing method, apparatus and system |
| US20170368815A1 (en) * | 2016-06-28 | 2017-12-28 | The Boeing Company | Wrinkle Reduction in Formed Composite Laminates |
| CN106507180A (en) * | 2016-11-24 | 2017-03-15 | 腾讯科技（深圳）有限公司 | A kind of method of Video processing and terminal |
| CN107918927A (en) * | 2017-11-30 | 2018-04-17 | 武汉理工大学 | A kind of matching strategy fusion and the fast image splicing method of low error |
| CN108650510A (en) * | 2018-05-10 | 2018-10-12 | 中南大学 | The coding method of video and device, storage medium, electronic device |
| CN109446350A (en) * | 2018-11-09 | 2019-03-08 | 腾讯音乐娱乐科技（深圳）有限公司 | Multi-medium play method, device, terminal and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 贺波涛: "《全景视频生成及目标对象检索关键技术研究》", 《信息科技》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113099313A (en) * | 2021-03-31 | 2021-07-09 | 杭州海康威视数字技术股份有限公司 | Video slicing method and device and electronic equipment |
| CN113099313B (en) * | 2021-03-31 | 2022-07-05 | 杭州海康威视数字技术股份有限公司 | Video slicing method and device and electronic equipment |
| CN116320535A (en) * | 2023-04-14 | 2023-06-23 | 北京百度网讯科技有限公司 | Method, device, electronic equipment and storage medium for generating video |
| CN116320535B (en) * | 2023-04-14 | 2024-03-22 | 北京百度网讯科技有限公司 | Method, device, electronic equipment and storage medium for generating video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110012238B (en) | 2021-06-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11657798B2 (en) | Methods and apparatus to segment audio and determine audio segment similarities | |
| CN108401193A (en) | A kind of video broadcasting method, device and electronic equipment | |
| US11593422B2 (en) | System and method for automatic synchronization of video with music, and gaming applications related thereto | |
| CN110012238A (en) | Multimedia joining method, device, terminal and storage medium | |
| CN108491463A (en) | Label determines method and device | |
| CN108776565A (en) | Animation display method and device, electronic equipment and storage medium | |
| KR20190063352A (en) | Apparatus and method for clip connection of image contents by similarity analysis between clips | |
| CN111488813B (en) | Video emotion marking method and device, electronic equipment and storage medium | |
| CN110347866A (en) | Information processing method, device, storage medium and electronic equipment | |
| CN110534131A (en) | A kind of audio frequency playing method and system | |
| JP2003084783A (en) | Method, device, and program for playing music data and recording medium with music data playing program recorded thereon | |
| CN110189752A (en) | A kind of mostly recognition methods of intention and device, terminal device | |
| CN109697244A (en) | Information processing method, device and storage medium | |
| CN106874294A (en) | A kind of information matching method and device | |
| CN109905774A (en) | Multi-medium play method, device, terminal and storage medium | |
| CN110019923A (en) | The lookup method and device of speech message | |
| CN109670572A (en) | Neural net prediction method and device | |
| CN109979591A (en) | A kind of method and device based on the figure neural network analysis plaque progression factor | |
| CN109889883A (en) | A kind of Wonderful time video recording method and device | |
| CN109446350A (en) | Multi-medium play method, device, terminal and storage medium | |
| CN110517656A (en) | Lyrics rhythm generation method, equipment, storage medium and device | |
| US7949667B2 (en) | Information processing apparatus, method, and program | |
| CN112135201B (en) | Video production method and related device | |
| CN110046263A (en) | Multimedia recommendation method, device, server and storage medium | |
| CN113012723B (en) | Multimedia file playing method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |