CN109600559A - A kind of special video effect adding method, device, terminal device and storage medium - Google Patents

A kind of special video effect adding method, device, terminal device and storage medium Download PDF

Info

Publication number
CN109600559A
CN109600559A CN201811447969.8A CN201811447969A CN109600559A CN 109600559 A CN109600559 A CN 109600559A CN 201811447969 A CN201811447969 A CN 201811447969A CN 109600559 A CN109600559 A CN 109600559A
Authority
CN
China
Prior art keywords
video
special
image frame
video effect
effect
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811447969.8A
Other languages
Chinese (zh)
Other versions
CN109600559B (en
Inventor
黄佳斌
唐堂
孟宇
陈曼仪
陈晔
林晔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN201811447969.8A priority Critical patent/CN109600559B/en
Publication of CN109600559A publication Critical patent/CN109600559A/en
Application granted granted Critical
Publication of CN109600559B publication Critical patent/CN109600559B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2621Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording

Abstract

The present disclosure discloses a kind of special video effect adding method, device, terminal device and storage mediums.This method comprises: obtaining at least one picture frame in video, and at least one target body artis of user is identified in described image frame;If it is determined that the target body artis identified in target image frame meets preset joint position condition, then obtain and the matched special video effect of joint position condition;In the video and at the associated video location of target image frame, addition and the matched special video effect of joint position condition.The embodiment of the present disclosure can add matched dynamic special efficacy for the artis of user, improve the scene diversification of video interactive application.

Description

A kind of special video effect adding method, device, terminal device and storage medium
Technical field
The embodiment of the present disclosure be related to data technique more particularly to a kind of special video effect adding method, device, terminal device and Storage medium.
Background technique
With the development of the communication technology and terminal device equipment, various terminal equipment such as mobile phone, tablet computer etc. is Become a part indispensable in people's work and life, and becoming increasingly popular with terminal device, video interactive is answered With the main channel for becoming a kind of communication and amusement.
Currently, video interactive application can recognize that user's face, and increase in user's head still image (such as Increase headwear on hair) or increase facial expression be covered in user's face.This method for increasing image is excessively limited to, together When application scenarios it is excessively single, be unable to satisfy the diversified demand of user.
Summary of the invention
The embodiment of the present disclosure provides a kind of special video effect adding method, device, terminal device and storage medium, can be directed to The artis of user adds matched dynamic special efficacy, improves the scene diversification of video interactive application.
In a first aspect, the embodiment of the present disclosure provides a kind of special video effect adding method, this method comprises:
At least one picture frame in video is obtained, and identifies at least one target body of user in described image frame Artis;
If it is determined that the target body artis identified in target image frame meets preset joint position condition, then It obtains and the matched special video effect of joint position condition;
In the video and at the associated video location of target image frame, addition and the joint position condition The special video effect matched.
Further, described at least one picture frame obtained in video, comprising:
During video record, at least one picture frame in the video is obtained in real time;
It is described in the video and at the associated video location of target image frame, addition and the joint position item The matched special video effect of part, comprising:
Starting point is added using the video location of the target image frame as special efficacy;
According to the special efficacy duration with the matched special video effect of joint position condition, starting point is added from the special efficacy Start, adds the special video effect with the picture frame of the special efficacy Duration match in the video.
Further, the target body artis that the determination identifies in target image frame meets preset joint position Set condition, comprising:
When position of the target body artis in described image frame is in, the joint position condition is matched to be set Determine in position range, and position of the target body artis in the previous image frame of described image frame be not in the setting When in position range, then described image frame is determined as target image frame, while determination identifies in the target image frame Target body artis meet preset joint position condition.
Further, the target body artis that the determination identifies in target image frame meets preset joint position Set condition, comprising:
When position of the target body artis in described image frame is in, the joint position condition is matched to be set Determine in position range, and described image frame do not include with the matched special video effect of joint position condition, then by described image Frame is determined as target image frame, while it is preset to determine that the target body artis identified in the target image frame meets Joint position condition.
Further, the setting position range includes setting plan-position range or setting spatial position range.
Further, the special video effect adding method, further includes:
In the recording process of the video, the picture frame in the video is presented in real time in video preview interface;
While in the video with the special video effect is added in the picture frame of the special efficacy Duration match, also Include:
In the video preview interface, the picture frame for adding the special video effect is presented in real time.
Further, the special video effect includes: dynamic animation effect and/or music special efficacy;
It is described in the video preview interface, the picture frame for adding the special video effect is presented in real time, comprising:
In the video preview interface, the real-time rendering dynamic animation effect in picture frame, and play music special efficacy.
Second aspect, the embodiment of the present disclosure additionally provide a kind of special video effect adding set, which includes:
Target body artis identification module, for obtaining at least one picture frame in video, and in described image frame At least one target body artis of middle identification user;
Special video effect obtains module, for if it is determined that the target body artis identified in target image frame meets Preset joint position condition then obtains and the matched special video effect of joint position condition;
Special video effect adding module, for adding in the video and at the associated video location of target image frame Add and the matched special video effect of joint position condition.
Further, the target body artis identification module, comprising:
Picture frame obtains module in real time, for obtaining at least one of described video in real time during video record Picture frame;
The special video effect adding module, comprising:
Special efficacy adds starting point determining module, for adding starting point for the video location of the target image frame as special efficacy;
The real-time adding module of special video effect, for being held according to the special efficacy with the matched special video effect of joint position condition The continuous time adds in the video with the picture frame of the special efficacy Duration match since the special efficacy adds starting point Add the special video effect.
Further, the special video effect obtains module, comprising: target body artis enters condition judgment module, uses The matched setting position of joint position condition is in working as position of the target body artis in described image frame In range, and position of the target body artis in the previous image frame of described image frame be not in the setting position model When enclosing interior, then described image frame is determined as target image frame, while determining the target identified in the target image frame Human joint points meet preset joint position condition.
Further, the special video effect obtains module, comprising: target body artis location status judgment module is used The matched setting position of joint position condition is in working as position of the target body artis in described image frame In range, and described image frame do not include with the matched special video effect of joint position condition, then by described image frame determine For target image frame, while determining that the target body artis identified in the target image frame meets preset joint position Set condition.
Further, the setting position range includes setting plan-position range or setting spatial position range.
Further, the special video effect adding set, further includes:
Module is presented in picture frame in real time, for being in real time in video preview interface in the recording process of the video Picture frame in the existing video;
Module is presented in special video effect in real time, adds the video spy for being presented in the video preview interface in real time The picture frame of effect.
Further, the special video effect includes: dynamic animation effect and/or music special efficacy;
Module is presented in the special video effect in real time, comprising: special efficacy is shown and playing module, in video preview circle In face, the real-time rendering dynamic animation effect in picture frame, and play music special efficacy.
The third aspect, the embodiment of the present disclosure additionally provide a kind of terminal device, which includes:
One or more processors;
Memory, for storing one or more programs;
When one or more of programs are executed by one or more of processors, so that one or more of processing Device realizes the special video effect adding method as described in the embodiment of the present disclosure.
Fourth aspect, the embodiment of the present disclosure additionally provide a kind of computer readable storage medium, are stored thereon with computer Program realizes the special video effect adding method as described in the embodiment of the present disclosure when program is executed by processor.
The embodiment of the present disclosure meets joint position item by the target body artis recognized in the picture frame of video Part solves the special video effect of video interactive application excessively for video addition and the matched movement special efficacy of joint position condition Single problem realizes that the movement for user increases special video effect, improves the flexibility that video increases special efficacy.
Detailed description of the invention
Fig. 1 a is a kind of flow chart for special video effect adding method that the embodiment of the present disclosure one provides;
Fig. 1 b is a kind of schematic diagram for human joint points that the embodiment of the present disclosure one provides;
Fig. 2 a is a kind of flow chart for special video effect adding method that the embodiment of the present disclosure two provides;
Fig. 2 b is a kind of schematic diagram for setting position range that the embodiment of the present disclosure two provides;
Fig. 2 c is the schematic diagram for another setting position range that the embodiment of the present disclosure two provides;
Fig. 2 d is a kind of schematic diagram for human joint points that the embodiment of the present disclosure two provides;
Fig. 2 e is the schematic diagram for another human joint points that the embodiment of the present disclosure two provides;
Fig. 3 is a kind of flow chart for special video effect adding method that the embodiment of the present disclosure three provides;
Fig. 4 is a kind of structural schematic diagram for special video effect adding set that the embodiment of the present disclosure four provides;
Fig. 5 is a kind of structural schematic diagram for terminal device that the embodiment of the present disclosure five provides.
Specific embodiment
The disclosure is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining the disclosure, rather than the restriction to the disclosure.It also should be noted that in order to just Part relevant to the disclosure is illustrated only in description, attached drawing rather than entire infrastructure.
Embodiment one
Fig. 1 a is a kind of flow chart for special video effect adding method that the embodiment of the present disclosure one provides, and the present embodiment is applicable In in video add special video effect the case where, this method can be executed by special video effect adding set, which can adopt It is realized with the mode of software and/or hardware, which can be configured in terminal device, such as typically computer etc..Such as Shown in Fig. 1 a, this method specifically comprises the following steps:
S110 obtains at least one picture frame in video, and at least one mesh of user is identified in described image frame Mark human joint points.
In general, video is that continuously projection is formed at a terrific speed by a series of picture frame of static state.Thus, it is possible to Video is split into a series of images frame, and edit operation is carried out to picture frame, to realize the edit operation to video.Image There are when multiple users in frame, according to the identification integrity degree of the artis of each user, confidence level or each user and can shoot The distance of the equipment of video selects one of user as the subsequent object for needing to add special video effect.Human joint points are used In the action states such as determining the action state of user in picture frame, such as stand, bow or jump, and for determining user's Location information, such as other objects taken by the distance between user and terminal device, user and terminal device are opposite The location informations such as the position of position or user in the picture taken by terminal device.
In a specific example, as shown in Figure 1 b, in the terminal, human body contour outline is specifically as shown in the figure, wherein Circle in human body contour outline indicates the human joint points recognized, and the line between two human joint points is for indicating human body Physical feeling, for example, the line between wrist joint point and elbow artis is used to indicate the arm between wrist and elbow.
Human joint points identification operation is carried out to each picture frame, all human regions can be identified in picture frame, Specifically it can be the depth information (depth information can be obtained by infrared camera) for being included according to picture frame, to the figure As frame progress image segmentation, all human regions in picture frame are identified.A human region is selected from all human regions Human joint points for identification specifically can be and show the distance between screen according to human region and terminal device, selection away from From shortest human region as the user for needing to identify human joint points, furthermore it is also an option that other modes determine, to this It is not particularly limited.After determining human region, human joint points identification is carried out to the people's body region, determination belongs to the user All human joint points, at least one mesh may further be filtered out from all human joint points of the user as needed Mark human joint points.
Wherein, the method for identifying human joint points specifically may is that determination belongs in the people's body region in human region Physical feeling region (arm, hand, thigh and foot etc.), and each physical feeling region calculate artis (elbow, wrist and knee Lid etc.) position, it is last that human skeleton system is generated according to each artis position recognized, and mesh is therefrom determined as needed Mark human joint points.Furthermore, it is possible to by using line (such as wrist joint point and the elbow joint of two target body artis Line between point is used to indicate the arm between wrist and elbow), for example, it is true by the coordinate of two target body artis The vector for determining the line segment of two o'clock composition, further judges the action state or location information in some physical feeling region of user, on The artis position calculating stated in the human bioequivalence being related to, physical feeling region recognition and physical feeling region can use Trained deep learning model realization in advance, and deep learning model can be according to the depth extracted by human depth's information Feature is trained.
It should be noted that there are also other methods for the method for identification human joint points, this embodiment of the present disclosure is not made to have Body limitation.
S120 judges the target body joint identified from the picture frame chosen at least one described picture frame Whether point meets preset joint position condition, until at least one described picture frame all complete by judgement, if so, executing S130;Otherwise, S140 is executed.
It needs the target body artis recognized to picture frames all in video to judge, specifically can be with one by one Choose the mode that picture frame is judged.
Joint position condition can refer to the status requirement of at least one target body artis, add video for starting Special efficacy, such as left hand is placed on camera shooting picture center position, it furthermore can also be two target body artis Relative position require, such as left hand is placed on left eye artis region, there are also other specific location regions, to this Open embodiment is not specifically limited.
It should be noted that the corresponding setting position range of a joint position condition, while a corresponding video spy It imitates, if it exists two joint position conditions, and when two target body artis meet above-mentioned two joint position condition respectively When corresponding setting position range, the corresponding two video spies of two joint position conditions can be added in the picture frame simultaneously Effect.
S130 will meet the corresponding picture frame of target body artis of preset joint position condition as target image Frame, and obtain and the matched special video effect of the joint position, execution S150.
It can increase since current image frame when meeting joint position condition, in video matched with joint position condition Special video effect.Special video effect is used to add in target image frame according to the matched special-effect of user action, to realize and use Family interaction, can specifically refer to animation effect and/or music special efficacy, and addition animation effect is used for target image frame in the mistake of display It draws static and or dynamic image simultaneously in journey to be covered in the original content of target image frame, addition music special efficacy is used in mesh During showing in logo image frame, while playing music.
S140 obtains next picture frame, returns and executes S120.
S150, in the video and at the associated video location of target image frame, addition and the joint position The matched special video effect of condition.
Video location is for indicating the position of picture frame in video.Since the picture frame that video is split out can be according to view Frequency playing sequence is arranged, thus, when video location can be also used for indicating broadcasting of the picture frame in video display process It carves, which can refer to the specific moment for the initial time that relative video plays.Video can be split a series of Picture frame is numbered according to playing sequence, specifically: the picture frame of first broadcasting is the 1st frame, after the 1st frame picture frame The picture frame of broadcasting is the 2nd frame, and so on, all picture frames split in the video are numbered.For example, video is removable It is divided into 100 frames, each picture frame is corresponding with a serial number, specifically, target image frame can be the 50th frame.
After the video location for determining target image frame, special video effect is added at the video location.In fact, video is special Effect can be indicated with code form, special video effect be added at the video location, namely in the corresponding code of target image frame The corresponding code snippet of special video effect is added in segment, adds special video effect in target image frame to realize.
The embodiment of the present disclosure meets joint position item by the target body artis recognized in the picture frame of video Part solves the special video effect of video interactive application excessively for video addition and the matched movement special efficacy of joint position condition Single problem realizes that the movement for user increases special video effect, improves the richness of video interactive application, while improving view Frequency increases the flexibility of special efficacy.
Embodiment two
Fig. 2 a is a kind of flow chart for special video effect adding method that the embodiment of the present disclosure two provides.The present embodiment is with above-mentioned It is embodied based on each optinal plan in embodiment.In the present embodiment, it will acquire at least one image in video Frame is embodied as: during video record, obtaining at least one picture frame in the video in real time.Meanwhile will it is described In the video and at the associated video location of target image frame, addition and the matched video of the joint position condition are special Effect is embodied as: adding starting point for the video location of the target image frame as special efficacy;According to the joint position condition The special efficacy duration of matched special video effect holds in the video with the special efficacy since the special efficacy adds starting point The special video effect is added in the picture frame of continuous time match.
Correspondingly, the method for the present embodiment may include:
S210 obtains at least one picture frame in the video, and in described image during video record in real time At least one target body artis of user is identified in frame.
Can be with captured in real-time video, and each picture frame in video is obtained in real time.
Video, picture frame, target body artis, joint position condition, video location and video in the present embodiment is special Effect etc. can be with reference to the description in above-described embodiment.
S220 judges the target body joint identified from the picture frame chosen at least one described picture frame Whether point meets preset joint position condition, until at least one described picture frame all complete by judgement, if so, executing S230;Otherwise, S240 is executed.
S230 will meet the corresponding picture frame of target body artis of preset joint position condition as target image Frame, and obtain and the matched special video effect of joint position condition, execution S250.
Wherein, target body artis meets preset joint position condition, can refer to that at least one target body is closed Node is continued within the scope of setting position, or refers to that at least one target body artis enters or exit setting position model In enclosing.Specifically, setting position range includes setting plan-position range or setting spatial position range, wherein setting is flat Face position range can refer to the position range in the plane same or parallel with video capture plane, when the object taken When position when being mapped to the plane is within the scope of setting position, determine that the object meets setting plan-position range;And it sets Spatial position range refers to the position range in space taken in video, when the object taken is in setting spatial position When in range, determine that the object meets setting spatial position range.That is setting plan-position range is believed not comprising depth Breath, and setting spatial position range includes depth information.In a specific example, as shown in Figure 2 b, three boxes are to set Face position range is allocated, is setting spatial position range in square as shown in Figure 2 c.
Optionally, the target body artis that the determination identifies in target image frame meets preset joint position Condition may include: that position when the target body artis in described image frame is in the joint position condition Within the scope of the setting position matched, and position of the target body artis in the previous image frame of described image frame be not in institute When stating within the scope of setting position, then described image frame is determined as target image frame, while determining in the target image frame The target body artis identified meets preset joint position condition.
Specifically, target body artis is entered the entrance state of setting position range as preset joint position item Part, when target body artis is within the scope of the setting position in current image frame, and not in the previous figure of current image frame When as within the scope of setting position in frame, determine target body artis by setting position range outside, enter setting position range It is interior, so that it is determined that target body artis exists for setting position range enters state, and then determine target body artis Meet preset joint position condition.In a specific example, as shown in Fig. 2 d- Fig. 2 e, setting position range is 5 void The size of line rectangle, each rectangular area can be not all the same, correspondingly, the corresponding special video effect in each rectangular area can phase Together, can also be not all the same, left hand wrist joint of the left hand wrist joint point outside the range of setting position, in Fig. 2 e in Fig. 2 d Point is within the scope of setting position, when position position shown in Fig. 2 d of user's left hand wrist joint point becomes position shown in Fig. 2 e When setting, determine that user's left hand wrist joint point enters within the scope of setting position outside the range of setting position, so that it is determined that user Left hand wrist joint point meets preset joint position condition.
Optionally, the target body artis that the determination identifies in target image frame meets preset joint position Condition may include: that position when the target body artis in described image frame is in the joint position condition Within the scope of the setting position matched, and described image frame do not include with the matched special video effect of joint position condition, then by institute It states picture frame and is determined as target image frame, while determining that the target body artis identified in the target image frame meets Preset joint position condition.
Specifically, keeping the location status within the scope of setting position as preset joint target body artis Locality condition.Due to when target body artis is constantly within the scope of setting position, if add always special video effect or Special video effect is updated, so that special video effect quickly repeats to show, causes user that can not tell each special video effect, such as connect Continuous 50 frames, each picture frame start to show the same special video effect, and user watches the folded of the same animation effect at this time Add picture, while hearing the superposition audio of music special efficacy.Accordingly it is desirable to be constantly in setting position model in target body artis In enclosing, and corresponding special video effect has played end or there is no when the special video effect, has added the special video effect, to avoid It quickly repeats to show same special video effect.In a specific example, as shown in Figure 2 e, the wrist joint point of user, which is located at, to be set Determine in position range, if the corresponding special video effect of setting position range is not present in picture frame at this time, corresponding addition video is special Effect;If picture frame is not processed there are the corresponding special video effect of setting position range at this time.
It should be noted that above-mentioned joint position condition can also refer to be all satisfied pass in multiple target body artis When saving locality condition, determine that target body artis meets joint position condition.
S240 obtains next picture frame, returns and executes S220.
S250, using the video location of the target image frame as special efficacy add starting point, according to the joint position item The special efficacy duration of the matched special video effect of part, since the special efficacy add starting point, in the video with the special efficacy The special video effect is added in the picture frame of Duration match.
Wherein, special efficacy addition starting point can refer to initial position and/or the initial time of special video effect addition.Special efficacy continues Time can refer to the initial position of special video effect to time or initial time to the finish time undergone between end position it Between time.It can refer in video since special efficacy adds starting point with the picture frame of special efficacy Duration match, that is, Since target image frame, until the corresponding all picture frames terminated between picture frame at the end of the special video effect.For example, Special video effect is music special efficacy, if the duration of a music special efficacy is 3s, in the video, 1s plays 30 picture frames, By video playing sequence, 90 picture frames (including target image frame) since target image frame are and the special efficacy duration Matched picture frame.
The embodiment of the present disclosure obtains a series of images frame that video is split by captured in real-time video in real time, thus real When judge shooting video in target body artis whether meet joint position condition, further meeting joint position item In the case where part, special video effect is added in real time, may be implemented to add special video effect while video record, improves special video effect Addition efficiency.
On the basis of the above embodiments, optionally, the special video effect adding method can also include: in the view In the recording process of frequency, the picture frame in the video is presented in real time in video preview interface;Correspondingly, in the video It can also include: in the video while with the special video effect is added in the picture frame of the special efficacy Duration match In preview interface, the picture frame for adding the special video effect is presented in real time.
Wherein, video preview interface can refer to the interface that the terminal device of video is browsed for user, wherein terminal is set Standby may include server-side devices or client device.While captured in real-time video, by video real-time display in video In preview interface, user can be with the content of the video of displaying live view to shooting as a result,.
While addition special video effect in real time, video is followed to display together in video preview interface special video effect, So that the video after user's displaying live view to addition video effect, improves the efficiency of special video effect addition, user experience is improved.
Optionally, the special video effect includes: dynamic animation effect and/or music special efficacy;Correspondingly, described described In video preview interface, the picture frame for adding the special video effect is presented in real time, may include: at the video preview interface In, the real-time rendering dynamic animation effect in picture frame, and play music special efficacy.
Specifically, drawing dynamic animation in the picture frame of real-time display when special video effect includes dynamic animation effect Special efficacy, for example, drawing at least one of musical instrument, background and personage etc. image.When special video effect includes music special efficacy, in image Music special efficacy is played while frame real-time display.Include dynamic animation effect and/or music special efficacy by setting special video effect, mentions The diversity of high special video effect.
Embodiment three
Fig. 3 is a kind of flow chart for special video effect adding method that the embodiment of the present disclosure three provides.The present embodiment is with above-mentioned It is embodied based on each optinal plan in embodiment.In the present embodiment, the determination is known in target image frame Not Chu target body artis meet preset joint position condition be embodied as when the target body artis described Position in picture frame is within the scope of the setting position, and the target body artis is in the previous figure of described image frame When as the position in frame not within the scope of the matched setting position of joint position condition, then described image frame is determined as mesh Logo image frame, while determining that the target body artis identified in the target image frame meets preset joint position item Part.
Correspondingly, the method for the present embodiment may include:
S310 obtains at least one picture frame in the video, in video preview circle during video record in real time The picture frame in the video is presented in face in real time, and identifies at least one target body joint of user in described image frame Point.
Video, picture frame, target body artis, joint position condition, video location, special video effect in the present embodiment It can be with reference to the description in above-described embodiment with setting position range etc..
S320 from the picture frame chosen at least one described picture frame, is judging that the target body artis exists Whether the position in described image frame is within the scope of the matched setting position of joint position condition, until described at least one A picture frame all complete by judgement, if so, executing S330;Otherwise, S340 is executed.
Whether S330 judges position of the target body artis in the previous image frame of described image frame described Within the scope of setting position, if it is, executing S340;Otherwise S350 is executed.
S340 obtains next picture frame, returns and executes S320.
S350 using described image frame as target image frame, and is obtained special with the matched video of the joint position condition Effect.
S360, using the video location of the target image frame as special efficacy add starting point, according to the joint position item The special efficacy duration of the matched special video effect of part, since the special efficacy add starting point, in the video with the special efficacy The special video effect is added in the picture frame of Duration match, in the video preview interface, is presented described in addition in real time The picture frame of special video effect.
Example IV
Fig. 4 is a kind of structural schematic diagram for special video effect adding set that the embodiment of the present disclosure provides, and the present embodiment can fit The case where for adding special video effect in video.The device can realize that the device can by the way of software and/or hardware To be configured in terminal device.As shown in figure 4, the apparatus may include: target body artis identification module 410, video are special Effect obtains module 420 and special video effect adding module 430.
Target body artis identification module 410, for obtaining at least one picture frame in video, and in described image At least one target body artis of user is identified in frame;
Special video effect obtains module 420, for if it is determined that the target body artis identified in target image frame Meet preset joint position condition, then obtains and the matched special video effect of joint position condition;
Special video effect adding module 430 is used in the video and at the associated video location of target image frame, Addition and the matched special video effect of joint position condition.
The embodiment of the present disclosure meets joint position item by the target body artis recognized in the picture frame of video Part solves the special video effect of video interactive application excessively for video addition and the matched movement special efficacy of joint position condition Single problem realizes that the movement for user increases special video effect, improves the flexibility that video increases special efficacy.
Further, the target body artis identification module 410, comprising: picture frame obtains module in real time, is used for During video record, at least one picture frame in the video is obtained in real time;The special video effect adding module 430, packet Include: special efficacy adds starting point determining module, for adding starting point for the video location of the target image frame as special efficacy;Video is special Imitate real-time adding module, for according to and the matched special video effect of joint position condition the special efficacy duration, from described Special efficacy addition starting point starts, in the video with that the video is added in the picture frame of the special efficacy Duration match is special Effect.
Further, the special video effect obtains module 420, comprising: and target body artis enters condition judgment module, For being within the scope of the setting position when the target body artis in the position in described image frame, and the target Position of the human joint points in the previous image frame of described image frame be not in the matched setting position of joint position condition When in range, then described image frame is determined as target image frame, while determining the mesh identified in the target image frame Mark human joint points meet preset joint position condition.
Further, the special video effect obtains module 420, comprising: target body artis location status judgment module, For being in the matched setting position of the joint position condition when position of the target body artis in described image frame Set in range, and described image frame do not include with the matched special video effect of joint position condition, then it is described image frame is true It is set to target image frame, while determines that the target body artis identified in the target image frame meets preset joint Locality condition.
Further, the setting position range includes setting plan-position range or setting spatial position range.
Further, the special video effect adding set, further includes: module is presented in picture frame in real time, in the view In the recording process of frequency, the picture frame in the video is presented in real time in video preview interface;Mould is presented in special video effect in real time Block, for the picture frame for adding the special video effect to be presented in real time in the video preview interface.
Further, the special video effect includes: dynamic animation effect and/or music special efficacy;
Module is presented in the special video effect in real time, comprising: special efficacy is shown and playing module, in video preview circle In face, the real-time rendering dynamic animation effect in picture frame, and play music special efficacy.
The special video effect adding set that the embodiment of the present disclosure provides, the special video effect adding method category provided with embodiment one In same inventive concept, the technical detail of detailed description not can be found in embodiment one, and the disclosure in the embodiments of the present disclosure Embodiment and the beneficial effect having the same of embodiment one.
Embodiment five
The embodiment of the present disclosure provides a kind of terminal device, and below with reference to Fig. 5, it illustrates be suitable for being used to realizing the disclosure The structural schematic diagram of the electronic equipment (such as client server) 500 of embodiment.Terminal in the embodiment of the present disclosure is set It is standby to can include but is not limited to such as mobile phone, laptop, digit broadcasting receiver, personal digital assistant (PDA), put down The mobile terminal of plate computer (PAD), portable media player (PMP), car-mounted terminal (such as vehicle mounted guidance terminal) etc. And the fixed terminal of such as number TV, desktop computer etc..Electronic equipment shown in Fig. 5 is only an example, is not answered Any restrictions are brought to the function and use scope of the embodiment of the present disclosure.
As shown in figure 5, electronic equipment 500 may include processing unit (such as central processing unit, graphics processor etc.) 501, random access can be loaded into according to the program being stored in read-only memory (ROM) 502 or from storage device 508 Program in memory (RAM) 503 and execute various movements appropriate and processing.In RAM 503, it is also stored with electronic equipment Various programs and data needed for 500 operations.Processing unit 501, ROM 502 and RAM 503 pass through the phase each other of bus 504 Even.Input/output (I/O) interface 505 is also connected to bus 504.
In general, following device can connect to I/O interface 505: including such as touch screen, touch tablet, keyboard, mouse, taking the photograph As the input unit 506 of head, microphone, accelerometer, gyroscope etc.;Including such as liquid crystal display (LCD), loudspeaker, vibration The output device 507 of dynamic device etc.;Storage device 508 including such as tape, hard disk etc.;And communication device 509.Communication device 509, which can permit electronic equipment 500, is wirelessly or non-wirelessly communicated with other equipment to exchange data.Although Fig. 5 shows tool There is the electronic equipment 500 of various devices, it should be understood that being not required for implementing or having all devices shown.It can be with Alternatively implement or have more or fewer devices.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium On computer program, which includes the program code for method shown in execution flow chart.In such reality It applies in example, which can be downloaded and installed from network by communication device 509, or from storage device 508 It is mounted, or is mounted from ROM 502.When the computer program is executed by processing unit 501, the embodiment of the present disclosure is executed Method in the above-mentioned function that limits.
Embodiment six
The embodiment of the present disclosure additionally provides a kind of computer readable storage medium, and computer-readable medium can be computer Readable signal medium or computer readable storage medium either the two any combination.Computer readable storage medium Such as may be-but not limited to-system, device or the device of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, or Any above combination.The more specific example of computer readable storage medium can include but is not limited to: have one or more It is the electrical connection of a conducting wire, portable computer diskette, hard disk, random access storage device (RAM), read-only memory (ROM), erasable Formula programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), optical storage Device, magnetic memory device or above-mentioned any appropriate combination.In the disclosure, computer readable storage medium can be It is any to include or the tangible medium of storage program, the program can be commanded execution system, device or device using or with It is used in combination.And in the disclosure, computer-readable signal media may include in a base band or as carrier wave a part The data-signal of propagation, wherein carrying computer-readable program code.The data-signal of this propagation can use a variety of Form, including but not limited to electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media may be used also To be any computer-readable medium other than computer readable storage medium, which can send, It propagates or transmits for by the use of instruction execution system, device or device or program in connection.Computer The program code for including on readable medium can transmit with any suitable medium, including but not limited to: electric wire, optical cable, radio frequency Or above-mentioned any appropriate combination (RF) etc..
Above-mentioned computer-readable medium can be included in above-mentioned electronic equipment;It is also possible to individualism, and not It is fitted into the electronic equipment.
Above-mentioned computer-readable medium carries one or more program, when said one or multiple programs are by the electricity When sub- equipment executes, so that the electronic equipment: obtaining at least one picture frame in video, and identify and use in described image frame At least one target body artis at family;If it is determined that the target body artis identified in target image frame meets in advance If joint position condition, then obtain with the matched special video effect of joint position condition;In the video with the mesh At the associated video location of logo image frame, addition and the matched special video effect of joint position condition.
The calculating of the operation for executing the disclosure can be write with one or more programming languages or combinations thereof Machine program code, above procedure design language include object oriented program language-such as Java, Smalltalk, C+ +, it further include conventional procedural programming language-such as " C " language or similar programming language.Program code can Fully to execute, partly execute on the user computer on the user computer, be executed as an independent software package, Part executes on the remote computer or executes on a remote computer or server completely on the user computer for part. In situations involving remote computers, remote computer can pass through the network of any kind --- including local area network (LAN) Or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as utilize Internet service Provider is connected by internet).
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journey The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation A part of one module, program segment or code of table, a part of the module, program segment or code include one or more use The executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in box The function of note can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are actually It can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it to infuse Meaning, the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart can be with holding The dedicated hardware based system of functions or operations as defined in row is realized, or can use specialized hardware and computer instruction Combination realize.
Being described in module involved in the embodiment of the present disclosure can be realized by way of software, can also be by hard The mode of part is realized.Wherein, the title of module does not constitute the restriction to the module itself under certain conditions, for example, mesh Mark human joint points identification module is also described as " obtaining at least one picture frame in video, and in described image frame The module of at least one target body artis of middle identification user ".
Above description is only the preferred embodiment of the disclosure and the explanation to institute's application technology principle.Those skilled in the art Member is it should be appreciated that the open scope involved in the disclosure, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic Scheme, while should also cover in the case where not departing from design disclosed above, it is carried out by above-mentioned technical characteristic or its equivalent feature Any combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed in the disclosure Can technical characteristic replaced mutually and the technical solution that is formed.

Claims (16)

1. a kind of special video effect adding method characterized by comprising
At least one picture frame in video is obtained, and identifies at least one target body joint of user in described image frame Point;
If it is determined that the target body artis identified in target image frame meets preset joint position condition, then obtain With the matched special video effect of joint position condition;
In the video and at the associated video location of target image frame, add matched with the joint position condition Special video effect.
2. the method according to claim 1, wherein described at least one picture frame obtained in video, comprising:
During video record, at least one picture frame in the video is obtained in real time;
It is described in the video and at the associated video location of target image frame, addition and the joint position condition The special video effect matched, comprising:
Starting point is added using the video location of the target image frame as special efficacy;
According to the special efficacy duration with the matched special video effect of joint position condition, opened from special efficacy addition starting point Begin, adds the special video effect with the picture frame of the special efficacy Duration match in the video.
3. according to the method described in claim 2, it is characterized in that, the target person that the determination identifies in target image frame Body artis meets preset joint position condition, comprising:
When position of the target body artis in described image frame is in the matched setting position of the joint position condition It sets in range, and position of the target body artis in the previous image frame of described image frame be not in the setting position When in range, then described image frame is determined as target image frame, while determining the mesh identified in the target image frame Mark human joint points meet preset joint position condition.
4. according to the method described in claim 2, it is characterized in that, the target person that the determination identifies in target image frame Body artis meets preset joint position condition, comprising:
When position of the target body artis in described image frame is in the matched setting position of the joint position condition Set in range, and described image frame do not include with the matched special video effect of joint position condition, then it is described image frame is true It is set to target image frame, while determines that the target body artis identified in the target image frame meets preset joint Locality condition.
5. the method according to claim 3 or 4, which is characterized in that the setting position range includes setting plan-position Range or setting spatial position range.
6. according to the method described in claim 2, it is characterized by further comprising:
In the recording process of the video, the picture frame in the video is presented in real time in video preview interface;
While in the video with the special video effect is added in the picture frame of the special efficacy Duration match, also wrap It includes:
In the video preview interface, the picture frame for adding the special video effect is presented in real time.
7. according to the method described in claim 6, it is characterized in that, the special video effect includes: dynamic animation effect, and/or Music special efficacy;
It is described in the video preview interface, the picture frame for adding the special video effect is presented in real time, comprising:
In the video preview interface, the real-time rendering dynamic animation effect in picture frame, and play music special efficacy.
8. a kind of special video effect adding set characterized by comprising
Target body artis identification module is known for obtaining at least one picture frame in video, and in described image frame At least one target body artis of other user;
Special video effect obtains module, for if it is determined that the target body artis satisfaction identified in target image frame is default Joint position condition, then obtain with the matched special video effect of joint position condition;
Special video effect adding module, in the video and at the associated video location of target image frame, addition with The matched special video effect of joint position condition.
9. device according to claim 8, which is characterized in that the target body artis identification module, comprising:
Picture frame obtains module in real time, for obtaining at least one image in the video in real time during video record Frame;
The special video effect adding module, comprising:
Special efficacy adds starting point determining module, for adding starting point for the video location of the target image frame as special efficacy;
The real-time adding module of special video effect, when for according to continuing with the special efficacy of the matched special video effect of joint position condition Between, since the special efficacy adds starting point, institute is added with the picture frame of the special efficacy Duration match in the video State special video effect.
10. device according to claim 9, which is characterized in that the special video effect obtains module, comprising:
Target body artis enters condition judgment module, for working as position of the target body artis in described image frame It sets within the scope of the matched setting position of joint position condition, and the target body artis is in described image frame When position in previous image frame is not within the scope of the setting position, then described image frame is determined as target image frame, together When determine that the target body artis that identifies in the target image frame meets preset joint position condition.
11. device according to claim 9, which is characterized in that the special video effect obtains module, comprising:
Target body artis location status judgment module, for working as position of the target body artis in described image frame It sets within the scope of the matched setting position of joint position condition, and described image frame does not include and the joint position item Described image frame is then determined as target image frame by the matched special video effect of part, while determination is known in the target image frame Not Chu target body artis meet preset joint position condition.
12. device described in 0 or 11 according to claim 1, which is characterized in that the setting position range includes setting plane position Set range or setting spatial position range.
13. device according to claim 9, which is characterized in that further include:
Module is presented in picture frame in real time, for institute to be presented in real time in video preview interface in the recording process of the video State the picture frame in video;
Module is presented in special video effect in real time, for presenting add the special video effect in real time in the video preview interface Picture frame.
14. device according to claim 13, which is characterized in that the special video effect includes: dynamic animation effect, and/ Or music special efficacy;
Module is presented in the special video effect in real time, comprising:
Special efficacy is shown and playing module, in the video preview interface, real-time rendering dynamic animation to be special in picture frame Effect, and play music special efficacy.
15. a kind of terminal device characterized by comprising
One or more processors;
Memory, for storing one or more programs;
When one or more of programs are executed by one or more of processors, so that one or more of processors are real Existing special video effect adding method as claimed in claim 1.
16. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor Special video effect adding method as claimed in claim 1 is realized when execution.
CN201811447969.8A 2018-11-29 2018-11-29 Video special effect adding method and device, terminal equipment and storage medium Active CN109600559B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811447969.8A CN109600559B (en) 2018-11-29 2018-11-29 Video special effect adding method and device, terminal equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811447969.8A CN109600559B (en) 2018-11-29 2018-11-29 Video special effect adding method and device, terminal equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109600559A true CN109600559A (en) 2019-04-09
CN109600559B CN109600559B (en) 2021-07-23

Family

ID=65959384

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811447969.8A Active CN109600559B (en) 2018-11-29 2018-11-29 Video special effect adding method and device, terminal equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109600559B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110582021A (en) * 2019-09-26 2019-12-17 深圳市商汤科技有限公司 Information processing method and device, electronic equipment and storage medium
CN110740262A (en) * 2019-10-31 2020-01-31 维沃移动通信有限公司 Background music adding method and device and electronic equipment
CN111611941A (en) * 2020-05-22 2020-09-01 腾讯科技(深圳)有限公司 Special effect processing method and related equipment
CN112106347A (en) * 2019-08-30 2020-12-18 深圳市大疆创新科技有限公司 Image generation method, image generation equipment, movable platform and storage medium
WO2022116751A1 (en) * 2020-12-02 2022-06-09 北京字节跳动网络技术有限公司 Interaction method and apparatus, and terminal, server and storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002298557A (en) * 2001-03-30 2002-10-11 Fantekkusu:Kk System for editing nonlinear video, recording medium and photograph holder
EP2028619A1 (en) * 2006-05-25 2009-02-25 NEC Corporation Video image special effect detecting device, special effect detecting method, special effect detecting program and video image reproducing device
CN103020648A (en) * 2013-01-09 2013-04-03 北京东方艾迪普科技发展有限公司 Method and device for identifying action types, and method and device for broadcasting programs
CN107038455A (en) * 2017-03-22 2017-08-11 腾讯科技(深圳)有限公司 A kind of image processing method and device
WO2018053257A1 (en) * 2016-09-16 2018-03-22 Second Spectrum, Inc. Methods and systems of spatiotemporal pattern recognition for video content development
CN108182396A (en) * 2017-12-25 2018-06-19 中国电子科技集团公司电子科学研究院 A kind of automatic identification is taken pictures the method and device of behavior
CN108289180A (en) * 2018-01-30 2018-07-17 广州市百果园信息技术有限公司 Method, medium and the terminal installation of video are handled according to limb action
CN108537867A (en) * 2018-04-12 2018-09-14 北京微播视界科技有限公司 According to the Video Rendering method and apparatus of user's limb motion
CN108615055A (en) * 2018-04-19 2018-10-02 咪咕动漫有限公司 A kind of similarity calculating method, device and computer readable storage medium
CN108712661A (en) * 2018-05-28 2018-10-26 广州虎牙信息科技有限公司 A kind of live video processing method, device, equipment and storage medium

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002298557A (en) * 2001-03-30 2002-10-11 Fantekkusu:Kk System for editing nonlinear video, recording medium and photograph holder
EP2028619A1 (en) * 2006-05-25 2009-02-25 NEC Corporation Video image special effect detecting device, special effect detecting method, special effect detecting program and video image reproducing device
CN103020648A (en) * 2013-01-09 2013-04-03 北京东方艾迪普科技发展有限公司 Method and device for identifying action types, and method and device for broadcasting programs
WO2018053257A1 (en) * 2016-09-16 2018-03-22 Second Spectrum, Inc. Methods and systems of spatiotemporal pattern recognition for video content development
CN107038455A (en) * 2017-03-22 2017-08-11 腾讯科技(深圳)有限公司 A kind of image processing method and device
CN108182396A (en) * 2017-12-25 2018-06-19 中国电子科技集团公司电子科学研究院 A kind of automatic identification is taken pictures the method and device of behavior
CN108289180A (en) * 2018-01-30 2018-07-17 广州市百果园信息技术有限公司 Method, medium and the terminal installation of video are handled according to limb action
CN108537867A (en) * 2018-04-12 2018-09-14 北京微播视界科技有限公司 According to the Video Rendering method and apparatus of user's limb motion
CN108615055A (en) * 2018-04-19 2018-10-02 咪咕动漫有限公司 A kind of similarity calculating method, device and computer readable storage medium
CN108712661A (en) * 2018-05-28 2018-10-26 广州虎牙信息科技有限公司 A kind of live video processing method, device, equipment and storage medium

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112106347A (en) * 2019-08-30 2020-12-18 深圳市大疆创新科技有限公司 Image generation method, image generation equipment, movable platform and storage medium
CN110582021A (en) * 2019-09-26 2019-12-17 深圳市商汤科技有限公司 Information processing method and device, electronic equipment and storage medium
CN110740262A (en) * 2019-10-31 2020-01-31 维沃移动通信有限公司 Background music adding method and device and electronic equipment
CN111611941A (en) * 2020-05-22 2020-09-01 腾讯科技(深圳)有限公司 Special effect processing method and related equipment
CN111611941B (en) * 2020-05-22 2023-09-19 腾讯科技(深圳)有限公司 Special effect processing method and related equipment
WO2022116751A1 (en) * 2020-12-02 2022-06-09 北京字节跳动网络技术有限公司 Interaction method and apparatus, and terminal, server and storage medium

Also Published As

Publication number Publication date
CN109600559B (en) 2021-07-23

Similar Documents

Publication Publication Date Title
CN109618183B (en) A kind of special video effect adding method, device, terminal device and storage medium
CN109462776B (en) Video special effect adding method and device, terminal equipment and storage medium
CN109600559A (en) A kind of special video effect adding method, device, terminal device and storage medium
CN109525891A (en) Multi-user's special video effect adding method, device, terminal device and storage medium
CN109495695A (en) Moving object special video effect adding method, device, terminal device and storage medium
CN111726536A (en) Video generation method and device, storage medium and computer equipment
CN109167950A (en) Video recording method, video broadcasting method, device, equipment and storage medium
CN111857923B (en) Special effect display method and device, electronic equipment and computer readable medium
CN109474850A (en) Move pixel special video effect adding method, device, terminal device and storage medium
CN109872297A (en) Image processing method and device, electronic equipment and storage medium
CN109091869A (en) Method of controlling operation, device, computer equipment and the storage medium of virtual objects
CN109495684A (en) A kind of image pickup method of video, device, electronic equipment and readable medium
CN109348277A (en) Move pixel special video effect adding method, device, terminal device and storage medium
CN109862274A (en) Earphone with camera function, the method and apparatus for exporting control signal
US20230419582A1 (en) Virtual object display method and apparatus, electronic device, and medium
CN109729372A (en) Method for switching between, device, terminal, server and storage medium is broadcast live
CN112261481B (en) Interactive video creating method, device and equipment and readable storage medium
CN109982130A (en) A kind of video capture method, apparatus, electronic equipment and storage medium
KR20220148915A (en) Audio processing methods, apparatus, readable media and electronic devices
CN111445901A (en) Audio data acquisition method and device, electronic equipment and storage medium
CN111028566A (en) Live broadcast teaching method, device, terminal and storage medium
US11886484B2 (en) Music playing method and apparatus based on user interaction, and device and storage medium
CN111276122A (en) Audio generation method and device and storage medium
CN109873905A (en) Audio frequency playing method, audio synthetic method, device and storage medium
CN116016817A (en) Video editing method, device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant