CN115082595A

CN115082595A - Video production method, template generation method, device and equipment

Info

Publication number: CN115082595A
Application number: CN202210541462.9A
Authority: CN
Inventors: 葛铁铮; 王标; 叶浩; 姜宇宁
Original assignee: Alibaba China Co Ltd
Current assignee: Alibaba China Co Ltd
Priority date: 2022-05-17
Filing date: 2022-05-17
Publication date: 2022-09-20

Abstract

The embodiment of the application provides a video production method, a template generation device and video production equipment. The video production method comprises the following steps: acquiring a design file template for manufacturing a video and a material of a target object; the design file template comprises template elements and labels corresponding to the template elements, and the labels are used for describing the requirements of the corresponding template elements on the materials; filling materials of the target object to the position where the corresponding template element is located according to the label to obtain a design file of the target object; and rendering the design file of the target object to obtain a video of the target object. The method and the device enable a designer to control the style of the generated video through filling of the label control material included in the template, thereby reducing the problem that the style of the video manufactured based on the template is far different from the style of the video which the designer wants to express through the template.

Description

Video production method, template generation method, device and equipment

Technical Field

The present application relates to the field of video production technologies, and in particular, to a video production method, a template generation method, an apparatus, and a device.

Background

In recent years, short videos are attracting more and more attention of users, and the display form of e-commerce products is gradually expanded from pictures to short videos, so that the production of short video displays for commodities becomes an important requirement.

At present, the main mode of automatic short video production is the mode of template and material filling. Specifically, a designer can obtain a design file template for making a video through design software, wherein template elements needing to be filled are reserved; when the video is produced, the video production system can fill pictures, files and videos of the commodity into the positions of the template elements to form the videos of the commodity.

However, in such a video production method, the video production system can fill in the material at will, which results in a problem that the formed video is far from the video style that the designer wants to achieve through the template.

Disclosure of Invention

The embodiment of the application provides a video production method, a template generation device and video production equipment, and aims to solve the problem that a video formed in the prior art is far different from a video style which a designer wants to achieve through a template.

In a first aspect, an embodiment of the present application provides a video production method, including:

acquiring a design file template for manufacturing a video and a material of a target object; the design file template comprises template elements and labels corresponding to the template elements, and the labels are used for describing the requirements of the corresponding template elements on the materials;

filling materials of the target object to the position of the corresponding template element according to the label to obtain a design file of the target object;

and rendering the design file of the target object to obtain a video of the target object.

In a second aspect, an embodiment of the present application provides a template generating method, including:

displaying elements in a design file of a sample video;

acquiring template design operation, wherein the template design operation is used for selecting target elements serving as elements in a template from the elements of the design file and setting labels corresponding to the target elements, and the labels are used for describing requirements of the corresponding target elements on materials;

and generating a design file template according to the template design operation, wherein the design file template comprises template elements and labels corresponding to the template elements.

In a third aspect, an embodiment of the present application provides a video production apparatus, including:

the acquisition module is used for acquiring a design file template for manufacturing a video and a material of a target object; the design file template comprises template elements and labels corresponding to the template elements, and the labels are used for describing the requirements of the corresponding template elements on the materials;

the filling module is used for filling the material of the target object to the position where the corresponding template element is located according to the label to obtain a design file of the target object;

and the rendering module is used for rendering the design file of the target object to obtain the video of the target object.

In a fourth aspect, an embodiment of the present application provides a template generating apparatus, including:

the display module is used for displaying elements in the design file of the sample video;

an obtaining module, configured to select, by the template design operation, a target element as an element in a template from elements in the design file and set a tag corresponding to the target element, where the tag is used to describe a requirement of the corresponding target element for a material;

and the generating module is used for generating a design file template according to the template design operation, wherein the design file template comprises template elements and labels corresponding to the template elements.

In a fifth aspect, an embodiment of the present application provides an electronic device, including: a memory, a processor; wherein the memory is to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the method of any of the first aspects.

In a sixth aspect, an embodiment of the present application provides an electronic device, including: a memory, a processor; wherein the memory is configured to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the method of any of the second aspects.

In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed, the method according to any one of the first aspect is implemented.

In an eighth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed, the method according to any one of the second aspects is implemented.

Embodiments of the present application also provide a computer program, which is used to implement the method according to any one of the first aspect when the computer program is executed by a computer.

Embodiments of the present application also provide a computer program, which is used to implement the method according to any one of the second aspect when the computer program is executed by a computer.

In the embodiment of the application, the video file template designed by the designer includes, in addition to the template elements, labels corresponding to the template elements, and the labels can be used for describing requirements of the corresponding template elements on materials, and when a video is produced, the materials of a target object are filled to the positions where the corresponding template elements are located according to the labels, so that the designer can control the style of the generated video by controlling the filling of the materials through the labels included in the template, thereby reducing the problem that the style of the video produced based on the template is far from the style of the video that the designer wants to express through the template.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following descriptions are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

Fig. 1 is a schematic view of an application scenario of a video production method according to an embodiment of the present application;

fig. 2 is a schematic flowchart of a video production method according to an embodiment of the present application;

fig. 3 is a schematic diagram of a scenario provided in an embodiment of the present application;

FIG. 4 is a schematic view of a label system provided by an embodiment of the present application;

FIGS. 5A-5D are schematic diagrams of videos generated by applying a scenario to a product according to an embodiment of the present application;

FIG. 6 is a schematic diagram illustrating an overall flow chart of a scenario applied to a product to produce a video of the product according to an embodiment of the present application;

fig. 7 is a schematic flowchart of a template generating method according to an embodiment of the present application;

fig. 8A and 8B are schematic diagrams of a marking interface provided in an embodiment of the present application;

FIG. 9 is a schematic diagram of a preview interface provided in an embodiment of the present application;

fig. 10 is a schematic structural diagram of a video production apparatus according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of a template generating apparatus according to an embodiment of the present application;

fig. 13 is a schematic structural diagram of an electronic device according to another embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terminology used in the embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the examples of this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, and "a" and "an" typically include at least two, but do not exclude the presence of at least one.

It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.

The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.

It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a commodity or system that includes the element.

In addition, the sequence of steps in each method embodiment described below is only an example and is not strictly limited.

Fig. 1 is a schematic view of an application scenario of a video production method provided in an embodiment of the present application, and as shown in fig. 1, the application scenario may include: a first device 11 and a second device 12. The first device 11 may generate a design file template for producing a video, and the second device 12 may produce a video of the target object based on the design file template generated by the first device 11 and the material of the target object. The target object refers to any type of object that needs to generate a video according to a design file template, taking application to an e-commerce scene as an example, the target object may specifically be a commodity object (hereinafter, the target object is mainly taken as the commodity object for example, and the material refers to any type of material that can be used for generating a video of the target object, such as a file, a video, a picture, and the like.

For example, the first device 12 in fig. 1 may send the generated design file template to the second device 12, or the first device 12 may store the generated design file template in a database, and the second device 12 may obtain the generated design file template from the database.

It should be noted that fig. 1 illustrates an example in which the apparatus for generating the template and the apparatus for creating the video are different apparatuses, and it is to be understood that in other embodiments, the apparatus for generating the template and the apparatus for creating the video may be the same apparatus.

Usually, only the template elements to be filled are reserved in the design file template, and the template elements can be filled at will during video production, for example, pictures can be selected at will to be filled to the positions of the picture elements.

In order to solve the technical problem that a video manufactured based on a template is far different from the style of the video which a designer wants to express through the template in the prior art, in the embodiment of the application, the video file template designed by the designer further comprises a label corresponding to the template element besides the template element, the label can be used for describing the requirement of the corresponding template element on a material, when the video is manufactured, the material of a target object is filled to the position where the corresponding template element is located according to the label, so that the designer can control the style of the generated video by controlling the filling of the material through the label included in the template, and the problem that the video manufactured based on the template is far different from the style of the video which the designer wants to express through the template is solved.

Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.

Fig. 2 is a flowchart illustrating a video production method according to an embodiment of the present application, where an execution subject of the embodiment may be the second device 12 in fig. 1, and may be specifically applied to a video production system running on the second device 12. As shown in fig. 2, the method of this embodiment may include:

step 21, acquiring a design file template for making a video and a material of a target object; the design file template comprises template elements and labels corresponding to the template elements, and the labels are used for describing the requirements of the corresponding template elements on the materials;

step 22, filling the material of the target object to the position of the corresponding template element according to the label to obtain a design file of the target object;

and step 23, rendering the design file of the target object to obtain a video of the target object.

In the embodiment of the application, the design file template is a template generated based on a design file of a sample video, the sample video may be a sample designed by a designer and used for making a video, the design file of the sample video may include a plurality of elements, and the types of the elements may include, for example, video clips, pictures, documents, sounds, and the like. It should be understood that the nature of the elements in the design file are material, and may be referred to as elements since they are part of the composition of the design file.

The design file template can be obtained by setting one or more elements in the design file of the sample video as reserved template elements for filling materials and setting corresponding labels for the template elements. In the embodiment of the present application, the template element may refer to a part of a figure, text, video, or the like in the scenario that may be replaced, that is, a part to be filled in the scenario.

In the present application, a design document template including template elements and their corresponding tags may be referred to as a design document scenario, simply "scenario". In the embodiment of the present application, a scenario may refer to an example and a generation manner description designed by a designer for controlling generation of a video style; the template elements can refer to parts such as figures, texts, videos and the like which can be replaced in the script, namely the parts to be filled in the script; the material may refer to a picture, a video clip, a file, etc. of the target object, which may be used to make a video, and may be filled in a scenario.

In embodiments of the present application, tags may be used to describe requirements for material that can be filled in to the location of the corresponding template element. Illustratively, the requirements for material that can be filled in to the location of the corresponding template element can be described in the form of an attribute tag. Based on this, in one embodiment, the template elements in the design file template may include a first template element, and the corresponding tags of the first template element may include attribute tags, where the attribute tags are used to describe attribute requirements of the corresponding template elements on the material that can be filled in. The first template element may specifically be any type of template element that needs to control material selection in the design file template, the number of the first template elements may be multiple, and for example, the type of the first template element may include one or more of a file, a picture, a video clip, and the like. The template element with the type of the case can be used for filling the material with the type of the case, the template element with the type of the picture can be used for filling the material with the type of the picture, and the template element with the type of the video clip can be used for filling the material with the type of the video clip.

Optionally, the attribute tag corresponding to the first template element may be specifically used to describe the attribute requirement of the corresponding template element on the material that can be filled. It should be noted that the self attribute requirement may be flexibly implemented as needed, and the attribute tag used for describing the self attribute requirement may include, for example, a type attribute tag, a scene attribute tag, and/or a definition attribute tag. The scene attribute tag may be, for example, an indoor scene, a street shooting scene, a canopy shooting scene, or the like.

For example, taking the type of the first template element as a case, the attribute tag corresponding to the first template element may include a case type attribute tag, and the case type attribute tag may be, for example, a selling point, a walking case, a keyword, a Sku case, a short title, a shop name, a long case, a starting question, a promotional word, or the like. For example, if a label corresponding to a certain template element in the design document template includes a selling point, it may indicate that a document with a type attribute of the selling point needs to be selected and filled in the position of the template element.

For another example, taking the type of the first template element as a picture as an example, the attribute tag corresponding to the first template element may include a picture type attribute tag, and the picture type attribute tag may be, for example, a main picture, a drawing, a Sku picture, a LOGO picture, a creative intention, a product cutout, a character cutout, a mask template picture, or the like. For example, if a tag corresponding to a certain template element in the design file template includes a main graph, it may indicate that a picture with a type attribute as the main graph needs to be selected to fill the position of the template element. The first picture is usually ordered as the main picture (main picture) and the following pictures are auxiliary pictures (figures), and example pictures for showing different attributes (size, color, etc.) of the same commodity are called Sku pictures.

For another example, taking the type of the first template element as a video as an example, the attribute tag corresponding to the first template element may include a video content attribute tag, and the video content attribute tag may be, for example, a product display video, a model display video, a detail display video, a summary display video, or the like. For example, if a tag corresponding to a certain template element in the design document template includes a product display, it may indicate that a video clip with a type attribute of a product display video is required to be filled into a position where the template element is located.

And/or optionally, the attribute tag corresponding to the first template element may be specifically used to describe a requirement of a relationship attribute between the corresponding template element and the material that can be filled in the position where the associated template element is located. Wherein the first template element and its associated template element may be located in the same segment divided by the shot. It should be noted that the relationship attribute requirement can be flexibly implemented as required, and the attribute tags for describing the relationship attribute requirement may include, for example, similar relationship attribute tags, collocation relationship attribute tags, and/or mutual exclusion relationship attribute tags. The similarity relationship may be, for example, a semantic similar similarity relationship, a visual similar similarity relationship, or the like; the collocation relationship can be, for example, a collocation relationship of semantic collocation, a collocation relationship of background color collocation, and the like; the mutual exclusion relationship may be, for example, a mutual exclusion relationship in which the sizes of the objects are not matched.

For example, taking the type of the first template element as a document as an example, the attribute tags corresponding to the first template element may include document group attribute tags, and the document group tags may be, for example, a group a, a group B, a group C, and the like that represent the similarity relationship between documents. For example, assuming that the tags corresponding to two template elements in the design document template both include group a, for one of the two template elements, it may indicate that a document with semantic similarity to the material on the other template element needs to be selected and filled in the position of the template element.

For another example, taking the type of the first template element as a picture as an example, the attribute tags corresponding to the first template element may include multimedia group attribute tags, and the multimedia group attribute tags may be, for example, group 1, group 2, group 3, and the like that represent visual similarity between the picture and the picture/video clip. For example, assuming that the labels of a certain template element and a certain template element in the design document template all include group 1, it may be indicated that, for one of the template elements, a picture visually similar to the material on the other template element needs to be selected to be filled in the position of the template element.

Optionally, the tag corresponding to the first template element may further include a form tag and/or a mode tag, where the form tag is used to describe a filling form requirement of the corresponding template element on the material, and the mode tag is used to describe a filling form requirement of the corresponding template element on the material. It should be noted that the requirements of the filling form and the filling manner can be flexibly implemented according to the requirements.

For example, when the type of the first template element is a case, the form tag corresponding to the first template element may include a semantic fold line tag, and the semantic fold line tag may be, for example, a semantic fold line or a semantic-free fold line, and when the semantic fold line tag is a semantic fold line, it may indicate that the case needs to be filled in a position where the template element is located in a form of the semantic fold line.

For another example, when the type of the first template element is a picture, the manner tag corresponding to the first template element may include a filling manner tag, and the filling manner tag may be, for example, equal-proportion filling or foreground filling, and when the filling manner tag is equal-proportion filling, it may indicate that the picture needs to be filled to the position of the template element in an equal-proportion filling manner.

In embodiments of the present application, tags may be used to describe requirements for the form in which material is populated where the corresponding template elements are located. Illustratively, the requirements for the form in which the material is populated where the corresponding template element is located may be described in the form of a form tag. Based on this, in one embodiment, optionally, the template element may include a second template element, and the tag corresponding to the second template element may include a form tag, where the form tag is used to describe a filling form requirement for the material on the first template element. The second template element may specifically be any type of template element that does not require control of material selection but requires control of material form in the design file template, and for example, the type of the second template element may include sound. Wherein the type-sound template element can be used to fill in the type-sound background music.

For example, taking the type of the second template element as a sound as an example, the attribute tag corresponding to the second template element may include a smart comment tag, which may be, for example, with or without a comment, and when the smart comment tag is with a comment, it may indicate that background music needs to be filled in a narration form to a position where the sound template element is located.

Assuming that the sample video is a short video of a basketball and the sample video is divided into a plurality of segments according to shots, the design file template provided in the embodiment of the present application may be, for example, as shown in fig. 3, and referring to fig. 3, the design file of the sample video may include a visual element of a type of video segment, a file element of a type of file, and a sound element of a type of sound. In the first lens, the type of the file in the first lens can be controlled to be an opening problem so as to provide a problem and guide to watch; the picture type can be controlled to be a main picture or an attached picture and the pattern type is a selling point pattern in the middle three lenses so as to answer questions; in the last shot, the content attribute can be controlled to be a model show or a commodity show and the file type is a long file for detailed introduction. In addition, the background music tape commentary can be controlled to play the intelligent commentary at the same time of playing the background music.

It should be noted that the "script" is the core innovation point of the scheme. As shown in fig. 3, the source of the scenario may be a specific video, which is usually a display video designed by a designer for a commodity, and the display video is usually divided into a plurality of segments (also called shots), each segment being composed of a number of pictures, texts or video segments (also called elements). In order to migrate the display video to other commodities, designers can dig out elements related to the commodities in the video, flow out blanks, make replaceable templates and wait for filling materials of subsequent target commodities.

On the basis of the template, in order to enable the filled materials to be matched more visually and enable the filled video to better meet the design intention of a designer, a concept of a label is provided, wherein the label can comprise an attribute label, and the attribute label is an attribute required by the script element. Designers have placed demands on material that can be filled in on elements by adding attribute tags to the elements. As shown in fig. 2, for the example scenario, the designer adds labels such as "main picture", "drawing", "model exhibition video", "commodity exhibition video" to the visual elements of each shot, respectively, and indicates that it is necessary to fill the positions of these elements with commodity materials having attributes such as main picture, drawing, video with model exhibition, and video with commodity exhibition.

In order to make designers express richer design ideas as much as possible, the embodiment of the present application may provide a set of label system, which may be shown in fig. 4, for example. Referring to fig. 4, the system can be divided into elements related to a document, a video image, a sound, etc., including types of the elements (e.g., document type), contents of the elements (e.g., video semantic content), and interrelations between the elements (e.g., similar multimedia group, indicating that a plurality of elements need to be visually similar). When designing the script, the designer can flexibly use the labels to express the design intention of the designer. It should be noted that the function of the fragment type tag in fig. 4 will be described in the embodiment shown in fig. 7.

In one embodiment, a video production system may automatically extract a plurality of stories of a target object used to generate a video. Taking the target object as a commodity object as an example, in the material extraction stage, various useful elements can be extracted around the commodity, which can include pictures, videos, copy and background music. For the pictures, for example, a main picture, a sub-picture, a Sku picture, an advertisement creative intention and the like of the commodity can be included, and in order to ensure visual aesthetics, the pictures are preprocessed and filtered by using an algorithm; for the video, for example, the video of the commodity including the head and the tail of the video can be segmented according to a transition shot to obtain segments as materials, and the materials can be processed by the aesthetic degree; the file can include the natural file such as the title of the commodity, the full-minus information and the like, and can also include the file generated by the natural language generation technology; for sound, for example, background music and automatically synthesized commentary may be included.

In the embodiment of the application, after the materials of the design file template and the target object are obtained, the materials can be filled based on the materials of the design file template and the target object.

In one embodiment, in the case that the template element includes a first template element, and the tag included in the first template element includes an attribute tag, the material that can be filled in by the template element may be selected by means of tag matching. Based on the above, in one embodiment, according to the attribute tags of the material of the target object, the material matching the attribute tag corresponding to the first template element is selected from the material of the target object, and the selected material is filled in the position where the first template element is located. For example, assuming that the type of a certain template element in the design document template is a picture, the type of another template element is a video, and the attribute tags of the two template elements both include the same similarity relationship attribute tag used for representing visual similarity, the picture in a visually similar picture and a video clip may be filled in the position where the template element of the two template elements, of which the type is a picture, is located, and the video clip is filled in the position where the template element of the two template elements, of which the type is a video, is located.

The material of the target object may have an attribute tag, and the attribute tag may include, for example, the main picture, the sub-picture, the keyword, the Sku pattern, and the like, and/or the video production system may print an attribute tag (material understanding) on the material, such as the indoor scene, the product display video, and the like, and in addition, the video production system may complete semantic folding of the pattern, that is, may determine a folding position of the pattern.

Both material extraction and material understanding can be completed in a material preparation stage, material preparation of target objects can be independent steps, and is not related to a specific design file template, and material preparation of each target object is irrelevant. That is, the material of the target object can be prepared and completed at one time for use by various subsequent design file templates, and designers can design new design file templates without preparing the material again.

In the material understanding stage, the scheme comprehensively applies image, video and Natural Language Processing (NLP) technology to understand and analyze the material, selects a proper label from the label system shown in fig. 4 to label the material, and can link the material suitable for filling with the filling position by designing the label of the script element and the label of the commodity material. For adapting to a plurality of complex labels, the scheme relates to a mode which can relate to understanding and analysis of a plurality of materials, for example, the definition of a picture/video can be analyzed through picture characteristic analysis, the foreground and background areas of the picture/video can be analyzed through spatial layout analysis, the foreground and background dominant colors of the picture/video can be analyzed through color analysis, the position of a picture/video model, the position of a body key point and the movement rhythm can be analyzed through character analysis, the recognition of indoor, street shooting and greenhouse shooting scenes of the picture/video can be carried out through scene understanding, and the semantic folding position of a file can be determined through semantic analysis on the file.

Optionally, under the condition that the tag corresponding to the first template element further includes a form tag, filling the selected material to the position where the first template element is located, which may specifically include: and filling the selected material in the form required by the form label to the position of the first template element.

And/or optionally, under the condition that the tag corresponding to the first template element further includes a mode tag, filling the selected material to the position where the first template element is located, which may specifically include: and filling the selected material to the position of the first template element according to the mode required by the mode label.

In another embodiment, in the case that the template elements in the design document template include a second template element, the material of the target object corresponding to the second template element may be filled in the form required by the corresponding form tag to the position where the second template element is located. For example, assuming that the formal tags of the sound template elements in the design file template include commentary, the sound template elements may be populated with background music and commentary.

In the embodiment of the application, the material of the target object is filled into the template element, so that the design file of the target object can be obtained, and the video of the target object can be obtained by rendering the design file of the target object. The tags in the design file template may be retained in the design file of the target object, and the tags may not be rendered during rendering. For a specific manner of rendering the design file to obtain the video, reference may be made to specific descriptions in the related art, and details are not described herein again.

Assuming that the attribute tags of the template elements of which the certain type is a picture and the attribute tags of the template elements of which the certain type is a video in the design file template both include the same similarity relationship attribute tag used for representing visual similarity, a picture in a visually similar picture and a video clip can be filled in the position where the template elements of which the type is a picture in the two template elements are located, and the video clip can be filled in the position where the template elements of which the type is a video in the two template elements are located, and the finally produced video can be shown in fig. 5D in fig. 5A, for example. Fig. 5A and 5B show images of a certain frame in videos of different products created using the same design document template, and fig. 5C and 5D show images of a certain frame in videos of different products created using the same design document template. Similarly, in one shot of the two design file templates, the left and right are respectively a picture and a video element, so that the picture vision of the produced video is more coordinated, a designer can mark the left and right elements with the mark that the picture element (left side of the shot) is similar to the video element (right side of the shot), and then when the video is produced, the video production system can select the picture and the video material with similar relation to fill in the shot, so that the left picture and the right video of the produced shot are similar, the picture is more coordinated, and the picture can not be achieved by the template scheme of simply filling the material.

As can be seen from fig. 5A and 5B or fig. 5C and 5D, the same design document template acts on different commodities to produce display videos with similar styles, and different design document templates can correspond to different video styles.

The general flow chart of applying the design file template to the commodity to make the video of the commodity is shown in fig. 6, and it can be seen that the video imitating the example of the commodity can be obtained by applying the design file template shown in fig. 3 to a certain commodity, and the style of the produced video can be consistent with the style of the original video of the script due to the label system. In addition, the labels of the materials of the commodities are pre-calculated, and the video production stage can be very fast, so that the requirement of producing the display video with controllable styles on a large scale can be met.

In the embodiment of the application, the template elements and the corresponding labels are included in the template of the design file, the material of the target object is filled to the positions where the corresponding template elements are located according to the labels, the design file of the target object is obtained, the design file of the target object is rendered, and the video of the target object is obtained, so that a designer can control the style of the generated video by controlling the filling of the material through the labels included in the template, and the problem that the video manufactured based on the template is far from the video effect which the designer wants to express through the template is solved.

Compared with the traditional scheme that only the strategy of template elements is reserved, the strategy of script proposed by the scheme introduces the concept of label, so that a designer can effectively express the requirements on each element in the output video; matching with the method, the method can increase the comprehension of the material after the material of the target object is extracted, so as to add a proper label to the material; in video production, appropriate materials are selected and filled into a video by matching the labels in the script with the labels of the materials. Thus, "tabbed" screenplay "enables control over the creation of a video style.

Fig. 7 is a flowchart illustrating a template generating method according to an embodiment of the present application, where an execution subject of the embodiment may be the first device 11 in fig. 1, and may be specifically applied to a template design platform running on the first device 11. As shown in fig. 7, the method of this embodiment may include:

step 71, displaying elements in a design file of the sample video;

step 72, acquiring template design operation, wherein the template design operation is used for selecting target elements from the elements of the design file as the elements in the template and setting labels corresponding to the target elements, and the labels are used for describing the requirements of the corresponding target elements on the material;

and 73, generating a design file template according to the template design operation, wherein the design file template comprises template elements and labels corresponding to the template elements.

The sample video may be a sample designed by a designer for making a video. The sample video may include a plurality of elements, and the types of the elements may include, for example, video clips, pictures, documentaries, sounds, and the like. The positions of elements in the design file of the sample video may be identified in a picture layer by taking a shot as a unit, and for the specific manner of identifying the elements, reference may be made to the specific description in the related art, which is not repeated herein. The location at which an element is located may be referred to as an element location.

In the embodiment of the application, the elements in the design file of the sample video can be displayed, and the template design operation input by a designer according to the displayed elements is obtained. Optionally, the elements in the design file are displayed in the fragment segments based on the fragments divided by the sample video according to the shot, so that designers can design the fragment segments respectively, and the use experience of the designers is improved.

Based on this, in an embodiment, the displaying of the elements in the design file of the sample video may specifically include: and responding to the section selection operation aiming at the sample video, and displaying the elements in the design file of the sample video, which are positioned in the current section selected by the section selection operation. Correspondingly, the obtaining of the template design operation may specifically include: a template design operation for the current segment is obtained. In this case, the template design operation may be specifically used to select a target element from the elements of the design file located in the current segment and set a tag corresponding to the target element.

For example, as shown in fig. 8A, assuming that a selection operation for a certain fragment of the multiple fragments shown in fig. 8A is obtained, a fragment marking interface as shown in fig. 8B may be displayed, and an element in the current fragment and a corresponding label option (for example, a selling point) thereof may be displayed in the fragment marking interface, so that a designer may mark the element in the fragment, and for example, the designer may select a target element from the elements in the current fragment and set a label corresponding to the target element by selecting the element and checking the label corresponding to the selected element.

Further optionally, the elements included in the design file can be displayed in a classified manner, so that designers can design respectively in a classified manner, and the use experience of the designers can be further improved. Based on this, in an embodiment, the position in the design file displaying the sample video in the current clip selected by the clip selection operation may specifically include: and displaying the elements of the first type in the current segment in the design file of the sample video. Correspondingly, the obtaining of the template design operation for the current segment may specifically include: a template design operation for an element of a first type in a current fragment is obtained. In this case, the template design operation may be specifically configured to select a target element from the first type of elements of the design file located in the current segment and set a tag corresponding to the target element.

For example, as shown in fig. 8B, the position of the document element in the current segment and the corresponding label option (for example, a selling point) thereof may be displayed in the segment marking interface, so that a designer may mark the document element, and for example, the designer may select a target element from the document elements in the current segment and set a label corresponding to the target element by selecting the document element and checking the label corresponding to the selected document element.

In a case that the type of the element in the design file of the sample video is multiple, the method provided in this embodiment may further include: and responding to the type switching operation, and displaying the second type element positioned in the current segment in the design file of the sample video. Accordingly, obtaining a template design operation for the current segment may further include: a template design operation for an element of a second type in the current fragment is obtained. In this case, the template design operation may also be used to select a target element from the second type of elements of the design file located in the current segment and set a tag corresponding to the target element.

For example, as shown in fig. 8B, in response to a click operation on the "next" button in fig. 8A, the positions of the multimedia elements in the current segment and the candidate tag options thereof may be displayed in the segment marking interface, so that the designer may mark the multimedia elements (the multimedia elements may include picture elements and video elements), and similarly, the designer may select a target element from the multimedia elements of the current segment and set the tag corresponding to the target element by selecting the multimedia element and checking the tag corresponding to the selected multimedia element.

Similarly, in response to a click operation on a "next" button in the segment marking interface displaying the position of the multimedia element in the current segment, the segment type tag shown in fig. 4 may be displayed in the segment marking interface as a candidate tag option, and considering that there are usually specific elements in the front cover and the back cover, for example, there is usually a LOGO in the back cover, a search box can be used to facilitate the designer to design by displaying the segment type tag so that these specific elements can be automatically selected as the target elements.

The template design platform shown in fig. 8A and 8B can receive a design file of a video of a sample uploaded by a designer, and display the design file in a lens mode, and meanwhile, the template design platform is matched with a marking device to support the designer to complete marking in a mode of selecting elements and selecting labels. After marking is finished, the generated design file template with the label can be used for a video production system to directly produce videos.

After the template design operation is obtained, a design file template may be generated according to the template design operation. The design file template is obtained by setting a target element in a design file of the sample video as a template element and adding a label corresponding to the target element to the template element. Regarding the specific manner of setting the elements in the design file as template elements to obtain the template including the design file, reference may be made to specific descriptions in the related art, and details are not repeated here. For specific contents of the design document template, reference may be made to the related description in the embodiment shown in fig. 2, which is not described herein again.

Optionally, after the design file template is generated, a preview function of the design file template applied to the object can be provided for a designer, and the result of the designed script applied to the output video of the object is quickly viewed through 'example preview', so that the script design efficiency and effect are greatly improved.

Based on this, in an embodiment, the method provided in this embodiment may further include: and in response to the preview operation for the design file template, filling the material of the preview object to the position of the template element according to the label corresponding to the template element in the design file template to obtain the design file of the preview object, rendering the design file of the preview object to obtain the video of the preview object, and displaying the video of the preview object.

For example, as shown in fig. 8A, in response to acquiring the click operation for "preview" in fig. 8A, a video of the preview object may be generated and displayed based on the design document template, and the display interface may be, for example, as shown in fig. 9. The video of the preview object is shown on the left side of fig. 9, and the right side can be used to select the preview object.

In the embodiment of the application, the template design operation for selecting the target elements as the elements in the template from the elements of the design file and setting the labels corresponding to the target elements is obtained through the elements in the design file for displaying the sample video, and the design file template comprising the template elements and the labels corresponding to the template elements is generated according to the template design operation, so that an interactive marking mode is provided, a designer can conveniently design the template, and the design efficiency is improved.

Fig. 10 is a schematic structural diagram of a video production apparatus according to an embodiment of the present application; referring to fig. 10, the present embodiment provides a video production apparatus, which can perform the method provided by the embodiment shown in fig. 2, and specifically, the apparatus can include:

an obtaining module 101, configured to obtain a design file template for making a video and a material of a target object; the design file template comprises template elements and labels corresponding to the template elements, and the labels are used for describing the requirements of the corresponding template elements on the materials;

a filling module 102, configured to fill the material of the target object to a position where a corresponding template element is located according to the tag, so as to obtain a design file of the target object;

and the rendering module 103 is configured to render the design file of the target object to obtain a video of the target object.

In one embodiment, the template elements comprise first template elements, the tags of which comprise attribute tags for describing attribute requirements of the corresponding template elements on the material that can be filled in;

the filling module 102 is specifically configured to: and selecting a material matched with the attribute label corresponding to the first template element from the material of the target object according to the attribute label of the material of the target object, and filling the selected material to the position of the first template element.

In an embodiment, the attribute tag is specifically used to describe an attribute requirement of the corresponding template element on the material that can be filled in, and/or the attribute tag is specifically used to describe a relationship attribute requirement of the corresponding template element on the material that can be filled in and the material that can be filled in to a position where the associated template element is located.

In one embodiment, the tag corresponding to the first template element further includes a form tag, and the form tag is used for describing a filling form requirement of the corresponding template element on the material; the filling module 102 is configured to fill the selected material to a position where the first template element is located, and includes: and filling the selected material in a form required by the form label to the position of the first template element.

In one embodiment, the tag corresponding to the first template element further includes a mode tag, where the mode tag is used to describe a filling mode requirement of the corresponding template element on the material; the filling module 102 is configured to fill the selected material to a position where the first template element is located, and includes: and filling the selected material to the position of the first template element according to the mode required by the mode label.

In one embodiment, the template elements include a second template element, and the corresponding tags of the second template element include form tags, and the form tags are used for describing filling form requirements of the corresponding template elements on the material; the filling module 102 is specifically configured to: and filling the material of the target object corresponding to the second template element to the position of the second template element in a form required by the corresponding form label.

The apparatus shown in fig. 10 can perform the method of the embodiment shown in fig. 2, and reference may be made to the related description of the embodiment shown in fig. 2 for a part of this embodiment that is not described in detail. The implementation process and technical effect of the technical solution refer to the description in the embodiment shown in fig. 2, and are not described herein again.

In one possible implementation, the structure of the apparatus shown in FIG. 10 may be implemented as an electronic device. As shown in fig. 11, the electronic device may include: a processor 111 and a memory 112. Wherein the memory 112 is used for storing programs that support the electronic device to execute the method provided in the embodiment shown in fig. 2, and the processor 111 is configured for executing the programs stored in the memory 112.

The program comprises one or more computer instructions, wherein the one or more computer instructions, when executed by the processor 111, are capable of performing the steps of:

acquiring a design file template for making a video and a material of a target object; the design file template comprises template elements and labels corresponding to the template elements, and the labels are used for describing the requirements of the corresponding template elements on the materials;

Optionally, the processor 111 is further configured to perform all or part of the steps in the foregoing embodiment shown in fig. 2.

The electronic device may further include a communication interface 113 configured to communicate with other devices or a communication network.

Fig. 12 is a schematic structural diagram of a template generating apparatus according to an embodiment of the present application; referring to fig. 12, the present embodiment provides a template generating apparatus, which may perform the method provided by the embodiment shown in fig. 13, and specifically, the apparatus may include:

a display module 121, configured to display elements in a design file of a sample video;

an obtaining module 122, configured to obtain a template design operation, where the template design operation is used to select a target element from elements in the design file as an element in a template and set a tag corresponding to the target element, where the tag is used to describe a requirement of the corresponding target element on a material;

and the generating module 123 is configured to generate a design document template according to the template design operation, where the design document template includes template elements and tags corresponding to the template elements.

In one embodiment, the display module 121 is specifically configured to: in response to a section selection operation for a sample video, displaying elements in a design file of the sample video, which are located in a current section selected by the section selection operation;

the obtaining module 122 is specifically configured to: obtaining a template design operation for the current segment.

In one embodiment, the display module 121 is specifically configured to: displaying elements of a first type in the design file of the sample video, wherein the elements are located in the current segment;

the obtaining module 122 is specifically configured to: obtaining a template design operation for the first type of element in the current segment.

In one embodiment, the display module 121 is further configured to: responding to type switching operation, and displaying elements of a second type in the design file of the sample video, wherein the elements of the second type are positioned in the current segment;

the obtaining module 122 is further configured to: obtaining a template design operation for the element of the second type in the current segment.

In one embodiment, the apparatus provided in this embodiment further includes a preview module; the preview module is used for: and in response to the preview operation for the design file template, filling materials of a preview object to the position of the template element according to the label corresponding to the template element in the design file template to obtain the design file of the preview object, rendering the design file of the preview object to obtain a video of the preview object, and displaying the video of the preview object.

The apparatus shown in fig. 12 can execute the method of the embodiment shown in fig. 7, and reference may be made to the related description of the embodiment shown in fig. 7 for a part of this embodiment that is not described in detail. The implementation process and technical effect of the technical solution are described in the embodiment shown in fig. 7, and are not described herein again.

In one possible implementation, the structure of the apparatus shown in FIG. 12 may be implemented as an electronic device. As shown in fig. 13, the electronic device may include: a processor 131 and a memory 132. Wherein the memory 132 is used for storing programs that support the electronic device to execute the method provided in the embodiment shown in fig. 7, and the processor 131 is configured for executing the programs stored in the memory 132.

The program comprises one or more computer instructions which, when executed by the processor 131, enable the following steps to be performed:

displaying elements in a design file of a sample video;

the template design operation is used for selecting target elements from the elements of the design file as the elements in the template and setting labels corresponding to the target elements, wherein the labels are used for describing the requirements of the corresponding target elements on materials;

Optionally, the processor 131 is further configured to perform all or part of the steps in the foregoing embodiment shown in fig. 7.

The electronic device may further include a communication interface 133 configured to communicate with other devices or a communication network.

In addition, the embodiment of the present application also provides a computer storage medium, on which a computer program is stored, and when the computer program is executed, the method according to the embodiment shown in fig. 2 is implemented.

The embodiment of the present application further provides a computer storage medium, on which a computer program is stored, and when the computer program is executed, the method according to the embodiment shown in fig. 7 is implemented.

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement such a technique without inventive effort.

Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment may be implemented by a necessary general hardware platform, and may also be implemented by a combination of hardware and software. With this understanding in mind, the above-described technical solutions and/or portions thereof that contribute to the prior art may be embodied in the form of a computer program product, which may be embodied on one or more computer-usable storage media having computer-usable program code embodied therein (including but not limited to disk storage, CD-ROM, optical storage, etc.).

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, linked lists, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method of video production, comprising:

2. The method of claim 1, wherein the template element comprises a first template element, wherein the first template element comprises a tag comprising an attribute tag describing an attribute requirement of the corresponding template element for the material that can be filled in;

filling the material of the target object to the position of the corresponding template element according to the label, including: and selecting a material matched with the attribute label corresponding to the first template element from the material of the target object according to the attribute label of the material of the target object, and filling the selected material to the position of the first template element.

3. The method according to claim 2, wherein the attribute tag is specifically used for describing the own attribute requirement of the corresponding template element on the fillable material, and/or the attribute tag is specifically used for describing the relationship attribute requirement between the corresponding template element on the fillable material and the material fillable to the position of the associated template element.

4. The method of claim 2, wherein the tags corresponding to the first template elements further comprise form tags describing filling form requirements of the corresponding template elements for the material; the filling the selected material to the position of the first template element comprises: and filling the selected material in a form required by the form label to the position of the first template element.

5. The method according to claim 2, wherein the tag corresponding to the first template element further comprises a mode tag, and the mode tag is used for describing a filling mode requirement of the corresponding template element on the material; the filling the selected material to the position of the first template element comprises: and filling the selected material to the position of the first template element according to the mode required by the mode label.

6. The method according to any one of claims 1-5, wherein the template element comprises a second template element, and the corresponding tag of the second template element comprises a form tag describing a filling form requirement of the corresponding template element for the material; filling the material of the target object to the position where the corresponding template element is located according to the label to obtain the design file of the target object, wherein the step of filling the material of the target object to the position where the corresponding template element is located comprises the following steps: and filling the material of the target object corresponding to the second template element to the position of the second template element in a form required by the corresponding form label.

7. A template generation method, comprising:

displaying elements in a design file of a sample video;

8. The method of claim 7, wherein displaying the elements in the design file of the sample video comprises: in response to a section selection operation for a sample video, displaying elements in a design file of the sample video, which are located in a current section selected by the section selection operation;

the get template design operation comprises: and acquiring a template design operation aiming at the current segment.

9. The method of claim 8, wherein the displaying the elements of the design file of the sample video in the current clip selected by the clip selection operation comprises: displaying elements of a first type in the design file of the sample video, wherein the elements are located in the current segment;

obtaining template design operations for the current segment, including: obtaining a template design operation for the first type of element in the current segment.

10. The method of claim 9, wherein the displaying the elements of the first type located in the current clip in the design file of the sample video further comprises: responding to type switching operation, and displaying elements of a second type in the design file of the sample video, wherein the elements of the second type are positioned in the current segment;

the obtaining a template design operation for the current segment further comprises: obtaining a template design operation for the element of the second type in the current segment.

11. A video production apparatus, comprising:

12. A template generation apparatus, comprising:

13. An electronic device, comprising: a memory, a processor; wherein the memory is to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the method of any of claims 1 to 10.

14. A computer-readable storage medium, having stored thereon a computer program which, when executed, implements the method of any one of claims 1 to 10.