CN111899714A

CN111899714A - Dubbing method and system

Info

Publication number: CN111899714A
Application number: CN202010764406.2A
Authority: CN
Inventors: 于毅欣
Original assignee: Yiqi Shanghai Intelligent Technology Co Ltd
Current assignee: Yiqi Shanghai Intelligent Technology Co Ltd
Priority date: 2020-08-02
Filing date: 2020-08-02
Publication date: 2020-11-06

Abstract

A dubbing system, comprising: audio information for each character, software system. The audio information of each character is information of audio recorded by a dubbing actor of each character individually, and includes sound information and time information or time offset information (time offset information relative to the starting position of the audio and video to be dubbed). The software system is a system that processes, synthesizes, and synthesizes audio information for each character with background audio to final audio. The original intention of the present invention was to enable skilled or higher-order dubbing actors to participate more frequently in the dubbing of many movies and not be recognized by the audience by reusing the dubbing actors, i.e. to implement a method and system that makes it easier to reuse the same or a small number of dubbing actors. The threshold of dubbing the film and television works is reduced to at least a certain degree, and the number of the film and television works after dubbing is positively helped to at least a certain degree.

Description

Dubbing method and system

Technical Field

The invention relates to the technical field of dubbing, in particular to a dubbing method and a dubbing system.

Background

The movie industry is a relatively large industry, needs the cooperation and integration of a plurality of people and workers, has good works in a plurality of countries, but often the languages of the countries have various differences, and dubbing is a good choice. However, in the dubbing industry, a problem frequently encountered is the problem of the interruption of the skill structure of the dubbing actors, namely that the first-line dubbing actor is more skilled in business, but has a relatively small number or is expensive, or is difficult to make up all roles, so that the dubbed movies introduced are large-production movies or dubbed movies with large investment, and many better movies or more favorable movies, even if excellent, cannot be introduced according to the local language dubbing due to the limitation of cost and dubbing resources, and the phenomenon at least to some extent influences the comprehension of the audience, particularly the lower-age audience, on the content and the essence of some movies. The original intention of the present invention was to enable skilled or higher-order dubbing actors to participate more frequently in the dubbing of many movies and not be recognized by the audience by reusing the dubbing actors, i.e. to implement a method and system that makes it easier to reuse the same or a small number of dubbing actors. The invention can achieve the result that one or a small number of people dubs the whole movie or TV play by a multi-role recording and post-period sound changing processing method, at least reduces the threshold of dubbing the film and TV works (the threshold of human resources or/and capital requirements) to a certain extent, and at least helps the number of the film and TV works after dubbing to a certain extent. The invention can lead the skilled dubbing actors to dub the film frequently, and then leads the audiences not to hear the dubbed film by the same person through various sound changing results, thereby having positive help to the number of the dubbed film and television works to a certain extent.

Disclosure of Invention

According to an aspect of the present disclosure, a dubbing system is characterized by comprising: audio information for each role, software system;

the audio information of each character is information of audio recorded by a dubbing actor of each character individually, and includes sound information and time information or time offset information (time offset information relative to the starting position of the audio and video to be dubbed).

The software system is a system that processes, synthesizes, and synthesizes audio information for each character with background audio to final audio.

Preferably, the processing of the audio information may include adjusting a time offset (an increasing or decreasing time interval with respect to a certain time point) of a time or a beginning of the audio information, and may further include noise reduction of the audio, and adding background music to the audio.

According to one aspect of the present disclosure, a dubbing method is characterized by comprising:

recording dubbing audio information of each dubbing actor independently;

processing dubbing audio information of each dubbing actor;

and fusing the processed audio information of the dubbing actors into the same audio and then outputting the audio information.

Preferably, the fusion of the audio information may be to synthesize several audio information or audio files into one audio information or audio file using audio processing software.

Preferably, as an alternative embodiment, a plurality of audio files may be stored according to the lines of each dubbing actor.

Further, at this time, start time information may be contained in each audio file.

Preferably, the audio processing may include processing of changing a tone color, such as a punk effect, a robot effect, and the like.

Preferably, the audio processing may include processing of changing the change of voice, such as girls, children, vicissants, fatness, and so on.

Preferably, the audio processing may comprise fixed patterns, each pattern having a plurality of parameters, each parameter being adjustable, for example, a pattern being a sharpening of the sound or a volume of stored information of each sound being increased to some extent.

Preferably, the audio processing may include an adjustment of a play position or a play time offset of one or a segment of the speech audio, where the time offset may be a time offset relative to a start position of the audio-video to be provided.

Preferably, the time offset of each audio information can be adjusted when the audio information of the respective dubbing actors is merged into the same audio track, e.g. a certain audio starts playing earlier or later.

Further, the time offset difference may be an increased value of time relative to the starting point of the audio to be dubbed, for example, 78 minutes 58 seconds of male hero dubbing audio.

Preferably, as an alternative embodiment, the dubbing people and time offset information may be used to name the dubbing audio file, such as the filename "78 th episode 58 second manleading dubbing audio 5".

Preferably, as an alternative implementation, the background music of the movie can be stored separately in one track or one file to facilitate multiple dubbing modes.

Preferably, as an alternative embodiment, the audio tracks of the entire movie for each person may be stored separately as one file.

Preferably, as an alternative implementation, the speech part of each person can be stored separately as several files.

Preferably, the time can be adjusted during the synthesis, that is, the track of the time can be adjusted, or the time interval or the time offset relative to the playing start point of the audio-video to be matched can be adjusted.

Preferably, the time trajectory can also be adjusted to the final synthesis of the speech of each character at the time of fusion.

Preferably, the output can be an audio file or a video file with dubbing output together into a specified format.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 schematically shows a schematic representation of a main process or main stages.

Detailed Description

The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.

Example 1

Step 1: each dubbing actor records dubbing voice only with own voice into an independent audio file by using an independent microphone, and each person can record a relatively closed recording time or recording partition in the process, so that the condition that the voice of other people is recorded into the recording file of the dubbing actor through the microphone of the dubbing actor to interfere with the recording result or the recording audio of the dubbing actor is avoided.

Further, during recording, each dubbing actor may create a new recording file each time they dub and a segment of speech may be stored in a dedicated dubbing audio file.

Step 2: and performing sound change processing on all the audio files of the dubbing actors, for example, changing the dubbing file of an actor A into audio with the sound characteristics of the child, and processing the audio files by using sound change software or processing each audio file of the dubbing actors according to the processing mode of the sound change software to obtain audio dubbing results with the sound characteristics of the child.

And step 3: the audio information sets of all the collected and processed audios of all the dubbing actors are synthesized into a dubbing file, and background music is added in the synthesizing process and corresponds to the whole playing time of the audio/video or the works to be dubbed and the mouth shapes of the actors.

And 4, step 4: the obtained audio file is fused with the audio and video to be matched or the works into a file (the integration method can be that the audio file and the audio and video to be matched are exported into a video format or packaged into a play file), the dubbing effect can be verified in the process, and the dubbing effect can be repeatedly modified until the final video file with sound is satisfied.

Example 2

Step 2: and performing sound change processing on the whole dubbing file of the dubbing actor, for example, changing the dubbing file of an actor A into the audio frequency of the sound characteristic of a maiden, and processing all the audio frequencies of the whole file by using sound change software to obtain the sound characteristic processing result of one dubbing file unique to the dubbing actor in the whole recording process.

And step 3: the dubbing audio file of the dubbing actor which has become the sound characteristic of the maiden is cut into files according to different pronunciation time, for example, the dubbing actor speaks a sentence at 23 to 24, then speaks a sentence at 30 to 32, and stores the voice content at 23 to 24 as a separate file (for example, the file name may be "23-division initial dubbing audio"), and stores the content at 30 to 32 as a separate file (for example, the file name may be "30-division initial dubbing audio").

And 4, step 4: the audio information sets of all the audio of the dubbing actors after being collected and processed are synthesized into a dubbing file, background music is added in the synthesizing process, the playing starting position of each dubbing audio file can be adjusted for multiple times in the process, the position can be the position of starting playing the dubbing audio file relative to the time axis of the audio and video or the works to be dubbed, and the position corresponds to the whole playing time and the actor mouth shape of the audio and video or the works to be dubbed.

And 5: the obtained audio file is fused with the audio and video to be matched or the works into a file (the integration method can be that the audio file and the audio and video to be matched are exported into a video format or packaged into a play file), the dubbing effect can be verified in the process, and the dubbing effect can be repeatedly modified until the final video file with sound is satisfied.

The above is a specific embodiment of the present invention, but the scope of the present invention should not be limited thereto. Any changes or substitutions that can be easily made by those skilled in the art within the technical scope of the present invention are included in the protection scope of the present invention, and therefore, the protection scope of the present invention is subject to the protection scope defined by the appended claims.

Claims

1. A dubbing system, comprising: audio information for each role, software system;

the audio information of each character is the information of the audio recorded by the dubbing actor of each character independently, and comprises sound information and time information or time offset information;

2. A dubbing method, comprising:

recording dubbing audio information of each dubbing actor independently;

processing dubbing audio information of each dubbing actor;

3. The method of claim 2, wherein recording dubbed audio information for each dubbed actor individually, further comprises:

as an alternative embodiment, a plurality of audio files may be stored according to the line of each dubbing actor;

4. The method of claim 2, wherein processing dubbed audio information for each dubbed actor further comprises:

the audio processing may include processing of changing timbre or changing sound; there may be fixed modes, each mode having a plurality of parameters, each parameter being adjustable;

the audio processing may comprise an adjustment of the playing position or playing time offset of one or more speech segments.

5. The method of claim 2, wherein the processed audio information of the respective dubbing actors is merged into the same audio and then output, further comprising:

the time offset of each audio information can be adjusted when the audio information of each dubbing actor is fused into the same audio track;

the output may be an audio file or may be output in a specified format along with the dubbed video file.

6. A computer-readable write medium on which a computer program and related data are stored, characterized in that the program, when executed by a processor, implements the relevant computing functions and content of the invention.

7. An electronic device, comprising:

one or more processors;

a storage device to store one or more programs.