CN111899714A - Dubbing method and system - Google Patents
Dubbing method and system Download PDFInfo
- Publication number
- CN111899714A CN111899714A CN202010764406.2A CN202010764406A CN111899714A CN 111899714 A CN111899714 A CN 111899714A CN 202010764406 A CN202010764406 A CN 202010764406A CN 111899714 A CN111899714 A CN 111899714A
- Authority
- CN
- China
- Prior art keywords
- audio
- dubbing
- information
- actor
- audio information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 24
- 238000004590 computer program Methods 0.000 claims 1
- 230000000694 effects Effects 0.000 description 6
- 230000010354 integration Effects 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000005192 partition Methods 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 230000002194 synthesizing effect Effects 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Management Or Editing Of Information On Record Carriers (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
A dubbing system, comprising: audio information for each character, software system. The audio information of each character is information of audio recorded by a dubbing actor of each character individually, and includes sound information and time information or time offset information (time offset information relative to the starting position of the audio and video to be dubbed). The software system is a system that processes, synthesizes, and synthesizes audio information for each character with background audio to final audio. The original intention of the present invention was to enable skilled or higher-order dubbing actors to participate more frequently in the dubbing of many movies and not be recognized by the audience by reusing the dubbing actors, i.e. to implement a method and system that makes it easier to reuse the same or a small number of dubbing actors. The threshold of dubbing the film and television works is reduced to at least a certain degree, and the number of the film and television works after dubbing is positively helped to at least a certain degree.
Description
Technical Field
The invention relates to the technical field of dubbing, in particular to a dubbing method and a dubbing system.
Background
The movie industry is a relatively large industry, needs the cooperation and integration of a plurality of people and workers, has good works in a plurality of countries, but often the languages of the countries have various differences, and dubbing is a good choice. However, in the dubbing industry, a problem frequently encountered is the problem of the interruption of the skill structure of the dubbing actors, namely that the first-line dubbing actor is more skilled in business, but has a relatively small number or is expensive, or is difficult to make up all roles, so that the dubbed movies introduced are large-production movies or dubbed movies with large investment, and many better movies or more favorable movies, even if excellent, cannot be introduced according to the local language dubbing due to the limitation of cost and dubbing resources, and the phenomenon at least to some extent influences the comprehension of the audience, particularly the lower-age audience, on the content and the essence of some movies. The original intention of the present invention was to enable skilled or higher-order dubbing actors to participate more frequently in the dubbing of many movies and not be recognized by the audience by reusing the dubbing actors, i.e. to implement a method and system that makes it easier to reuse the same or a small number of dubbing actors. The invention can achieve the result that one or a small number of people dubs the whole movie or TV play by a multi-role recording and post-period sound changing processing method, at least reduces the threshold of dubbing the film and TV works (the threshold of human resources or/and capital requirements) to a certain extent, and at least helps the number of the film and TV works after dubbing to a certain extent. The invention can lead the skilled dubbing actors to dub the film frequently, and then leads the audiences not to hear the dubbed film by the same person through various sound changing results, thereby having positive help to the number of the dubbed film and television works to a certain extent.
Disclosure of Invention
According to an aspect of the present disclosure, a dubbing system is characterized by comprising: audio information for each role, software system;
the audio information of each character is information of audio recorded by a dubbing actor of each character individually, and includes sound information and time information or time offset information (time offset information relative to the starting position of the audio and video to be dubbed).
The software system is a system that processes, synthesizes, and synthesizes audio information for each character with background audio to final audio.
Preferably, the processing of the audio information may include adjusting a time offset (an increasing or decreasing time interval with respect to a certain time point) of a time or a beginning of the audio information, and may further include noise reduction of the audio, and adding background music to the audio.
According to one aspect of the present disclosure, a dubbing method is characterized by comprising:
recording dubbing audio information of each dubbing actor independently;
processing dubbing audio information of each dubbing actor;
and fusing the processed audio information of the dubbing actors into the same audio and then outputting the audio information.
Preferably, the fusion of the audio information may be to synthesize several audio information or audio files into one audio information or audio file using audio processing software.
Preferably, as an alternative embodiment, a plurality of audio files may be stored according to the lines of each dubbing actor.
Further, at this time, start time information may be contained in each audio file.
Preferably, the audio processing may include processing of changing a tone color, such as a punk effect, a robot effect, and the like.
Preferably, the audio processing may include processing of changing the change of voice, such as girls, children, vicissants, fatness, and so on.
Preferably, the audio processing may comprise fixed patterns, each pattern having a plurality of parameters, each parameter being adjustable, for example, a pattern being a sharpening of the sound or a volume of stored information of each sound being increased to some extent.
Preferably, the audio processing may include an adjustment of a play position or a play time offset of one or a segment of the speech audio, where the time offset may be a time offset relative to a start position of the audio-video to be provided.
Preferably, the time offset of each audio information can be adjusted when the audio information of the respective dubbing actors is merged into the same audio track, e.g. a certain audio starts playing earlier or later.
Further, the time offset difference may be an increased value of time relative to the starting point of the audio to be dubbed, for example, 78 minutes 58 seconds of male hero dubbing audio.
Preferably, as an alternative embodiment, the dubbing people and time offset information may be used to name the dubbing audio file, such as the filename "78 th episode 58 second manleading dubbing audio 5".
Preferably, as an alternative implementation, the background music of the movie can be stored separately in one track or one file to facilitate multiple dubbing modes.
Preferably, as an alternative embodiment, the audio tracks of the entire movie for each person may be stored separately as one file.
Preferably, as an alternative implementation, the speech part of each person can be stored separately as several files.
Preferably, the time can be adjusted during the synthesis, that is, the track of the time can be adjusted, or the time interval or the time offset relative to the playing start point of the audio-video to be matched can be adjusted.
Preferably, the time trajectory can also be adjusted to the final synthesis of the speech of each character at the time of fusion.
Preferably, the output can be an audio file or a video file with dubbing output together into a specified format.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 schematically shows a schematic representation of a main process or main stages.
Detailed Description
The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
Example 1
Step 1: each dubbing actor records dubbing voice only with own voice into an independent audio file by using an independent microphone, and each person can record a relatively closed recording time or recording partition in the process, so that the condition that the voice of other people is recorded into the recording file of the dubbing actor through the microphone of the dubbing actor to interfere with the recording result or the recording audio of the dubbing actor is avoided.
Further, during recording, each dubbing actor may create a new recording file each time they dub and a segment of speech may be stored in a dedicated dubbing audio file.
Step 2: and performing sound change processing on all the audio files of the dubbing actors, for example, changing the dubbing file of an actor A into audio with the sound characteristics of the child, and processing the audio files by using sound change software or processing each audio file of the dubbing actors according to the processing mode of the sound change software to obtain audio dubbing results with the sound characteristics of the child.
And step 3: the audio information sets of all the collected and processed audios of all the dubbing actors are synthesized into a dubbing file, and background music is added in the synthesizing process and corresponds to the whole playing time of the audio/video or the works to be dubbed and the mouth shapes of the actors.
And 4, step 4: the obtained audio file is fused with the audio and video to be matched or the works into a file (the integration method can be that the audio file and the audio and video to be matched are exported into a video format or packaged into a play file), the dubbing effect can be verified in the process, and the dubbing effect can be repeatedly modified until the final video file with sound is satisfied.
Example 2
Step 1: each dubbing actor records dubbing voice only with own voice into an independent audio file by using an independent microphone, and each person can record a relatively closed recording time or recording partition in the process, so that the condition that the voice of other people is recorded into the recording file of the dubbing actor through the microphone of the dubbing actor to interfere with the recording result or the recording audio of the dubbing actor is avoided.
Step 2: and performing sound change processing on the whole dubbing file of the dubbing actor, for example, changing the dubbing file of an actor A into the audio frequency of the sound characteristic of a maiden, and processing all the audio frequencies of the whole file by using sound change software to obtain the sound characteristic processing result of one dubbing file unique to the dubbing actor in the whole recording process.
And step 3: the dubbing audio file of the dubbing actor which has become the sound characteristic of the maiden is cut into files according to different pronunciation time, for example, the dubbing actor speaks a sentence at 23 to 24, then speaks a sentence at 30 to 32, and stores the voice content at 23 to 24 as a separate file (for example, the file name may be "23-division initial dubbing audio"), and stores the content at 30 to 32 as a separate file (for example, the file name may be "30-division initial dubbing audio").
And 4, step 4: the audio information sets of all the audio of the dubbing actors after being collected and processed are synthesized into a dubbing file, background music is added in the synthesizing process, the playing starting position of each dubbing audio file can be adjusted for multiple times in the process, the position can be the position of starting playing the dubbing audio file relative to the time axis of the audio and video or the works to be dubbed, and the position corresponds to the whole playing time and the actor mouth shape of the audio and video or the works to be dubbed.
And 5: the obtained audio file is fused with the audio and video to be matched or the works into a file (the integration method can be that the audio file and the audio and video to be matched are exported into a video format or packaged into a play file), the dubbing effect can be verified in the process, and the dubbing effect can be repeatedly modified until the final video file with sound is satisfied.
The above is a specific embodiment of the present invention, but the scope of the present invention should not be limited thereto. Any changes or substitutions that can be easily made by those skilled in the art within the technical scope of the present invention are included in the protection scope of the present invention, and therefore, the protection scope of the present invention is subject to the protection scope defined by the appended claims.
Claims (7)
1. A dubbing system, comprising: audio information for each role, software system;
the audio information of each character is the information of the audio recorded by the dubbing actor of each character independently, and comprises sound information and time information or time offset information;
the software system is a system that processes, synthesizes, and synthesizes audio information for each character with background audio to final audio.
2. A dubbing method, comprising:
recording dubbing audio information of each dubbing actor independently;
processing dubbing audio information of each dubbing actor;
and fusing the processed audio information of the dubbing actors into the same audio and then outputting the audio information.
3. The method of claim 2, wherein recording dubbed audio information for each dubbed actor individually, further comprises:
as an alternative embodiment, a plurality of audio files may be stored according to the line of each dubbing actor;
further, at this time, start time information may be contained in each audio file.
4. The method of claim 2, wherein processing dubbed audio information for each dubbed actor further comprises:
the audio processing may include processing of changing timbre or changing sound; there may be fixed modes, each mode having a plurality of parameters, each parameter being adjustable;
the audio processing may comprise an adjustment of the playing position or playing time offset of one or more speech segments.
5. The method of claim 2, wherein the processed audio information of the respective dubbing actors is merged into the same audio and then output, further comprising:
the time offset of each audio information can be adjusted when the audio information of each dubbing actor is fused into the same audio track;
the output may be an audio file or may be output in a specified format along with the dubbed video file.
6. A computer-readable write medium on which a computer program and related data are stored, characterized in that the program, when executed by a processor, implements the relevant computing functions and content of the invention.
7. An electronic device, comprising:
one or more processors;
a storage device to store one or more programs.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010764406.2A CN111899714A (en) | 2020-08-02 | 2020-08-02 | Dubbing method and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010764406.2A CN111899714A (en) | 2020-08-02 | 2020-08-02 | Dubbing method and system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111899714A true CN111899714A (en) | 2020-11-06 |
Family
ID=73183994
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010764406.2A Pending CN111899714A (en) | 2020-08-02 | 2020-08-02 | Dubbing method and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111899714A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112672207A (en) * | 2020-12-30 | 2021-04-16 | 广州繁星互娱信息科技有限公司 | Audio data processing method and device, computer equipment and storage medium |
-
2020
- 2020-08-02 CN CN202010764406.2A patent/CN111899714A/en active Pending
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112672207A (en) * | 2020-12-30 | 2021-04-16 | 广州繁星互娱信息科技有限公司 | Audio data processing method and device, computer equipment and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9847078B2 (en) | Music performance system and method thereof | |
US20080275700A1 (en) | Method of and System for Modifying Messages | |
US20210151082A1 (en) | Systems and methods for mixing synthetic voice with original audio tracks | |
EP3824461B1 (en) | Method and system for creating object-based audio content | |
CN109005419B (en) | Voice information processing method and client | |
CN110675886A (en) | Audio signal processing method, audio signal processing device, electronic equipment and storage medium | |
CN109104616B (en) | Voice microphone connecting method and client for live broadcast room | |
US20200329331A1 (en) | Audio generation system and method | |
US11462207B1 (en) | Method and apparatus for editing audio, electronic device and storage medium | |
CN108965904B (en) | Volume adjusting method and client of live broadcast room | |
Pauletto | The sound design of cinematic voices | |
WO2021239285A1 (en) | Audio source separation and audio dubbing | |
KR101944365B1 (en) | Method and apparatus for generating synchronization of content, and interface module thereof | |
CN111899714A (en) | Dubbing method and system | |
JP2010140278A (en) | Voice information visualization device and program | |
JP2008217447A (en) | Content generation device and content generation program | |
KR20160106239A (en) | sound capturing equipment used mobile terminal | |
Avarese | Post sound design: the art and craft of audio post production for the moving image | |
KR100383061B1 (en) | A learning method using a digital audio with caption data | |
JP2005352330A (en) | Speech division recording device | |
JP4052561B2 (en) | VIDEO Attached Audio Data Recording Method, VIDEO Attached Audio Data Recording Device, and VIDEO Attached Audio Data Recording Program | |
TWI790705B (en) | Method for adjusting speech rate and system using the same | |
US20220417659A1 (en) | Systems, methods, and devices for audio correction | |
KR100329941B1 (en) | The changed method of a tone color in oral narration system of the fairy tale | |
Sisto | The practice of dubbing and the evolution of the soundtrack in Italian cinema: a schizophonic take |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20201106 |