CN108630243B - Method and terminal for assisting singing - Google Patents
Method and terminal for assisting singing Download PDFInfo
- Publication number
- CN108630243B CN108630243B CN201810437636.0A CN201810437636A CN108630243B CN 108630243 B CN108630243 B CN 108630243B CN 201810437636 A CN201810437636 A CN 201810437636A CN 108630243 B CN108630243 B CN 108630243B
- Authority
- CN
- China
- Prior art keywords
- time
- singing
- note
- current
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Pharmaceuticals Containing Other Organic And Inorganic Compounds (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
Abstract
The invention provides a singing assisting method and a terminal, wherein a intonation evaluation file of a current singing song is obtained and analyzed, and time, pitch and strength information of all notes of the current singing song is obtained; according to the time, the pitch and the dynamics information of the notes and the preset tone of the musical instrument, the notes are synthesized into melody audio signals in real time, and the melody audio signals and the accompaniment of the currently sung song are played synchronously, so that the user has enough melody information for reference when singing, the auxiliary effect is good, and the fun and the level of singing of the user can be improved.
Description
Technical Field
The invention relates to the field of audio processing, in particular to a method and a terminal for assisting singing.
Background
In a digital audio-visual place, songs only have two tracks of original singing and accompaniment, and the accompaniment is generally started when a user sings, but the accompaniment generally only has beat information, insufficient melody information and poor guidance.
In order to guide the user to sing, a common method is to draw a pitch line or other numbered musical notation information in the system interface and indicate the current singing position through a specific mark, and this method has a certain role of assisting the singing, but the user still has less definition of how high each tone should be sung, and the assisting effect is not good.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: the singing assisting method and the singing assisting terminal can effectively assist a user in singing and are good in assisting effect.
In order to solve the technical problems, the invention adopts a technical scheme that:
a method of assisting singing, comprising the steps of:
s1, obtaining and analyzing a tone evaluation file of the current singing song to obtain time, pitch and strength information of all notes of the current singing song;
and S2, synthesizing the notes into melody audio signals in real time according to the time, the pitch and the strength information of the notes and the preset tone colors of the instruments, and synchronously playing the melody audio signals and the accompaniment of the current singing song.
In order to solve the technical problem, the invention adopts another technical scheme as follows:
a terminal for assisting singing, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
s1, obtaining and analyzing a tone evaluation file of the current singing song to obtain time, pitch and strength information of all notes of the current singing song;
and S2, synthesizing the notes into melody audio signals in real time according to the time, the pitch and the strength information of the notes and the preset tone colors of the instruments, and synchronously playing the melody audio signals and the accompaniment of the current singing song.
The invention has the beneficial effects that: the musical notes are synthesized into melody audio signals in real time according to the time, the pitch and the dynamics information of the musical notes and the preset tone colors of musical instruments, and the melody audio signals and the accompaniment of the currently sung song are played synchronously, so that the user has enough melody information for reference when singing, the auxiliary effect is good, and the fun and the level of singing of the user can be improved.
Drawings
Fig. 1 is a flowchart of a method for assisting singing according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a terminal for assisting singing according to an embodiment of the present invention;
description of reference numerals:
1. a terminal for assisting singing; 2. a memory; 3. a processor.
Detailed Description
In order to explain technical contents, achieved objects, and effects of the present invention in detail, the following description is made with reference to the accompanying drawings in combination with the embodiments.
The most key concept of the invention is as follows: and synthesizing the notes into melody audio signals in real time according to the time, the pitch and the strength information of the notes and the preset timbre of the musical instrument, and synchronously playing the melody audio signals and the accompaniment of the current singing song.
Referring to fig. 1, a method for assisting singing includes the steps of:
s1, obtaining and analyzing a tone evaluation file of the current singing song to obtain time, pitch and strength information of all notes of the current singing song;
and S2, synthesizing the notes into melody audio signals in real time according to the time, the pitch and the strength information of the notes and the preset tone colors of the instruments, and synchronously playing the melody audio signals and the accompaniment of the current singing song.
From the above description, the beneficial effects of the present invention are: the musical notes are synthesized into melody audio signals in real time according to the time, the pitch and the dynamics information of the musical notes and the preset tone colors of musical instruments, and the melody audio signals and the accompaniment of the currently sung song are played synchronously, so that the user has enough melody information for reference when singing, the auxiliary effect is good, and the fun and the level of singing of the user can be improved.
Further, the step S1 includes:
s11, acquiring and analyzing a tone evaluation file of the current singing song, and determining the number n of channels of the current singing song, wherein n is a positive integer greater than or equal to 1;
and S12, respectively obtaining note information of the n channels, wherein the note information comprises time, pitch and strength information of notes.
According to the description, the note information of each channel of the current singing song is obtained based on the channels, and the synthesized melody audio signal can be ensured to be more accurate and complete.
Further, the step S1 further includes:
s13, determining the duration of the note according to the time information of the note, wherein the time information of the note comprises the starting time and the ending time of the note, and respectively acquiring lyric information and lyric line information corresponding to the note information in n channels;
s14, respectively preprocessing the note information of the n channels:
s141, combining notes with the same pitch in the same character;
s142, combining the notes in the same row with the duration less than a first preset threshold value to the previous note or the next note;
s143, adjusting the ending time of the previous note in the same row to the starting time of the next note;
and S144, sequentially judging whether the ending time of the note at the tail of each line exceeds the starting time of the first note in the next line after the ending time of the note at the tail of each line is prolonged by a second preset threshold, if not, prolonging the ending time of the note at the tail of each line by the second preset threshold, and otherwise, not processing.
According to the description, the note information of each channel is preprocessed continuously, so that the subsequently synthesized melody sound can be more natural and continuous, and the auditory perception of the user is improved.
Further, the step S2 includes:
s21, after acquiring the note information of n channels, respectively processing the n channels of the current singing song as follows: comparing the playing time of the current singing song with the time information of the musical notes in the channel, and synthesizing the corresponding musical notes into melody audio signals of the musical notes in real time according to the pitch, the strength information and the preset musical instrument timbre when the playing time of the current singing song is equal to or greater than the starting time of the musical notes for the first time; when the playing time of the current singing song is equal to or more than the ending time of the musical note for the first time, ending synthesizing the melody audio signal of the musical note;
and S22, superposing the audio signals of the current melody synthesized by the n channels according to the proportion and then synchronously playing the audio signals of the current melody and the accompaniment of the current singing song.
Further, the step S2 further includes:
presetting a synchronization time interval of the current melody audio signal and the accompaniment of the current singing song, and repeating the steps S21 and S22 according to the synchronization time interval.
According to the above description, the synchronization between the current melody audio signal and the current singing song accompaniment can be quickly restored even if the current melody audio signal processing unexpected delay occurs by continuously synchronizing the current melody audio signal and the current singing song accompaniment according to the synchronization time interval.
Further, the step S1 is preceded by the steps of:
s0, receiving an auxiliary singing mode, if the auxiliary singing mode is a manual mode, starting the auxiliary singing when a command of starting the auxiliary singing is received, and sequentially executing steps S1 and S2;
and when a command of closing the auxiliary singing is received, only playing the accompaniment of the current singing song.
As can be seen from the above description, the singing auxiliary mode selected by the user is received and determined by adding the selection of the auxiliary singing mode, if the singing auxiliary mode is the manual mode, the auxiliary singing function is turned on to perform auxiliary singing if the command of turning on the auxiliary singing sent by the user is received, and the auxiliary singing function is turned off if the command of turning off the auxiliary singing sent by the user is received, so that whether to turn on the auxiliary singing function can be executed according to the will of the user, and the flexibility is high.
Further, if the mode of the auxiliary singing in step S0 is the automatic mode, the method further includes, between steps S1 and S2:
playing the accompaniment of the current singing song, and extracting pitch and strength information of the singing voice of the user in real time;
matching the pitch and strength information of singing voice of the user with the pitch and strength information of the corresponding time point of the intonation evaluation file to obtain the real-time score and the current total score of each lyric;
if the real-time scores of the m continuous sentences are lower than the preset score value, and m is a positive integer greater than or equal to 1, executing step S2;
or, if the current total score is lower than the preset score, performing step S2;
or, calculating the score of the first high-pitch segment or low-pitch segment currently sung by the user, and judging whether the score is smaller than a preset score, if so, executing step S2 on the subsequent high-pitch part or low-pitch part;
otherwise, only playing the accompaniment of the current singing song.
According to the description, if the user selects the automatic mode, whether the function of assisting singing is started or not can be automatically judged according to the singing level of the user, the user does not need to manually start or close the function, the automation degree is high, the flexibility is better, and brand-new karaoke experience is brought to the user.
Referring to fig. 2, a terminal for assisting singing includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the following steps:
s1, obtaining and analyzing a tone evaluation file of the current singing song to obtain time, pitch and strength information of all notes of the current singing song;
and S2, synthesizing the notes into melody audio signals in real time according to the time, the pitch and the strength information of the notes and the preset tone colors of the instruments, and synchronously playing the melody audio signals and the accompaniment of the current singing song.
From the above description, the beneficial effects of the present invention are: the musical notes are synthesized into melody audio signals in real time according to the time, the pitch and the dynamics information of the musical notes and the preset tone colors of musical instruments, and the melody audio signals and the accompaniment of the currently sung song are played synchronously, so that the user has enough melody information for reference when singing, the auxiliary effect is good, and the fun and the level of singing of the user can be improved.
Further, the step S1 includes:
s11, acquiring and analyzing a tone evaluation file of the current singing song, and determining the number n of channels of the current singing song, wherein n is a positive integer greater than or equal to 1;
and S12, respectively obtaining note information of the n channels, wherein the note information comprises time, pitch and strength information of notes.
According to the description, the note information of each channel of the current singing song is obtained based on the channels, and the synthesized melody audio signal can be ensured to be more accurate and complete.
Further, the step S1 further includes:
s13, determining the duration of the note according to the time information of the note, wherein the time information of the note comprises the starting time and the ending time of the note, and respectively acquiring lyric information and lyric line information corresponding to the note information in n channels;
s14, respectively preprocessing the note information of the n channels:
s141, combining notes with the same pitch in the same character;
s142, combining the notes in the same row with the duration less than a first preset threshold value to the previous note or the next note;
s143, adjusting the ending time of the previous note in the same row to the starting time of the next note;
and S144, sequentially judging whether the ending time of the note at the tail of each line exceeds the starting time of the first note in the next line after the ending time of the note at the tail of each line is prolonged by a second preset threshold, if not, prolonging the ending time of the note at the tail of each line by the second preset threshold, and otherwise, not processing.
According to the description, the note information of each channel is preprocessed continuously, so that the subsequently synthesized melody sound can be more natural and continuous, and the auditory perception of the user is improved.
Further, the step S2 includes:
s21, after acquiring the note information of n channels, respectively processing the n channels of the current singing song as follows: comparing the playing time of the current singing song with the time information of the musical notes in the channel, and synthesizing the corresponding musical notes into melody audio signals of the musical notes in real time according to the pitch, the strength information and the preset musical instrument timbre when the playing time of the current singing song is equal to or greater than the starting time of the musical notes for the first time; when the playing time of the current singing song is equal to or more than the ending time of the musical note for the first time, ending synthesizing the melody audio signal of the musical note;
and S22, superposing the audio signals of the current melody synthesized by the n channels according to the proportion and then synchronously playing the audio signals of the current melody and the accompaniment of the current singing song.
Further, the step S2 further includes:
presetting a synchronization time interval of the current melody audio signal and the accompaniment of the current singing song, and repeating the steps S21 and S22 according to the synchronization time interval.
According to the above description, the synchronization between the current melody audio signal and the current singing song accompaniment can be quickly restored even if the current melody audio signal processing unexpected delay occurs by continuously synchronizing the current melody audio signal and the current singing song accompaniment according to the synchronization time interval.
Further, the processor, when executing the computer program, before the step S1, further includes implementing the following steps:
s0, receiving an auxiliary singing mode, if the auxiliary singing mode is a manual mode, starting the auxiliary singing when a command of starting the auxiliary singing is received, and sequentially executing steps S1 and S2;
and when a command of closing the auxiliary singing is received, only playing the accompaniment of the current singing song.
As can be seen from the above description, the singing auxiliary mode selected by the user is received and determined by adding the selection of the auxiliary singing mode, if the singing auxiliary mode is the manual mode, the auxiliary singing function is turned on to perform auxiliary singing if the command of turning on the auxiliary singing sent by the user is received, and the auxiliary singing function is turned off if the command of turning off the auxiliary singing sent by the user is received, so that whether to turn on the auxiliary singing function can be executed according to the will of the user, and the flexibility is high.
Further, if the mode of the auxiliary singing in step S0 is the automatic mode, the method further includes, between steps S1 and S2:
playing the accompaniment of the current singing song, and extracting pitch and strength information of the singing voice of the user in real time;
matching the pitch and strength information of singing voice of the user with the pitch and strength information of the corresponding time point of the intonation evaluation file to obtain the real-time score and the current total score of each lyric;
if the real-time scores of the m continuous sentences are lower than the preset score value, and m is a positive integer greater than or equal to 1, executing step S2;
or, if the current total score is lower than the preset score, performing step S2;
or, calculating the score of the first high-pitch segment or low-pitch segment currently sung by the user, and judging whether the score is smaller than a preset score, if so, executing step S2 on the subsequent high-pitch part or low-pitch part;
otherwise, only playing the accompaniment of the current singing song.
According to the description, if the user selects the automatic mode, whether the function of assisting singing is started or not can be automatically judged according to the singing level of the user, the user does not need to manually start or close the function, the automation degree is high, the flexibility is better, and brand-new karaoke experience is brought to the user.
Example one
Referring to fig. 1, a method for assisting singing includes the steps of:
s1, obtaining and analyzing a tone evaluation file of the current singing song to obtain time, pitch and strength information of all notes of the current singing song;
the intonation evaluation file generally contains the following information:
channel information: line information indicating that the song contains several channels;
line information, which indicates that a certain channel of the song contains the lyric information of the lines;
lyric information: the lyric content of the whole song is included, wherein the lyric content is divided into a plurality of lines, and each word in the lyric corresponds to a note of the same timestamp of the song video;
note information: marking pitch, strength and time information contained in a note of the song;
for example, the following is part of the content of the intonation evaluation standard file of song "Dongfeng breaker":
< title > Dongfeng Cao </title > (the song is named as "Dongfeng Cao" (Dongfeng Cao))
< metochanel ═ 2'/> (the song contains lyrics, pitch and time information for two channels)
< channelnum ═ 1"> (this indicates the lyrics, pitch and time information of the first channel)
< Linenum ═ 1' > (indicating the lyrics, pitch and time information of the first line)
< lrcnm ═ one > (this is the first word in the first line, "one", contains both pitch and time information)
< metaoff ═ 13.475, "on ═ 13.424," pi ═ 67, "vol ═ 100"/> (the start time of the first note, labeled with the word "one", is 13.424 seconds, the end time is 13.475 seconds, the pitch value is 67, the duration is 0.051 seconds, the dynamics is 100)
< metaoff ═ 13.707, "on ═ 13.475," pi ═ 69, "vol ═ 100"/> (the start time of the second note, labeled with the word "one," is 13.475 seconds, the end time is 13.707 seconds, the pitch value is 69, the duration is 0.232 seconds, and the force is 100)
</lrc > (end mark of one word in lyric)
< lrcnm ═ cup "> (second word information)
<metaoff＝"14.121"on＝"13.808"pi＝"67"vol＝"100"/>
</lrc>
……
</line > (end of line Mark)
Specifically, the method comprises the following steps:
s11, acquiring and analyzing a tone evaluation file of the current singing song, and determining the number n of channels of the current singing song, wherein n is a positive integer greater than or equal to 1;
s12, respectively obtaining note information of n channels, wherein the note information comprises time, pitch and strength information of notes;
s13, determining the duration of the note according to the time information of the note, wherein the time information of the note comprises the starting time and the ending time of the note, and respectively acquiring lyric information of n channels and lyric line information, wherein the lyric information comprises word information;
s14, respectively preprocessing the note information of the n channels:
s141, combining notes with the same pitch in the same character, wherein for example, a character contains 2 notes, the starting time, the ending time, the pitch and the strength are respectively (12.101,12.301 and 65,100) and (12.301,12.401 and 65,100), and 1 note is obtained after combination (12.101,12.401 and 65,100);
(S142) merging the notes with the duration less than the first preset threshold value in the same row to the previous notes or the next notes, for example, 2 consecutive notes in a certain row, wherein the start time, the end time, the pitch and the strength are (12.101,12.151,65,100) and (12.151,12.301,66,100), respectively, the first preset threshold value is set to 0.1S, and 1 note is obtained after merging (12.101,12.301,66,100);
s143, adjusting the ending time of the previous note in the same row to the starting time of the next note, for example, the starting time, the ending time, the pitch and the strength of 2 consecutive notes in a certain row are (12.101,12.201,65,100) and (12.251,12.401,66,100), and obtaining (12.101,12.251,65,100) after adjusting the previous note;
s144, sequentially judging whether the ending time of the last note in each line exceeds the starting time of the first note in the next line after being prolonged by a second preset threshold, if not, prolonging the ending time of the last note by the second preset threshold, otherwise, not processing, for example, the ending time, the pitch and the strength of the last note in a certain line are respectively (12.101,12.201 and 65,100), the second preset threshold is set to be 0.2S, and the adjustment is carried out to obtain (12.101,12.401 and 65,100);
s2, synthesizing the notes into melody audio signals in real time according to the time, pitch and strength information of the notes and preset musical instrument timbre, and synchronously playing the melody audio signals and the accompaniment of the current singing song;
specifically, the method comprises the following steps:
s21, after acquiring the note information of n channels, respectively processing the n channels of the current singing song as follows: comparing the playing time of the current singing song with the time information of the musical notes in the channel, and synthesizing the corresponding musical notes into melody audio signals of the musical notes in real time according to the pitch, the strength information and the preset musical instrument timbre when the playing time of the current singing song is equal to or greater than the starting time of the musical notes for the first time; when the playing time of the current singing song is equal to or more than the ending time of the musical note for the first time, ending synthesizing the melody audio signal of the musical note;
wherein, the melody audio signal that will correspond note and synthesize this note in real time according to pitch, dynamics information and predetermined musical instrument tone quality includes:
synthesizing pitch, duration and strength information of corresponding notes into melody audio signals of corresponding channels in real time according to preset musical instrument timbres by adopting a wavetable synthesis mode;
the specific way of wave table synthesis (wave table) is to store digital samples of sound in a fixed area, then take out corresponding samples according to commands and restore and replay the samples, for example, by using the digital recording technology of real musical instruments, the digitalized sound of various real musical instruments such as cello, violin, piano, drum, guitar, saxophone and the like is stored in a read only memory ROM, and the stored wave table is found out for synthesis when music is generated;
s22, superposing the current melody audio signals synthesized by n channels according to the proportion and then synchronously playing the current melody audio signals and the accompaniment of the current singing song, wherein the proportion of the melody audio signals of each channel can be set according to the requirement of actual conditions;
continuously synchronously playing the melody audio signals of the current channels and the accompaniment of the current singing song according to the ratio according to the song playing progress until the song is played completely;
the step S2 further includes: presetting a synchronization time interval between the current melody audio signal and the accompaniment of the current singing song, repeating the steps S21 and S22 according to the synchronization time interval, for example, setting the synchronization time interval to be 30S, in some environments with bad network or when the performance of the equipment is in trouble, the played accompaniment may be jammed or the speed of synthesizing the current melody audio signal is slowed down, so that the current melody audio signal and the accompaniment of the current singing song are not synchronized in time, at this time, according to the synchronization time interval, for example, every 30 seconds, the playing time of the current singing song is obtained again, the playing time of the current singing song is the current playing time, then the current melody audio signal corresponding to the playing time of the current singing song is synthesized, and finally the current melody audio signal and the accompaniment of the current singing song are played synchronously, by continuously synchronizing the current melody audio signal and the accompaniment of the current singing song according to the synchronization time interval, even if unexpected delay of the current melody audio signal processing occurs, the time synchronization of the current melody audio signal and the accompaniment of the current singing song can be quickly recovered.
Example two
The difference between the embodiment and the first embodiment is that a selection function of an auxiliary singing mode is added, the embodiment has a manual mode and an automatic mode, and when a user needs to perform auxiliary singing, one of the manual mode and the automatic mode can be selected;
if the user selects the manual mode, when a command of starting the auxiliary singing is received, starting the auxiliary singing function, and sequentially executing the steps S1 and S2 in the first embodiment to realize the auxiliary singing;
when a command of closing the auxiliary singing is received, closing the auxiliary singing function, and only playing the accompaniment of the current singing song;
if the user selects the automatic mode, then:
step S1 is executed;
playing the accompaniment of the current singing song, and extracting pitch and strength information of the singing voice of the user in real time;
matching the pitch and strength information of singing voice of the user with the pitch and strength information of the corresponding time point of the intonation evaluation file to obtain the real-time score and the current total score of each lyric;
if the real-time scores of the m continuous sentences are lower than the preset score value, and m is a positive integer greater than or equal to 1, executing step S2;
or, if the current total score is lower than the preset score, performing step S2;
or, calculating the score of the first high-pitch segment or low-pitch segment currently sung by the user, and judging whether the score is smaller than a preset score, if so, executing step S2 on the subsequent high-pitch part or low-pitch part;
otherwise, only playing the accompaniment of the current singing song.
EXAMPLE III
Referring to fig. 2, a terminal 1 for assisting singing includes a memory 2, a processor 3, and a computer program stored on the memory 2 and operable on the processor 3, wherein the processor 3 implements the steps of the first embodiment when executing the computer program.
Example four
Referring to fig. 2, a terminal 1 for assisting singing includes a memory 2, a processor 3, and a computer program stored on the memory 2 and operable on the processor 3, wherein the processor 3 implements the steps of the second embodiment when executing the computer program.
In summary, according to the method and the terminal for assisting singing provided by the invention, the notes are synthesized into the melody audio signal in real time according to the time, pitch and dynamics information of the notes and the preset musical instrument timbre, the melody audio signal and the accompaniment of the currently sung song are synchronously played, and the melody of the song is synthesized and played in real time to guide the user to sing, so that the user has enough melody information for the user to refer to when singing, the assisting effect is good, the fun and level of singing of the user can be improved, meanwhile, the means mode and the automatic mode are set, and whether the melody of the song is synthesized or not can be automatically judged according to the singing score condition of the user in the automatic mode, so that brand-new experience of the K song is brought to the user.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent changes made by using the contents of the present specification and the drawings, or applied directly or indirectly to the related technical fields, are included in the scope of the present invention.
Claims (14)
1. A method of assisting singing, comprising the steps of:
s1, obtaining and analyzing a tone evaluation file of the current singing song to obtain time, pitch and strength information of all notes of the current singing song;
and S2, synthesizing the notes into melody audio signals in real time according to the time, the pitch and the strength information of the notes and the preset tone colors of the instruments, and synchronously playing the melody audio signals and the accompaniment of the current singing song.
2. The method of claim 1, wherein the step S1 comprises:
s11, acquiring and analyzing a tone evaluation file of the current singing song, and determining the number n of channels of the current singing song, wherein n is a positive integer greater than or equal to 1;
and S12, respectively obtaining note information of the n channels, wherein the note information comprises time, pitch and strength information of notes.
3. The method of claim 2, wherein the step S1 further comprises:
s13, determining the duration of the note according to the time information of the note, wherein the time information of the note comprises the starting time and the ending time of the note, and respectively acquiring lyric information and lyric line information corresponding to the note information in n channels;
s14, respectively preprocessing the note information of the n channels:
s141, combining notes with the same pitch in the same character;
s142, combining the notes in the same row with the duration less than a first preset threshold value to the previous note or the next note;
s143, adjusting the ending time of the previous note in the same row to the starting time of the next note;
and S144, sequentially judging whether the ending time of the note at the tail of each line exceeds the starting time of the first note in the next line after the ending time of the note at the tail of each line is prolonged by a second preset threshold, if not, prolonging the ending time of the note at the tail of each line by the second preset threshold, and otherwise, not processing.
4. The method for assisting singing according to any one of claims 1 to 3, wherein the step S2 includes:
s21, after acquiring the note information of n channels, respectively processing the n channels of the current singing song as follows: comparing the playing time of the current singing song with the time information of the musical notes in the channel, and synthesizing the corresponding musical notes into melody audio signals of the musical notes in real time according to the pitch, the strength information and the preset musical instrument timbre when the playing time of the current singing song is equal to or greater than the starting time of the musical notes for the first time; when the playing time of the current singing song is equal to or more than the ending time of the musical note for the first time, ending synthesizing the melody audio signal of the musical note;
and S22, superposing the audio signals of the current melody synthesized by the n channels according to the proportion and then synchronously playing the audio signals of the current melody and the accompaniment of the current singing song.
5. The method of claim 4, wherein the step S2 further comprises:
presetting a synchronization time interval of the current melody audio signal and the accompaniment of the current singing song, and repeating the steps S21 and S22 according to the synchronization time interval.
6. The method of claim 1, wherein the step S1 is preceded by the steps of:
s0, receiving an auxiliary singing mode, if the auxiliary singing mode is a manual mode, starting the auxiliary singing when a command of starting the auxiliary singing is received, and sequentially executing steps S1 and S2;
and when a command of closing the auxiliary singing is received, only playing the accompaniment of the current singing song.
7. The method of claim 6, wherein if the mode of the auxiliary singing is automatic in step S0, the method further comprises steps between steps S1 and S2:
playing the accompaniment of the current singing song, and extracting pitch and strength information of the singing voice of the user in real time;
matching the pitch and strength information of singing voice of the user with the pitch and strength information of the corresponding time point of the intonation evaluation file to obtain the real-time score and the current total score of each lyric;
if the real-time score of the lyrics of m continuous sentences is lower than the preset score value, and m is a positive integer greater than or equal to 1, executing the step S2;
or, if the current total score is lower than the preset score, performing step S2;
or, calculating the score of the first high-pitch segment or low-pitch segment currently sung by the user, and judging whether the score is smaller than a preset score, if so, executing step S2 on the subsequent high-pitch part or low-pitch part;
otherwise, only playing the accompaniment of the current singing song.
8. A terminal for assisting singing, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program:
s1, obtaining and analyzing a tone evaluation file of the current singing song to obtain time, pitch and strength information of all notes of the current singing song;
and S2, synthesizing the notes into melody audio signals in real time according to the time, the pitch and the strength information of the notes and the preset tone colors of the instruments, and synchronously playing the melody audio signals and the accompaniment of the current singing song.
9. The terminal for assisting singing according to claim 8,
the step S1 includes:
s11, acquiring and analyzing a tone evaluation file of the current singing song, and determining the number n of channels of the current singing song, wherein n is a positive integer greater than or equal to 1;
and S12, respectively obtaining note information of the n channels, wherein the note information comprises time, pitch and strength information of notes.
10. The terminal for assisting singing according to claim 9,
the step S1 further includes:
s13, determining the duration of the note according to the time information of the note, wherein the time information of the note comprises the starting time and the ending time of the note, and respectively acquiring lyric information and lyric line information corresponding to the note information in n channels;
s14, respectively preprocessing the note information of the n channels:
s141, combining notes with the same pitch in the same character;
s142, combining the notes in the same row with the duration less than a first preset threshold value to the previous note or the next note;
s143, adjusting the ending time of the previous note in the same row to the starting time of the next note;
and S144, sequentially judging whether the ending time of the note at the tail of each line exceeds the starting time of the first note in the next line after the ending time of the note at the tail of each line is prolonged by a second preset threshold, if not, prolonging the ending time of the note at the tail of each line by the second preset threshold, and otherwise, not processing.
11. The terminal for assisting singing according to any one of claims 8 to 10, wherein the step S2 includes:
s21, after acquiring the note information of n channels, respectively processing the n channels of the current singing song as follows: comparing the playing time of the current singing song with the time information of the musical notes in the channel, and synthesizing the corresponding musical notes into melody audio signals of the musical notes in real time according to the pitch, the strength information and the preset musical instrument timbre when the playing time of the current singing song is equal to or greater than the starting time of the musical notes for the first time; when the playing time of the current singing song is equal to or more than the ending time of the musical note for the first time, ending synthesizing the melody audio signal of the musical note;
and S22, superposing the current melody audio signals synthesized by the n channels according to the proportion and then playing the signals synchronously with the accompaniment of the current singing song.
12. The terminal for assisting singing according to claim 11, wherein the step S2 further includes:
presetting a synchronization time interval of the current melody audio signal and the accompaniment of the current singing song, and repeating the steps S21 and S22 according to the synchronization time interval.
13. The terminal of claim 8, wherein the processor, when executing the computer program, further comprises before the step S1, the step of:
s0, receiving an auxiliary singing mode, if the auxiliary singing mode is a manual mode, starting the auxiliary singing when a command of starting the auxiliary singing is received, and sequentially executing steps S1 and S2;
and when a command of closing the auxiliary singing is received, only playing the accompaniment of the current singing song.
14. The terminal for assisting singing according to claim 13, wherein if the mode of the assisting singing is the automatic mode in step S0, the method further comprises, between steps S1 and S2, the steps of:
playing the accompaniment of the current singing song, and extracting pitch and strength information of the singing voice of the user in real time;
matching the pitch and strength information of singing voice of the user with the pitch and strength information of the corresponding time point of the intonation evaluation file to obtain the real-time score and the current total score of each lyric;
if the real-time score of the lyrics of m continuous sentences is lower than the preset score value, and m is a positive integer greater than or equal to 1, executing the step S2;
or, if the current total score is lower than the preset score, performing step S2;
or, calculating the score of the first high-pitch segment or low-pitch segment currently sung by the user, and judging whether the score is smaller than a preset score, if so, executing step S2 on the subsequent high-pitch part or low-pitch part;
otherwise, only playing the accompaniment of the current singing song.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810437636.0A CN108630243B (en) | 2018-05-09 | 2018-05-09 | Method and terminal for assisting singing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810437636.0A CN108630243B (en) | 2018-05-09 | 2018-05-09 | Method and terminal for assisting singing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108630243A CN108630243A (en) | 2018-10-09 |
| CN108630243B true CN108630243B (en) | 2020-08-11 |
Family
ID=63692419
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810437636.0A Active CN108630243B (en) | 2018-05-09 | 2018-05-09 | Method and terminal for assisting singing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108630243B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110418183B (en) * | 2019-08-05 | 2022-11-15 | 北京字节跳动网络技术有限公司 | Audio and video synchronization method and device, electronic equipment and readable medium |
| CN110444185B (en) * | 2019-08-05 | 2024-01-12 | 腾讯音乐娱乐科技（深圳）有限公司 | Music generation method and device |
| CN112420004A (en) * | 2019-08-22 | 2021-02-26 | 北京峰趣互联网信息服务有限公司 | Method and device for generating songs, electronic equipment and computer readable storage medium |
| CN110534081B (en) * | 2019-09-05 | 2021-09-03 | 长沙市回音科技有限公司 | Real-time playing method and system for converting guitar sound into other musical instrument sound |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1287346A (en) * | 1999-09-03 | 2001-03-14 | 科乐美股份有限公司 | Accompanying system for singing |
| CN104361883A (en) * | 2014-10-10 | 2015-02-18 | 福建星网视易信息***有限公司 | Production method and device of singing evaluation standards files |
| US9818448B1 (en) * | 2017-04-10 | 2017-11-14 | Avid Technology, Inc. | Media editing with linked time-based metadata |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751914A (en) * | 2008-12-04 | 2010-06-23 | 江亮都 | Lyric display system and method |
| EP3270378A1 (en) * | 2016-07-14 | 2018-01-17 | Steinberg Media Technologies GmbH | Method for projected regularization of audio data |
| CN106782460B (en) * | 2016-12-26 | 2018-10-30 | 广州酷狗计算机科技有限公司 | The method and apparatus for generating music score |
-
2018
- 2018-05-09 CN CN201810437636.0A patent/CN108630243B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1287346A (en) * | 1999-09-03 | 2001-03-14 | 科乐美股份有限公司 | Accompanying system for singing |
| CN104361883A (en) * | 2014-10-10 | 2015-02-18 | 福建星网视易信息***有限公司 | Production method and device of singing evaluation standards files |
| US9818448B1 (en) * | 2017-04-10 | 2017-11-14 | Avid Technology, Inc. | Media editing with linked time-based metadata |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108630243A (en) | 2018-10-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108630243B (en) | Method and terminal for assisting singing | |
| US6856923B2 (en) | Method for analyzing music using sounds instruments | |
| JP3900580B2 (en) | Karaoke equipment | |
| US8027631B2 (en) | Song practice support device | |
| US6191349B1 (en) | Musical instrument digital interface with speech capability | |
| US5889224A (en) | Karaoke scoring apparatus analyzing singing voice relative to melody data | |
| EP1094442B1 (en) | Musical tone-generating method | |
| JPH0944171A (en) | Karaoke device | |
| US6740804B2 (en) | Waveform generating method, performance data processing method, waveform selection apparatus, waveform data recording apparatus, and waveform data recording and reproducing apparatus | |
| JP2003241757A (en) | Device and method for waveform generation | |
| JP2005107333A (en) | Karaoke machine | |
| JP4204941B2 (en) | Karaoke equipment | |
| JP3915807B2 (en) | Automatic performance determination device and program | |
| JP3750533B2 (en) | Waveform data recording device and recorded waveform data reproducing device | |
| JP5782972B2 (en) | Information processing system, program | |
| JP2006301019A (en) | Pitch-notifying device and program | |
| JP6075314B2 (en) | Program, information processing apparatus, and evaluation method | |
| JP4048249B2 (en) | Karaoke equipment | |
| JP2013210501A (en) | Synthesis unit registration device, voice synthesis device, and program | |
| JP5418525B2 (en) | Karaoke equipment | |
| JP2005107332A (en) | Karaoke machine | |
| JP2016183998A (en) | Voice synthesis device, and program | |
| JP5983670B2 (en) | Program, information processing apparatus, and data generation method | |
| JP5569307B2 (en) | Program and editing device | |
| JP4159961B2 (en) | Karaoke equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |