CN110111761A - The method followed in real time and Related product are played to musical sound - Google Patents

The method followed in real time and Related product are played to musical sound Download PDF

Info

Publication number
CN110111761A
CN110111761A CN201910242672.6A CN201910242672A CN110111761A CN 110111761 A CN110111761 A CN 110111761A CN 201910242672 A CN201910242672 A CN 201910242672A CN 110111761 A CN110111761 A CN 110111761A
Authority
CN
China
Prior art keywords
musical sound
characteristic locus
tone
locus
plays
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910242672.6A
Other languages
Chinese (zh)
Other versions
CN110111761B (en
Inventor
段志尧
刘纯阳
李博琛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Mango Future Education Technology Co Ltd
Original Assignee
Shenzhen Mango Future Education Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Mango Future Education Technology Co Ltd filed Critical Shenzhen Mango Future Education Technology Co Ltd
Priority to CN201910242672.6A priority Critical patent/CN110111761B/en
Publication of CN110111761A publication Critical patent/CN110111761A/en
Application granted granted Critical
Publication of CN110111761B publication Critical patent/CN110111761B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0008Associated control or indicating means
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0033Recording/reproducing or transmission of music for electrophonic musical instruments
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H7/00Instruments in which the tones are synthesised from a data store, e.g. computer organs

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Auxiliary Devices For Music (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

The embodiment of the present application discloses a kind of pair of musical sound and plays the method followed in real time and Related product, by during player plays target song, obtain the tone data of player, the first tone data currently played are obtained, default music score corresponding to target song is analyzed, and is obtained with reference to musical sound characteristic locus, first tone data are analyzed, first tone characteristic locus is obtained, reference musical sound characteristic locus is matched with first tone characteristic locus, obtains matching result;The first performance position that player plays in real time is determined according to matching result, label first plays position in default music score, so, the music score being not required to during player plays on the screen for seeing electronic equipment, electronic equipment can determine that in real time currently play first plays position with active with the performance of player.

Description

The method followed in real time and Related product are played to musical sound
Technical field
This application involves musical sound processing technology fields, and in particular to a kind of pair of musical sound play the method followed in real time and Related product.
Background technique
In music learning field, user's learning instrument is usually imparted knowledge to students by the music teachers of profession face-to-face, and User practices after class, usually independent exercise, alternatively, accompanying practice musical instrument by parent, still, parent is usually not belonging to music Professional, parent accompany practice, it is difficult to and it is instructed to user, and professional ladder player is engaged to carry out training mate, it is costly, Therefore, how to help user is more intelligent, efficiently carries out devices for learning musical instruments to become problem to be solved.
Summary of the invention
The embodiment of the present application provides a kind of pair of musical sound and plays the method followed in real time and Related product, can be actively The performance for following user, more intelligently instructs user to play.
In a first aspect, the embodiment of the present application, which provides a kind of pair of musical sound, plays the method followed in real time, it is applied to electronics Equipment, which comprises
During player plays target song, the first tone data of the player are obtained, are obtained currently The first tone data of performance;
The corresponding default music score of the target song is analyzed, is obtained with reference to musical sound characteristic locus, it is described with reference to pleasure Sound characteristic locus is the musical sound characteristic locus arranged sequentially in time;
The first tone data are analyzed, first tone characteristic locus, the first tone characteristic locus are obtained For the musical sound characteristic locus arranged sequentially in time;
It is matched with reference to musical sound characteristic locus with the first tone characteristic locus to described, obtains matching result;Root The first performance position that player plays in real time is determined according to the matching result;Described first is marked to drill in the default music score Play position.
Second aspect, the embodiment of the present application provide a kind of pair of musical sound and play the device followed in real time, are applied to electricity Sub- equipment, the device followed in real time to musical sound performance include:
Acquiring unit, for obtaining the first tone number of the player during player plays target song According to obtaining the currently first tone data played;
Analytical unit is obtained for analyzing the corresponding default music score of the target song with reference to musical sound feature rail Mark, described with reference to musical sound characteristic locus is the musical sound characteristic locus arranged sequentially in time;And it is happy to described first Sound data are analyzed, and first tone characteristic locus is obtained, and the first tone characteristic locus is to be arranged sequentially in time The musical sound characteristic locus of column;
Matching unit is obtained for matching with reference to musical sound characteristic locus with the first tone characteristic locus to described To matching result;
Determination unit, for determining that player plays in real time first plays position according to the matching result;
Marking unit, for marking described first to play position in the default music score.
The third aspect, the embodiment of the present application provide a kind of electronic equipment, including processor, memory, communication interface, and One or more programs, wherein said one or multiple programs are stored in above-mentioned memory, and are configured by above-mentioned It manages device to execute, above procedure is included the steps that for executing the instruction in the embodiment of the present application first aspect.
Fourth aspect, the embodiment of the present application provide a kind of computer readable storage medium, wherein above-mentioned computer-readable Storage medium storage is used for the computer program of electronic data interchange, wherein above-mentioned computer program executes computer such as Step some or all of described in the embodiment of the present application first aspect.
5th aspect, the embodiment of the present application provide a kind of computer program product, wherein above-mentioned computer program product Non-transient computer readable storage medium including storing computer program, above-mentioned computer program are operable to make to calculate Machine executes the step some or all of as described in the embodiment of the present application first aspect.The computer program product can be one A software installation packet.
As can be seen that playing the method followed in real time and related production to musical sound described in the embodiment of the present application Product obtain currently played first by obtaining the tone data of player during player plays target song Tone data, default music score corresponding to target song are analyzed, and are obtained with reference to musical sound characteristic locus, to first tone data It is analyzed, obtains first tone characteristic locus, reference musical sound characteristic locus is matched with first tone characteristic locus, is obtained To matching result;The first performance position that player plays in real time, the label first in default music score are determined according to matching result Position is played, in this way, being not required to the music score on the screen for seeing electronic equipment during player plays, electronic equipment can be with master The performance with player is moved, determines that currently play first plays position in real time.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.
Figure 1A is the flow diagram that a kind of pair of musical sound provided by the embodiments of the present application plays the method followed in real time;
Figure 1B is a kind of demonstration schematic diagram of the application interface of musical sound assessment application disclosed in the embodiment of the present application;
Fig. 2 is that the process that another kind disclosed in the embodiment of the present application plays the method followed in real time to musical sound is illustrated Figure;
Fig. 3 is that the process that another kind disclosed in the embodiment of the present application plays the method followed in real time to musical sound is illustrated Figure;
Fig. 4 is the structural schematic diagram of a kind of electronic equipment disclosed in the embodiment of the present application;
Fig. 5 A is the structural schematic diagram that a kind of pair of musical sound plays the device followed in real time disclosed in the embodiment of the present application;
Fig. 5 B is the modification that the device followed in real time is played musical sound shown in Fig. 5 A disclosed in the embodiment of the present application Structure.
Specific embodiment
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is only Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art Every other embodiment obtained without creative efforts, shall fall in the protection scope of this application.
The description and claims of this application and term " first " in above-mentioned attached drawing, " second " etc. are for distinguishing Different objects, are not use to describe a particular order.In addition, term " includes " and " having " and their any deformations, it is intended that It is to cover and non-exclusive includes.Such as the process, method, system, product or equipment for containing a series of steps or units do not have It is defined in listed step or unit, but optionally further comprising the step of not listing or unit, or optionally also wrap Include other step or units intrinsic for these process, methods, product or equipment.
Referenced herein " embodiment " is it is meant that a particular feature, structure, or characteristic described can wrap in conjunction with the embodiments It is contained at least one embodiment of the application.Each position in the description occur the phrase might not each mean it is identical Embodiment, nor the independent or alternative embodiment with other embodiments mutual exclusion.Those skilled in the art explicitly and Implicitly understand, embodiment described herein can be combined with other embodiments.
Electronic equipment involved by the embodiment of the present application may include the various handheld devices with wireless communication function, Mobile unit, wireless headset calculate equipment or are connected to other processing equipments of radio modem and various forms of User equipment (user equipment, UE), mobile station (mobile station, MS), terminal device (terminal Device) etc., electronic equipment can be for example smart phone, tablet computer, laptop, palm PC, Earphone box etc. Deng.For convenience of description, apparatus mentioned above is referred to as electronic equipment.
It describes in detail below to the embodiment of the present application.
Figure 1A is please referred to, Figure 1A is that a kind of pair of musical sound disclosed in the embodiment of the present application plays the method followed in real time Flow diagram is applied to electronic equipment, this is played the method followed in real time to musical sound and includes the following steps:
101, during player plays target song, the first tone data of the player is obtained, are worked as The preceding first tone data played.
Wherein, above-mentioned target song is the song that user is played by musical instrument, and musical instrument may include following any one Kind: violin, piano, violoncello, guitar, accordion, Chinese zither etc., the application is with no restrictions.
Wherein, above-mentioned first tone data can be the audio signal of microphone acquisition, the vibration being arranged on musical instrument passes Sensor obtain vibration note signal, by musical instrument digital interface (musical instrument digital interface, MIDI the digital note signal etc.) obtained, the application is with no restrictions.
In the embodiment of the present application, the first tone data of the player are obtained, the microphone on electronic equipment can be passed through Obtain the audio signal that player plays;It can also be passed through by the way that electronic equipment and the vibrating sensor on musical instrument to be attached Vibrating sensor on musical instrument obtains the signal of musical instrument vibration, for example, user fingers a stringed instrument, can detect the vibration signal of string; Alternatively, it is happy that corresponding number can be obtained by the way that electronic equipment and the MIDI on musical instrument to be attached, when user plays an instrument Sound signal.Wherein first tone data refer to the tone data obtained when player plays to any moment, specific implementation In, the mountable musical sound assessment application dedicated for instructing user to play of electronic equipment please refers to Figure 1B, is the embodiment of the present application A kind of demonstration schematic diagram of the application interface of musical sound assessment application provided, can store different songs in the memory of electronic equipment Multiple music score, user can choose the target song that will be played in this application, and electronic equipment receives user and chooses target After the instruction of song, the corresponding music score of target song as shown in Figure 1B can be shown on a display screen, then, when electronic equipment connects Receive user triggering be used to indicate electronic equipment obtain first tone data open command after, microphone start obtain musical sound Data, alternatively, can open microphone after musical sound tests and assesses application unlatching, first tone data are then obtained by microphone, from And the currently first tone data played can be arrived, for example, when playing to 20s, can obtain first happy from 0s to 20s Sound data.
102, the corresponding default music score of the target song is analyzed, is obtained with reference to musical sound characteristic locus, the ginseng Examining musical sound characteristic locus is the musical sound characteristic locus arranged sequentially in time.
In the embodiment of the present application, music score corresponding with target song can be stored in advance in the memory in electronic equipment, thus, Electronic equipment receive user choose target song instruction after, can default music score corresponding to target song analyze, It obtains with reference to musical sound characteristic locus.
103, the first tone data are analyzed, obtains first tone characteristic locus, the first tone feature Track is the musical sound characteristic locus arranged sequentially in time.
Wherein, before analyzing first tone data, first tone data can also be pre-processed, pretreatment can Including filtering processing, enhanced processing can filter out the noise in first tone data by filtering processing, amplify processing, The accuracy of first tone characteristic locus can be improved.
104, it is matched with reference to musical sound characteristic locus with the first tone characteristic locus to described, obtains matching knot Fruit;The first performance position that player plays in real time is determined according to the matching result;In the default music score described in label First plays position.
In the embodiment of the present application, the first tone data played can be passed through during user plays Determine that user currently plays the position in target song, wherein the first performance position refers to plays in first tone data Last musical sound feature corresponding position in music score, so as to the label of the real-time exhibition user performance progress on music score, example Such as, when user plays to 30s, it may be determined that corresponding with the musical sound feature that the 30th second plays first plays position, then in electricity Label first plays position on the music score that sub- equipment is shown, in another example, when user plays to 35s, it may be determined that with the 35th second The musical sound feature of performance corresponding first plays position, and label first plays position on the music score shown on electronic equipment screen It sets, thus, the label on music score can be jumped with the progress that user plays, and show the position that player currently plays in real time It sets.
Optionally, it in above-mentioned steps 104, is carried out to described with reference to musical sound characteristic locus and the first tone characteristic locus Matching, it may include following steps:
41, it is referred to described with reference to selection in musical sound characteristic locus and the part neighbouring with reference to musical sound feature matched recently Characteristic locus;
42, the target musical sound feature locations of newest performance are chosen in the first tone characteristic locus;
It 43, will be each with reference to musical sound feature in the target musical sound feature locations, with part fixed reference feature track Position matches one by one, obtains matching degree curve;
The first performance position for determining that player plays in real time according to the matching result, it may include following steps:
44, the matching degree curve is analyzed, obtains the maximum position of matching degree in part fixed reference feature track It sets;
45, musical sound characteristic locus is referred to according to described, the maximum position of the matching degree is converted, obtain described the One plays position.
In the embodiment of the present application, it can will be chosen in reference musical sound characteristic locus with matched recently with reference to musical sound feature neighbour Close part fixed reference feature track, if with reference in musical sound characteristic locus there are no matched part fixed reference feature track, The part musical sound characteristic locus with reference to the preset length most started in musical sound characteristic locus is chosen, then, in first tone feature The target musical sound feature locations of newest performance are chosen in track, in turn, by target musical sound feature locations, with the part with reference to special Each musical sound feature locations that refer in sign track match one by one, obtain matching degree curve.
Further, matching degree curve can be analyzed, obtains the maximum position of matching degree in the fixed reference feature track of part It sets, then refers to musical sound characteristic locus according to described, the maximum position of matching degree is converted, the first performance position is obtained.
As it can be seen that by real time by the target musical sound feature locations of performance newest in first tone characteristic locus successively with ginseng It examines in musical sound characteristic locus and is matched with the nearest matched part fixed reference feature track neighbouring with reference to musical sound feature, it can be actively The movement for following the target musical sound feature locations of newest performance in first tone characteristic locus determines that the first of newest performance is played Position.
Optionally, in the embodiment of the present application, to it is described with reference to musical sound characteristic locus and the first tone characteristic locus into Before row matching, the method be can comprise the further steps of:
A1, the default music score is shown on the electronic equipment;The player is obtained in the default music score subscript Position is played in the starting of note;
A2, since position is played in the starting, will be described successively special with the first tone with reference to musical sound characteristic locus Sign track is matched, and the starting musical sound feature locations in the first tone characteristic locus are obtained;
A3, the corresponding relationship that position is played according to the starting musical sound feature locations and the starting, continue to execute described Matched operation is carried out with reference to musical sound characteristic locus and the first tone characteristic locus to described, obtains matching result.
Wherein, above-mentioned starting is played position and is referred to, target song is corresponding with reference in musical sound characteristic locus, and player will The position to strike up, in the embodiment of the present application, it is contemplated that user may play since the middle position of target song, Therefore, position is played in the starting that electronic equipment can obtain user's selection, and specifically, player can set before performance in electronics The start note position is marked on the music score of standby display, shows that player will play position from the starting and strike up.Specifically In realization, user can trigger the position that will be played on music score by the screen of electronic equipment, then the position is what user chose Position is played in starting, for example, then can trigger the corresponding position of the second trifle on music score when user wants to strike up from the second trifle It sets, which is to originate to play position.
Wherein, above-mentioned starting musical sound feature locations are the practical target songs that strikes up of user in first tone data Position, for example, first tone data include the tone data of 60s obtained after microphone is opened, if player is not from the 0th Second strikes up target song, but strikes up from 3s, then the pervious tone data of 3s is not belonging to player and plays target The data of song, it is thus necessary to determine that the starting musical sound feature locations in first tone data, i.e. tone data corresponding first Just belong to starting musical sound feature locations in musical sound characteristic locus since 3s.
In the embodiment of the present application, can since starting play position, will with reference to musical sound characteristic locus successively with first tone Characteristic locus is matched, and the starting musical sound feature locations in first tone characteristic locus are obtained, then special according to starting musical sound The corresponding relationship that position is played with starting in sign position continues will be with reference to musical sound characteristic locus and the progress of first tone characteristic locus Match, implements to determine that newest musical sound feature corresponding first plays position in first tone track.
Optionally, it in the embodiment of the present application, can comprise the further steps of:
B1, select in matched matching result with reference to musical sound characteristic locus from the first tone characteristic locus with described Take the corresponding part matching result of second musical tone data of the neighbouring described first predetermined time period for playing position;
B2, the musical sound characteristic error according to present in the third tone data for including in the part matching result Rate stops executing the operation for obtaining the tone data if the musical sound characteristic error rate is higher than preset threshold.
In the embodiment of the present application, when player stops player, electronic equipment can stop obtaining tone data, wherein when Performance accuracy in continuing for some time is lower, it may be determined that player may stop playing, alternatively, may play in player Frequently continuous error, at this point, the operation that controllable microphone stops obtaining tone data specifically can be according to second musical tone number It is determined according to corresponding part matching result, musical sound characteristic error rate present in third tone data, if musical sound characteristic error rate Higher than preset threshold, the operation for obtaining tone data can be stopped.
Optionally, in the embodiment of the present application, after stopping executing the operation for obtaining the tone data, may also include Following steps:
C1, third tone data is obtained;
C2, the third tone data is analyzed, obtains second musical tone characteristic locus;
C3, the last one musical sound feature in the third tone data is determined according to the second musical tone characteristic locus;
C4, determine that position is played in end corresponding with the last one described musical sound feature in the music score;
C5, terminate to play position from the start note position to described with reference to selection in musical sound characteristic locus from described Object reference musical sound characteristic locus;
C6, according to the last one described musical sound feature and the corresponding relationship terminated between note locations, by described the Two musical sound characteristic locus are matched with the object reference musical sound characteristic locus, are obtained in the second musical tone data about pleasure The object matching result of sound assessment indicator;
C7, target evaluating result is determined according to the object matching result and preset code of points.
In the embodiment of the present application, after player stops playing, third tone data can be obtained, wherein first tone Data and second musical tone data are that the part tone data of third tone data in turn can carry out the third tone data Assessment, obtains target evaluating result.
It is appreciated that third tone data is the complete tone data that the needs that player plays are measured, the application is real It applies in example, can also test and assess to third tone data, to can determine the effect that player plays.Specifically, it can be directed to and drill The musical sounds assessment indicators such as accuracy in pitch, rhythm, performance speed that the person of playing plays are tested and assessed, and can also be drilled according to the determination of object matching result Play leakage sound, the wrong sound, multitone of middle appearance.
Wherein, can multiple dimensions such as accuracy in pitch, speed, rhythm test and assess to second musical tone data, specifically, can be by second Musical sound characteristic locus is matched with target musical sound characteristic locus, and it is happy to obtain musical sound feature and target in second musical tone characteristic locus The object matching result of sound characteristic locus alignment.Then, drilling in second musical tone characteristic locus is determined according to object matching result Play the performance speed deviation that speed is played in speed and target musical sound characteristic locus;Determine that second is happy according to object matching result The performance rhythm deviation that rhythm is played in rhythm and target musical sound characteristic locus is played in sound characteristic locus;According to target The accuracy in pitch deviation of note pitch in note pitch and target musical sound characteristic locus in second musical tone characteristic locus is determined with result Value.In turn, it is determined according to performance speed deviation and preset performance speed code of points and plays speed score value;According to performance Rhythm deviation and preset performance rhythm code of points, which determine, plays rhythm score value;According to accuracy in pitch deviation and preset sound Quasi- code of points determines accuracy in pitch score value.Finally, true according to speed score value, performance rhythm score value and accuracy in pitch score value is played Set the goal score value.
Wherein, also leakage sound in first tone data and more can be determined according to object matching result and rhythm deviation Lingering sound determines the wrong sound in first tone data according to object matching result and accuracy in pitch deviation, thus, player can be detailed Carefully know leakage sound in playing procedure, extra sound and wrong sound, thus, can more intelligent, targetedly instruct player into Row playing practice.
As can be seen that the method followed in real time is played musical sound described in the embodiment of the present application, by drilling During the person of playing plays target song, the tone data of player is obtained, obtains the first tone data currently played, it is right The corresponding default music score of target song is analyzed, and obtains analyzing first tone data with reference to musical sound characteristic locus, obtaining To first tone characteristic locus, reference musical sound characteristic locus is matched with first tone characteristic locus, obtains matching result; The first performance position that player plays in real time is determined according to matching result, and label first plays position in default music score, such as This, the music score being not required on the screen for seeing electronic equipment during player plays, electronic equipment can be with active with performance The performance of person determines that currently play first plays position in real time.
Consistent with the abovely, Fig. 2 is that a kind of pair of musical sound disclosed in the embodiment of the present application plays the method followed in real time Flow diagram.Applied to electronic equipment, this is played the method followed in real time to musical sound and includes the following steps:
201, the corresponding default music score of target song is shown on an electronic device;The player is obtained in the default pleasure Position is played in the starting marked in spectrum.
202, during player plays the target song, the first tone data of the player is obtained, are obtained To the first tone data currently played.
203, the default music score is analyzed, is obtained with reference to musical sound characteristic locus, it is described to refer to musical sound characteristic locus For the musical sound characteristic locus arranged sequentially in time.
204, the first tone data are analyzed, obtains first tone characteristic locus, the first tone feature Track is the musical sound characteristic locus arranged sequentially in time.
205, since position is played in the starting, to the reference musical sound characteristic locus and the first tone feature rail Mark is matched, and the starting musical sound feature locations in the first tone characteristic locus are obtained.
206, the corresponding relationship that position is played according to the starting musical sound feature locations and the starting, continues to execute described Matched operation is carried out with reference to musical sound characteristic locus and the first tone characteristic locus to described, obtains matching result.
207, determine that player plays in real time first plays position according to the matching result;In the default music score Described first is marked to play position.
Wherein, it is described to musical sound performance progress to be referred to Figure 1A for the specific descriptions of above-mentioned steps 201- step 207 The corresponding description of the method followed in real time, details are not described herein.
As can be seen that the method followed in real time is played musical sound described in the embodiment of the present application, by electricity The corresponding default music score of target song is shown in sub- equipment;It obtains the starting that the player marks on default music score and plays position It sets, during player plays target song, obtains the tone data of player, obtain the first tone currently played Data, default music score corresponding to target song are analyzed, and obtain carrying out first tone data with reference to musical sound characteristic locus Analysis, obtains first tone characteristic locus, it is special to reference musical sound characteristic locus and first tone since position is played in starting Sign track is matched, and the starting musical sound feature locations in first tone characteristic locus are obtained, according to starting musical sound feature locations The corresponding relationship that position is played with starting continues to described with reference to musical sound characteristic locus and the progress of first tone characteristic locus Match, obtain matching result, the first performance position that player plays in real time is determined according to matching result, is marked in default music score First plays position, in this way, being not required to the music score on the screen for seeing electronic equipment during player plays, electronic equipment can With active with the performance of player, determine that currently play first plays position in real time.
Consistent with the abovely, Fig. 3 is that a kind of pair of musical sound disclosed in the embodiment of the present application plays the method followed in real time Flow diagram.Applied to electronic equipment, this is played the method followed in real time to musical sound and includes the following steps:
301, during player plays target song, the first tone data of the player is obtained, are worked as The preceding first tone data played.
302, the corresponding default music score of the target song is analyzed, is obtained with reference to musical sound characteristic locus, the ginseng Examining musical sound characteristic locus is the musical sound characteristic locus arranged sequentially in time.
303, the first tone data are analyzed, obtains first tone characteristic locus, the first tone feature Track is the musical sound characteristic locus arranged sequentially in time.
304, it is matched with reference to musical sound characteristic locus with the first tone characteristic locus to described, obtains matching knot Fruit;The first performance position that player plays in real time is determined according to the matching result;In the default music score described in label First plays position.
305, it is carried out in matched matching result from the first tone characteristic locus and the reference musical sound characteristic locus Choose the corresponding part matching result of second musical tone data for the predetermined time period that neighbouring described first plays position.
306, the musical sound characteristic error according to present in the third tone data for including in the part matching result Rate stops executing the operation for obtaining the tone data if the musical sound characteristic error rate is higher than preset threshold.
Wherein, it is described to musical sound performance progress to be referred to Figure 1A for the specific descriptions of above-mentioned steps 301- step 306 The corresponding description of the method followed in real time, details are not described herein.
As can be seen that the method followed in real time is played musical sound described in the embodiment of the present application, by drilling During the person of playing plays target song, the first tone data of player currently played are obtained, it is corresponding to target song Default music score analyzed, obtain analyzing first tone data with reference to musical sound characteristic locus, obtain first tone spy Track is levied, reference musical sound characteristic locus is matched with first tone characteristic locus, obtains matching result;According to matching result Determine that player plays in real time first plays position, label first plays position in default music score, selects from matching result The corresponding part matching result of second musical tone data for taking the neighbouring first predetermined time period for playing position, matches according to part As a result musical sound characteristic error rate present in the second musical tone data for including in, if musical sound characteristic error rate is higher than preset threshold, Stop executing and obtains tone data, in this way, the music score on the screen for seeing electronic equipment is not required to during player plays, electricity Sub- equipment can determine that in real time currently play first plays position, can be set by electronics with active with the performance of player The standby incorrect frequency automatically according to performance determines that player stops playing, and obtains tone data to more intelligently terminate.
Referring to Fig. 4, Fig. 4 is the structural schematic diagram of a kind of electronic equipment disclosed in the embodiment of the present application, as shown, should Electronic equipment includes processor, memory, communication interface, and one or more programs, wherein said one or multiple programs It is stored in above-mentioned memory, and is configured to be executed by above-mentioned processor, above procedure includes for executing following steps Instruction:
During player plays target song, the first tone data of the player are obtained, are obtained currently The first tone data of performance;
The corresponding default music score of the target song is analyzed, is obtained with reference to musical sound characteristic locus, it is described with reference to pleasure Sound characteristic locus is the musical sound characteristic locus arranged sequentially in time;
The first tone data are analyzed, first tone characteristic locus, the first tone characteristic locus are obtained For the musical sound characteristic locus arranged sequentially in time;
It is matched with reference to musical sound characteristic locus with the first tone characteristic locus to described, obtains matching result;Root The first performance position that player plays in real time is determined according to the matching result;Described first is marked to drill in the default music score Play position.
In a possible example, it is described to it is described with reference to musical sound characteristic locus and the first tone characteristic locus into Before row matching, above procedure further includes the instruction for executing following steps:
The default music score is shown on the electronic equipment;Obtain what the player marked on the default music score Position is played in starting;
Since position is played in the starting, to it is described with reference to musical sound characteristic locus and the first tone characteristic locus into Row matching, obtains the starting musical sound feature locations in the first tone characteristic locus;
The corresponding relationship that position is played according to the starting musical sound feature locations and the starting, continues to execute described to institute It states and carries out matched operation with reference to musical sound characteristic locus and the first tone characteristic locus, obtain matching result.
In a possible example, described to the reference musical sound characteristic locus and the first tone characteristic locus In terms of being matched, above procedure includes the instruction for executing following steps:
Described special with reference to selection in musical sound characteristic locus and the part reference neighbouring with reference to musical sound feature matched recently Levy track;
The target musical sound feature locations of newest performance are chosen in the first tone characteristic locus;
It will be each with reference to musical sound feature locations in the target musical sound feature locations, with part fixed reference feature track It matches one by one, obtains matching degree curve;
It is described determined according to the matching result player plays in real time first play position in terms of, above procedure packet Include the instruction for executing following steps:
The matching degree curve is analyzed, the maximum position of matching degree in part fixed reference feature track is obtained;
Musical sound characteristic locus is referred to according to described, the maximum position of the matching degree is converted, obtains described first Play position.
In a possible example, above procedure further includes the instruction for executing following steps:
Choose in matched matching result with reference to musical sound characteristic locus from the first tone characteristic locus with described Neighbouring described first plays the corresponding part matching result of second musical tone data of the predetermined time period of position;
According to musical sound characteristic error rate present in the second musical tone data for including in the part matching result, if The musical sound characteristic error rate is higher than preset threshold, stops executing the operation for obtaining the tone data.
In a possible example, after stopping executing the operation for obtaining the tone data, above procedure is also Including the instruction for executing following steps:
Obtain third tone data;
The third tone data is analyzed, second musical tone characteristic locus is obtained;
The last one musical sound feature in the third tone data is determined according to the second musical tone characteristic locus;
Determine that position is played in end corresponding with the last one described musical sound feature in the music score;
From described with reference to the mesh chosen in musical sound characteristic locus from the start note position to end performance position Mark refers to musical sound characteristic locus;
It is happy by described second according to the last one described musical sound feature and the corresponding relationship terminated between note locations Sound characteristic locus is matched with the object reference musical sound characteristic locus, obtains surveying in the third tone data about musical sound Comment the object matching result of index;
Target evaluating result is determined according to the object matching result and preset code of points.
It is above-mentioned that mainly the scheme of the embodiment of the present application is described from the angle of method side implementation procedure.It is understood that , in order to realize the above functions, it comprises execute the corresponding hardware configuration of each function and/or software mould for electronic equipment Block.Those skilled in the art should be readily appreciated that, in conjunction with each exemplary unit of embodiment description presented herein And algorithm steps, the application can be realized with the combining form of hardware or hardware and computer software.Some function actually with Hardware or computer software drive the mode of hardware to execute, the specific application and design constraint item depending on technical solution Part.Professional technician can specifically realize described function to each using distinct methods, but this reality Now it is not considered that exceeding scope of the present application.
The embodiment of the present application can carry out the division of functional unit according to above method example to electronic equipment, for example, can With each functional unit of each function division of correspondence, two or more functions can also be integrated in a processing unit In.Above-mentioned integrated unit both can take the form of hardware realization, can also realize in the form of software functional units.It needs It is noted that be schematical, only a kind of logical function partition to the division of unit in the embodiment of the present application, it is practical real It is current that there may be another division manner.
Fig. 5 A is please referred to, Fig. 5 A is that a kind of pair of musical sound disclosed in the embodiment of the present application plays the device followed in real time Structural schematic diagram, is applied to electronic equipment, and the device followed in real time to musical sound performance includes acquiring unit 501, divides Analyse unit 502, matching unit 503, determination unit 504 and marking unit 505, wherein
The acquiring unit 501, for obtaining the first of the player during player plays target song Tone data obtains the first tone data currently played;
The analytical unit 502 is obtained for analyzing the corresponding default music score of the target song with reference to musical sound Characteristic locus, described with reference to musical sound characteristic locus is the musical sound characteristic locus arranged sequentially in time;And to described First tone data are analyzed, and first tone characteristic locus is obtained, and the first tone characteristic locus is sequentially in time The musical sound characteristic locus arranged;
The matching unit 503, for being carried out to described with reference to musical sound characteristic locus and the first tone characteristic locus Matching, obtains matching result;
The determination unit 504, for determining that player plays in real time first plays position according to the matching result;
The marking unit 505, for marking described first to play position in the default music score.
Optionally, the acquiring unit is also used to show the default music score on the electronic equipment;It is drilled described in acquisition Position is played in the starting that the person of playing marks on the default music score;
The matching unit is also used to since position is played in the starting, successively by the reference musical sound characteristic locus It is matched with the first tone characteristic locus, obtains the starting musical sound feature locations in the first tone characteristic locus; And the corresponding relationship of position is played according to the starting musical sound feature locations and the starting, it continues to execute described to described Matched operation is carried out with reference to musical sound characteristic locus and the first tone characteristic locus, obtains matching result.
Optionally, match party is carried out with reference to musical sound characteristic locus and the first tone characteristic locus to described described Face, the matching unit are specifically used for:
Described special with reference to selection in musical sound characteristic locus and the part reference neighbouring with reference to musical sound feature matched recently Levy track;
The target musical sound feature locations of newest performance are chosen in the first tone characteristic locus;
It will be each with reference to musical sound feature locations in the target musical sound feature locations, with part fixed reference feature track It matches one by one, obtains matching degree curve;
The determination unit is specifically used for:
The matching degree curve is analyzed, the maximum position of matching degree in part fixed reference feature track is obtained;
Musical sound characteristic locus is referred to according to described, the maximum position of the matching degree is converted, obtains described first Play position.
Optionally, the acquiring unit 501 is also used to:
Choose in matched matching result with reference to musical sound characteristic locus from the first tone characteristic locus with described Neighbouring described first plays the corresponding part matching result of second musical tone data of the predetermined time period of position;
According to musical sound characteristic error rate present in the second musical tone data for including in the part matching result, if The musical sound characteristic error rate is higher than preset threshold, stops executing the operation for obtaining the tone data.
Optionally, as shown in Figure 5 B, Fig. 5 B is the modification that the device followed in real time is played musical sound shown in Fig. 5 A Structure can also include: assessment unit 506 compared with Fig. 5 A, wherein
The assessment unit 506, for it is happy to obtain third after stopping executing the operation for obtaining the tone data Sound data;The third tone data is analyzed, second musical tone characteristic locus is obtained;
The determination unit 504 is also used to be determined in the third tone data according to the second musical tone characteristic locus The last one musical sound feature;Determine that position is played in end corresponding with the last one described musical sound feature in the music score;
The matching unit 503, for from it is described with reference to choose in musical sound characteristic locus from the start note position to The object reference musical sound characteristic locus for terminating to play position;According to the last one described musical sound feature and the end note Corresponding relationship between position matches the second musical tone characteristic locus with the object reference musical sound characteristic locus, Obtain the object matching result in the third tone data about musical sound assessment indicator;
The determination unit 504 is also used to determine that target is surveyed according to the object matching result and preset code of points Comment result.
As can be seen that the device followed in real time is played musical sound described in the embodiment of the present application, by drilling During the person of playing plays target song, the tone data of player is obtained, obtains the first tone data currently played, it is right The corresponding default music score of target song is analyzed, and obtains analyzing first tone data with reference to musical sound characteristic locus, obtaining To first tone characteristic locus, reference musical sound characteristic locus is matched with first tone characteristic locus, obtains matching result; The first performance position that player plays in real time is determined according to matching result, and label first plays position in default music score, such as This, the music score being not required on the screen for seeing electronic equipment during player plays, electronic equipment can be with active with performance The performance of person determines that currently play first plays position in real time.
It should be noted that electronic equipment described in the embodiment of the present application is presented in the form of functional unit.Here Used term " unit " should be understood as meaning as widest as possible, for realizing pair of function described by each " unit " As for example can be integrated circuit ASIC, single circuit, for executing the processor of one or more softwares or firmware program (altogether Enjoying, dedicated or chipset) and memory, combinational logic circuit, and/or provide and realize other suitable groups of above-mentioned function Part.
The embodiment of the present application also provides a kind of computer storage medium, wherein computer storage medium storage is for electricity The computer program of subdata exchange, it is as any in recorded in above method embodiment which execute computer A kind of pair of musical sound plays some or all of the method followed in real time step.
The embodiment of the present application also provides a kind of computer program product, and the computer program product includes storing calculating The non-transient computer readable storage medium of machine program, the computer program are operable to that computer is made to execute such as above-mentioned side Some or all of any method that musical sound performance is followed in real time recorded in method embodiment step.
It should be noted that for the various method embodiments described above, for simple description, therefore, it is stated as a series of Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because According to the application, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art should also know It knows, the embodiments described in the specification are all preferred embodiments, related actions and modules not necessarily the application It is necessary.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, reference can be made to the related descriptions of other embodiments.
In several embodiments provided herein, it should be understood that disclosed device, it can be by another way It realizes.For example, the apparatus embodiments described above are merely exemplary, such as the division of the unit, it is only a kind of Logical function partition, there may be another division manner in actual implementation, such as multiple units or components can combine or can To be integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual Coupling, direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of device or unit, It can be electrical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also be realized in the form of software program module.
If the integrated unit is realized in the form of software program module and sells or use as independent product When, it can store in a computer-readable access to memory.Based on this understanding, the technical solution of the application substantially or Person says that all or part of the part that contributes to existing technology or the technical solution can body in the form of software products Reveal and, which is stored in a memory, including some instructions are used so that a computer equipment (can be personal computer, server or network equipment etc.) executes all or part of each embodiment the method for the application Step.And memory above-mentioned includes: USB flash disk, read-only memory (read-only memory, ROM), random access memory The various media that can store program code such as (random access memory, RAM), mobile hard disk, magnetic or disk.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can It is completed with instructing relevant hardware by program, which can store in a computer-readable memory, memory It may include: flash disk, ROM, RAM, disk or CD etc..
The embodiment of the present application is described in detail above, specific case used herein to the principle of the application and Embodiment is expounded, the description of the example is only used to help understand the method for the present application and its core ideas; At the same time, for those skilled in the art can in specific embodiments and applications according to the thought of the application There is change place, in conclusion the contents of this specification should not be construed as limiting the present application.

Claims (10)

1. a kind of pair of musical sound plays the method followed in real time, which is characterized in that be applied to electronic equipment, the method packet It includes:
During player plays target song, the first tone data of the player are obtained, obtain currently having played First tone data;
The corresponding default music score of the target song is analyzed, is obtained with reference to musical sound characteristic locus, it is described special with reference to musical sound Levying track is the musical sound characteristic locus arranged sequentially in time;
The first tone data are analyzed, obtain first tone characteristic locus, the first tone characteristic locus be by The musical sound characteristic locus arranged according to time sequencing;
It is matched with reference to musical sound characteristic locus with the first tone characteristic locus to described, obtains matching result;According to institute It states matching result and determines that player plays in real time first plays position;Described first is marked to play position in the default music score It sets.
2. the method according to claim 1, wherein described to the reference musical sound characteristic locus and described first Before musical sound characteristic locus is matched, the method also includes:
The default music score is shown on the electronic equipment;Obtain the starting that the player marks on the default music score Play position;
Since position is played in the starting, to described with reference to musical sound characteristic locus and first tone characteristic locus progress Match, obtains the starting musical sound feature locations in the first tone characteristic locus;
The corresponding relationship that position is played according to the starting musical sound feature locations and the starting, continues to execute described to the ginseng It examines musical sound characteristic locus and the first tone characteristic locus carries out matched operation, obtain matching result.
3. according to the method described in claim 2, it is characterized in that, described to the reference musical sound characteristic locus and described first Musical sound characteristic locus is matched, comprising:
Described with reference to selection in musical sound characteristic locus and the nearest matched part fixed reference feature rail neighbouring with reference to musical sound feature Mark;
The target musical sound feature locations of newest performance are chosen in the first tone characteristic locus;
One by one by each reference musical sound feature locations in the target musical sound feature locations, with part fixed reference feature track Matching, obtains matching degree curve;
The first performance position for determining that player plays in real time according to the matching result, comprising:
The matching degree curve is analyzed, the maximum position of matching degree in part fixed reference feature track is obtained;
Musical sound characteristic locus is referred to according to described, the maximum position of the matching degree is converted, described first is obtained and plays Position.
4. according to the described in any item methods of Claims 2 or 3, which is characterized in that the method also includes:
It is chosen from the first tone characteristic locus and the matched matching result of the reference musical sound characteristic locus progress neighbouring Described first plays the corresponding part matching result of second musical tone data of the predetermined time period of position;
According to musical sound characteristic error rate present in the second musical tone data for including in the part matching result, if described Musical sound characteristic error rate is higher than preset threshold, stops executing the operation for obtaining the tone data.
5. according to the method described in claim 4, it is characterized in that, stopping executing the operation for obtaining the tone data Afterwards, the method also includes:
Obtain third tone data;
The third tone data is analyzed, second musical tone characteristic locus is obtained;
The last one musical sound feature in the third tone data is determined according to the second musical tone characteristic locus;
Determine that position is played in end corresponding with the last one described musical sound feature in the music score;
From described with reference to the target ginseng chosen in musical sound characteristic locus from the start note position to end performance position Examine musical sound characteristic locus;
It is according to the last one described musical sound feature and the corresponding relationship terminated between note locations, the second musical tone is special Sign track is matched with the object reference musical sound characteristic locus, obtains referring in the third tone data about musical sound assessment Target object matching result;
Target evaluating result is determined according to the object matching result and preset code of points.
6. a kind of pair of musical sound plays the device followed in real time, which is characterized in that it is applied to electronic equipment, it is described that musical sound is drilled Playing the device followed in real time includes:
Acquiring unit, for obtaining the first tone data of the player, obtaining during player plays target song To the first tone data currently played;
Analytical unit is obtained for analyzing the corresponding default music score of the target song with reference to musical sound characteristic locus, institute Stating with reference to musical sound characteristic locus is the musical sound characteristic locus arranged sequentially in time;And to the first tone number According to being analyzed, first tone characteristic locus is obtained, the first tone characteristic locus is arranged sequentially in time Musical sound characteristic locus;
Matching unit obtains for matching with reference to musical sound characteristic locus with the first tone characteristic locus to described With result;
Determination unit, for determining that player plays in real time first plays position according to the matching result;
Marking unit, for marking described first to play position in the default music score.
7. device according to claim 6, which is characterized in that
The acquiring unit is also used to show the default music score on the electronic equipment;The player is obtained described Position is played in the starting marked on default music score;
The matching unit, be also used to since the starting play position, by it is described with reference to musical sound characteristic locus successively with institute It states first tone characteristic locus to be matched, obtains the starting musical sound feature locations in the first tone characteristic locus;And According to the corresponding relationship for originating musical sound feature locations and starting performance position, continue to execute described to the reference pleasure Sound characteristic locus and the first tone characteristic locus carry out matched operation, obtain matching result.
8. device according to claim 7, which is characterized in that it is described to described with reference to musical sound characteristic locus and described the In terms of one musical sound characteristic locus is matched, the matching unit is specifically used for:
Described with reference to selection in musical sound characteristic locus and the nearest matched part fixed reference feature rail neighbouring with reference to musical sound feature Mark;
The target musical sound feature locations of newest performance are chosen in the first tone characteristic locus;
One by one by each reference musical sound feature locations in the target musical sound feature locations, with part fixed reference feature track Matching, obtains matching degree curve;
The determination unit is specifically used for:
The matching degree curve is analyzed, the maximum position of matching degree in part fixed reference feature track is obtained;
Musical sound characteristic locus is referred to according to described, the maximum position of the matching degree is converted, described first is obtained and plays Position.
9. a kind of electronic equipment, which is characterized in that including processor, memory, communication interface, and one or more programs, One or more of programs are stored in the memory, and are configured to be executed by the processor, described program packet Include the instruction for executing the step in the method according to claim 1 to 5.
10. a kind of computer readable storage medium, which is characterized in that storage is used for the computer program of electronic data interchange, In, the computer program makes computer execute the method according to claim 1 to 5.
CN201910242672.6A 2019-03-28 2019-03-28 Method for real-time following musical performance and related product Active CN110111761B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910242672.6A CN110111761B (en) 2019-03-28 2019-03-28 Method for real-time following musical performance and related product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910242672.6A CN110111761B (en) 2019-03-28 2019-03-28 Method for real-time following musical performance and related product

Publications (2)

Publication Number Publication Date
CN110111761A true CN110111761A (en) 2019-08-09
CN110111761B CN110111761B (en) 2022-03-11

Family

ID=67484683

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910242672.6A Active CN110111761B (en) 2019-03-28 2019-03-28 Method for real-time following musical performance and related product

Country Status (1)

Country Link
CN (1) CN110111761B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112037738A (en) * 2020-08-31 2020-12-04 腾讯音乐娱乐科技(深圳)有限公司 Music data processing method and device and computer storage medium
CN112669798A (en) * 2020-12-15 2021-04-16 深圳芒果未来教育科技有限公司 Accompanying method for actively following music signal and related equipment
WO2021114815A1 (en) * 2020-05-26 2021-06-17 平安科技(深圳)有限公司 Method and device for determining score following path, electronic device, and storage medium
CN113286183A (en) * 2021-05-10 2021-08-20 小叶子(北京)科技有限公司 Method, device and equipment for synchronously displaying performance process and music score and storage medium
US20210295805A1 (en) * 2020-03-23 2021-09-23 Yamaha Corporation Musical instrument, non-transitory computer readable medium and musical instrument communication system

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5208413A (en) * 1991-01-16 1993-05-04 Ricos Co., Ltd. Vocal display device
CN1531644A (en) * 2001-05-21 2004-09-22 �����ּ�����˾ Method and apparatus for tracking musical score
CN1953044A (en) * 2006-09-26 2007-04-25 中山大学 Present and detection system and method of instrument performance based on MIDI file
JP2007133199A (en) * 2005-11-11 2007-05-31 Nippon Hoso Kyokai <Nhk> Musical score information tracking device
JP2011075619A (en) * 2009-09-29 2011-04-14 Korg Inc Musical score tracing device
CN103377647A (en) * 2012-04-24 2013-10-30 中国科学院声学研究所 Automatic music notation recording method and system based on audio and video information
CN106340286A (en) * 2016-09-27 2017-01-18 华中科技大学 Universal real-time musical instrument playing evaluation system
CN107077836A (en) * 2014-06-10 2017-08-18 Makemusic公司 For tracking the method for music score and the modeling method of correlation
CN108281127A (en) * 2017-12-29 2018-07-13 王楠珊 A kind of music practice auxiliary system, method, apparatus and storage device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5208413A (en) * 1991-01-16 1993-05-04 Ricos Co., Ltd. Vocal display device
CN1531644A (en) * 2001-05-21 2004-09-22 �����ּ�����˾ Method and apparatus for tracking musical score
JP2007133199A (en) * 2005-11-11 2007-05-31 Nippon Hoso Kyokai <Nhk> Musical score information tracking device
CN1953044A (en) * 2006-09-26 2007-04-25 中山大学 Present and detection system and method of instrument performance based on MIDI file
JP2011075619A (en) * 2009-09-29 2011-04-14 Korg Inc Musical score tracing device
CN103377647A (en) * 2012-04-24 2013-10-30 中国科学院声学研究所 Automatic music notation recording method and system based on audio and video information
CN107077836A (en) * 2014-06-10 2017-08-18 Makemusic公司 For tracking the method for music score and the modeling method of correlation
CN106340286A (en) * 2016-09-27 2017-01-18 华中科技大学 Universal real-time musical instrument playing evaluation system
CN108281127A (en) * 2017-12-29 2018-07-13 王楠珊 A kind of music practice auxiliary system, method, apparatus and storage device

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210295805A1 (en) * 2020-03-23 2021-09-23 Yamaha Corporation Musical instrument, non-transitory computer readable medium and musical instrument communication system
US11961498B2 (en) * 2020-03-23 2024-04-16 Yamaha Corporation Musical instrument, non-transitory computer readable medium and musical instrument communication system
WO2021114815A1 (en) * 2020-05-26 2021-06-17 平安科技(深圳)有限公司 Method and device for determining score following path, electronic device, and storage medium
CN112037738A (en) * 2020-08-31 2020-12-04 腾讯音乐娱乐科技(深圳)有限公司 Music data processing method and device and computer storage medium
CN112037738B (en) * 2020-08-31 2024-05-28 腾讯音乐娱乐科技(深圳)有限公司 Music data processing method and device and computer storage medium
CN112669798A (en) * 2020-12-15 2021-04-16 深圳芒果未来教育科技有限公司 Accompanying method for actively following music signal and related equipment
CN112669798B (en) * 2020-12-15 2021-08-03 深圳芒果未来教育科技有限公司 Accompanying method for actively following music signal and related equipment
CN113286183A (en) * 2021-05-10 2021-08-20 小叶子(北京)科技有限公司 Method, device and equipment for synchronously displaying performance process and music score and storage medium
CN113286183B (en) * 2021-05-10 2022-11-01 小叶子(北京)科技有限公司 Method, device and equipment for synchronously displaying performance process and music score and storage medium

Also Published As

Publication number Publication date
CN110111761B (en) 2022-03-11

Similar Documents

Publication Publication Date Title
CN110111761A (en) The method followed in real time and Related product are played to musical sound
CN110070847A (en) Musical sound assessment method and Related product
CN103165119B (en) Karaoke method and system
US9928835B1 (en) Systems and methods for determining content preferences based on vocal utterances and/or movement by a user
CN109166564A (en) For the method, apparatus and computer readable storage medium of lyrics text generation melody
US20100279772A1 (en) Methods and apparatus for stringed controllers and/or instruments
CN107316638A (en) A kind of poem recites evaluating method and system, a kind of terminal and storage medium
CN108877753B (en) Music synthesis method and system, terminal and computer readable storage medium
EP3220384A1 (en) Musical instrument with intelligent interface
CN109326270A (en) Generation method, terminal device and the medium of audio file
CN104505103B (en) Voice quality assessment equipment, method and system
CN106205571A (en) A kind for the treatment of method and apparatus of singing voice
JP4479701B2 (en) Music practice support device, dynamic time alignment module and program
Mayor et al. Performance analysis and scoring of the singing voice
CN111399745A (en) Music playing method, music playing interface generation method and related products
CN105895079A (en) Voice data processing method and device
CN109410972A (en) Generate the method, apparatus and storage medium of sound effect parameters
CN106095943B (en) It gives song recitals and knows well range detection method and device
WO1993017408A1 (en) Method and apparatus for ear training
JP2014041319A (en) Education device and method for musical expression power and musical performance evaluation device
KR102118189B1 (en) media contents service system using terminal
Jaime et al. A new multiformat rhythm game for music tutoring
CN110136677B (en) Musical tone control method and related product
CN103678533B (en) A kind of method and apparatus for handling chart data
JP2008040258A (en) Musical piece practice assisting device, dynamic time warping module, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 518000 No. a821, 8 / F, block a, Mingyou procurement center, labor community, Xixiang street, Bao'an District, Shenzhen, Guangdong

Applicant after: Shenzhen mango Future Technology Co.,Ltd.

Address before: 518000 No. A541, 5 / F, block a, Mingyou procurement center, labor community, Xixiang street, Bao'an District, Shenzhen, Guangdong

Applicant before: Shenzhen Mango Future Education Technology Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant