CN107302548A - Method, terminal device, server and the system of aid musical instruments playing practice - Google Patents

Method, terminal device, server and the system of aid musical instruments playing practice Download PDF

Info

Publication number
CN107302548A
CN107302548A CN201610229297.8A CN201610229297A CN107302548A CN 107302548 A CN107302548 A CN 107302548A CN 201610229297 A CN201610229297 A CN 201610229297A CN 107302548 A CN107302548 A CN 107302548A
Authority
CN
China
Prior art keywords
signal
musical instrument
audio signal
practitioner
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610229297.8A
Other languages
Chinese (zh)
Inventor
马晓军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Telecom Corp Ltd
Original Assignee
China Telecom Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Telecom Corp Ltd filed Critical China Telecom Corp Ltd
Priority to CN201610229297.8A priority Critical patent/CN107302548A/en
Publication of CN107302548A publication Critical patent/CN107302548A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B15/00Teaching music
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10GREPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS
    • G10G7/00Other auxiliary devices or accessories, e.g. conductors' batons or separate holders for resin or strings
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/566Grouping or aggregating service requests, e.g. for unified processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Acoustics & Sound (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Electrophonic Musical Instruments (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The present invention discloses a kind of method, terminal device, server and the system of aid musical instruments playing practice.This method includes:Obtain the audio signal produced when musical instrument practitioner plays and surface electromyogram signal;Such performance data is reported into server, so that server determines to play evaluation result according to such performance data, wherein such performance data includes audio signal and surface electromyogram signal;The performance evaluation result that the reception server is returned;The performance evaluation result is shown, to instruct musical instrument practitioner to practise playing music.The sound that sends and player's finger motion when the present invention is by using instrument playing and the surface electromyogram signal produced, it is possible thereby to which finger is on the premise of the operation of musical instrument, auxiliary carries out instrument playing exercise when not influenceing to play;Making devices for learning musical instruments, person even stays at home, can also alone, easily and flexibly carry out playing practice, and the practice effect of learner is judged.

Description

Method, terminal device, server and the system of aid musical instruments playing practice
Technical field
The present invention relates to instrument playing aided education field, more particularly to a kind of aid musical instruments, which are played, to be practiced Method, terminal device, server and the system of habit.
Background technology
At present, devices for learning musical instruments person is typically necessary teacher and carries out aspectant guidance, due to limited Teacher's quantity and fixed instructional blocks of time arrangement so that time, the frequency and the place of study and exercise Deng can all be restricted, learner can not obtain sufficiently study and exercise.
Even if can practise alone at home, but timely, correctly instructed due to lacking, easily Produce mistake performance custom, then to teacher instructed face-to-face when, correct get up to compare consumption When, effort, can also influence the confidence and enthusiasm of learner.
Using instrument playing assisted teaching system, enable learner according to the wish of oneself neatly Practice periods is adjusted, just turns into the effective means for improving devices for learning musical instruments efficiency.But it is existing There is corresponding technical problem in instrument playing aided education technical scheme.
A kind of existing technical scheme is judged only with audio signal, it is impossible to judge player's Whether action is correct, specification.
Existing another technical scheme needs musical instrument band piezoelectric transducer, and usually used musical instrument Without piezoelectric transducer.In addition, in addition it is also necessary to wear gravity sensor at the limbs of motion, this It can influence to play, particularly to needing finger to carry out the performance of fine fit, the musical instrument of control.
The content of the invention
In view of above technical problem, the invention provides a kind of method of aid musical instruments playing practice, Terminal device, server and system, it is possible to use the sound and player's hand sent during instrument playing The surface electromyogram signal for referring to motion and producing, auxiliary carries out instrument playing exercise.
According to an aspect of the present invention there is provided a kind of method of aid musical instruments playing practice, bag Include:
Obtain the audio signal produced when musical instrument practitioner plays and surface electromyogram signal;
Such performance data is reported into server, so that server determines that performance is commented according to such performance data Valency result, wherein such performance data include audio signal and surface electromyogram signal;
The performance evaluation result that the reception server is returned;
The performance evaluation result is shown, to instruct musical instrument practitioner to practise playing music.
In one embodiment of the invention, it is described to obtain the sound produced when musical instrument practitioner plays The step of frequency signal and surface electromyogram signal, includes:
Synchronous working is sent to audio signal sample device and surface myoelectric signal collection apparatus to refer to Order, and indicate that musical instrument practitioner strikes up, so as to audio signal sample device and surface myoelectric Audio signal and surface myoelectric that signal pickup assembly synchronous acquisition musical instrument practitioner produces when playing Signal;
Receive audio signal and surface electromyogram signal acquisition that audio signal sample device is sent The surface electromyogram signal that device is sent.
In one embodiment of the invention, the such performance data also includes musical instrument practitioner selection Exercise song;The audio signal and surface flesh produced when the acquisition musical instrument practitioner plays Before the step of electric signal, methods described also includes:Obtain the etude of musical instrument practitioner selection Mesh.
In one embodiment of the invention, the such performance data also includes the level of musical instrument practitioner Not;It is described such performance data is reported into server the step of before, methods described also includes: Obtain the rank of musical instrument practitioner.
According to another aspect of the present invention there is provided a kind of method of aid musical instruments playing practice, including:
The such performance data that receiving terminal apparatus is reported, wherein such performance data include audio signal and table Facial muscle electric signal;
Determined to play evaluation result according to the such performance data;
Evaluation result will be played and return to terminal device, so that terminal device shows that the performance is commented Valency result, to instruct musical instrument practitioner to practise playing music.
In one embodiment of the invention, it is described to be determined to play evaluation according to the such performance data As a result the step of, includes:
Instrument science is judged according to the corresponding relation of audio signal, audio signal and surface electromyogram signal Whether the pitch of habit person's exercise playing music, rhythm, volume, finger information are correct;
According to pitch, rhythm, volume, finger information evaluation result, obtain composite score;
It regard the evaluation result and composite score as performance evaluation result.
In one embodiment of the invention, the such performance data also includes musical instrument practitioner selection Exercise song;
It is described to be judged to find pleasure according to the corresponding relation of audio signal, audio signal and surface electromyogram signal Whether the pitch of device learner exercise playing music, rhythm, volume, finger information correctly walk Suddenly include:
The exercise song selected according to musical instrument practitioner obtains the corresponding standard pronunciation of the exercise song Information, wherein the standard pronunciation information includes standard pronunciation audio-frequency information and standard pronunciation finger information;
Audio signal is compared with standard pronunciation audio-frequency information, judging devices for learning musical instruments, person's exercise is drilled Whether bent pitch, rhythm, the volume of playing music are correct;
Determine that musical instrument practitioner plays pleasure according to the corresponding relation of audio signal and surface electromyogram signal Finger information when bent;
The finger information of musical instrument practitioner is compared with standard pronunciation finger information, musical instrument is judged Whether finger information during learner's exercise playing music is correct.
In one embodiment of the invention, the such performance data also includes the level of musical instrument practitioner Not;
Described that audio signal is compared with standard pronunciation audio-frequency information, judging devices for learning musical instruments, person practices The whether correct step of the pitch of habit playing music, rhythm, volume includes:
Audio signal is compared with standard pronunciation audio-frequency information;
If comparing error is less than allowable error, devices for learning musical instruments person exercise playing music is judged Pitch, rhythm, volume are correct, wherein, the rank of musical instrument practitioner is higher, it is allowed to which error is got over It is small.
According to another aspect of the present invention there is provided a kind of terminal device, including signal acquisition module, Data reporting module, result receiving module and display module, wherein:
Signal acquisition module, for obtaining the audio signal produced when musical instrument practitioner plays and table Facial muscle electric signal;
Data reporting module, for such performance data to be reported into server, so as to server according to Such performance data determines performance evaluation result, and wherein such performance data includes audio signal and surface myoelectric Signal;
As a result receiving module, the performance evaluation result returned for the reception server;
Display module, for showing the performance evaluation result, to instruct musical instrument practitioner to practise Playing music.
In one embodiment of the invention, signal acquisition module includes instruction issuance unit and letter Number receiving unit, wherein:
Issuance unit is instructed, for being filled to audio signal sample device and surface electromyogram signal acquisition Transmission synchronous working instruction is put, and indicates that musical instrument practitioner strikes up, so that audio signal is adopted The sound produced when acquisition means and surface myoelectric signal collection apparatus synchronous acquisition musical instrument practitioner performance Frequency signal and surface electromyogram signal;
Signal receiving unit, for receive audio signal sample device transmission audio signal, with And the surface electromyogram signal that surface myoelectric signal collection apparatus is sent.
In one embodiment of the invention, the such performance data also includes musical instrument practitioner selection Exercise song;
The terminal device also includes song acquisition module, wherein:
Song acquisition module, is produced for being obtained in signal acquisition module when musical instrument practitioner plays Audio signal and surface electromyogram signal before, obtain the exercise song of musical instrument practitioner selection.
In one embodiment of the invention, the such performance data also includes the level of musical instrument practitioner Not;
The terminal device also includes rank acquisition module, wherein:
Rank acquisition module, for data reporting module by such performance data report server it Before, obtain the rank of musical instrument practitioner.
According to another aspect of the present invention there is provided a kind of server, including data reception module, knot Fruit determining module and result return to module, wherein:
Data reception module, the such performance data reported for receiving terminal apparatus, wherein playing number According to including audio signal and surface electromyogram signal;
As a result determining module, for being determined to play evaluation result according to the such performance data;
As a result module is returned, terminal device is returned to for evaluation result will to be played, so as to terminal Equipment shows the performance evaluation result, to instruct musical instrument practitioner to practise playing music.
In one embodiment of the invention, as a result determining module includes index identifying unit, comprehensive Fraction determining unit and evaluation result determining unit are closed, wherein:
Index identifying unit, for according to audio signal, audio signal and surface electromyogram signal Corresponding relation judges devices for learning musical instruments, and person practises the pitch of playing music, rhythm, volume, finger letter Whether breath is correct;
Composite score determining unit, for being commented according to pitch, rhythm, volume, finger information Sentence result, obtain composite score;
Evaluation result determining unit, for the evaluation result and composite score to be commented as performance Valency result.
In one embodiment of the invention, the such performance data also includes musical instrument practitioner selection Exercise song;
Index identifying unit includes standard information determination sub-module, audio and compares submodule, finger Information determination sub-module and finger information compare submodule, wherein:
Standard information determination sub-module, the exercise song for being selected according to musical instrument practitioner is obtained It is described to practise the corresponding standard pronunciation information of song, wherein the standard pronunciation information includes standard pronunciation sound Frequency information and standard pronunciation finger information;
Audio compares submodule, for audio signal to be compared with standard pronunciation audio-frequency information, Whether the pitch of the person that judges devices for learning musical instruments exercise playing music, rhythm, volume are correct;
Finger information determination sub-module, for corresponding with surface electromyogram signal according to audio signal Relation determines finger information during musical instrument practitioner's playing music;
Finger information compares submodule, for by the finger information of musical instrument practitioner and standard pronunciation hand Refer to information to be compared, just whether the finger information when person that judges devices for learning musical instruments practises playing music Really.
In one embodiment of the invention, the such performance data also includes the level of musical instrument practitioner Not;
Audio, which compares submodule, to be used to audio signal being compared with standard pronunciation audio-frequency information;Such as Fruit compares error and is less than allowable error, then judge devices for learning musical instruments person exercise playing music pitch, Rhythm, volume are correct, wherein, the rank of musical instrument practitioner is higher, it is allowed to which error is smaller.
According to another aspect of the present invention there is provided a kind of system of aid musical instruments playing practice, including Audio signal sample device, surface myoelectric signal collection apparatus, as described in above-mentioned any embodiment Terminal device and the server as described in above-mentioned any embodiment, wherein:
Audio signal sample device, for obtaining the audio signal produced when musical instrument practitioner plays, And the audio signal is sent to terminal device;
Surface myoelectric signal collection apparatus, for obtaining the surface produced when musical instrument practitioner plays Electromyographic signal, and the surface electromyogram signal is sent to terminal device.
In one embodiment of the invention, audio signal sample device include sound transducer and Audio-frequency signal processing module, wherein:
Sound transducer, for picking up the sound that musical instrument is sent when musical instrument practitioner plays, and will The voice signal is converted to electric signal, and the electric signal is input into Audio Signal Processing mould Block;
Audio-frequency signal processing module, for handling the electric signal that sound transducer is inputted, And the audio signal after processing is sent to terminal device.
In one embodiment of the invention, surface myoelectric signal collection apparatus includes surface myoelectric Sensor and surface electromyogram signal processing module, wherein:
Surface myoelectric sensor, the surface myoelectric for picking up practitioner when musical instrument practitioner plays Signal, and the surface electromyogram signal is input to surface electromyogram signal processing module;
Surface electromyogram signal processing module, for the electric signal inputted to surface myoelectric sensor Handled, and the surface electromyogram signal after processing is sent to terminal device.
The present invention can utilize the sound sent during instrument playing and player's finger motion and produce Surface electromyogram signal, it is possible thereby to which finger is to the premise of the operation of musical instrument when not influenceing to play Under, auxiliary carries out instrument playing exercise;Making devices for learning musical instruments, person even stays at home, can also Alone, playing practice is easily and flexibly carried out, and the practice effect of learner is commented Sentence.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will The required accompanying drawing used in embodiment or description of the prior art is briefly described, it is clear that Ground, drawings in the following description are only some embodiments of the present invention, for the common skill in this area For art personnel, on the premise of not paying creative work, it can also be obtained according to these accompanying drawings Other accompanying drawings.
Fig. 1 is the schematic diagram of system one embodiment of aid musical instruments playing practice of the present invention.
Fig. 2 is the schematic diagram of another embodiment of system of aid musical instruments playing practice of the present invention.
Fig. 3 is the schematic diagram of terminal device one embodiment of the present invention.
Fig. 4 is the schematic diagram of signal acquisition module in one embodiment of the invention.
Fig. 5 is the schematic diagram of another embodiment of terminal device of the present invention.
Fig. 6 is the schematic diagram of server one embodiment of the present invention.
Fig. 7 is the schematic diagram of result determining module in one embodiment of the invention.
Fig. 8 is the schematic diagram of index identifying unit in one embodiment of the invention.
Fig. 9 is the schematic diagram of method one embodiment of aid musical instruments playing practice of the present invention.
Figure 10 is the schematic diagram of another embodiment of method of aid musical instruments playing practice of the present invention.
Figure 11 is analyzed melody standard pronunciation, handled for server in one embodiment of the invention Schematic diagram.
Figure 12 is audio signal number of the server in one embodiment of the invention to devices for learning musical instruments person The schematic diagram analyzed, handled according to, hand surface electromyogram signal data.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, to the technical scheme in the embodiment of the present invention It is clearly and completely described, it is clear that described embodiment is only that a part of the invention is real Apply example, rather than whole embodiments.Description below at least one exemplary embodiment is actual On be merely illustrative, never as to the present invention and its application or any limitation for using.Base Embodiment in the present invention, those of ordinary skill in the art are not making creative work premise Lower obtained every other embodiment, belongs to the scope of protection of the invention.
Unless specifically stated otherwise, the part that otherwise illustrates in these embodiments and step it is relative Arrangement, numerical expression and numerical value are not limited the scope of the invention.
Simultaneously, it should be appreciated that for the ease of description, the size of the various pieces shown in accompanying drawing It is not to be drawn according to actual proportionate relationship.
It may not make in detail for technology, method and apparatus known to person of ordinary skill in the relevant Discuss, but in the appropriate case, the technology, method and apparatus should be considered as authorizing specification A part.
In shown here and discussion all examples, any occurrence, which should be construed as merely, to be shown Example property, not as limitation.Therefore, the other examples of exemplary embodiment can have not Same value.
It should be noted that:Similar label and letter represents similar terms in following accompanying drawing, therefore, Once being defined in a certain Xiang Yi accompanying drawing, then it need not be entered to advance in subsequent accompanying drawing One step discussion.
Fig. 1 is the schematic diagram of system one embodiment of aid musical instruments playing practice of the present invention.Such as Shown in Fig. 1, the system includes audio signal sample device 100, surface electromyogram signal acquisition Device 200, terminal device 300 and server 400, wherein:
Audio signal sample device 100, for obtaining the audio produced when musical instrument practitioner plays Signal, and the audio signal is sent to terminal device 300.
Surface myoelectric signal collection apparatus 200, for obtaining practitioner when musical instrument practitioner plays Finger motion and the surface electromyogram signal produced, and the surface electromyogram signal is sent to terminal Equipment 300.
Terminal device 300, is adopted for receiving audio signal sample device 100 and surface electromyogram signal Audio signal and surface electromyogram signal that acquisition means 200 are sent;By the audio signal and surface Electromyographic signal is sent to server;The reception server send evaluation result, composite score, whether The information such as satisfied, and show these information of receiving.
In one embodiment of the invention, terminal device 300 can be smart mobile phone, flat board The mobile intelligent terminals such as computer, or the intelligent terminal such as notebook, desktop computer.
Server 400, the melody standard pronunciation for storing instrument playing expert performance;To melody Standard pronunciation is pre-processed, time frequency analysis, obtains relevant information, and store relevant information;Connect Receive the data (audio signal and surface electromyogram signal data) that terminal device 300 is sent;To this Data are pre-processed, time frequency analysis, and are compared with the relevant information of melody standard pronunciation, Evaluation result is obtained, composite score is calculated, judges whether satisfaction;By evaluation result, total score The information such as count, whether be satisfied with and being sent to terminal device 300.
In one embodiment of the invention, server 400 can be set beyond the clouds, that is, be serviced Device 400 can be cloud server.
In one embodiment of the invention, audio signal sample device 100 and terminal device 300 Between row data communication can be entered by wireless networks such as bluetooth, WiFi.
In one embodiment of the invention, surface myoelectric signal collection apparatus 200 and terminal device Row data communication can be entered by wireless networks such as bluetooth, WiFi between 300.
In one embodiment of the invention, it can lead between server 400 and terminal device 300 Cross the cellular mobile communication networks such as the wireless networks such as WiFi or 3G, 4G and enter row data communication.
The system of the aid musical instruments playing practice provided based on the above embodiment of the present invention, uses audio The mode that signal is combined with surface electromyogram signal, rather than only with audio signal, judge The practice effect of devices for learning musical instruments person.The above embodiment of the present invention can judge to find pleasure according to audio signal Whether the pitch of device learner exercise playing music, rhythm, volume are correct;And believed according to audio When the corresponding relation number with surface electromyogram signal, the person's exercise playing music that judges devices for learning musical instruments whether With correct finger key (hole).
The above embodiment of the present invention need not install piezoelectric transducer on musical instrument, utilize the present invention System, devices for learning musical instruments person use common musical instrument, it is possible to alone, easily and flexibly enter Row playing practice, the autonomous most of problem solved in music playing exercise.It is face-to-face in teacher When instructing, it can be taught, be improved learning efficiency mainly for difficult point.
The system of the above embodiment of the present invention can be used for primary school, middle school, university (it is unmusical specially Industry) student practise musical instrument performance, can be used for children's palace, Youth Activity Center etc. Student, and amateur practise the performance of musical instrument.
The system of the above embodiment of the present invention, can be used for sheng, a reed pipe wind instrument, flute, suona horn etc. needs finger Carry out fine fit, the playing practice of the musical instrument of control.
Fig. 2 is the schematic diagram of another embodiment of system of aid musical instruments playing practice of the present invention.With figure 1 embodiment is compared, in embodiment illustrated in fig. 2, and audio signal sample device 100 can specifically be wrapped Sound transducer 110 and audio-frequency signal processing module 120 are included, wherein:
Sound transducer 110, for picking up the sound that musical instrument is sent when musical instrument practitioner plays, And the voice signal is converted into electric signal, and the electric signal is input at audio signal Manage module 120.
In one embodiment of the invention, sound transducer 110 can be microphone.
In one embodiment of the invention, microphone can use electrodynamic type microphone, electric capacity Formula microphone etc., the sound sent during for picking up the instrument playings such as sheng, a reed pipe wind instrument (pickup), and by sound Message number is converted to electric signal, passes through wired or wireless (FM frequency ranges, VHF frequency ranges, UHF Frequency range) electric signal is input to audio-frequency signal processing module 120 by mode.
Audio-frequency signal processing module 120, for entering to the electric signal that sound transducer 110 is inputted Row amplifies, filters out the frequency that may cause aliasing noise, modulus (A/D) conversion, sampling guarantor Hold, the data processing such as compressed data, data storage, and the audio signal after processing is sent to Terminal device 300.
Fidelity, the convenience carried, the easiness realized, the warp of cost for considering sound Factor in terms of Ji property, the present invention can concentrate on the function of audio-frequency signal processing module 120 Realized on one equipment (device);Microphone integrated amplifier can also be utilized, and (microphone is put Big device), the combination such as the computer with sound card realizes;Or if terminal device 300 is (for example, intelligence Mobile phone, tablet personal computer etc.) there is preferable recording effect, can also be real using terminal device 300 The function of existing audio-frequency signal processing module 120 and sound transducer 110.
In one embodiment of the invention, audio-frequency signal processing module 120 passes through wireless network (for example, bluetooth, WiFi etc.) interface is communicated with terminal device 300.
In the embodiment depicted in figure 2, surface myoelectric signal collection apparatus 200 can specifically include table Facial muscle electric transducer 210 and surface electromyogram signal processing module 220, wherein:
Surface myoelectric sensor 210, for picking up practitioner's finger fortune when musical instrument practitioner plays The surface electromyogram signal for moving and producing, and the surface electromyogram signal is input to surface myoelectric letter Number processing module 220.
Surface electromyogram signal processing module 220, for the telecommunications inputted to surface myoelectric sensor 210 Number handled, and the surface electromyogram signal after processing is sent to terminal device 300.
In the specific example of the present invention, surface myoelectric sensor 210 is specifically as follows electrode, Surface myoelectric sensor 210 can make the glove form for exposing finger, on the inside of gloves, with hand The corresponding location arrangements electrode of portion's muscle group (for example, silver-gilt copper wire electrode, high-purity silver wire electrode, Gel electrode etc.).These hand muscle groups include:Thenar muscle group, hypothenar muscle group, middle muscle group, Wherein:Thenar muscle group includes:Short abductor muscle of thumb, short flexor muscel of thumb, opponens pollicis, mesothenar.Small fish Border muscle group includes:Abductor digiti minimi, musculus flexor digiti quinti brevis, musculus opponens digiti quinti manus.Middle muscle group includes:Earthworm Shape flesh, volar interosseous muscles, dorsal interosseous muscles.
The learner of the musical instruments such as sheng, a reed pipe wind instrument is when carrying out playing practice, and both hands wear the hand for exposing finger The hand belly of muscle good contact of electrode and relevant position on the inside of set, gloves, and the finger exposed can Neatly to be operated to sheng, a reed pipe wind instrument.
The flexible electricity produced of the corresponding belly of muscle of 10 finger motions of electrode acquisition control at hand muscle group 10 road electric signals are inputted 10 surface electromyogram signal processing units by signal respectively.
Each road electric signal of surface electromyogram signal processing unit processes 1, is inputted to respective electrode Electric signal carries out high impedance matching, small signals amplification, filters out noise jamming caused by pseudo-motion track For example, (passband is 10Hz~500Hz), modulus (A/D) conversion, sampling are kept, compression number According to data processings such as, data storages.
In terms of the fidelity that considers signal, the convenience worn, the easiness realized because Element, can concentrate on the function of above-mentioned surface electromyogram signal processing unit one equipment (device) It is upper to realize, it can also be distributed on two equipment (device) and realize, for example, an equipment (dress Put) realize high impedance matching, small signals amplification, filter out noise jamming etc. caused by pseudo-motion track Function;Another equipment (device) realizes that filtering, amplification, modulus (A/D) conversion, sampling are protected Hold, the function such as compressed data, data storage, can be by soft between the two equipment (device) Property flat cable is connected.
Ten surface electromyogram signal processing units constitute a surface electromyogram signal processing module 220, lead to Cross unified wireless network (for example, bluetooth, WiFi etc.) interface and terminal device 300 is led to Letter.
Not on finger, this is special according to the belly of muscle of control finger motion for the above embodiment of the present invention Point, the flexible electric signal produced of belly of muscle for controlling finger motion is detected using surface myoelectric sensor, And the motion of finger is judged with this, and it is worn on the surface myoelectric sensor at corresponding belly of muscle not Operation of the finger to musical instrument when can influence to play, thus making devices for learning musical instruments, person even stays at home, Can also alone, easily and flexibly carry out playing practice, and the practice effect of learner is entered Row is judged.
Below by specific embodiment to the terminal device 300 described in Fig. 1 or Fig. 2 embodiments It is described further with the 26S Proteasome Structure and Function of server 400.
Fig. 3 is the schematic diagram of terminal device one embodiment of the present invention.As shown in figure 3, Fig. 1 or Terminal device 300 described in Fig. 2 embodiments can include signal acquisition module 310, data Reporting module 320, result receiving module 330 and display module 340, wherein:
Signal acquisition module 310, for obtaining the audio signal produced when musical instrument practitioner plays And surface electromyogram signal.
In one embodiment of the invention, signal acquisition module 310 is specifically for receiving audio Signal pickup assembly 100 send musical instrument practitioner play when produce audio signal, Yi Jibiao Facial muscle electrical signal collection device 200 send musical instrument practitioner play when practitioner's finger motion and The surface electromyogram signal of generation.
Data reporting module 320, for such performance data to be reported into server 400, to service Device 400 determines performance evaluation result according to such performance data, and wherein such performance data includes audio signal And surface electromyogram signal.
As a result receiving module 330, the performance evaluation result returned for the reception server 400.
Display module 340, for showing the performance evaluation result, to instruct musical instrument practitioner Practise playing music.
Fig. 4 is the schematic diagram of signal acquisition module in one embodiment of the invention.As shown in figure 4, Signal acquisition module 310 in Fig. 3 embodiments can include instruction issuance unit 311 and signal Receiving unit 312, wherein:
Issuance unit 311 is instructed, for believing to audio signal sample device 100 and surface myoelectric Number harvester 200 sends synchronous working instruction, and indicates that musical instrument practitioner strikes up, with Just audio signal sample device 100 and the synchronous acquisition musical instrument of surface myoelectric signal collection apparatus 200 Audio signal and surface electromyogram signal that practitioner produces when playing.
Signal receiving unit 312, the audio for receiving the transmission of audio signal sample device 100 The surface electromyogram signal that signal and surface myoelectric signal collection apparatus 200 are sent.
The specific Audio Signal Processing that can be used for respectively shown in Fig. 2 of instruction issuance unit 311 Module 120 and surface electromyogram signal processing module 220 send synchronous working instruction or break-off Instruction.Audio-frequency signal processing module 120 and surface electromyogram signal processing module 220 specifically for After the synchronous working instruction that instruction issuance unit 311 is issued is received, start simultaneously at into line number According to processing work;And after the break-off instruction that instruction issuance unit 311 is issued is received, Suspend data processing work simultaneously.
Thus the above embodiment of the present invention can be realized to the same of audio signal and surface electromyogram signal Step collection, so as to facilitate server to be closed according to audio signal is corresponding with surface electromyogram signal System, whether with correct finger key (hole) when the person that judges devices for learning musical instruments practises playing music.
Fig. 5 is the schematic diagram of another embodiment of terminal device of the present invention.In embodiment illustrated in fig. 5 In, such performance data can also include the exercise song that musical instrument practitioner selects.With reality shown in Fig. 3 Apply example to compare, in the embodiment shown in fig. 5, terminal device 300 can also include song and obtain mould Block 350, wherein:
Song acquisition module 350, is drilled for obtaining musical instrument practitioner in signal acquisition module 310 Before the audio signal and surface electromyogram signal that are produced when playing, the white silk of musical instrument practitioner selection is obtained Practise song.Thus, it is possible to facilitate server to select corresponding standard pronunciation according to exercise song, will The data and the corresponding information of standard pronunciation that musical instrument practitioner produces when playing are compared, it is determined that should The performance evaluation result of secondary exercise, to instruct musical instrument practitioner to practise playing music.
In one embodiment of the invention, as shown in figure 5, in Fig. 1-Fig. 3 any embodiments Terminal device 300 can also include rank acquisition module 360, wherein:
Rank acquisition module 360, for reporting such performance data in data reporting module 320 Before server 400, the rank of musical instrument practitioner is obtained.
In one embodiment of the invention, the such performance data that data reporting module 320 is reported is also The rank of musical instrument practitioner can be included.
The rank of devices for learning musical instruments person can manually be set by devices for learning musical instruments person;Can also be according to certain Condition, is raised, reduced the rank of each User automatically by server.
The rank of learner determines that the server person that judges devices for learning musical instruments practises the sound of playing music Whether correct height, rhythm, volume allowable error, the rank of learner be higher, corresponding to permit Perhaps error is smaller;Conversely, then allowable error is bigger.
The above embodiment of the present invention can cause the rank of server associative learning person to go to determine to allow The size of error, and then determine to play evaluation result, so that further increasing performance evaluates knot The science and specific aim of fruit.
Fig. 6 is the schematic diagram of server one embodiment of the present invention.As shown in fig. 6, Fig. 1 or It is true that server 400 described in Fig. 2 embodiments can include data reception module 410, result Cover half block 420 and result return to module 430, wherein:
Data reception module 410, the such performance data reported for receiving terminal apparatus 300, its Middle such performance data includes audio signal and surface electromyogram signal.
As a result determining module 420, for being determined to play evaluation result according to the such performance data.
As a result module 430 is returned, terminal device 300 is returned to for evaluation result will to be played, with Just terminal device 300 shows the performance evaluation result, to instruct musical instrument practitioner exercise performance Melody.
Fig. 7 is the schematic diagram of result determining module in one embodiment of the invention.As shown in fig. 7, Result determining module 420 in Fig. 6 embodiments includes index identifying unit 421, composite score Determining unit 422 and evaluation result determining unit 423, wherein:
Index identifying unit 421, for being believed according to audio signal, audio signal and surface myoelectric Number the corresponding relation person that judges devices for learning musical instruments practise pitch, rhythm, volume, the hand of playing music Whether correct refer to the indexs such as information.
Composite score determining unit 422, for according to pitch, rhythm, volume, finger information Etc. the evaluation result of index, composite score is obtained.
Evaluation result determining unit 423, for using the evaluation result and composite score as drilling Play evaluation result.
Fig. 8 is the schematic diagram of index identifying unit in one embodiment of the invention.As shown in figure 8, Index identifying unit 421 in Fig. 7 embodiments can include standard information determination sub-module 4211st, audio compares submodule 4212, finger information determination sub-module 4213 and finger information Submodule 4214 is compared, wherein:
Standard information determination sub-module 4211, for the exercise song selected according to musical instrument practitioner The corresponding standard pronunciation information of the exercise song is obtained, wherein the standard pronunciation information includes standard Sound audio-frequency information and standard pronunciation finger information.
Audio compares submodule 4212, for audio signal to be compared with standard pronunciation audio-frequency information Right, the audio-frequency index such as pitch, rhythm, volume of the person that judges devices for learning musical instruments exercise playing music is It is no correct.
Finger information determination sub-module 4213, for according to audio signal and surface electromyogram signal Corresponding relation determines finger information during musical instrument practitioner's playing music.
Finger information compares submodule 4214, for by the finger information and standard of musical instrument practitioner Sound finger information is compared, and the finger information during person that judges devices for learning musical instruments exercise playing music is It is no correct.
In one embodiment of the invention, the terminal device 300 that data reception module 410 is received The such performance data reported can also include the exercise song that musical instrument practitioner selects.
The server of the aid musical instruments playing practice provided based on the above embodiment of the present invention, uses sound The mode that frequency signal is combined with surface electromyogram signal, rather than only with audio signal, comment The practice effect for the person that sentences devices for learning musical instruments.The above embodiment of the present invention can judge according to audio signal Whether the pitch of devices for learning musical instruments person exercise playing music, rhythm, volume are correct;And according to audio The corresponding relation of signal and surface electromyogram signal, be during the person that judges devices for learning musical instruments exercise playing music It is no with correct finger key (hole).
The above embodiment of the present invention can facilitate server to select corresponding standard according to exercise song Sound, the data and the corresponding information of standard pronunciation produced when musical instrument practitioner is played are compared, The performance evaluation result of this exercise is determined, to instruct musical instrument practitioner to practise playing music.
In one embodiment of the invention, audio compare submodule 4212 it is specific can be used for by Audio signal is compared with standard pronunciation audio-frequency information;If comparing error is less than allowable error, Then judge that the pitch, rhythm, volume of devices for learning musical instruments person exercise playing music are correct, wherein, it is happy The rank of device practitioner is higher, and corresponding allowable error is smaller;Conversely, then allowable error is bigger.
In the above embodiment of the present invention, the terminal device 300 that data reception module 410 is received The such performance data reported can also include the rank of musical instrument practitioner.
The server of the above embodiment of the present invention can go decision to allow mistake with the rank of associative learning person The size of difference, and then determine to play evaluation result, so as to further increase performance evaluation result Science and specific aim.
Fig. 9 is the schematic diagram of method one embodiment of aid musical instruments playing practice of the present invention.It is preferred that Ground, the present embodiment can be held as the terminal device described in any embodiment in Fig. 3-Fig. 5 of the present invention OK.As shown in figure 9, methods described includes:
Step 101, the audio signal produced when musical instrument practitioner plays and surface myoelectric letter are obtained Number.
In one embodiment of the invention, signal acquisition module 310 is specifically for receiving audio Signal pickup assembly 100 send musical instrument practitioner play when produce audio signal, Yi Jibiao Facial muscle electrical signal collection device 200 send musical instrument practitioner play when practitioner's finger motion and The surface electromyogram signal of generation.
Step 102, such performance data is reported into server 400, so that server 400 is according to drilling Play data to determine to play evaluation result, wherein such performance data includes audio signal and surface myoelectric is believed Number.
In one embodiment of the invention, the such performance data also includes musical instrument practitioner selection Exercise song and/or musical instrument practitioner rank.
Step 103, it is the reception server 400 is returned evaluation result, composite score, whether full Meaning etc. plays evaluation result.Wherein, whether evaluation result is correct including pitch, rhythm, volume, Whether the evaluation results such as correct finger key (hole) are used.
Step 104, the performance evaluation result is shown, to instruct musical instrument practitioner exercise performance Melody.
The method of the aid musical instruments playing practice provided based on the above embodiment of the present invention, using sound The mode that frequency signal is combined with surface electromyogram signal, rather than only with audio signal, comment The practice effect for the person that sentences devices for learning musical instruments.Thus, devices for learning musical instruments person uses common musical instrument, so that it may With alone, easily and flexibly carry out playing practice, it is autonomous solve in music playing exercise it is big Subproblem.It when teacher instructs face-to-face, can be taught, be improved mainly for difficult point Learning efficiency.
The method of the above embodiment of the present invention, going for sheng, a reed pipe wind instrument, flute, suona horn etc. needs hand The playing practice of fingering row fine fit, the musical instrument of control.
Below by specific embodiment, by taking musical instrument sheng, a reed pipe wind instrument as an example, aid musical instruments of the present invention are played and practiced The method of habit is introduced.
Figure 10 is the schematic diagram of another embodiment of method of aid musical instruments playing practice of the present invention.This reality Applying example can be performed by the system of aid musical instruments playing practice of the present invention.As shown in Figure 10, it is described Method can include:
Step 201, User is run after APP login service devices on the terminal device, can be with The rank of learner is selected, sheng, a reed pipe wind instrument learner can be divided into several ranks such as primary, intermediate, senior.
During sheng, a reed pipe wind instrument learner's playing practice, the synthesis accumulated according to each User Fraction, the number of times accounting more than a certain fraction (for example, 90 points), less than a certain fraction (example Such as, 80 points) the condition such as number of times accounting, server can automatically raise, reduce each student The rank of the learner of user.
The rank of server storage learner corresponding with each User.Learn by sheng, a reed pipe wind instrument The audio signal of person is corresponding to melody standard pronunciation (sheng, a reed pipe wind instrument plays the melody standard pronunciation that expert plays) There is the relevant information of tablet section when being compared, server can be according to the rank of learner, selection Appropriate allowable error, the rank of learner is higher, and corresponding allowable error is smaller;Conversely, Then allowable error is bigger.
Step 202, sheng, a reed pipe wind instrument learner selection exercise song.
Step 203, terminal device display it is reciprocal 3,2, after 1 three preparations clap, respectively to Audio-frequency signal processing module, surface electromyogram signal processing module send synchronous working instruction.
Step 204, sheng, a reed pipe wind instrument learner strikes up exercise (step 2041);Audio Signal Processing Module, surface electromyogram signal processing module start simultaneously at work, each record corresponding data (step Rapid 2042,2043).
Step 205, judge whether terminal device receives the pause instruction of sheng, a reed pipe wind instrument learner transmission, Wherein, sheng, a reed pipe wind instrument learner can suspend exercise at any time during playing practice.If received The pause instruction that sheng, a reed pipe wind instrument learner sends, then perform step 206;Otherwise, if not receiving sheng, a reed pipe wind instrument The pause instruction that learner sends, then perform step 204, i.e. sheng, a reed pipe wind instrument learner proceeds to drill Exercise is played, and audio-frequency signal processing module, surface electromyogram signal processing module continue to record respective Corresponding data.
Step 206, after sheng, a reed pipe wind instrument learner selection pause, terminal device is respectively simultaneously to audio signal Processing module, surface electromyogram signal processing module send break-off instruction.
Step 207, receive after break-off instruction, audio-frequency signal processing module, surface myoelectric Signal processing module suspends record data, sends the data of each this record to terminal respectively Equipment.
Step 208, terminal device has been received after data, by the rank of learner, audio signal Data, hand surface electromyogram signal data, the configured information of this section or next section of melody are sent to Server.
Step 209, server is believed audio signal data, the hand surface myoelectric of sheng, a reed pipe wind instrument learner Number is analyzed, handled, obtain evaluation result, composite score, and by evaluation result, Composite score is sent to terminal device.
Step 210, terminal device shows evaluation result, composite score.
Step 211, according to the evaluation result, composite score shown on terminal device, by sheng, a reed pipe wind instrument Habit person oneself judges whether satisfaction.If sheng, a reed pipe wind instrument learner is satisfied with to evaluation result, composite score, Then perform step 212;Otherwise, if sheng, a reed pipe wind instrument learner is unsatisfied with to evaluation result, composite score, Then perform step 213.
In another embodiment of the invention, after step 209, methods described can also include: According to evaluation result, composite score and certain rule, judged whether by server after satisfaction, then By evaluation result, composite score, the information such as whether it is satisfied with and is sent to terminal device and show.
Step 212, judge whether this song terminates.If this song terminates, step is performed 218;Otherwise, if this song does not terminate, step 203 is performed, i.e. do not tie in this song Shu Shi, sheng, a reed pipe wind instrument learner can continue to practise next section of melody.
Step 213, chosen whether to listen the standard pronunciation of this section of melody by sheng, a reed pipe wind instrument learner.If sheng, a reed pipe wind instrument Learner selects not listening the standard pronunciation of this section of melody, then performs step 203, i.e. sheng, a reed pipe wind instrument learner can With the section melody of exercise-book again;If sheng, a reed pipe wind instrument learner selection will listen the standard pronunciation of this section of melody, Perform step 214.
Step 214, wherein step 214 can include step 2141, and terminal device is from server Transfer the standard pronunciation of this section of melody;Step 2142, on the terminal device, in the form of Streaming Media Play, or after downloading on terminal device, then play.
Step 215, the standard pronunciation of hard of hearing section melody is judged whether by sheng, a reed pipe wind instrument learner.In logic Control under, broadcasting of the terminal device to standard pronunciation can be repeated, for sheng, a reed pipe wind instrument learner learn. If sheng, a reed pipe wind instrument learner determines the standard pronunciation of hard of hearing section melody, step 2142 is repeated;Such as Fruit sheng, a reed pipe wind instrument learner determines the standard pronunciation of not hard of hearing section melody, then performs step 216.
In one embodiment of the invention, be stored with the performances of the musical instruments such as sheng, a reed pipe wind instrument in server The melody standard pronunciation that expert plays.
Step 216, sheng, a reed pipe wind instrument learner can choose whether will again exercise-book section melody.If sheng, a reed pipe wind instrument Learner will again exercise-book section melody, then perform step 203;Otherwise, if sheng, a reed pipe wind instrument learner Not again exercise-book section melody, then perform step 217.
Step 217, sheng, a reed pipe wind instrument learner can choose whether to continue to practise next section of melody.If Sheng, a reed pipe wind instrument learner will continue to practise next section of melody, then perform step 203;Otherwise, if sheng, a reed pipe wind instrument Habit person does not continue to practise next section of melody, then performs step 218.
Step 218, sheng, a reed pipe wind instrument learner can choose whether to continue exercise.If sheng, a reed pipe wind instrument learner will Continue to practise, then perform step 202, i.e. sheng, a reed pipe wind instrument learner selection exercise song, sheng, a reed pipe wind instrument learner can To select the song identical song with just practising, another song can also be selected;If sheng, a reed pipe wind instrument Learner does not continue exercise, then terminates.
In the above embodiment of the present invention, server storage has (happy with each User Device learner) corresponding playing practice each time audio signal data, hand surface myoelectric letter Number, evaluation result, composite score, the data such as whether it is satisfied with.
In one embodiment of the invention, teacher's user login services device (can utilize terminal The APP of equipment is logged in, and can also be logged on computers by browser) after, can transfer, The recording of sheng, a reed pipe wind instrument learner's playing practice of autotutorial is listened in advance.Before face-to-face instruct, to certainly Subject matter present in own student's playing practice accomplishes to know what's what, then carries out targetedly Teach, so as to save the guidance time.
In another embodiment of the invention, sheng, a reed pipe wind instrument learner can constitute study teams and groups, same class Between the student of group can with the achievement of PK playing practices, by making a breakthrough, advanced, reward etc. it is living It is dynamic, so as to add interactive, the interest of exercise, improve the enthusiasm of student.
In one embodiment of the invention, before the formal use of server, methods described is also Including:Server to melody standard pronunciation is analyzed, handled in advance, and storing relevant information.
In one embodiment of the invention, it is described before the step 208 of Figure 10 embodiments Method also includes:Server to melody standard pronunciation is analyzed, handled in advance, and storing correlation Information.
Figure 11 is analyzed melody standard pronunciation, handled for server in one embodiment of the invention Schematic diagram.Preferably, the present embodiment can be as described in any embodiment in Fig. 6-Fig. 8 of the present invention Server perform.As shown in figure 11, methods described can include:
Step 301, the melody standard pronunciation stored in server reading service device.
Step 302, server is pre-processed to melody standard pronunciation.
In one embodiment of the invention, step 302 can include:By melody standard cent Into waiting duration and duration very short frame;Carry out having the judgement of sound tone-off to melody standard pronunciation.
Step 303, server obtains the frequency for having tablet section to there is tablet section to carry out time frequency analysis Spectrum information, Autocorrelation envelop information, information volume (it is for instance possible to use logarithmic energy) etc. Audio-frequency information.
Step 304, server storage has the corresponding spectrum information of tablet section, from phase with each Close the audio-frequency informations such as envelope information, information volume.
Step 305, mark and storage has section corresponding finger of tablet with each in the server Information (i.e. each has tablet section corresponding with which or several fingers).
Figure 12 is audio signal number of the server in one embodiment of the invention to devices for learning musical instruments person The schematic diagram analyzed, handled according to, hand surface electromyogram signal data.As shown in figure 12, Methods described can include:
Step 401, the rank for the learner that server receiving terminal equipment is sent, musical instrument exercise Exercise song, audio signal data, hand surface electromyogram signal data of person's selection etc. play number According to.
Step 402, server has been received after such performance data, respectively to audio signal data, hand Portion's surface electromyogram signal data are pre-processed.
In one embodiment of the invention, step 402 can include step 4021 and step 4022, wherein:
Step 4021, server is pre-processed to audio signal data.The pretreatment can be wrapped Include:Audio signal data is decompressed;Audio signal data such as is divided at the duration and duration is very short Frame;Carry out having the judgement of sound tone-off to audio signal data.
Step 4022 can include step 4022a and step 4022b again, wherein:
Step 4022a, server is pre-processed to hand surface electromyogram signal data, and this is pre- Processing can include:Hand surface electromyogram signal data decompression;By hand surface electromyogram signal Data the duration such as are divided into and duration very short frame.
Step 4022b, utilizes pretreated hand surface electromyogram signal data, server pair Finger motion is judged, obtains finger motion information.
Step 403, server obtains the frequency for having tablet section to there is tablet section to carry out time frequency analysis Spectrum information, Autocorrelation envelop information, information volume (it is for instance possible to use logarithmic energy) etc. Audio-frequency information.
Step 404, above-mentioned audio-frequency information should mutually be had a sound by server with melody standard pronunciation respectively The audio-frequency informations such as spectrum information, Autocorrelation envelop information, the information volume of fragment are compared.
Step 405, whether server is correctly carried out to audio-frequency indexes such as pitch, rhythm, volumes Judge.
In one embodiment of the invention, step 405 can include, and pass through spectrum information Compare, judge whether pitch is correct;By the comparison of Autocorrelation envelop information, judge that rhythm is It is no correct;By the comparison of information volume, judge whether volume is correct.It is less than when comparing error During allowable error, that is, praise.Allowable error is different and different with the rank of learner, The rank of learner is higher, and corresponding allowable error is smaller;Conversely, then allowable error is bigger.
Step 406, according to time synchronized principle, server is by finger motion information and has tablet Duan Guanlian, it is determined that having the corresponding finger information of tablet section with each, (i.e. each has tablet section It is corresponding with which or several fingers).
Step 407, there is tablet section for each, server is by above-mentioned finger information and melody The respective finger information of standard pronunciation is compared.
Step 408, whether server is entered to musical instrument practitioner with correct finger key (hole) Row is judged.
Step 409, on the basis of above-mentioned all evaluation results, according to certain rule, service Device calculates composite score.
Step 410, evaluation result, composite score are sent to terminal device by server;Or, According to evaluation result, composite score and certain rule, server judges whether after satisfaction, then will Evaluation result, composite score, the information such as whether it is satisfied with and is sent to terminal device.
The above embodiment of the present invention can detect control finger motion using surface myoelectric sensor The flexible electric signal produced of belly of muscle, and judge with this motion of finger, and it is worn on corresponding belly of muscle Operation of the finger to musical instrument when the surface myoelectric sensor at place can't influence to play.Therefore this hair It is bright using audio signal by the way of surface electromyogram signal is combined come the white silk for the person that judges devices for learning musical instruments Practise effect.
The pitch of the present invention can judge devices for learning musical instruments according to audio signal person exercise playing music, Whether rhythm, volume are correct;And according to audio signal and the corresponding relation of surface electromyogram signal, Whether with correct finger key (hole) during the person that judges devices for learning musical instruments exercise playing music.
Therefore, the above embodiment of the present invention need not install piezoelectric transducer on musical instrument, so that it may To cause devices for learning musical instruments, person uses common musical instrument, alone, easily and flexibly carries out performance white silk Practise, the autonomous most of problem solved in music playing exercise.When teacher instructs face-to-face, It can be taught, be improved learning efficiency mainly for difficult point.
The above embodiment of the present invention can be used for primary school, middle school, university's (unmusical specialty) The performance of raw exercise musical instrument, can be used for the student of children's palace, Youth Activity Center etc., And amateur practises the performance of musical instrument.
Terminal device 300 described above, server 400, audio-frequency signal processing module 120, The grade functional unit of surface electromyogram signal processing module 220 can be implemented as being retouched for performing the application State the general processor, programmable logic controller (PLC) (PLC), digital signal processor of function (DSP), application specific integrated circuit (ASIC), field programmable gate array (FPGA) or its His PLD, discrete gate or transistor logic, discrete hardware components or its It is any appropriately combined.
So far, the present invention is described in detail.In order to avoid the design of the masking present invention, do not have Description some details known in the field.Those skilled in the art as described above, completely It can be appreciated how implementing technical scheme disclosed herein.
One of ordinary skill in the art will appreciate that realizing all or part of step of above-described embodiment It can be completed by hardware, the hardware of correlation can also be instructed to complete by program, it is described Program can be stored in a kind of computer-readable recording medium, and storage medium mentioned above can be with It is read-only storage, disk or CD etc..
Description of the invention is provided for the sake of example and description, and is not exhaustively Or limit the invention to disclosed form.Common skill of many modifications and variations for this area It is obvious for art personnel.Selection and description embodiment be in order to more preferably illustrate the present invention principle And practical application, and make one of ordinary skill in the art it will be appreciated that the present invention is so as to design suitable In the various embodiments with various modifications of special-purpose.

Claims (19)

1. a kind of method of aid musical instruments playing practice, it is characterised in that including:
Obtain the audio signal produced when musical instrument practitioner plays and surface electromyogram signal;
Such performance data is reported into server, so that server determines that performance is commented according to such performance data Valency result, wherein such performance data include audio signal and surface electromyogram signal;
The performance evaluation result that the reception server is returned;
The performance evaluation result is shown, to instruct musical instrument practitioner to practise playing music.
2. according to the method described in claim 1, it is characterised in that the acquisition musical instrument exercise The step of audio signal and surface electromyogram signal that person produces when playing, includes:
Synchronous working is sent to audio signal sample device and surface myoelectric signal collection apparatus to refer to Order, and indicate that musical instrument practitioner strikes up, so as to audio signal sample device and surface myoelectric Audio signal and surface myoelectric that signal pickup assembly synchronous acquisition musical instrument practitioner produces when playing Signal;
Receive audio signal and surface electromyogram signal acquisition that audio signal sample device is sent The surface electromyogram signal that device is sent.
3. method according to claim 1 or 2, it is characterised in that the such performance data Also include the exercise song that musical instrument practitioner selects;
The audio signal that is produced when the acquisition musical instrument practitioner plays and surface electromyogram signal Before step, methods described also includes:
Obtain the exercise song of musical instrument practitioner selection.
4. method according to claim 1 or 2, it is characterised in that the such performance data Also include the rank of musical instrument practitioner;
It is described such performance data is reported into server the step of before, methods described also includes:
Obtain the rank of musical instrument practitioner.
5. a kind of method of aid musical instruments playing practice, it is characterised in that including:
The such performance data that receiving terminal apparatus is reported, wherein such performance data include audio signal and table Facial muscle electric signal;
Determined to play evaluation result according to the such performance data;
Evaluation result will be played and return to terminal device, so that terminal device shows that the performance is commented Valency result, to instruct musical instrument practitioner to practise playing music.
6. method according to claim 5, it is characterised in that described to be played according to described Data determine to include the step of playing evaluation result:
Instrument science is judged according to the corresponding relation of audio signal, audio signal and surface electromyogram signal Whether the pitch of habit person's exercise playing music, rhythm, volume, finger information are correct;
According to pitch, rhythm, volume, finger information evaluation result, obtain composite score;
It regard the evaluation result and composite score as performance evaluation result.
7. method according to claim 6, it is characterised in that the such performance data is also wrapped Include the exercise song of musical instrument practitioner selection;
It is described to be judged to find pleasure according to the corresponding relation of audio signal, audio signal and surface electromyogram signal Whether the pitch of device learner exercise playing music, rhythm, volume, finger information correctly walk Suddenly include:
The exercise song selected according to musical instrument practitioner obtains the corresponding standard pronunciation of the exercise song Information, wherein the standard pronunciation information includes standard pronunciation audio-frequency information and standard pronunciation finger information;
Audio signal is compared with standard pronunciation audio-frequency information, judging devices for learning musical instruments, person's exercise is drilled Whether bent pitch, rhythm, the volume of playing music are correct;
Determine that musical instrument practitioner plays pleasure according to the corresponding relation of audio signal and surface electromyogram signal Finger information when bent;
The finger information of musical instrument practitioner is compared with standard pronunciation finger information, musical instrument is judged Whether finger information during learner's exercise playing music is correct.
8. method according to claim 7, it is characterised in that the such performance data is also wrapped Include the rank of musical instrument practitioner;
Described that audio signal is compared with standard pronunciation audio-frequency information, judging devices for learning musical instruments, person practices The whether correct step of the pitch of habit playing music, rhythm, volume includes:
Audio signal is compared with standard pronunciation audio-frequency information;
If comparing error is less than allowable error, devices for learning musical instruments person exercise playing music is judged Pitch, rhythm, volume are correct, wherein, the rank of musical instrument practitioner is higher, it is allowed to which error is got over It is small.
9. a kind of terminal device, it is characterised in that report mould including signal acquisition module, data Block, result receiving module and display module, wherein:
Signal acquisition module, for obtaining the audio signal produced when musical instrument practitioner plays and table Facial muscle electric signal;
Data reporting module, for such performance data to be reported into server, so as to server according to Such performance data determines performance evaluation result, and wherein such performance data includes audio signal and surface myoelectric Signal;
As a result receiving module, the performance evaluation result returned for the reception server;
Display module, for showing the performance evaluation result, to instruct musical instrument practitioner to practise Playing music.
10. terminal device according to claim 9, it is characterised in that signal acquisition mould Block includes instruction issuance unit and signal receiving unit, wherein:
Issuance unit is instructed, for being filled to audio signal sample device and surface electromyogram signal acquisition Transmission synchronous working instruction is put, and indicates that musical instrument practitioner strikes up, so that audio signal is adopted The sound produced when acquisition means and surface myoelectric signal collection apparatus synchronous acquisition musical instrument practitioner performance Frequency signal and surface electromyogram signal;
Signal receiving unit, for receive audio signal sample device transmission audio signal, with And the surface electromyogram signal that surface myoelectric signal collection apparatus is sent.
11. the terminal device according to claim 9 or 10, it is characterised in that described to drill Playing data also includes the exercise song that musical instrument practitioner selects;
The terminal device also includes song acquisition module, wherein:
Song acquisition module, is produced for being obtained in signal acquisition module when musical instrument practitioner plays Audio signal and surface electromyogram signal before, obtain the exercise song of musical instrument practitioner selection.
12. the terminal device according to claim 9 or 10, it is characterised in that described to drill Playing data also includes the rank of musical instrument practitioner;
The terminal device also includes rank acquisition module, wherein:
Rank acquisition module, for data reporting module by such performance data report server it Before, obtain the rank of musical instrument practitioner.
13. a kind of server, it is characterised in that determine mould including data reception module, result Block and result return to module, wherein:
Data reception module, the such performance data reported for receiving terminal apparatus, wherein playing number According to including audio signal and surface electromyogram signal;
As a result determining module, for being determined to play evaluation result according to the such performance data;
As a result module is returned, terminal device is returned to for evaluation result will to be played, so as to terminal Equipment shows the performance evaluation result, to instruct musical instrument practitioner to practise playing music.
14. server according to claim 13, it is characterised in that result determining module Including index identifying unit, composite score determining unit and evaluation result determining unit, wherein:
Index identifying unit, for according to audio signal, audio signal and surface electromyogram signal Corresponding relation judges devices for learning musical instruments, and person practises the pitch of playing music, rhythm, volume, finger letter Whether breath is correct;
Composite score determining unit, for being commented according to pitch, rhythm, volume, finger information Sentence result, obtain composite score;
Evaluation result determining unit, for the evaluation result and composite score to be commented as performance Valency result.
15. server according to claim 14, it is characterised in that the such performance data Also include the exercise song that musical instrument practitioner selects;
Index identifying unit includes standard information determination sub-module, audio and compares submodule, finger Information determination sub-module and finger information compare submodule, wherein:
Standard information determination sub-module, the exercise song for being selected according to musical instrument practitioner is obtained It is described to practise the corresponding standard pronunciation information of song, wherein the standard pronunciation information includes standard pronunciation sound Frequency information and standard pronunciation finger information;
Audio compares submodule, for audio signal to be compared with standard pronunciation audio-frequency information, Whether the pitch of the person that judges devices for learning musical instruments exercise playing music, rhythm, volume are correct;
Finger information determination sub-module, for corresponding with surface electromyogram signal according to audio signal Relation determines finger information during musical instrument practitioner's playing music;
Finger information compares submodule, for by the finger information of musical instrument practitioner and standard pronunciation hand Refer to information to be compared, just whether the finger information when person that judges devices for learning musical instruments practises playing music Really.
16. server according to claim 15, it is characterised in that the such performance data Also include the rank of musical instrument practitioner;
Audio, which compares submodule, to be used to audio signal being compared with standard pronunciation audio-frequency information;Such as Fruit compares error and is less than allowable error, then judge devices for learning musical instruments person exercise playing music pitch, Rhythm, volume are correct, wherein, the rank of musical instrument practitioner is higher, it is allowed to which error is smaller.
17. a kind of system of aid musical instruments playing practice, it is characterised in that including audio signal Harvester, surface myoelectric signal collection apparatus, as any one of claim 9-12 Terminal device and the server as any one of claim 13-16, wherein:
Audio signal sample device, for obtaining the audio signal produced when musical instrument practitioner plays, And the audio signal is sent to terminal device;
Surface myoelectric signal collection apparatus, for obtaining the surface produced when musical instrument practitioner plays Electromyographic signal, and the surface electromyogram signal is sent to terminal device.
18. system according to claim 17, it is characterised in that audio signal sample is filled Put including sound transducer and audio-frequency signal processing module, wherein:
Sound transducer, for picking up the sound that musical instrument is sent when musical instrument practitioner plays, and will The voice signal is converted to electric signal, and the electric signal is input into Audio Signal Processing mould Block;
Audio-frequency signal processing module, for handling the electric signal that sound transducer is inputted, And the audio signal after processing is sent to terminal device.
19. the system according to claim 17 or 18, it is characterised in that surface myoelectric Signal pickup assembly includes surface myoelectric sensor and surface electromyogram signal processing module, wherein:
Surface myoelectric sensor, the surface myoelectric for picking up practitioner when musical instrument practitioner plays Signal, and the surface electromyogram signal is input to surface electromyogram signal processing module;
Surface electromyogram signal processing module, for entering to the electric signal that surface myoelectric sensor is inputted Row processing, and the surface electromyogram signal after processing is sent to terminal device.
CN201610229297.8A 2016-04-14 2016-04-14 Method, terminal device, server and the system of aid musical instruments playing practice Pending CN107302548A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610229297.8A CN107302548A (en) 2016-04-14 2016-04-14 Method, terminal device, server and the system of aid musical instruments playing practice

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610229297.8A CN107302548A (en) 2016-04-14 2016-04-14 Method, terminal device, server and the system of aid musical instruments playing practice

Publications (1)

Publication Number Publication Date
CN107302548A true CN107302548A (en) 2017-10-27

Family

ID=60136677

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610229297.8A Pending CN107302548A (en) 2016-04-14 2016-04-14 Method, terminal device, server and the system of aid musical instruments playing practice

Country Status (1)

Country Link
CN (1) CN107302548A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108711337A (en) * 2018-05-25 2018-10-26 京东方科技集团股份有限公司 Keyboard instrument auxiliary exercise method, apparatus
CN108922315A (en) * 2018-08-21 2018-11-30 福州大学厦门工艺美术学院 A kind of guitar auxiliary practice device
CN109035968A (en) * 2018-07-12 2018-12-18 杜蘅轩 Piano study auxiliary system and piano
CN109147741A (en) * 2018-10-31 2019-01-04 北京戴乐科技有限公司 A kind of musical performance method and apparatus
CN109512425A (en) * 2019-01-09 2019-03-26 大悦创新(苏州)医疗科技股份有限公司 Compression, the method and apparatus for decompressing myoelectricity data
CN110555415A (en) * 2019-09-06 2019-12-10 诺百爱(杭州)科技有限责任公司 method and device for evaluating accuracy of playing fingering and electronic equipment
WO2020155915A1 (en) * 2019-01-29 2020-08-06 北京字节跳动网络技术有限公司 Method and apparatus for playing back audio
CN112424802A (en) * 2020-10-01 2021-02-26 曹庆恒 Musical instrument teaching system, use method thereof and computer readable storage medium
CN112735224A (en) * 2020-12-30 2021-04-30 广东爱乐社教育科技有限公司 Violin auxiliary learning experience system based on Internet of things teaching augmented reality
CN112805765A (en) * 2018-10-05 2021-05-14 索尼公司 Information processing apparatus

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090158920A1 (en) * 2007-12-20 2009-06-25 Yoshikazu Itami Sound producing device which uses physiological information
CN103514866A (en) * 2012-06-28 2014-01-15 曾平蔚 Method and device for instrumental performance grading
CN203773779U (en) * 2013-12-25 2014-08-13 北京趣乐科技有限公司 Piano learning machine
CN104134060A (en) * 2014-08-03 2014-11-05 上海威璞电子科技有限公司 Sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors
CN105391764A (en) * 2015-10-14 2016-03-09 小米科技有限责任公司 Method and device for monitoring musical instrument learning

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090158920A1 (en) * 2007-12-20 2009-06-25 Yoshikazu Itami Sound producing device which uses physiological information
CN103514866A (en) * 2012-06-28 2014-01-15 曾平蔚 Method and device for instrumental performance grading
CN203773779U (en) * 2013-12-25 2014-08-13 北京趣乐科技有限公司 Piano learning machine
CN104134060A (en) * 2014-08-03 2014-11-05 上海威璞电子科技有限公司 Sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors
CN105391764A (en) * 2015-10-14 2016-03-09 小米科技有限责任公司 Method and device for monitoring musical instrument learning

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108711337A (en) * 2018-05-25 2018-10-26 京东方科技集团股份有限公司 Keyboard instrument auxiliary exercise method, apparatus
CN108711337B (en) * 2018-05-25 2021-08-10 京东方科技集团股份有限公司 Keyboard instrument auxiliary exercise method and device
CN109035968A (en) * 2018-07-12 2018-12-18 杜蘅轩 Piano study auxiliary system and piano
CN109035968B (en) * 2018-07-12 2020-10-30 杜蘅轩 Piano learning auxiliary system and piano
CN108922315A (en) * 2018-08-21 2018-11-30 福州大学厦门工艺美术学院 A kind of guitar auxiliary practice device
CN112805765A (en) * 2018-10-05 2021-05-14 索尼公司 Information processing apparatus
CN112805765B (en) * 2018-10-05 2023-11-07 索尼公司 Information processing apparatus
CN109147741A (en) * 2018-10-31 2019-01-04 北京戴乐科技有限公司 A kind of musical performance method and apparatus
CN109512425A (en) * 2019-01-09 2019-03-26 大悦创新(苏州)医疗科技股份有限公司 Compression, the method and apparatus for decompressing myoelectricity data
WO2020155915A1 (en) * 2019-01-29 2020-08-06 北京字节跳动网络技术有限公司 Method and apparatus for playing back audio
CN110555415B (en) * 2019-09-06 2022-03-18 诺百爱(杭州)科技有限责任公司 Method and device for evaluating accuracy of playing fingering and electronic equipment
CN110555415A (en) * 2019-09-06 2019-12-10 诺百爱(杭州)科技有限责任公司 method and device for evaluating accuracy of playing fingering and electronic equipment
CN112424802A (en) * 2020-10-01 2021-02-26 曹庆恒 Musical instrument teaching system, use method thereof and computer readable storage medium
WO2022067832A1 (en) * 2020-10-01 2022-04-07 曹庆恒 Musical instrument teaching system, method for using same, and computer-readable storage medium
CN112735224A (en) * 2020-12-30 2021-04-30 广东爱乐社教育科技有限公司 Violin auxiliary learning experience system based on Internet of things teaching augmented reality

Similar Documents

Publication Publication Date Title
CN107302548A (en) Method, terminal device, server and the system of aid musical instruments playing practice
CN103150940B (en) A kind of keyboard instrument teaching system and teaching method
CN103729062B (en) Multifunctional synchronous interaction system and method of music instruments
CN104460981A (en) Presenting audio based on biometrics parameters
CN107485826B (en) Hand rehabilitation training system based on virtual reality technology
CN205645223U (en) Indicate to stop ware more
CN109658917A (en) E-book chants method, apparatus, computer equipment and storage medium
JP7367690B2 (en) information processing equipment
CN106971645A (en) A kind of interactive teaching instrument for music teaching
CN107146599A (en) A kind of piano intelligently plays training system
CN107993519A (en) A kind of piano intelligently plays training system
CN106097829A (en) A kind of vocal music exercising auxiliary device
US11547904B2 (en) Exercise assisting device and exercise assisting method
CN105096691A (en) Piano simulation learning equipment and usage method thereof
CN208340021U (en) A kind of button finger function recovery training appliance for recovery
CN107126697A (en) A kind of contactless musical toy
Barrass et al. Probing preferences between six designs of interactive sonifications for recreational sports, health and fitness
CN206194191U (en) Music instrument play judgees and feedback device
CN109086448A (en) Voice question searching method based on gender characteristic information and family education equipment
CN214344200U (en) Human body limb movement and instrument movement simulated sound motion capability enhancing device
CN110189733B (en) Piano training wearing equipment based on MQTT protocol
CN203217815U (en) Fingering trainer
Overholt Advancements in violin-related human-computer interaction
CN204856974U (en) Piano emulation study equipment
CN111128098A (en) Hand-wearing type intelligent musical instrument and playing method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20171027

RJ01 Rejection of invention patent application after publication