EP1212747A1 - Method and apparatus for playing musical instruments based on a digital music file - Google Patents

Method and apparatus for playing musical instruments based on a digital music file

Info

Publication number
EP1212747A1
EP1212747A1 EP00963100A EP00963100A EP1212747A1 EP 1212747 A1 EP1212747 A1 EP 1212747A1 EP 00963100 A EP00963100 A EP 00963100A EP 00963100 A EP00963100 A EP 00963100A EP 1212747 A1 EP1212747 A1 EP 1212747A1
Authority
EP
European Patent Office
Prior art keywords
music
playmg
musical
notes
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP00963100A
Other languages
German (de)
French (fr)
Inventor
Yun-Jong Kim
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hanseulsoft Co Ltd
Original Assignee
Hanseulsoft Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hanseulsoft Co Ltd filed Critical Hanseulsoft Co Ltd
Publication of EP1212747A1 publication Critical patent/EP1212747A1/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/361Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0008Associated control or indicating means
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0033Recording/reproducing or transmission of music for electrophonic musical instruments
    • G10H1/0041Recording/reproducing or transmission of music for electrophonic musical instruments in coded form
    • G10H1/0058Transmission between separate instruments or between individual components of a musical system
    • G10H1/0066Transmission between separate instruments or between individual components of a musical system using a MIDI interface
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/091Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith
    • G10H2220/101Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith for graphical creation, edition or control of musical data or parameters
    • G10H2220/126Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith for graphical creation, edition or control of musical data or parameters for graphical editing of individual notes, parts or phrases represented as variable length segments on a 2D or 3D representation, e.g. graphical edition of musical collage, remix files or pianoroll representations of MIDI-like files
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/135Musical aspects of games or videogames; Musical instrument-shaped game input interfaces
    • G10H2220/141Games on or about music, i.e. based on musical knowledge, e.g. musical multimedia quizzes
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/091Info, i.e. juxtaposition of unrelated auxiliary information or commercial messages with or between music files
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/281Protocol or standard connector for transmission of analog or digital data to or from an electrophonic musical instrument
    • G10H2240/295Packet switched network, e.g. token ring
    • G10H2240/305Internet or TCP/IP protocol use for any electrophonic musical instrument data or musical parameter transmission purposes

Definitions

  • the present invention relates to a method of converting a digital music file, in which tracks are classified on the bas ⁇ s of musical instruments to be played in such as a MIDI (musical Instrument Digital Interface) , to a musical performance file (hereinafter, referred to as a VOS (Virtual Orchestra System) file) which makes a direction of performance and playing back for each musical instrument, a musical performance system and method that one or more users select his own musical instrument and play the music through the electronic musical score displayed on a screen based on the VOS file, and a computer readable medium storing programs for realizing them.
  • a digital music file in which tracks are classified on the bas ⁇ s of musical instruments to be played in such as a MIDI (musical Instrument Digital Interface)
  • VOS Virtual Orchestra System
  • MIDI Musical Instrument Digital Interface
  • MIDI'S MIDI'S standards.
  • the electronic musical instruments for domestic use are divided into the electronic organ, the electronic piano, the electronic keyboard, etc. and these instruments, that synthesize and- output sound waves using the well-known analog or digital circuit, also follows the MIDI'S standards.
  • MIDI has been considered as international standards for the compatibility n transmitting information about playing of musical instruments, and recommends the exclusive five pin-cable for sending/receiving channel and system messages .
  • MIDI recommends that the channel message may include the performance information, such as scale interval, dynamic and transformation of timbre programs, etc.
  • the data can be shared with PCs (Personal Computers), and the electronic musical instruments can be controlled by the PCs.
  • PCs Personal Computers
  • the signals in the PC are required to be converted to MIDI signals for electronic musical instruments, and then the MIDI interface is necessarily required for this purpose.
  • the MIDI interfaces may be divided into the intelligent type with CPU and the non-intelligent type without it.
  • sixteen-different channel information can be transmitted through -just one cable, therefore the MIDI file, which has the sounds of sixteen different musical instruments, can be easily transmitted (it is obvious that the extension of the channel information is available to the ordinary skilled in the art) .
  • the present invention is suggested as a technique using these environments and resources.
  • Fig. 1 is a block diagram illustrating a method for playing a music through the "Beatmania” system.
  • "Beatmania” of "KONAMI” is a music playing simulation game system, which directs a playing operation to users at a predetermined point of time and, when the users get into operation based on the direction, executes the manipulation such as a mixing of a preset playing sound wave (user input sound wave) and a effect sound wave (background music except the user input sound wave) given by Disc Jockey (DJ) . It directs the timing of playing operation to the user using an indicator, a kind of electronic musical score, and the user can play the music with five buttons and one turntable. According to the result of user's playing operation, "Beatmania” synthesizes and outputs the play sound wave and the effect sound wave .
  • DJ Disc Jockey
  • this "Beatmania" system is useful in that it makes the user play the music easily by indicating the timing of playing operations, it requires a lot of efforts for professional musicians to compose the whole piece of music, because in the "Beatmania” system, the playing sound wave (user input wave) and the background sound wave should be separately designed for each musical instrument selected by the user. That is, in this system, the design of the play sound wave (user input wave) and the background sound wave should be repeatedly made as many as the number of musical instruments to be selected by the user, because it is impossible to design the whole music at one time by partitioning the musical notes depending on each musical instrument.
  • a method for converting a digital music file to a music playing file for each musical instrument comprises the steps of: classifying MIDI messages in MIDI files by type and storing them to memory; converting the delta time information of MIDI message to the absolute time information; and generating a VOS file by constructing a playing note message (for example, a user can select just one musical instrument through the whole playing time, change musical instruments during the playing, or plural users can play simultaneously with each their own musical instrument) .
  • a method of converting file to the VOS file by classifying musical notes for playing each musical instrument comprises: classifying MIDI message and storing them to memory for obtaining necessary information from the message of MIDI file, in the apparatus with processor which converts a digital music file to a music playing file to be played for each musical instrument; carrying out the time conversion which change the delta time information to the absolute time information, and the classification of users based on relation to the musical instruments; generating a electronic score by simplifying the playing style to make it easy to play the musical instruments; generating a digital music file, which represents the notes in the timing of playing operation by partitioning the notes according to the playing order and musical instrument (track) , from the generated electronic musical score by changing the position of the notes, omitting some notes, adjusting the complexity of performance; and inserting additional information (advertising message, image, or sound clip for some corporations, goods, music) to said complexity coordinated musical score, and deciding the time to show the additional information to users.
  • a computer readable medium storing program code for realizing the present invention comprises: a first function of classifying MIDI message in MIDI files and storing them to memory; a second function of converting the delta time information of MIDI message to the absolute time information; and a third function of generating a VOS file by constructing a playing note message.
  • a computer readable medium storing program code for realizing the present invention comprises: a first function of classifying MIDI message and storing them to memory for obtaining necessary information from the message of MIDI file, m the apparatus with processor which converts a digital music file to a music playing file to be played for each musical instrument; a second function of carrying out the time conversion which change the delta time information to the absolute time information, and the classification of users based on relation to the musical instruments; a third function of generating a electronic score by simplifying the playing style to make it easy to play the musical instruments; a fourth function of generating a digital music file, which represents the notes m the timing of playing operation by partitioning the notes according to the playing order and musical instrument (track) , from the generated electronic musical score by changing the position of the notes, omitting some notes, adjusting the complexity of performance; and a fifth function of inserting additional information
  • the music playing system of the present invention comprises: music file providing means for providing a music file to represent notes for each musical instrument at the timing of playing operation by classifying the notes depending on a playing order and a track corresponding to the musical instrument for said music; musical score display means for displaying each note for the musical instrument to be played as an electronic musical score; at least one playing operation input means for getting an playing operation input from the users according to the playing order of notes in the electronic musical score displayed by said musical score display means; musical processing means for storing a digital music file, converting the notes m a score to the electronic musical score representing the playing order, and providing the notes to the musical score display means, and outputtmg a designated sound manipulated by the playing operation input means and the background sound except the designated sound; music playing means for synthesizing and playing the designated sound and the background sound from the musical processing means; and output means for outputting the music played by the music playing means .
  • the music playing method of the present invention includes the steps of: generating music file representing the notes in the timing of playing order by partitioning the notes depending on the track of the playing order and musical instrument for the music; getting inputs of the title of music and the musical instrument to be played from users; displaying electronic musical notes for musical instruments to be played as an electronic musical score that shows the playing order of the notes on a screen at a real-time; and synthesizing and playing the designated sound manipulated by users and the background sound except the designated sound according to the musical score displayed on the screen.
  • a computer readable medium storing the program code for realizing the present invention includes the function of: generating music files for representing the notes for the music in the timing of playing order by partitioning the notes according to the playing order and musical instrument (track) in the music playing device with processor; getting inputs of the title of music and the musical instrument to be played from users; displaying the musical notes for said music to be played as an electronic musical score that shows the playing order of the notes on a screen at a real-time; and synthesizing and playing the designated sound manipulated by users and the background sound except the designated sound according to the musical score displayed on the screen.
  • FIG. 1 is a block diagram for explaining a prior musical playing system of "Beatmania"
  • FIG. 2 is a flowchart showing a method of converting a digital music file to a musical performance file for each musical instrument in accordance with the present invention
  • FIG. 3 is a comparative diagram of delta time information of a digital music file and absolute time information of a VOS file in accordance with the present invention
  • FIG. 4 is a flowchart illustrating a method of converting delta time information to absolute time information m accordance with the present invention
  • FIG. 5 is a schematic view illustrating a method of generating VOS electronic score in accordance with the present invention
  • FIG. 6 is a schematic view illustrating a method of adjusting the complexity during the generation of VOS electronic musical score
  • FIG. 7 is a flowchart illustrating an embodiment of a music playing system in accordance with the present invention.
  • FIG. 8 is a schematic view illustrating a structure of the VOS file in accordance with the present invention
  • FIG. 9 is a schematic view illustrating a playing environment of VOS in accordance with the present invention
  • FIG. 10 is a schematic view illustrating a structure of playing environment of VOS in accordance with an embodiment of the present invention
  • FIG. 11 is a flowchart illustrating a method of playing music in accordance with an embodiment of the present invention
  • FIG. 12 is a schematic view illustrating a display of an electronic score in a musical performance according to the present invention
  • FIG. 13 is a schematic view illustrating the output of designated sound in the musical performance according to the present invention.
  • FIG. 14 is a schematic view showing an achievement of the musical performance in accordance with an embodiment of the present invention.
  • FIG. 15 is a schematic view illustrating a playing environment (karaoke) using in accordance with the present invention .
  • the present invention makes ordinary people, who is not skilled in musical instrument, play music easily using VOS format music files. Also, without a large space such as a studio with expensive musical instruments or special facilities, the present invention enables plural users connected through the computer network to constitute a virtual orchestra by selecting each their own musical instrument and then they play a music through a VOS electronic musical score displayed on each user's screen, using the VOS file format.
  • the present invention provides a method of converting digital music files, such as MIDI files, to the VOS files by classifying musical notes for directing musical operations on the basis of musical instruments and playing sounds for each musical instrument, and computer readable media storing the programs for realizing the same method.
  • MIDI file when MIDI file is previously provided for music, it may be used as a source file for the VOS file, otherwise, a MIDI file for the music should be made by a known- method and converted to the VOS file format (it means a specific file for representing the electronic score for each musical instrument for each user) so that the VOS electronic score for one or more musical instruments can be provided to the players, and the sound of selected musical instrument may be played by inputs according to the users' operations.
  • MIDI file is already widely used in a musical entertainment such as noraebang (karaoke) because it is not only easy and cheap to make but also excluded from voice of a specific singer (so the royalty is not expensive) .
  • the formation of the VOS file in accordance with the present invention classifies MIDI messages on the basis of type and stores them in a memory at step 110.
  • the messages are divided into control messages (such as volume control, effect, etc), playing messages, and musical instrument configuration messages, etc. and a time domain of the entire message in the MIDI file is ⁇ efined as a delta time.
  • the delta time system all the time information of message are decided based on a time difference between the prior time information and the current time information (see FIG. 3) .
  • the MIDI format message defined as the delta time have to be converted to those of the absolute time for a Virtual Orchestra playing .
  • FIG. 3 illustrating the display of the time information for playing a message. That is, in FIG. 3, the left part shows the delta time information and the right part the absolute time information.
  • the conversion of the delta time to the absolute time can be explained by the flowchart of FIG. 4. That is, the conversion of the delta time information of the MIDI format message to the absolute time information is accomplished by an initialization of setting the first value of the delta time as the initial value of the absolute time at step 121, and it repeatedly performs the steps of deciding if there is any message with converted delta time information at step 123 and setting the absolute time value of the current target message by adding the current delta time value of target message to the previous absolute time value until there is no more unconverted ⁇ elta time messages at step 125.
  • the present invention forms a VOS file so that a single user may select just one musical instrument through the whole playing time, change the instrument during the playing, or multiple users may play with each their own musical instrument simultaneously.
  • the playing operation input devices to play all octaves without any modification such as simplification may be required, but in most case ordinary people don't require to play a sophisticated music in such a way.
  • the simplification of the playing operation is necessary so that the ordinary people play some musical instruments without excessive training, and reversely, for the specialized players, advanced playing operation is possible through the complication of the playing operation at step 130.
  • a range of all the notes can be confined within just one octave by removing the octave element in notes
  • the original musical score 11a can be simplified to a new type of electronic musical score lib at step
  • VOS file is enlarged by specifying the display time with the advertising information at step 160.
  • VOS file is generated at step 170.
  • a reference numeral 21 represents an input device, 22 a screen display device,
  • VOS Virtual Orchestra System
  • the music playing system in accordance with the present invention includes the VOS file providing device 24 for supplying the VOS file, which represents the notes in the timing of playing order by classifying the notes according to playing order and musical instrument ftrack; for each music, the screen display device 22 for representing each note of music as an electronic musical score which shows the playing order of the notes, at least one input device 21 for getting the playing operation inputs from users according to the playing order of the notes in the electronic musical score on the screen display device 22, the VOS processing device 23 for storing the VOS file, converting the notes for each musical instrument in the VOS file to the electronic musical score, which shows the playing order, providing it to the screen display device 22 and outputtmg the designated sound manipulated by the input device 21 and the background sound, the MIDI output device 25 for synthesizing and playing the designated sound and the background sound from the VOS processing device 23, and the speaker 26 for outputtmg the music played by the MIDI output device 25.
  • the VOS file providing device 24 for supplying the VOS file, which represents the notes in
  • the input device 21 is a device for getting inputs from users, which are usually keyboards, mouses, MIDI instruments, oypads and simulative musical instruments (keyboard instruments, stringed instruments, a percussion instruments, wind instruments, etc) , and it may get the input from user operation according to the playing order of notes in the electronic musical score on the screen display device 22.
  • a keyboard means a common input device used in PC system.
  • a mouse doesn't have enough number of input keys as a main input device, it can be used as an assistant playing device with a keyboard or a joypad.
  • the screen display device 22 is a screen for showing the VOS file to users as a type of electronic musical score, which is usually a monitor, a LCD display, or a TV.
  • the electronic musical score is a kind of score, which represents the playing order of the notes for music to be played in the VOS file.
  • the VOS processing device 23 has several functions of loading and storing the VOS file from the VOS file providing device 24 using a network operating system (for example, Windows NT, Windows 95/98), a set top box, a game device, a noraebang
  • a network operating system for example, Windows NT, Windows 95/98
  • a set top box for example, a game device, a noraebang
  • the VOS file providing device 24 is a device for providing the VOS file necessary for playmg music using a network line, a hard disk, or a CD-ROM, etc.
  • the VOS file s generated by classifying the notes according to the playmg order and the musical instrument, and converting to VOS format using MIDI file.
  • the external sources such as a remote host connected by the wire or wireless internet, or a set top box using satellites.
  • the MIDI output device 25 synthesizes and plays the MIDI output messages (that is, the ⁇ esignated sound and the background sound) from the VOS processing device 23 using a MIDI module, a Software MIDI, and a FM synthesizer. Then, the virtual orchestra playing method will be concretely described in the following, which plural users can play each their own musical instrument in the network, such as internet or intranet, using the VOS file converted from MIDI file or some other sources for each musical instrument.
  • the VOS file which is classified depending on the playmg order and the musical instruments for the music, is preferably classified into track messages for piano, violin, drum, trumpet, Korean gong, etc., as illustrated in FIG. 8.
  • the classification function (VOS file generating function) is to classify and store the ready made or created music on the basis of the musical instruments to be played with, editing and classifying the track from the MIDI file on the basis of musical instruments.
  • the VOS file since the VOS file has data which are classified depending on tracks from ordinary music, the data is displayed on the screen as a type of electronic score at a real-time. Therefore, when there is a user input from the input device according to the playing order in the electronic score, the playing function determines the note corresponding to the input at a real-time by the terminal loaded with the VOS and outputs the MIDI output message to the MIDI output device 25.
  • the user plays the designated sound of the selected musical instrument and the VOS system plays the sound of the rest of musical instruments (that is, background sound) .
  • the user terminals with the VOS system may communicate with one another using communication protocol such as TCP/IP (Transmission Control Protocol/Internet Protocol) , IPX (Internetworking Packet Exchange) , and each user of the terminal with the VOS system may hear other sounds and plays h s own musical instrument in accordance with it, therefore the virtual orchestra playmg may be accomplished.
  • TCP/IP Transmission Control Protocol/Internet Protocol
  • IPX Internetworking Packet Exchange
  • the abstract playmg environment as shown in FIG. 9 may be implemented by a playing environment as shown in FIG. 10.
  • the VOS installed terminal may be a PC or a portable computer
  • a common keyboard As an input device, a common keyboard, a keypad (that is, joypad with more than seven buttons as an option) , or a well-known
  • MIDI instrument may be employed.
  • a direct music a software MIDI system for users without MIDI modules
  • a hardware MIDI module producing a high quality sound with high quality musical instrument sound fonts (such as the sound canvas , FM synthesizer, etc.) may be employed.
  • the terminals communicate with one another using network protocols such as TCP/IP, IPX, etc.
  • VOS playing process in accordance with the present invention will be described the following.
  • Fig. 11 is a flowchart of an embodiment of the musical playmg method in accordance with the present invention which shows the VOS playmg process using the VOS file.
  • a list of music stored in the system is provided to the user, and then the music to be played is selected by the user through an input device at step 601.
  • VOS file generated through the above process is provided by the VOS file providing device 24, and information for playmg of musical instruments and advertisement are loaded from the VOS file at step 602, then the loaded information for playmg and advertisement are stored to a ma memory device which has fast access time enough to use the information at a real-time at step 603.
  • the musical mstruments list for the selected music is provided to the user, and one of the musical instruments is selected by the user at step 604.
  • the electronic score for the musical instrument played by the user is displayed on the screen display device 22 at step 605.
  • the electronic score may be scrolled according to the progress of playing in order to show the spot to be played, m case where the music is too long to show all the electronic score displayed on a screen.
  • the progress of displaying the electronic score is illustrated m FIG. 12. That is, the notes of part A may be converted to those of B in the electronic score.
  • the VOS processing device 23 recognizes the playing operation inputted by user, when the user plays with the input device 21 according to the electronic score on the screen display device 22.
  • the VOS processing device 23 outputs the notes corresponding to key inputs from the user at a real-time (that is, the MIDI output messages of the designated sound) to the MIDI output device 25 at step 607, and for the rest of the musical instruments to be played by the user, outputs the notes (that is, the MIDI output messages of the background sound) automatically to the MIDI output device 25 at step 608.
  • the inputs go out directly to the user, without any simplification.
  • the notes nearest to it may be a sent to the user as an output.
  • the notes nearer to the user input (a) may be decided to be played.
  • the sound corresponding to the notes played by the user with a musical mstrument and the background sound corresponding to the notes played by the VOS processing device 23 automatically, not by the user, are mixed at a real-time by the MIDI output device 25, and go out through the speaker 26 at step 609.
  • the achievement or grade of the users' play, compared with the original music 9b, can be shown as illustrated in FIG. 14 at step 610.
  • the ensemble is realized by mixing the designated sound of the selected musical instruments of the first and the second player with unselected musical instruments at a real-time and by making each player listen to the other's sound through the computer network.
  • the ensemble with more than two players may be implemented in the same way.
  • the present invention provides the ensemble play for the whole music by generating the VOS file from the MIDI file or other sources corresponding to it, which is classified depending on the musical instruments and by making the users play each their musical instrument in the network environment based on the VOS file. It means an overlap of the sound effect corresponding to the playmg operation of the designated sound directed by the users and the background sound provided by the system.
  • the present invention directs the timing of playmg operation visually to the users thereof, not only the skilled player but also the ordinary people may play the music more easily, and the present invention may also adjust the complexity of playmg by adding or deleting the input keys and make advanced sound effect such as a scratch effect. Also, in accordance with the present invention, the result is evaluated by comparing the playmg operation directed to the users with the real operation by users, and is given to users as a feedback, so the present invention has usefulness not only for amusement but also for competition to get better grade.
  • the present invention may be implemented by the single user mode or the multi-user mode not only in the network but also a noraebang (karaoke), a game room, an arcade and a digital satellite broadcasting network.
  • the VOS installed karaoke system is used for terminals, and the VOS controllers (preferably, simulative musical instruments such as keyboard instruments, stringed instruments, percussion instruments, wind mstruments) for noraebang (karaoke) with ten or more buttons or other devices may be used for the input device.
  • the VOS controllers preferably, simulative musical instruments such as keyboard instruments, stringed instruments, percussion instruments, wind mstruments
  • noraebang karaoke
  • the communication system may be achieved by the network system among the karaoke devices .
  • game rooms by installing the VOS system each terminal, a single user or plural users may play the music using each their own terminal.
  • a selected music may be played with hands or feet, and the game may be continued according to the grade of game.
  • the VOS player is installed on the set top box, the information on the selected music is transmitted from the digital satellite, and then the electronic musical score is displayed on the TV screen, therefore the music may be played according to the score.
  • the simplification of playmg music is supposed so that one may play some musical instruments without much training
  • the wide range adjustment of complexity is possible by extending the musical range to two or five octaves, and it is obvious that such a transformation has the same effect as the embodiment of the present invention and is within the technical aspect of the present invention.
  • the MIDI instrument may be used for an input device because the MIDI instrument doesn ' t make real sound but send out signals for sound, and the correctness of the playmg the MIDI instrument may be compared with the real musical score.
  • feet as well as hands may be used as an input.
  • the simulative musical instruments used in a noraebang (karaoke) a game room, an arcade can be made in the shape of real musical instruments for amusement .
  • various musical instruments may be played more easily by forming the VOS file from the well-known MIDI file, and the ensemble is possible among a group of people making an advantage of chatting. And even unskilled people who are not trained for some musical instruments are able to play the music, and virtual orchestra may be implemented without any expensive real musical instruments, studio, or other equipments within the network environment such as internet or intranet.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)
  • Auxiliary Devices For Music (AREA)

Abstract

The present invention relates to a system and method for playing musical instruments using a digital music file. The method for playing the musical instrument based on a computing system includes the steps of: generating a digital music file which stores a play order for each musical instrument and sound data for each musical instrument by partitioning the digital music file depending on the musical instruments; inputting music type data and musical instrument type data by a user; displaying an electronic score at a real-time wherein musical notes corresponding to each instrument to play the music are represented, selected from the music file; and playing the music according to the displayed electronic score by synthesizing a designated sound manipulated by the user and a background sound of the music wherein the designated sound is omitted. Accordingly, at least one user can play the music based on the music file. At the same time, the user can play the music, selecting desired instruments and watching the displayed electronic score.

Description

METHOD AND APPARATUS FOR PLAYING MUSICAL INSTRUMENTS BASED ON A DIGITAL MUSIC FILE
Technical Field
The present invention relates to a method of converting a digital music file, in which tracks are classified on the bas±s of musical instruments to be played in such as a MIDI (musical Instrument Digital Interface) , to a musical performance file (hereinafter, referred to as a VOS (Virtual Orchestra System) file) which makes a direction of performance and playing back for each musical instrument, a musical performance system and method that one or more users select his own musical instrument and play the music through the electronic musical score displayed on a screen based on the VOS file, and a computer readable medium storing programs for realizing them.
Background Art
MIDI (Musical Instrument Digital Interface) is a kind of music file which can automatically play back sound or music through the electronic devices, and it has international standards for the compatibility of the data exchange among electronic musical instruments. Most electronic musical instruments can send/receive the data based on MIDI' s standards . For example, the electronic musical instruments for domestic use are divided into the electronic organ, the electronic piano, the electronic keyboard, etc. and these instruments, that synthesize and- output sound waves using the well-known analog or digital circuit, also follows the MIDI'S standards.
In other words, MIDI has been considered as international standards for the compatibility n transmitting information about playing of musical instruments, and recommends the exclusive five pin-cable for sending/receiving channel and system messages . Also, MIDI recommends that the channel message may include the performance information, such as scale interval, dynamic and transformation of timbre programs, etc.
Recently, there are many cases where the data can be shared with PCs (Personal Computers), and the electronic musical instruments can be controlled by the PCs. For the PCs to control the musical instruments with a MIDI port, the signals in the PC are required to be converted to MIDI signals for electronic musical instruments, and then the MIDI interface is necessarily required for this purpose. The MIDI interfaces may be divided into the intelligent type with CPU and the non-intelligent type without it. In the present technologies, sixteen-different channel information can be transmitted through -just one cable, therefore the MIDI file, which has the sounds of sixteen different musical instruments, can be easily transmitted (it is obvious that the extension of the channel information is available to the ordinary skilled in the art) . The present invention is suggested as a technique using these environments and resources.
As a prior arts, "Beatmama" (it is the brandname) system of "KONAMI", which is well known as a music playing game system, will be explained concretely referring to Fig. 1.
Fig. 1 is a block diagram illustrating a method for playing a music through the "Beatmania" system. As shown in Fig. 1, "Beatmania" of "KONAMI" is a music playing simulation game system, which directs a playing operation to users at a predetermined point of time and, when the users get into operation based on the direction, executes the manipulation such as a mixing of a preset playing sound wave (user input sound wave) and a effect sound wave (background music except the user input sound wave) given by Disc Jockey (DJ) . It directs the timing of playing operation to the user using an indicator, a kind of electronic musical score, and the user can play the music with five buttons and one turntable. According to the result of user's playing operation, "Beatmania" synthesizes and outputs the play sound wave and the effect sound wave .
Although, this "Beatmania" system is useful in that it makes the user play the music easily by indicating the timing of playing operations, it requires a lot of efforts for professional musicians to compose the whole piece of music, because in the "Beatmania" system, the playing sound wave (user input wave) and the background sound wave should be separately designed for each musical instrument selected by the user. That is, in this system, the design of the play sound wave (user input wave) and the background sound wave should be repeatedly made as many as the number of musical instruments to be selected by the user, because it is impossible to design the whole music at one time by partitioning the musical notes depending on each musical instrument.
Also it has another problem in that once the music is made for "Beatmania", the change of the file requires the same complex procedures as making it first, because the musical performance file made through these procedures is in a type of a wave file.
Even if the musical performance file is compressed, it needs a few or a few dozens of megabyte because the file for the music playing game through these procedures is wave file, therefore the transmission of it needs large bandwidth. In result, in the current PC version, "Beatmania" has a technical limitation to a downgrade sound quality due to the reduction of an amount of data.
Disclosure of the Invention
Therefore, to solve the above problems, it is an object of the present invention to provide a method of converting a music file to a VOS file by partitioning the musical notes for directing musical operation and playing sounds depending on each musical instrument in the computing system using digital music file (for example MIDI files), and a computer readable medium storing programs for implementing the above-mentioned method. It is another object of the present invention to provide a music playing system, which one or more users select their own musical instruments and play the music, showing electronic musical scores displayed on the screen based on the VOS file; its method; and a computer readable medium storing programs for realizing them.
To achieve the first purpose of the invention, a method for converting a digital music file to a music playing file for each musical instrument comprises the steps of: classifying MIDI messages in MIDI files by type and storing them to memory; converting the delta time information of MIDI message to the absolute time information; and generating a VOS file by constructing a playing note message (for example, a user can select just one musical instrument through the whole playing time, change musical instruments during the playing, or plural users can play simultaneously with each their own musical instrument) .
A method of converting file to the VOS file by classifying musical notes for playing each musical instrument comprises: classifying MIDI message and storing them to memory for obtaining necessary information from the message of MIDI file, in the apparatus with processor which converts a digital music file to a music playing file to be played for each musical instrument; carrying out the time conversion which change the delta time information to the absolute time information, and the classification of users based on relation to the musical instruments; generating a electronic score by simplifying the playing style to make it easy to play the musical instruments; generating a digital music file, which represents the notes in the timing of playing operation by partitioning the notes according to the playing order and musical instrument (track) , from the generated electronic musical score by changing the position of the notes, omitting some notes, adjusting the complexity of performance; and inserting additional information (advertising message, image, or sound clip for some corporations, goods, music) to said complexity coordinated musical score, and deciding the time to show the additional information to users.
To accomplish said first purpose of the invention, a computer readable medium storing program code for realizing the present invention comprises: a first function of classifying MIDI message in MIDI files and storing them to memory; a second function of converting the delta time information of MIDI message to the absolute time information; and a third function of generating a VOS file by constructing a playing note message. Also, a computer readable medium storing program code for realizing the present invention comprises: a first function of classifying MIDI message and storing them to memory for obtaining necessary information from the message of MIDI file, m the apparatus with processor which converts a digital music file to a music playing file to be played for each musical instrument; a second function of carrying out the time conversion which change the delta time information to the absolute time information, and the classification of users based on relation to the musical instruments; a third function of generating a electronic score by simplifying the playing style to make it easy to play the musical instruments; a fourth function of generating a digital music file, which represents the notes m the timing of playing operation by partitioning the notes according to the playing order and musical instrument (track) , from the generated electronic musical score by changing the position of the notes, omitting some notes, adjusting the complexity of performance; and a fifth function of inserting additional information
(advertising message, image, or sound clip for some corporations , goods, music) to said complexity coordinated musical score, and deciding the time to show the additional information to users.
To achieve the second purpose, the music playing system of the present invention comprises: music file providing means for providing a music file to represent notes for each musical instrument at the timing of playing operation by classifying the notes depending on a playing order and a track corresponding to the musical instrument for said music; musical score display means for displaying each note for the musical instrument to be played as an electronic musical score; at least one playing operation input means for getting an playing operation input from the users according to the playing order of notes in the electronic musical score displayed by said musical score display means; musical processing means for storing a digital music file, converting the notes m a score to the electronic musical score representing the playing order, and providing the notes to the musical score display means, and outputtmg a designated sound manipulated by the playing operation input means and the background sound except the designated sound; music playing means for synthesizing and playing the designated sound and the background sound from the musical processing means; and output means for outputting the music played by the music playing means . To achieve the second purpose, the music playing method of the present invention includes the steps of: generating music file representing the notes in the timing of playing order by partitioning the notes depending on the track of the playing order and musical instrument for the music; getting inputs of the title of music and the musical instrument to be played from users; displaying electronic musical notes for musical instruments to be played as an electronic musical score that shows the playing order of the notes on a screen at a real-time; and synthesizing and playing the designated sound manipulated by users and the background sound except the designated sound according to the musical score displayed on the screen.
Further, to achieve the second purpose of the present invention, a computer readable medium storing the program code for realizing the present invention includes the function of: generating music files for representing the notes for the music in the timing of playing order by partitioning the notes according to the playing order and musical instrument (track) in the music playing device with processor; getting inputs of the title of music and the musical instrument to be played from users; displaying the musical notes for said music to be played as an electronic musical score that shows the playing order of the notes on a screen at a real-time; and synthesizing and playing the designated sound manipulated by users and the background sound except the designated sound according to the musical score displayed on the screen. Brief Description of the Drawings
FIG. 1 is a block diagram for explaining a prior musical playing system of "Beatmania";
FIG. 2 is a flowchart showing a method of converting a digital music file to a musical performance file for each musical instrument in accordance with the present invention;
FIG. 3 is a comparative diagram of delta time information of a digital music file and absolute time information of a VOS file in accordance with the present invention;
FIG. 4 is a flowchart illustrating a method of converting delta time information to absolute time information m accordance with the present invention; FIG. 5 is a schematic view illustrating a method of generating VOS electronic score in accordance with the present invention;
FIG. 6 is a schematic view illustrating a method of adjusting the complexity during the generation of VOS electronic musical score;
FIG. 7 is a flowchart illustrating an embodiment of a music playing system in accordance with the present invention;
FIG. 8 is a schematic view illustrating a structure of the VOS file in accordance with the present invention; FIG. 9 is a schematic view illustrating a playing environment of VOS in accordance with the present invention; FIG. 10 is a schematic view illustrating a structure of playing environment of VOS in accordance with an embodiment of the present invention;
FIG. 11 is a flowchart illustrating a method of playing music in accordance with an embodiment of the present invention; FIG. 12 is a schematic view illustrating a display of an electronic score in a musical performance according to the present invention;
FIG. 13 is a schematic view illustrating the output of designated sound in the musical performance according to the present invention;
FIG. 14 is a schematic view showing an achievement of the musical performance in accordance with an embodiment of the present invention; and
FIG. 15 is a schematic view illustrating a playing environment (karaoke) using in accordance with the present invention .
Best mode for 'Carrying Out the Invention
The present invention makes ordinary people, who is not skilled in musical instrument, play music easily using VOS format music files. Also, without a large space such as a studio with expensive musical instruments or special facilities, the present invention enables plural users connected through the computer network to constitute a virtual orchestra by selecting each their own musical instrument and then they play a music through a VOS electronic musical score displayed on each user's screen, using the VOS file format.
For this purpose, as a tool for getting anyone to make VOS format music files easily, the present invention provides a method of converting digital music files, such as MIDI files, to the VOS files by classifying musical notes for directing musical operations on the basis of musical instruments and playing sounds for each musical instrument, and computer readable media storing the programs for realizing the same method. In the present invention, when MIDI file is previously provided for music, it may be used as a source file for the VOS file, otherwise, a MIDI file for the music should be made by a known- method and converted to the VOS file format (it means a specific file for representing the electronic score for each musical instrument for each user) so that the VOS electronic score for one or more musical instruments can be provided to the players, and the sound of selected musical instrument may be played by inputs according to the users' operations. For the reference, MIDI file is already widely used in a musical entertainment such as noraebang (karaoke) because it is not only easy and cheap to make but also excluded from voice of a specific singer (so the royalty is not expensive) .
The objects, features and utilities of the present invention will be clearer through the description and attached figures in the following. Referring to the figures, the best mode in accordance with the present invention will be explained in detail. First, a method of generating VOS file by converting the MIDI file to the VOS format file will be explained.
As illustrated m FIG. 2, to obtain necessary information from messages in a MIDI format music file, the formation of the VOS file in accordance with the present invention classifies MIDI messages on the basis of type and stores them in a memory at step 110. For the reference, the messages are divided into control messages (such as volume control, effect, etc), playing messages, and musical instrument configuration messages, etc. and a time domain of the entire message in the MIDI file is αefined as a delta time. In the delta time system, all the time information of message are decided based on a time difference between the prior time information and the current time information (see FIG. 3) . During the formation of the VOS file in the present invention, the MIDI format message defined as the delta time have to be converted to those of the absolute time for a Virtual Orchestra playing .
The meaning of the delta time and absolute time is easily understood by FIG. 3 illustrating the display of the time information for playing a message. That is, in FIG. 3, the left part shows the delta time information and the right part the absolute time information.
Also, the conversion of the delta time to the absolute time can be explained by the flowchart of FIG. 4. That is, the conversion of the delta time information of the MIDI format message to the absolute time information is accomplished by an initialization of setting the first value of the delta time as the initial value of the absolute time at step 121, and it repeatedly performs the steps of deciding if there is any message with converted delta time information at step 123 and setting the absolute time value of the current target message by adding the current delta time value of target message to the previous absolute time value until there is no more unconverted αelta time messages at step 125.
Then, in a construction of the note messages for users to play, the present invention forms a VOS file so that a single user may select just one musical instrument through the whole playing time, change the instrument during the playing, or multiple users may play with each their own musical instrument simultaneously. Although, in some cases, the playing operation input devices to play all octaves without any modification such as simplification may be required, but in most case ordinary people don't require to play a sophisticated music in such a way. The simplification of the playing operation is necessary so that the ordinary people play some musical instruments without excessive training, and reversely, for the specialized players, advanced playing operation is possible through the complication of the playing operation at step 130.
For example, the simplification process of a musical score will be explained in the following referring to FIG. 5 and FIG. 6.
Referring to FIG. 5, a range of all the notes can be confined within just one octave by removing the octave element in notes
("g" of 11a and lib in Fig. 5) . Among the notes, semi-tones can be replaced with whole-tones ("e" of 11a and lib in Fig. 5).
Through these processes, the original musical score 11a can be simplified to a new type of electronic musical score lib at step
140. However, such a new electronic musical score lib actually has both the original information for users to direct the normal playing operation and simplified information of the playing operation. Also, if necessary, additional modification, such as a change of the arrangement of the note and deletion of the notes to be played, can be made for the new style electronic score generated at step 150. For example, an editor can be used for adjusting the complexity by deleting the notes, as illustrated in FIG. 12.
On the other hand, in case that the original score has an idle time, or the electronic score is modified by changing the arrangement or deleting the notes, additional advertising information (advertising words, image, sound clip for some corporation, goods, music) can be inserted for such an idle time.
In this case, the utility of VOS file is enlarged by specifying the display time with the advertising information at step 160.
Finally, the VOS file is generated at step 170.
In Fig. 7 which illustrates a structure of the music playing system in accordance with the present invention, a reference numeral 21 represents an input device, 22 a screen display device,
23 a VOS (Virtual Orchestra System) processing device, 24 a VOS system file providing device, 25 a MIDI output device, 26 a speaker, respectively.
As illustrated in FIG. 7, the music playing system in accordance with the present invention includes the VOS file providing device 24 for supplying the VOS file, which represents the notes in the timing of playing order by classifying the notes according to playing order and musical instrument ftrack; for each music, the screen display device 22 for representing each note of music as an electronic musical score which shows the playing order of the notes, at least one input device 21 for getting the playing operation inputs from users according to the playing order of the notes in the electronic musical score on the screen display device 22, the VOS processing device 23 for storing the VOS file, converting the notes for each musical instrument in the VOS file to the electronic musical score, which shows the playing order, providing it to the screen display device 22 and outputtmg the designated sound manipulated by the input device 21 and the background sound, the MIDI output device 25 for synthesizing and playing the designated sound and the background sound from the VOS processing device 23, and the speaker 26 for outputtmg the music played by the MIDI output device 25.
The input device 21 is a device for getting inputs from users, which are usually keyboards, mouses, MIDI instruments, oypads and simulative musical instruments (keyboard instruments, stringed instruments, a percussion instruments, wind instruments, etc) , and it may get the input from user operation according to the playing order of notes in the electronic musical score on the screen display device 22. Here, a keyboard means a common input device used in PC system. Although a mouse doesn't have enough number of input keys as a main input device, it can be used as an assistant playing device with a keyboard or a joypad. The screen display device 22 is a screen for showing the VOS file to users as a type of electronic musical score, which is usually a monitor, a LCD display, or a TV. Here, the electronic musical score is a kind of score, which represents the playing order of the notes for music to be played in the VOS file.
The VOS processing device 23 has several functions of loading and storing the VOS file from the VOS file providing device 24 using a network operating system (for example, Windows NT, Windows 95/98), a set top box, a game device, a noraebang
(karaoke) device etc. , converting the notes of VOS files for each musical instrument to the electronic musical score which shows the playing order, providing the converted electronic musical score to the screen display device 22, getting and processing user inputs, outputtmg the MIDI messages (that is, the designated sound manipulated by the input device 21 and the background sound excluding the designated sound) to the MIDI output device 25.
The VOS file providing device 24 is a device for providing the VOS file necessary for playmg music using a network line, a hard disk, or a CD-ROM, etc. As stated in FIG. 2 to FIG. 6, the VOS file s generated by classifying the notes according to the playmg order and the musical instrument, and converting to VOS format using MIDI file. On the other hand, when there is no VOS file in a user terminal, it may be loaded from the external sources through the network, such as a remote host connected by the wire or wireless internet, or a set top box using satellites. The MIDI output device 25 synthesizes and plays the MIDI output messages (that is, the αesignated sound and the background sound) from the VOS processing device 23 using a MIDI module, a Software MIDI, and a FM synthesizer. Then, the virtual orchestra playing method will be concretely described in the following, which plural users can play each their own musical instrument in the network, such as internet or intranet, using the VOS file converted from MIDI file or some other sources for each musical instrument. In the preferred embodiment of the present invention, the VOS file, which is classified depending on the playmg order and the musical instruments for the music, is preferably classified into track messages for piano, violin, drum, trumpet, Korean gong, etc., as illustrated in FIG. 8. Here, the classification function (VOS file generating function) is to classify and store the ready made or created music on the basis of the musical instruments to be played with, editing and classifying the track from the MIDI file on the basis of musical instruments. On the other hand, as shown in FIG 4, since the VOS file has data which are classified depending on tracks from ordinary music, the data is displayed on the screen as a type of electronic score at a real-time. Therefore, when there is a user input from the input device according to the playing order in the electronic score, the playing function determines the note corresponding to the input at a real-time by the terminal loaded with the VOS and outputs the MIDI output message to the MIDI output device 25.
To accomplish a ensemble play function, in a single user playing mode, the user plays the designated sound of the selected musical instrument and the VOS system plays the sound of the rest of musical instruments (that is, background sound) . On the other hand, in a multi-user playmg mode, the user terminals with the VOS system may communicate with one another using communication protocol such as TCP/IP (Transmission Control Protocol/Internet Protocol) , IPX (Internetworking Packet Exchange) , and each user of the terminal with the VOS system may hear other sounds and plays h s own musical instrument in accordance with it, therefore the virtual orchestra playmg may be accomplished.
The abstract playmg environment as shown in FIG. 9 may be implemented by a playing environment as shown in FIG. 10. The VOS installed terminal may be a PC or a portable computer
(notebook PC) with a operating system such as Windows or Linux.
As an input device, a common keyboard, a keypad (that is, joypad with more than seven buttons as an option) , or a well-known
MIDI instrument may be employed. For the MIDI output device, a direct music (a software MIDI system for users without MIDI modules) or a hardware MIDI module producing a high quality sound with high quality musical instrument sound fonts (such as the sound canvas , FM synthesizer, etc.) may be employed.
In this real VOS play g environment, the terminals communicate with one another using network protocols such as TCP/IP, IPX, etc.
The VOS playing process in accordance with the present invention will be described the following.
Fig. 11 is a flowchart of an embodiment of the musical playmg method in accordance with the present invention which shows the VOS playmg process using the VOS file.
As illustrated in FIG. 11, in a first step of the VOS playmg method in accordance with the present invention, a list of music stored in the system is provided to the user, and then the music to be played is selected by the user through an input device at step 601.
The VOS file generated through the above process is provided by the VOS file providing device 24, and information for playmg of musical instruments and advertisement are loaded from the VOS file at step 602, then the loaded information for playmg and advertisement are stored to a ma memory device which has fast access time enough to use the information at a real-time at step 603.
Then, the musical mstruments list for the selected music is provided to the user, and one of the musical instruments is selected by the user at step 604.
The electronic score for the musical instrument played by the user is displayed on the screen display device 22 at step 605. The electronic score may be scrolled according to the progress of playing in order to show the spot to be played, m case where the music is too long to show all the electronic score displayed on a screen. The progress of displaying the electronic score is illustrated m FIG. 12. That is, the notes of part A may be converted to those of B in the electronic score.
Then, at step 606 the VOS processing device 23 recognizes the playing operation inputted by user, when the user plays with the input device 21 according to the electronic score on the screen display device 22.
Then, for the musical instruments to be played by the user, the VOS processing device 23 outputs the notes corresponding to key inputs from the user at a real-time (that is, the MIDI output messages of the designated sound) to the MIDI output device 25 at step 607, and for the rest of the musical instruments to be played by the user, outputs the notes (that is, the MIDI output messages of the background sound) automatically to the MIDI output device 25 at step 608. For the electronic musical score without there being a simplification, for example, for playing with the real MIDI musical instruments, the inputs go out directly to the user, without any simplification. For the simplified version of electronic musical score, the notes nearest to it may be a sent to the user as an output.
For example, as illustrated in FIG. 13, if the user put downs 'Do' after a lapse of 100s (C) from the starting point, and if 'Do' of the 5th (b) octave exists at a position after a lapse 90s, and that of 6th octave (a) should be at the 105s, the notes nearer to the user input (a) , that is, the note after a lapse of 105s may be decided to be played.
Finally, the sound corresponding to the notes played by the user with a musical mstrument and the background sound corresponding to the notes played by the VOS processing device 23 automatically, not by the user, are mixed at a real-time by the MIDI output device 25, and go out through the speaker 26 at step 609. During this processing, the achievement or grade of the users' play, compared with the original music 9b, can be shown as illustrated in FIG. 14 at step 610.
As stated in the above description, in the single player mode, displaying the electronic musical score at step 605, receiving the input from the user at step 606, outputtmg the designated sound of selected musical instrument at step 607, outputtmg the designated sound of unselected musical instruments automatically at step 608, making the ensemble process at step 609 are repeated until the end of the play g.
On the other hand, m the double player mode, the ensemble is realized by mixing the designated sound of the selected musical instruments of the first and the second player with unselected musical instruments at a real-time and by making each player listen to the other's sound through the computer network. And, it is obvious that the ensemble with more than two players may be implemented in the same way. As stated above, the present invention provides the ensemble play for the whole music by generating the VOS file from the MIDI file or other sources corresponding to it, which is classified depending on the musical instruments and by making the users play each their musical instrument in the network environment based on the VOS file. It means an overlap of the sound effect corresponding to the playmg operation of the designated sound directed by the users and the background sound provided by the system.
Since the present invention directs the timing of playmg operation visually to the users thereof, not only the skilled player but also the ordinary people may play the music more easily, and the present invention may also adjust the complexity of playmg by adding or deleting the input keys and make advanced sound effect such as a scratch effect. Also, in accordance with the present invention, the result is evaluated by comparing the playmg operation directed to the users with the real operation by users, and is given to users as a feedback, so the present invention has usefulness not only for amusement but also for competition to get better grade.
The present invention may be implemented by the single user mode or the multi-user mode not only in the network but also a noraebang (karaoke), a game room, an arcade and a digital satellite broadcasting network.
Referring to Fig. 15, in an application for noraebang (karaoke) , the VOS installed karaoke system is used for terminals, and the VOS controllers (preferably, simulative musical instruments such as keyboard instruments, stringed instruments, percussion instruments, wind mstruments) for noraebang (karaoke) with ten or more buttons or other devices may be used for the input device. For output device, a well-known output system in karaoke may be used without change. The communication system may be achieved by the network system among the karaoke devices . On the other hand, in game rooms, by installing the VOS system each terminal, a single user or plural users may play the music using each their own terminal.
In arcades, by inserting coins, a selected music may be played with hands or feet, and the game may be continued according to the grade of game. In the digital satellite broadcasting system, the VOS player is installed on the set top box, the information on the selected music is transmitted from the digital satellite, and then the electronic musical score is displayed on the TV screen, therefore the music may be played according to the score.
In this embodiment which one or more users play the music according to the electronic musical score displayed on the screen using computer system, although the simplification of playmg music is supposed so that one may play some musical instruments without much training, the wide range adjustment of complexity is possible by extending the musical range to two or five octaves, and it is obvious that such a transformation has the same effect as the embodiment of the present invention and is within the technical aspect of the present invention. Also, the MIDI instrument may be used for an input device because the MIDI instrument doesn ' t make real sound but send out signals for sound, and the correctness of the playmg the MIDI instrument may be compared with the real musical score. Further, feet as well as hands may be used as an input. Also, the simulative musical instruments used in a noraebang (karaoke) , a game room, an arcade can be made in the shape of real musical instruments for amusement .
Industrial Applicability
As apparent from the above description, according to the present invention, various musical instruments may be played more easily by forming the VOS file from the well-known MIDI file, and the ensemble is possible among a group of people making an advantage of chatting. And even unskilled people who are not trained for some musical instruments are able to play the music, and virtual orchestra may be implemented without any expensive real musical instruments, studio, or other equipments within the network environment such as internet or intranet.
The present invention does not confined to the said embodiments or attached figures, and it is clear that the replacement, transformation or modification is possible for the skilled man in the art within the technical aspect of the present invention .

Claims

C l a ims
1. A music playmg system supporting users to play music for a selected musical instrument based on the computing system, comprising; music file providing means for providing a music file to represent notes for each musical instrument at the timing of playmg operation by classifying the notes depending on a playmg order and a track corresponding to the musical instrument for said music; musical score display means for displaying each note for the musical instrument to be played as an electronic musical score; at least one playmg operation input means for getting an playmg operation input from the users according to the playing order of notes in the electronic musical score displayed by said musical score display means; musical processing means for storing a digital music file, converting the notes in a score to the electronic musical score representing the playmg order, and providing the notes to the musical score display means, and outputtmg a designated sound manipulated by the playmg operation input means and the background sound except the designated sound; music play g means for synthesizing and playmg the designated sound and the background sound from the musical processing means; and output means for outputtmg the music played by the music playing means.
2. The music playmg system of Claim 1, wherein the musical processing means has musical data classified depending on the track of the musical instrument and display the electronic musical score on the musical score display means at a real-time, wherein the musical processing means provides, m a single user mode, the designated sound of the user according to the electronic musical score and the background sound to the music playmg means in the type of MIDI output message; and provides, m a multi user mode, the designated sound of the users according to the electronic musical score and the background sound to the music playmg means in the type of MIDI output message;
3. The music playmg system of Claim 1 or 2, wherein the music playmg means make an ensemble play in a single user mode, by mixing the designated sound from the musical processing means with the background sound and playmg the music and, in a multi user mode, by mixing the designated sounds of the plural users from the musical processing means with the background sounds of the users .
4. The music playmg system of Claim 3, wherein said electronic musical score is a digital electronic musical score, visually directs the playmg order by scrolling a part of the musical score to be played according to playmg time, and inputs adjusts a complexity of the key for each musical instrument.
5. The music playmg system of Claim 4, wherein the electronic musical score is a digital electronic musical score, visually directs the playmg order by scrolling the part of the musical score to be played according to play g time, a range of all the notes to one octave by deleting the octave element in notes to degrade the complexity of key input for each musical instrument, and changes all the semi-tones to whole-tones.
6. The music playmg system of Claim 4, wherein the electronic musical score is a digital electronic musical score, visually directs the playmg order by scrolling the part of the musical score to be played according to playmg time, and the range of all the notes extends to two to five octaves by increasing the input keys to upgrade the complexity of key input for each musical instrument.
7. The music playmg system of Claim 4, wherein the at least one playmg operation input means are at least one terminals providing the playmg operation inputted by hands or feet of user according to the playing order of notes in said electronic musical score displayed on the musical score display means to the musical processing means.
8. The music playmg system of Claim 7, wherein the computing system is for well known commercial network, a noraebang (karaoke), a game rooms, or the digital satellite broadcasting system.
9. The music playmg system of Claim 8, wherein the music includes ready made and created music.
10. A music play g method m computing system, comprising the steps of: a) generating music file representing the notes in the timing of playmg order by partitioning the notes depending on the track of the playmg order and musical mstrument for the music; b) getting inputs of the title of music and the musical instrument to be played from users; c) displaying electronic musical notes for musical instruments to be played as an electronic musical score that shows the play g order of the notes on a screen at a real-time; and d) synthesizing and playing the designated sound manipulated by users and the background sound except the designated sound according to the musical score displayed on the screen .
11. The music playmg method of Claim 11, wherein, in single user mode, the step d) mixes the designated sound of the user according to the electronic musical score and the background sound, and play said music, in multi user mode, mixes the designated sounds of plural users according to the musical score and the background sounds, and play the music.
12. The music playmg method of Claim 11, wherein the step a) includes the steps of: al) classifying MIDI messages by type and storing them in memory to get the necessary information from musical message stored in the MIDI files; a2) converting the delta time information in the MIDI files to the absolute time information and classifying the users based on the relation to the musical instruments; a3) generating the electronic score by simplifying the playmg style to make it easy to play the musical instruments; and a4) generating the music file by changing the position of notes, omitting notes needed, coordinating the complexity of playmg, in the generated score through the step a3) .
13. The music playing method of Claim 12, further including the step of after the step a3) inserting the additional information (advertising message, image, or sound clip for some corporations, goods, music) to the complexity coordinated musical score and deciding the time to show each additional information to users .
14. The music playmg method of Claim 12, wherein the step a3) includes the step of deleting the octave element in notes so that the range of all the notes can be confined to one octave, and changing the semi-tones to the whole-tones.
15. The music playing method of Claim 14, wherein the electronic musical score is a digital electronic musical score, visually directs the playing order by scrolling the part of the musical score to be played according to playing time, and a complexity of key inputs adjusts for each musical instrument.
16. The music playing method of Claim 15, wherein the electronic musical score is a digital electronic musical score, visually directs the playing order by scrolling the part of said musical score to be played according to time, a range of all the notes confines to one octave by deleting the octave element in notes to degrade the complexity of key input for each musical instrument, and all the semi-tones changed to whole-tones.
17. The music playing method of Claim 15, wherein the electronic musical score is a digital electronic musical score, visually directs the playing order by scrolling the part of said musical score to be played according to playing time, and the range of all the notes extends to two or three octaves by increasing the input keys to upgrade the complexity of key input for each musical instrument.
18. The music playmg method of Claim 15, wherein the computing system is for well known commercial network, a noraebang (karaoke), a game room, or the digital satellite broadcasting system.
19. The music play g system of Claim 18, wherein the music includes ready made and created music.
20. A method for converting a digital music file to a music playmg file for each musical instrument, comprising the steps of: a) classifying MIDI messages in MIDI files by type and storing them to memory; b) converting the delta time information of MIDI message to the absolute time information; and c) generating a VOS file by constructing a playmg note message.
21. The method for converting a digital music file to a music playing file for each musical instrument of Claim 20, wherein the message includes control message, playmg message, and musical instrument configuration message.
22. The method for converting a digital music file to a music playmg file for each musical instrument of Claim 20, wherein the step b) includes the steps of: bl) generating a electronic score by simplifying the playmg style to make it easy to play the musical instruments; and b2 ) generating the music file, which represents the musical notes to be played for each musical instrument according to the playmg timing by classifying the notes depending on the playmg order and musical instrument (track) , by changing the position of notes, omitting notes needed, coordinating the complexity of playing in the generated electronic musical score through the step bl ) .
23. The method for converting a digital music file to a music playmg file for each musical instrument of Claim 22, wherein the step b) further includes the step of b3) inserting the additional information (advertising message, image, or sound clip for some corporations, goods, music) to the complexity coordinated musical score and deciding the time to show each additional information to users.
24. In a device with a processor that converts digital music files to music playing files for each musical instrument, a computer readable medium storing instructions for realizing the functions of: a) classifying MIDI message MIDI files and storing them to memory; b) converting the delta time information of MIDI message to the absolute time information; and c) generating a VOS file by constructing a playmg note message .
25. In a device with a processor that partitions notes depending on musical instruments and stores them, a computer readable medium storing instructions for realizing the functions of: a) classifying MIDI message and storing them to memory for obtaining necessary information from the message of MIDI file, in the apparatus with processor which converts a digital music file to a music playmg file to be played for each musical mstrument ; b) carrying out the time conversion which change the delta time information to the absolute time information, and the classification of users based on relation to the musical instruments ; c) generating a electronic score by simplifying the playmg style to make it easy to play the musical mstruments; and d) generating a digital music file, which represents the notes in the timing of playmg operation by partitioning the notes according to the playmg order and musical instrument (track) , from the generated electronic musical score by changing the position of the notes, omitting some notes, adjusting the complexity of performance.
26. The computer readable medium of Claim 25, further comprising the function of e) inserting additional information (advertising message, image, or sound clip for some corporations, goods, music) to said complexity coordinated musical score, and deciding the time to show the additional information to users.
27. In a music play g device with processor, a computer readable medium storing instructions for realizing the function of: generating music files for representing the notes for the music in the timing of playmg order by partitioning the notes according to the playmg order and musical instrument (track) in the music playmg device with processor; getting inputs of the title of music and the musical instrument to be played from users; displaying the musical notes for said music to be played as an electronic musical score that shows the playmg order of the notes on a screen at a real-time; and synthesizing and playmg the designated sound manipulated by users and the background sound except the designated sound according to the musical score displayed on the screen.
EP00963100A 1999-09-16 2000-09-16 Method and apparatus for playing musical instruments based on a digital music file Withdrawn EP1212747A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
KR9939854 1999-09-16
KR19990039854 1999-09-16
PCT/KR2000/001042 WO2001020594A1 (en) 1999-09-16 2000-09-16 Method and apparatus for playing musical instruments based on a digital music file

Publications (1)

Publication Number Publication Date
EP1212747A1 true EP1212747A1 (en) 2002-06-12

Family

ID=19611851

Family Applications (1)

Application Number Title Priority Date Filing Date
EP00963100A Withdrawn EP1212747A1 (en) 1999-09-16 2000-09-16 Method and apparatus for playing musical instruments based on a digital music file

Country Status (5)

Country Link
EP (1) EP1212747A1 (en)
JP (1) JP2003509729A (en)
CN (1) CN1269101C (en)
AU (1) AU7455400A (en)
WO (1) WO2001020594A1 (en)

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001046829A1 (en) * 1999-12-20 2001-06-28 Hanseulsoft Co., Ltd. Network based music playing/song accompanying service system and method
US6482087B1 (en) * 2001-05-14 2002-11-19 Harmonix Music Systems, Inc. Method and apparatus for facilitating group musical interaction over a network
KR100418563B1 (en) * 2001-07-10 2004-02-14 어뮤즈텍(주) Method and apparatus for replaying MIDI with synchronization information
US6969797B2 (en) 2001-11-21 2005-11-29 Line 6, Inc Interface device to couple a musical instrument to a computing device to allow a user to play a musical instrument in conjunction with a multimedia presentation
US6740803B2 (en) 2001-11-21 2004-05-25 Line 6, Inc Computing device to allow for the selection and display of a multimedia presentation of an audio file and to allow a user to play a musical instrument in conjunction with the multimedia presentation
US7030311B2 (en) * 2001-11-21 2006-04-18 Line 6, Inc System and method for delivering a multimedia presentation to a user and to allow the user to play a musical instrument in conjunction with the multimedia presentation
IL165817A0 (en) 2004-12-16 2006-01-15 Samsung Electronics U K Ltd Electronic music on hand portable and communication enabled devices
JP4321476B2 (en) * 2005-03-31 2009-08-26 ヤマハ株式会社 Electronic musical instruments
JP4755472B2 (en) * 2005-09-29 2011-08-24 ヒタチグローバルストレージテクノロジーズネザーランドビーブイ Data transfer method and system
JP5399831B2 (en) * 2009-09-11 2014-01-29 株式会社コナミデジタルエンタテインメント Music game system, computer program thereof, and method of generating sound effect data
KR101081493B1 (en) * 2009-12-31 2011-11-08 주식회사 금영 Method of playing karaoke player with electronic device
CN101790056B (en) * 2010-03-18 2012-08-01 青岛海信电器股份有限公司 Method and television for outputting electronic music scores
JP5842383B2 (en) * 2011-05-16 2016-01-13 ヤマハ株式会社 Karaoke system and karaoke device
CN102800305A (en) * 2012-08-03 2012-11-28 中科英华湖州工程技术研究中心有限公司 System and method for auxiliary process of music creation playing
CN103258529B (en) 2013-04-16 2015-09-16 初绍军 A kind of electronic musical instrument, musical performance method
CN106652655B (en) * 2015-10-29 2019-11-26 施政 A kind of musical instrument of track replacement
CN106205577A (en) * 2016-09-07 2016-12-07 广州丰谱信息技术有限公司 A kind of there is spatial audio effect sense can the electronic musical instrument of flexible configuration loudspeaker array
CN106383448B (en) * 2016-10-27 2019-04-19 广东格兰仕集团有限公司 The more equipment linkages of intelligent appliance are performed music the control method of system
CN106548767A (en) * 2016-11-04 2017-03-29 广东小天才科技有限公司 Playing control method and device and playing musical instrument
CN106527718B (en) * 2016-11-09 2019-03-12 快创科技(大连)有限公司 Musical instrument auxiliary based on AR augmented reality is played and experiencing system is played by association
IT201600131975A1 (en) * 2016-12-29 2018-06-29 Third House Srls System and method of reproducing the sound of an orchestra
CN107358943B (en) * 2017-07-03 2020-02-07 武汉理工大学 Network virtual woodwind instrument
CN107452361B (en) * 2017-08-08 2020-07-07 腾讯音乐娱乐(深圳)有限公司 Song sentence dividing method and device
CN108076232B (en) * 2018-01-03 2020-08-04 上海传英信息技术有限公司 Music playing method and device based on mobile terminal
CN110379400B (en) * 2018-04-12 2021-09-24 森兰信息科技(上海)有限公司 Method and system for generating music score
JP7193831B2 (en) * 2018-05-24 2022-12-21 学校法人 関西大学 Score data generation model construction method, score data generator, score data generation method, and computer program
CN108766408A (en) * 2018-05-24 2018-11-06 广州音乐猫乐器科技有限公司 A kind of electronic musical instrument ensemble system and method
US10991349B2 (en) * 2018-07-16 2021-04-27 Samsung Electronics Co., Ltd. Method and system for musical synthesis using hand-drawn patterns/text on digital and non-digital surfaces
CN110070849A (en) * 2019-03-22 2019-07-30 福建星网视易信息***有限公司 Audio performance method and computer readable storage medium
CN110767031A (en) * 2019-10-28 2020-02-07 武强嘉华乐器有限公司 Music teaching platform of VR technique
CN110861086A (en) * 2019-11-20 2020-03-06 珠海格力智能装备有限公司 Control method and device for robot piano playing, storage medium and robot
CN111554250A (en) * 2020-04-26 2020-08-18 苏州缪斯谈谈科技有限公司 Automatic music score turning method, system, electronic equipment and computer readable storage medium
CN112652279A (en) * 2020-12-17 2021-04-13 广东爱乐社教育科技有限公司 Automatic electronic playing method, system, device, equipment and storage medium for music score
CN113539215B (en) * 2020-12-29 2024-01-12 腾讯科技(深圳)有限公司 Music style conversion method, device, equipment and storage medium
CN112669796A (en) * 2020-12-29 2021-04-16 西交利物浦大学 Method and device for converting music into music book based on artificial intelligence

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5858592A (en) * 1981-10-02 1983-04-07 ヤマハ株式会社 Music display
US5208421A (en) * 1990-11-01 1993-05-04 International Business Machines Corporation Method and apparatus for audio editing of midi files
JPH0572965A (en) * 1991-09-11 1993-03-26 Casio Comput Co Ltd Music device
JP3383108B2 (en) * 1995-02-24 2003-03-04 ヤマハ株式会社 Electronic musical instrument
JP3743024B2 (en) * 1995-06-26 2006-02-08 ヤマハ株式会社 Performance practice device
JP3489290B2 (en) * 1995-08-29 2004-01-19 ヤマハ株式会社 Automatic composer
JP3568326B2 (en) * 1996-07-22 2004-09-22 株式会社河合楽器製作所 Electronic musical instrument
JPH1124659A (en) * 1997-07-01 1999-01-29 Roland Corp Musical score display device
JP3933757B2 (en) * 1997-08-18 2007-06-20 アルパイン株式会社 Score display conversion method
JP2922509B2 (en) * 1997-09-17 1999-07-26 コナミ株式会社 Music production game machine, production operation instruction system for music production game, and computer-readable storage medium on which game program is recorded
JP3704980B2 (en) * 1997-12-17 2005-10-12 ヤマハ株式会社 Automatic composer and recording medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO0120594A1 *

Also Published As

Publication number Publication date
CN1379898A (en) 2002-11-13
JP2003509729A (en) 2003-03-11
AU7455400A (en) 2001-04-17
CN1269101C (en) 2006-08-09
WO2001020594A1 (en) 2001-03-22

Similar Documents

Publication Publication Date Title
EP1212747A1 (en) Method and apparatus for playing musical instruments based on a digital music file
US6975995B2 (en) Network based music playing/song accompanying service system and method
US10056062B2 (en) Systems and methods for the creation and playback of animated, interpretive, musical notation and audio synchronized with the recorded performance of an original artist
US7394012B2 (en) Wind instrument phone
JPH0643861A (en) Multimedia-system
US10140967B2 (en) Musical instrument with intelligent interface
WO2007073353A1 (en) Simultaneous sharing of system resources by multiple input devices
KR100320036B1 (en) Method and apparatus for playing musical instruments based on a digital music file
JP2001331175A (en) Device and method for generating submelody and storage medium
KR100819775B1 (en) Network based music playing/song accompanying service apparatus, system method and computer recordable medium
US7504572B2 (en) Sound generating method
WO2001093261A1 (en) Apparatus and method for providing song accompanying/music playing service using wireless terminal
US7030312B2 (en) System and methods for changing a musical performance
JP4483304B2 (en) Music score display program and music score display device
JP2003521005A (en) Device for displaying music using a single or several linked workstations
JP5969421B2 (en) Musical instrument sound output device and musical instrument sound output program
CN113096622A (en) Display method, electronic device, performance data display system, and storage medium
KR20060079094A (en) Musical composition system having portable music editing device and on-line singing room system operating method using the same
Menzies New performance instruments for electroacoustic music
Tomczak On the development of an interface framework in chipmusic: theoretical context, case studies and creative outcomes
JP2004354803A (en) Music playback device
CN118135974A (en) Method, apparatus, electronic device and computer readable storage medium for generating music
JP3837994B2 (en) Musical score data conversion apparatus and recording medium
Huber Midi
Tangible Products of Interest

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20020320

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

RIN1 Information on inventor provided before grant (corrected)

Inventor name: KIM, YUN-JONG

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20060401