EP3757984A1 - Elektronisches musikinstrument, verfahren und programm - Google Patents

Elektronisches musikinstrument, verfahren und programm Download PDF

Info

Publication number
EP3757984A1
EP3757984A1 EP20180044.8A EP20180044A EP3757984A1 EP 3757984 A1 EP3757984 A1 EP 3757984A1 EP 20180044 A EP20180044 A EP 20180044A EP 3757984 A1 EP3757984 A1 EP 3757984A1
Authority
EP
European Patent Office
Prior art keywords
waveform
output
data
difference
envelope
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP20180044.8A
Other languages
English (en)
French (fr)
Other versions
EP3757984B1 (de
Inventor
Hiroki Sato
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Casio Computer Co Ltd
Original Assignee
Casio Computer Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Casio Computer Co Ltd filed Critical Casio Computer Co Ltd
Publication of EP3757984A1 publication Critical patent/EP3757984A1/de
Application granted granted Critical
Publication of EP3757984B1 publication Critical patent/EP3757984B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/02—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos
    • G10H1/04—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation
    • G10H1/053—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation during execution only
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/02—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/02—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos
    • G10H1/04—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation
    • G10H1/053—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation during execution only
    • G10H1/057—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation during execution only by envelope-forming circuits
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/32—Constructional details
    • G10H1/34—Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments
    • G10H1/342—Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments for guitar-like instruments with or without strings and with a neck on which switches or string-fret contacts are used to detect the notes being played
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/18—Selecting circuits
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2230/00—General physical, ergonomic or hardware implementation of electrophonic musical tools or instruments, e.g. shape or architecture
    • G10H2230/045—Special instrument [spint], i.e. mimicking the ergonomy, shape, sound or other characteristic of a specific acoustic musical instrument category
    • G10H2230/075—Spint stringed, i.e. mimicking stringed instrument features, electrophonic aspects of acoustic stringed musical instruments without keyboard; MIDI-like control therefor
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2250/00—Aspects of algorithms or signal processing methods without intrinsic musical character, yet specifically adapted for or used in electrophonic musical processing
    • G10H2250/541—Details of musical waveform synthesis, i.e. audio waveshape processing from individual wavetable samples, independently of their origin or of the sound they represent
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H7/00—Instruments in which the tones are synthesised from a data store, e.g. computer organs
    • G10H7/02—Instruments in which the tones are synthesised from a data store, e.g. computer organs in which amplitudes at successive sample points of a tone waveform are stored in one or more memories

Definitions

  • the present disclosure relates to an electronic musical instrument, a method and a program.
  • An electronic musical instrument includes: means for inputting, based on a user operation on at least one operation element, first waveform data to a first wave generator and second waveform data to a second wave generator, wherein the second waveform data indicates positive/negative inversion data of a portion of the first waveform data exceeding a certain clipping level, so as to cause the first wave generator to output first output data and the second wave generator to output second output data; and means for generating addition data based on the first output data output from the first wave generator and the second output data output from the second wave generator.
  • FIG. 1A is a view for illustrating a contact sound that is generated in an acoustic piano.
  • FIG. 1B illustrates an output image diagram of a waveform that does not include a contact sound generated in the acoustic piano (Comparative Example), and an output image diagram of a waveform that includes the contact sound (first embodiment).
  • a level of sound i.e., an amplitude of a waveform upon the key release is controlled so as to change over time, in accordance with an envelope that reproduces an envelope of amplitudes of the string 130 upon the key release.
  • the change in contact sound over time as described above is not reproduced. Therefore, in an electronic musical instrument of the present embodiment, as shown in a lower drawing of FIG.
  • a threshold value envelope indicating threshold values of generation of the contact sound is set, and when an amplitude envelope of a waveform exceeds the threshold value envelope, amplitudes of the waveform are restricted, so that the contact sound is generated.
  • a distortion sound corresponding to a waveform of which amplitudes are restricted is generated as a sound that simulates the contact sound. For example, amplitudes of a waveform with respect to a sound upon the key release of the acoustic piano 100 are controlled so as to be largely restricted over time.
  • the distortion sound as the contact sound is controlled so as to be further emphasized as a time period k1, a time period k2, and a time period k3 progress, as shown in the lower drawing of FIG. 1B , for example (a difference value between a broken line value of the broken line indicative of the threshold value envelope and a solid line value of the solid line indicative of an amplitude envelope gradually increases as the time period k1, the time period k2, and the time period k3 progress, so that the amplitudes of the waveform are largely restricted over time and the contact sound that is the distortion sound is further emphasized over time). Therefore, it is possible to favorably reproduce the contact sound of the damper 120 and the string 130, which is generated upon the key release in the acoustic piano 100.
  • FIG. 2A is a view for illustrating a contact sound that is generated in a guitar.
  • FIG. 2B is an output image diagram of a waveform that does not include a contact sound generated in the guitar (Comparative Example), and an output image diagram of a waveform that includes the contact sound (second embodiment).
  • a contact sound is generated. More specifically, while the finger F presses the string 210, the contact sound is not generated because the string 210 vibrates about a fret 220 as a support point. However, when the finger F starts to move away from the fret 220, the support point of the string 210 moves from the fret 220 to the finger F, so that the string 210 vibrates about the finger F as a support point. When the string 210 comes into contact with the fret 220 or the like, the contact sound is generated.
  • the contact sound starts to be heard immediately after the string releases, unlike the acoustic piano 100. Then, as the amplitude of the string 210 becomes smaller over time or the finger F moves away from the fret 220, the contact sound becomes difficult to be heard.
  • a level of sound i.e., an amplitude of a waveform upon the key release is controlled so as to change over time, in accordance with an envelope that reproduces an envelope of amplitudes of the string 210 upon the key release. More specifically, the amplitude of the waveform is controlled so as to increase over time during a time period k4 immediately after the key release of the electronic musical instrument, i.e., immediately after the key release of the guitar 200, and to attenuate over time during time periods k5 and k6 thereafter, for example.
  • the threshold value envelope is set as shown in a lower drawing of FIG. 2B , for example.
  • the distortion sound as the contact sound is controlled so that it is emphasized over time during the time period k4 (because the difference value between the broken line value of the broken line and the solid line value of the solid line becomes gradually larger), is attenuated over time during the time period k5 (because the difference value between the broken line value of the broken line and the solid line value of the solid line becomes gradually smaller), and is not heard during the time period k6 (because the solid line value has not reached the broken line value).
  • FIG. 3 depicts an example of an outer shape of an electronic musical instrument in accordance with an embodiment of the present disclosure.
  • FIG. 4 is a block diagram depicting a hardware configuration of the electronic musical instrument.
  • FIG. 5 is a view for illustrating a normal waveform and a difference waveform.
  • an electronic musical instrument 300 includes a CPU (Central Processing Unit) 310, a RAM (Random Access Memory) 320, a ROM (Read Only Memory) 330, a switch panel 340, an LCD (liquid crystal monitor) 350, a keyboard 360, a sound source LSI (large-scale integration) 370, a D/A converter 380, an amplifier 385 and a timer counter 390.
  • the CPU 310, the RAM 320, the ROM 330 and the sound source LSI 370 are each connected to a bus 395.
  • the switch panel 340, the LCD 350 and the keyboard 360 are each connected to the bus 395 via each of an I/O interface 345, an LCD controller 355 and a key scanner 365.
  • the CPU 310 as a processor is configured to control the respective constituent elements and to execute a variety of calculation processing, in accordance with programs.
  • the RAM 320 is configured to temporarily store programs, data and the like, as a work area.
  • the ROM 330 as a memory has a program area and a data area, and stores a variety of programs, data and the like in advance.
  • the ROM 330 is configured to store a plurality of pieces of waveform data corresponding to multiple musical instrument sounds, as a waveform memory, for example.
  • the ROM 330 is configured to store first waveform data of a normal waveform and second waveform data (positive/negative inversion data) of a difference waveform as shown in FIG. 5 , with respect to a sound of a musical instrument that generates a contact sound of a string.
  • the normal waveform is a waveform corresponding to a usual musical instrument sound having intervals and not including a contact sound of a string.
  • the difference waveform is a waveform in which a portion exceeding a certain clipping level is cut out from the normal waveform and is made into an opposite phase, i.e., a sign (positive/negative) of the portion is inverted.
  • the difference waveform is generated in advance, based on a normal waveform and a clipping level set in accordance with an envelope of the normal waveform.
  • the clipping level may be set to a level obtained by multiplying a fixed ratio (for example, 90%) by a level indicated by the envelope of the normal waveform.
  • the method of setting the clipping level is not limited to the above example, and the clipping level may be varied over time, in accordance with a playing method, and the like.
  • the ROM 330 stores data of a normal waveform, and does not store data of a difference waveform.
  • the switch panel 340 includes a plurality of switches 341, and is configured to receive a user operation of pressing each of the plurality of switches 341.
  • the switch panel 340 includes the plurality of switches 341 corresponding to multiple musical instrument sounds, and receives a user operation of selecting a certain musical instrument sound from the multiple musical instrument sounds.
  • the I/O interface 345 is configured to monitor each of the plurality of switches 341 of the switch panel 340, and, when it is detected that each of the plurality of switches 341 is pressed, notifies the detection to the CPU 310.
  • the LCD 350 is configured to display a variety of information.
  • the LCD controller 355 is an IC (integrated circuit) configured to control the LCD 350.
  • the keyboard 360 has a plurality of keys 361 as operation elements, and is configured to receive user operations of pressing and releasing the keys, as a user operation.
  • Each of the plurality of keys 361 is configured to operate at one end of a leaf spring or the like, as a support point, and may include a plurality of switches (contact points) that is sequentially turned on or off by the key pressing or the key release.
  • the key scanner 365 is configured to monitor each of the plurality of keys 361 of the keyboard 360, and to detect whether each of the plurality of keys 361 is pressed or released.
  • the key scanner 365 detects and notifies, to the CPU 310, a key number (note number) of the pressed key 361, and a velocity upon the key pressing corresponding to a key pressing speed.
  • the key scanner 365 detects and notifies, to the CPU 310, a key number of the released key 361, and a velocity upon the key release corresponding to a key release speed.
  • the key scanner 365 may detect the velocity upon the key pressing or upon the key release by measuring a difference between times at which at least two switches of each of the plurality of keys 361 are detected to be on or off.
  • the sound source LSI 370 as a processor adopts a well-known waveform memory reading method, and is configured to read out and process waveform data corresponding to a musical instrument sound selected by the user from the ROM 330, and to output the same to the D/A converter 380.
  • the sound source LSI 370 will be described later in detail with reference to FIG. 5 .
  • the D/A converter 380 is configured to convert digital waveform data output from the sound source LSI 370 into analog waveform signals, and to output the same to the amplifier 385.
  • the amplifier 385 is configured to amplify the analog waveform signals output from the D/A converter 380, and to output the same to a speaker, an output terminal or the like (not shown).
  • the timer counter 390 includes a counter configured to increment a value every 1 ⁇ sec, for example, and is configured to measure time.
  • the electronic musical instrument 300 may include a constituent element, in addition to the above-described constituent elements, and may not include some of the above-described constituent elements.
  • FIG. 6 is a block diagram depicting a schematic configuration of the sound source LSI.
  • FIG. 7 is a view for illustrating addition processing of the normal waveform and the difference waveform.
  • the sound source LSI 370 includes a plurality of generator sections 371 (for example, corresponding to 256 channels), and a generator mixer 372 configured to mix waveform data that is output from each of the generator sections 371.
  • Each of the generator sections 371 includes a normal channel (also referred to as a normal system or a first system) 373 including a normal waveform generator (first waveform generator) 3731, a normal waveform filter 3732, a normal waveform amplifier (first waveform amplifier) 3733 and the like, a difference channel (also referred to as a difference system or a second system) 374 including a difference waveform generator (second waveform generator) 3741, a difference waveform filter 3742, a difference waveform amplifier (second waveform amplifier) 3743 and the like, and a section mixer 375 configured to mix (add) waveform data (also referred to as "output data”) in each channel.
  • a normal channel also referred to as a normal system or a first system
  • a difference channel also referred to
  • each of the generator sections 371 further includes a normal waveform filter envelope generator 3734, a normal waveform amplifier envelope generator 3735, an envelope detector 3736, a difference waveform filter envelope generator 3744, an envelope comparison unit 3745 and a threshold value envelope generator 3746 for controlling each of the constituent elements.
  • the envelope generator is also denoted as "EG".
  • the normal waveform generator 3731 is configured to read out, from the ROM 330, normal waveform data corresponding to a musical instrument sound selected by the user at a reading speed corresponding to the key number of the pressed key 361, and to generate normal waveform data corresponding to the key number.
  • the normal waveform filter 3732 is configured to control a quality of sound corresponding to the normal waveform data, in accordance with a filter envelope generated by the normal waveform filter EG 3734 and indicating a temporal change in a cutoff frequency of a filter (for example, a low-pass filter).
  • the normal waveform amplifier 3733 is configured to control a level of sound corresponding to the normal waveform data, i.e., an amplitude of the normal waveform, in accordance with an amplifier envelope generated by the normal waveform amplifier EG 3735 and indicating a temporal change in a volume of sound (level). That is, the normal waveform data is input to the normal waveform generator 3731, and is output from the normal waveform amplifier 3733.
  • the envelope detector 3736 includes an absolute value circuit (full wave rectification circuit), a low-pass filter and the like, and is configured to detect an amplitude envelope of a waveform indicated by the normal waveform data output from the normal waveform amplifier 3733.
  • the difference waveform generator 3741 is configured to read out, from the ROM 330, difference waveform data corresponding to a musical instrument sound selected by the user at a reading speed corresponding to the key number of the pressed key 361, and to generate difference waveform data corresponding to the key number.
  • the difference waveform generator 3741 is configured to read out the difference waveform data at a timing that is synchronous with the reading timing of the normal waveform data.
  • the difference waveform filter 3742 is configured to control a quality of sound corresponding to the difference waveform data, in accordance with a filter envelope generated by the difference waveform filter EG 3744.
  • the difference waveform amplifier 3743 is configured to control a level of sound corresponding to the difference waveform data, in accordance with an amplifier envelope output by the envelope comparison unit 3745.
  • the envelope comparison unit 3745 is configured to output an amplifier envelope (multiplication coefficient) of the difference waveform, based on a comparison result of the amplitude envelope of the normal waveform detected by the envelope detector 3736 and a threshold value envelope generated by the threshold EG 3746. Therefore, it can be said that an output value of the difference waveform amplifier 3743 is a value in which a shape of the difference waveform is adjusted based on the difference between the envelopes. In other words, it can be said that a waveform of output values when the difference of the comparison result is a second difference larger than a first difference is adjusted so that it is larger than a waveform when the difference of the comparison result is the first difference.
  • the threshold EG 3746 is configured to generate a threshold value envelope indicating a temporal change in threshold value that is determined in accordance with a musical instrument sound selected by the user, as shown in FIGS. 1B and 2B .
  • the envelope comparison unit 3745 is configured to output an amplifier envelope (multiplication coefficient) indicating a temporal change in level (difference) that is obtained by subtracting a level of the threshold value envelope generated by the threshold EG 3746 from a level of the amplitude envelope of the normal waveform detected by the envelope detector 3736. Therefore, as the level obtained by the subtraction is larger, the envelope comparison unit 3745 outputs an amplifier envelope having a larger level. Thereby, as shown in FIGS.
  • the envelope comparison unit 3745 may output an amplifier envelope of which a value of a level is zero.
  • the multiplication coefficient becomes zero, so that the difference waveform is not output from the difference waveform amplifier 3743.
  • the normal waveform output from the normal waveform amplifier 3733 is output from the section mixer 375, as it is.
  • the multiplication coefficient approximates to 1 from 0, and a shape of the difference waveform output from the difference waveform amplifier 3743 approximates to a shape of the stored difference waveform.
  • a waveform having such a shape that a waveform of the portions of the normal waveform exceeding the clipping level is slightly changed so as to approximate to the clipping level as the multiplication coefficient approximates to 1 from 0 is output from the section mixer 375.
  • a shape of the difference waveform that is output from the difference waveform amplifier 3743 becomes the same as the shape of the stored difference waveform, and a waveform having such a shape that the portions of the normal waveform exceeding the clipping level are clipped is output from the section mixer 375.
  • an amplitude of a waveform at a boundary between time periods k4 and k5 in which the difference value between the envelope and the clipping level is large is located on a broken line-side between the solid line value and the broken line value.
  • an amplitude of a waveform at a boundary between time periods k5 and k6 in which the difference value between the envelope and the clipping level is small is located on the solid line-side between the solid line value and the broken line value.
  • the multiplication coefficient may also be a value larger than 1.0.
  • the number of simultaneous tones may be restricted to 128 from 256.
  • Each of the EGs 3734, 3735, 3744 and 3746 as described above is configured to generate each envelope as shown in FIGS. 8A and 8B , based on parameters relating to each envelope and supplied from the CPU 310, upon the key pressing and upon the key release.
  • the parameters include a parameter relating to target levels L0 to L4, a parameter relating to rates R1 to R4 for reaching the target levels, and the like.
  • each of the EGs 3734, 3735, 3744 and 3746 may be supplied with a parameter corresponding to a velocity from the CPU 310 or may generate each envelope corresponding to the velocity.
  • each of the EGs 3734, 3735, 3744 and 3746 may be supplied, from the CPU 310, with parameters including a release rate R4 of which gradient is set gentler as a value of the velocity is smaller, i.e., a key release speed is lower.
  • the section mixer 375 is configured to mix a normal waveform indicated by the normal waveform data output from the normal waveform amplifier 3733 and a difference waveform indicated by the difference waveform data output from the difference waveform amplifier 3743.
  • the section mixer 375 outputs data (addition data) of a waveform (added waveform) obtained by adding the normal waveform and the difference waveform, for example, as shown in FIG. 7 .
  • the section mixer 375 can output the data of the added waveform corresponding to the distortion sound as a sound that simulates the contact sound.
  • the section mixer 375 is configured to output, as waveform data reproducing a virtual clipping, data of the added waveform obtained by adding portions of the normal waveform and a difference waveform corresponding to portions of the normal waveform exceeding a certain clipping level.
  • the amplitudes of the normal waveform and the difference waveform are respectively controlled, in accordance with the amplifier envelope generated by the normal waveform amplifier EG 3735 and the amplifier envelope output by the envelope comparison unit 3745, as described above. Therefore, an addition ratio of the normal waveform and the difference waveform in the section mixer 375 is also controlled in accordance with the envelopes, and the addition ratio is controlled, so that data of the added waveform including various clipping shapes is output, as shown in FIG. 7 . For example, when the addition ratio is 1:1, data of the added waveform in which the amplitude is favorably restricted in the clipping level is output.
  • the addition ratio is smaller than 1:1 (namely, the addition ratio of the difference waveform to the normal waveform is smaller than 1)
  • data of the added waveform in which a degree of distortion is smaller is output.
  • the added waveform may be a waveform corresponding to a modest contact sound such as a sound that is generated when the soft damper 120 comes into contact with the string 130 in the acoustic piano 100 as shown in FIG. 1A .
  • the addition ratio is larger than 1:1 (namely, the addition ratio of the difference waveform to the normal waveform is larger than 1)
  • data of the added waveform in which a degree of distortion is larger is output.
  • the added waveform may be a waveform corresponding to a contact sound in which higher harmonics are emphasized, such as a sound that is generated when the string 210 comes into contact with the rigid metal fret 220 in the guitar 200 as shown in FIG. 2A .
  • the addition ratio of the normal waveform and the difference waveform may be controlled in the section mixer 375, instead of the threshold value envelope or in addition to the threshold value envelope.
  • the operation of the threshold EG 3746 may be stopped, and an amplifier envelope that is similar to the amplitude envelope of the normal waveform detected by the envelope detector 3736 may be output by the envelope comparison unit 3745.
  • the ratio of the normal waveform and the difference waveform that are input to the section mixer 375 is controlled to a value close to 1:1.
  • the addition ratio of the normal waveform data and the difference waveform data may be adjusted to a setting value of the addition ratio supplied from the CPU 310.
  • the addition ratio can be controlled by the simpler method than a method of individually controlling each of the EGs 3735 and 3746 and the like.
  • a rough addition ratio of the normal waveform and the difference waveform may be set as a fixed ratio, and a slight variation in the addition ratio over time may be reproduced by each of the EGs 3735 and 3746 and the like.
  • the section mixer 375 may be supplied, from the CPU 310, with a setting value of the addition ratio corresponding to a velocity, and may adjust the addition ratio of the normal waveform and the difference waveform to the setting value of the addition ratio corresponding to a velocity.
  • the sound source LSI 370 may be configured to implement functions, in addition to the above-described functions, and may also be configured not to implement some of the above-described functions.
  • each of the waveform generators 3731 and 3741 may be configured to execute loop processing of repeatedly reading out each waveform data from the ROM 330, thereby generating each waveform data corresponding to a sustained sound.
  • the generator mixer 372 may be supplied, from the CPU 310, with a setting value of a level corresponding to a velocity or may adjust a value of a level of sound corresponding to each waveform data output from each generator section 371 to the setting value of a level corresponding to a velocity.
  • FIGS. 8A to 8C depict examples of an envelope that is generated for an acoustic piano sound.
  • the normal waveform filter EG 3734 and the difference waveform filter EG 3744 generate a filter envelope as shown in FIG. 8A
  • the normal waveform amplifier EG 3735 generates an amplifier envelope as shown in FIG. 8B
  • the threshold value EG 3746 generates a threshold value envelope as shown in FIG. 8C .
  • a value of the threshold value envelope upon the key pressing is set to 1.0 that is the maximum value, so that the contact sound is not generated upon the key pressing. Also, a value of the threshold value envelope upon the key release is set smaller over time, so that the contact sound can be easily heard over time.
  • the addition ratio of the normal waveform and the difference waveform may be controlled in the section mixer 375, and the addition ratio of the normal waveform and the difference waveform in the section mixer 375 may be set to about 1:0.6.
  • the normal waveform filter EG 3734 and the difference waveform filter EG 3744 generate a filter envelope as shown in FIG. 9A
  • the normal waveform amplifier EG 3735 generates an amplifier envelope as shown in FIG. 9B
  • the threshold value EG 3746 generates a threshold value envelope as shown in FIG. 9C .
  • a value of the threshold value envelope upon the key pressing is set smaller than a value of the normal waveform amplifier envelope during a certain time period immediately after the key is pressed, so that the contact sound is generated upon the key release and during a certain time period when pressing the key.
  • a value of the threshold value envelope upon the key release is set to the minimum value immediately after the key release, and increases toward 1.0 that is the maximum value. Thereby, the contact sound is difficult to be heard over time.
  • the addition ratio of the normal waveform and the difference waveform may be controlled in the section mixer 375, and the addition ratio of the normal waveform and the difference waveform in the section mixer 375 may be set to about 1:1.5.
  • FIG. 10 is a flowchart depicting a sequence of processing that is executed by the CPU.
  • FIG. 11 is a subroutine flowchart depicting a sequence of sound source LSI control processing of step S108 in FIG. 10 .
  • Algorithms shown in each flowchart are stored as programs in the ROM 330 or the like, and are executed by the CPU 310.
  • the CPU 310 when a power supply becomes on, the CPU 310 first executes initialization processing on each constituent element of the electronic musical instrument 300 (step S101). Then, the CPU 310 executes user interface processing (UI processing) of displaying a variety of information on the LCD 350 or receiving a user operation via the switch panel 340 (step S 102). For example, the CPU 310 receives a user operation of selecting a certain musical instrument sound from the multiple musical instrument sounds, via the switch panel 340.
  • UI processing user interface processing
  • the CPU 310 determines whether the user has performed the key pressing (step S103).
  • the CPU 310 executes key pressing processing (also referred to as "sound producing processing” or "note-on processing") (step S104).
  • the key pressing processing includes processing of acquiring a key number and a velocity of the key 361 on which the key pressing has been performed, processing of assigning the generator section 371, and the like, for example.
  • the key pressing processing includes control processing for causing the sound source LSI 370 to execute initialization and operation start of each of the waveform generators 3731 and 3741 in the assigned generator section 371, readout of the waveform data in each of the waveform generators 3731 and 3741 of which operations have started, initialization of each of the EGs 3734, 3735, 3744 and 3746, and the like.
  • the operation of each of the EGs 3734, 3735, 3744 and 3746 is automatically started in EG steady processing of step S107, which will be described later.
  • step S103 NO
  • the CPU 310 proceeds to processing of step S105.
  • the CPU 310 determines whether the user has performed the key release (step S105).
  • step S105: YES the CPU 310 executes key release processing (also referred to as “silencing processing ", "sound muffling processing” or “note-off processing") (step S106).
  • the key release processing includes processing of acquiring a key number and a velocity of the key 361 on which the key release has been performed, control processing of each of the EGs 3734, 3735, 3744 and 3746, and the like, for example. That is, the CPU 310 executes, as the key release processing, processing of shifting each of the EGs 3734, 3735, 3744 and 3746 to a release state, for example.
  • step S105: NO the CPU 310 proceeds to processing of step S107.
  • the CPU 310 executes EG steady processing (step S107). More specifically, the CPU 310 supplies parameters corresponding to the selected musical instrument sound and the current state to each of the EGs 3734, 3735, 3744 and 3746, thereby executing processing of generating envelopes. Then, the CPU 310 executes sound source LSI control processing (step S108). The sound source LSI control processing will be described later in detail with reference to FIG. 11 .
  • the CPU 310 determines whether a value counted by the timer counter 390 is equal to or greater than 1000 ⁇ sec, i.e., 1ms (step S109). When it is determined that the counted value is not equal to or greater than 1000 ⁇ sec, i.e., is less than 1000 ⁇ sec (step S109: NO), the CPU 310 stands by until the counted value becomes equal to or greater than 1000 ⁇ sec. On the other hand, when it is determined that the counted value is equal to or greater than 1000 ⁇ sec (step S109: YES), the CPU 310 subtracts 1000 ⁇ sec from the value counted by the timer counter 390 (step S110), and returns to the processing of step S102. That is, the CPU 310 executes the processing of step S109 and S110 so as to execute the processing from step S102 to S108 every 1000 ⁇ sec on average.
  • step S108 the sound source LSI control processing of step S108 is described in detail.
  • the CPU 310 controls the sound source LSI 370 to execute processing from step S201 to S206 shown in FIG. 11 .
  • the filter envelope generated by the difference waveform filter EG 3744 is set in the difference waveform filter 3742 (step S201). Also, the amplifier envelope output by the envelope comparison unit 3745 is set in the difference waveform amplifier 3743 (step S202). Also, the filter envelope generated by the normal waveform filter EG 3734 is set in the normal waveform filter 3732 (step S203), and the amplifier envelope generated by the normal waveform amplifier EG 3735 is set in the normal waveform amplifier 3733 (step S204).
  • step S205 it is determined whether both a value of the amplifier envelope generated by the normal waveform amplifier EG 3735 and a value of the amplifier envelope output by the envelope comparison unit 3745 have reached zero and the operations of both the normal waveform amplifier 3733 and the difference waveform amplifier 3743 have stopped.
  • step S205 When it is determined that the operations of both the amplifiers 3733 and 3743 have stopped (step S205: YES), the operations of the normal waveform generator 3731 and the difference waveform generator 3741 are also stopped (step S206), and the sound source LSI control processing is over. On the other hand, when it is determined that the operations of both the amplifiers 3733 and 3743 have not stopped (step S205: NO), the sound source LSI control processing is over.
  • the present embodiment achieves following effects.
  • the electronic musical instrument 300 outputs the data of the added waveform obtained by adding the normal waveform and the difference waveform corresponding to the portions of the normal waveform exceeding a certain clipping level. Thereby, the electronic musical instrument 300 can reproduce the contact sound of the string that is generated in the musical instrument with strings and changes over time and in accordance with a playing method and the like simply by executing the addition processing that is relatively simple signal processing.
  • the difference waveform is a waveform in which a sign of the portions of the normal waveform exceeding a certain clipping level is inverted.
  • the electronic musical instrument 300 can add the normal waveform and the difference waveform corresponding to the portions of the normal waveform exceeding a certain clipping level and can output the data of the added waveform in which a virtual clipping is reproduced.
  • the output value of the difference waveform amplifier 3743 is adjusted, based on the difference between the amplitude envelope of the normal waveform detected by the envelope detector 3736 and the threshold value envelope generated by the threshold EG 3746.
  • the electronic musical instrument 300 can favorably reproduce the contact sound that changes in accordance with movement of actual strings in a musical instrument with strings.
  • the threshold value indicated by the threshold value envelope is determined, in accordance with the musical instrument sound selected by the user. Thereby, the electronic musical instrument 300 can favorably reproduce the contact sound that is different for each musical instrument.
  • the normal waveform and the difference waveform are added with a certain ratio.
  • the electronic musical instrument 300 can output the data of the added waveform including various clipping shapes.
  • the addition ratio of the normal waveform and the difference waveform when the guitar sound is selected from the multiple musical instrument sounds is set larger than the addition ratio when the acoustic piano sound is selected.
  • the electronic musical instrument 300 can favorably reproduce the contact sound of the soft damper 120 coming into contact with the string 130 in the acoustic piano 100 and the contact sound of the string 210 coming into contact with the rigid metal fret 220 in the guitar 200.
  • the difference waveform data is generated in advance and is stored in the ROM 330.
  • the difference waveform data may not be stored in the ROM 330.
  • the difference waveform data may be generated based on the normal waveform data.
  • the parameter, the setting value and the like corresponding to the velocity are supplied from the CPU 310 to the sound source LSI 370.
  • a parameter, a setting value and the like corresponding to an element other than the velocity may be supplied to the sound source LSI 370.
  • the element other than the velocity after-touch that can be detected by a pressure sensor or the like may be exemplified.
  • the processing shown in FIG. 10 is executed by the CPU 310. However, at least some of the processing shown in FIG. 10 may be executed by the sound source LSI 370.
  • the contact sounds that are generated in the acoustic piano 100 and the guitar 200 are reproduced in the electronic musical instrument 300.
  • contact sounds that are generated in other musical instruments with strings may also be reproduced.
  • folk musical instruments such as sitar having a contact plate (bridge), a fretless bass, and the like may be exemplified.
  • the electronic musical instrument 300 may control so that a value of a level obtained by subtracting a level of the threshold value envelope from a level of the amplitude envelope is a positive value for a long time.
  • the contact sounds that are generated in the musical instruments with strings are reproduced in the electronic musical instrument 300.
  • the contact sounds may be reproduced in other instruments.
  • a PC and the like that are used for music production may be exemplified.
  • the present disclosure is not limited to the above-described embodiment, and can be diversely modified without departing from the gist thereof, in the implementation phase.
  • the functions that are executed in the above-described embodiment may be implemented with being combined appropriately as much as possible.
  • the above-described embodiment includes inventions of diverse stages, and various inventions can be extracted by combining appropriately a plurality of constituent elements disclosed in the embodiment. For example, even if some constituent elements are omitted from all the constituent elements disclosed in the embodiment, the resultant configuration can be extracted as an invention, inasmuch as the effects can be achieved.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)
EP20180044.8A 2019-06-27 2020-06-15 Elektronisches musikinstrument, verfahren und programm Active EP3757984B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2019120368A JP6922943B2 (ja) 2019-06-27 2019-06-27 電子楽器、方法およびプログラム

Publications (2)

Publication Number Publication Date
EP3757984A1 true EP3757984A1 (de) 2020-12-30
EP3757984B1 EP3757984B1 (de) 2022-11-30

Family

ID=71096612

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20180044.8A Active EP3757984B1 (de) 2019-06-27 2020-06-15 Elektronisches musikinstrument, verfahren und programm

Country Status (3)

Country Link
EP (1) EP3757984B1 (de)
JP (1) JP6922943B2 (de)
CN (1) CN112150990A (de)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR200445730Y1 (ko) * 2009-03-13 2009-08-27 주식회사 거성토건 하수관로 생활악취 제거장치

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5147970A (en) * 1989-08-11 1992-09-15 Casio Computer Co., Ltd. Electronic musical instrument for generating musical tones on the basis of characteristics of input waveform signal
US20080245213A1 (en) * 2006-10-19 2008-10-09 Gen Izumisawa Music sound generator
US20090080677A1 (en) * 2007-09-24 2009-03-26 Webster Stephen P Stringed instrument with simulator preamplifier
JP2011154394A (ja) 2011-04-05 2011-08-11 Kawai Musical Instr Mfg Co Ltd 楽音発生装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02267595A (ja) * 1989-04-10 1990-11-01 Matsushita Electric Ind Co Ltd 楽音合成装置
JPH056174A (ja) * 1991-06-27 1993-01-14 Yamaha Corp 楽音信号発生装置
JPH0944162A (ja) * 1995-07-28 1997-02-14 Kawai Musical Instr Mfg Co Ltd 楽音信号発生装置及び楽音信号発生方法
JP3642013B2 (ja) * 2000-08-08 2005-04-27 ヤマハ株式会社 非線形歪付加装置
JP6806120B2 (ja) * 2018-10-04 2021-01-06 カシオ計算機株式会社 電子楽器、楽音発生方法及びプログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5147970A (en) * 1989-08-11 1992-09-15 Casio Computer Co., Ltd. Electronic musical instrument for generating musical tones on the basis of characteristics of input waveform signal
US20080245213A1 (en) * 2006-10-19 2008-10-09 Gen Izumisawa Music sound generator
US20090080677A1 (en) * 2007-09-24 2009-03-26 Webster Stephen P Stringed instrument with simulator preamplifier
JP2011154394A (ja) 2011-04-05 2011-08-11 Kawai Musical Instr Mfg Co Ltd 楽音発生装置

Also Published As

Publication number Publication date
EP3757984B1 (de) 2022-11-30
CN112150990A (zh) 2020-12-29
JP2021005062A (ja) 2021-01-14
JP6922943B2 (ja) 2021-08-18

Similar Documents

Publication Publication Date Title
US6018118A (en) System and method for controlling a music synthesizer
US11222618B2 (en) Sound signal generation device, keyboard instrument, and sound signal generation method
US8106287B2 (en) Tone control apparatus and method using virtual damper position
JP2004251926A (ja) 電子楽器
EP3757984A1 (de) Elektronisches musikinstrument, verfahren und programm
EP3882905A1 (de) Elektronisches musikinstrument, elektronisches tastenmusikinstrument und verfahren zur erzeugung eines musiktons
JP2020060630A (ja) 音信号発生装置、音信号発生方法および音信号発生プログラム
EP3373289A1 (de) Elektronisches musikinstrument, musiktonerzeugungsverfahren und speichermedium
EP3757985A1 (de) Elektronisches musikinstrument, verfahren und programm
US5434348A (en) Electronic keyboard instrument
JP4238807B2 (ja) 音源用波形データの決定装置
JP7332002B2 (ja) 電子楽器、方法及びプログラム
JP5600968B2 (ja) 自動演奏装置および自動演奏プログラム
JP7172423B2 (ja) 電子鍵盤楽器、方法およびプログラム
JP4186855B2 (ja) 楽音制御装置及びプログラム
JP3996987B2 (ja) 電子楽器
JP3182098B2 (ja) 電子楽器
JP3620405B2 (ja) 楽音変動情報生成方法、楽音変動情報生成装置および記録媒体
JP3231896B2 (ja) 電子楽器
JP2016045254A (ja) サウンドプレビュー装置及びプログラム
JP3716701B2 (ja) 発音チャンネル割り当て方法及び装置
JP4048913B2 (ja) エンベロープ編集装置およびエンベロープ編集のプログラム
JP2684791B2 (ja) 楽音制御用波形信号発生装置
JP4066176B2 (ja) 発音条件設定装置及び発音条件設定プログラム
JP2006133342A (ja) 楽音制御装置および楽音制御処理のプログラム

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200615

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G10H 1/18 20060101ALN20220519BHEP

Ipc: G10H 7/02 20060101ALN20220519BHEP

Ipc: G10H 1/34 20060101ALI20220519BHEP

Ipc: G10H 1/053 20060101ALI20220519BHEP

Ipc: G10H 1/057 20060101AFI20220519BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: G10H 1/18 20060101ALN20220602BHEP

Ipc: G10H 7/02 20060101ALN20220602BHEP

Ipc: G10H 1/34 20060101ALI20220602BHEP

Ipc: G10H 1/053 20060101ALI20220602BHEP

Ipc: G10H 1/057 20060101AFI20220602BHEP

RIC1 Information provided on ipc code assigned before grant

Ipc: G10H 1/18 20060101ALN20220603BHEP

Ipc: G10H 7/02 20060101ALN20220603BHEP

Ipc: G10H 1/34 20060101ALI20220603BHEP

Ipc: G10H 1/053 20060101ALI20220603BHEP

Ipc: G10H 1/057 20060101AFI20220603BHEP

INTG Intention to grant announced

Effective date: 20220624

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1535281

Country of ref document: AT

Kind code of ref document: T

Effective date: 20221215

Ref country code: DE

Ref legal event code: R096

Ref document number: 602020006564

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20221130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230331

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230228

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1535281

Country of ref document: AT

Kind code of ref document: T

Effective date: 20221130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230330

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230510

Year of fee payment: 4

Ref country code: DE

Payment date: 20230502

Year of fee payment: 4

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602020006564

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20230831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230615

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230615

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230615

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230615

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221130

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230630