EP3586328B1 - Augmented acoustic music instrument with feedforward and feedback actuators . - Google Patents
Augmented acoustic music instrument with feedforward and feedback actuators . Download PDFInfo
- Publication number
- EP3586328B1 EP3586328B1 EP17793990.7A EP17793990A EP3586328B1 EP 3586328 B1 EP3586328 B1 EP 3586328B1 EP 17793990 A EP17793990 A EP 17793990A EP 3586328 B1 EP3586328 B1 EP 3586328B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- radiating structure
- transfer function
- sound
- feedback
- actuator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003190 augmentative effect Effects 0.000 title 1
- 230000000694 effects Effects 0.000 claims description 39
- 238000012546 transfer Methods 0.000 claims description 35
- 238000000034 method Methods 0.000 claims description 23
- 238000012545 processing Methods 0.000 claims description 17
- 230000008859 change Effects 0.000 claims description 7
- 230000004913 activation Effects 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 3
- 230000003213 activating effect Effects 0.000 claims 1
- 230000006870 function Effects 0.000 description 30
- 230000009466 transformation Effects 0.000 description 10
- 238000013459 approach Methods 0.000 description 8
- 238000005259 measurement Methods 0.000 description 8
- 230000004048 modification Effects 0.000 description 8
- 238000012986 modification Methods 0.000 description 8
- 238000013016 damping Methods 0.000 description 7
- 238000004422 calculation algorithm Methods 0.000 description 6
- 230000005284 excitation Effects 0.000 description 6
- 238000000844 transformation Methods 0.000 description 6
- 241000251556 Chordata Species 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 238000003199 nucleic acid amplification method Methods 0.000 description 4
- 230000003321 amplification Effects 0.000 description 3
- ALEXXDVDDISNDU-JZYPGELDSA-N cortisol 21-acetate Chemical compound C1CC2=CC(=O)CC[C@]2(C)[C@@H]2[C@@H]1[C@@H]1CC[C@@](C(=O)COC(=O)C)(O)[C@@]1(C)C[C@@H]2O ALEXXDVDDISNDU-JZYPGELDSA-N 0.000 description 3
- 241001342895 Chorus Species 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- HAORKNGNJCEJBX-UHFFFAOYSA-N cyprodinil Chemical compound N=1C(C)=CC(C2CC2)=NC=1NC1=CC=CC=C1 HAORKNGNJCEJBX-UHFFFAOYSA-N 0.000 description 2
- 230000005520 electrodynamics Effects 0.000 description 2
- 235000021183 entrée Nutrition 0.000 description 2
- 238000002347 injection Methods 0.000 description 2
- 239000007924 injection Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000001131 transforming effect Effects 0.000 description 2
- 239000002033 PVDF binder Substances 0.000 description 1
- 230000003416 augmentation Effects 0.000 description 1
- 239000000919 ceramic Substances 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- RDYMFSUJUZBWLH-UHFFFAOYSA-N endosulfan Chemical compound C12COS(=O)OCC2C2(Cl)C(Cl)=C(Cl)C1(Cl)C2(Cl)Cl RDYMFSUJUZBWLH-UHFFFAOYSA-N 0.000 description 1
- UPCIBFUJJLCOQG-UHFFFAOYSA-L ethyl-[2-[2-[ethyl(dimethyl)azaniumyl]ethyl-methylamino]ethyl]-dimethylazanium;dibromide Chemical compound [Br-].[Br-].CC[N+](C)(C)CCN(C)CC[N+](C)(C)CC UPCIBFUJJLCOQG-UHFFFAOYSA-L 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000010363 phase shift Effects 0.000 description 1
- 229920002981 polyvinylidene fluoride Polymers 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/02—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos
- G10H1/04—Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation
- G10H1/043—Continuous modulation
- G10H1/045—Continuous modulation by electromechanical means
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/46—Volume control
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H3/00—Instruments in which the tones are generated by electromechanical means
- G10H3/12—Instruments in which the tones are generated by electromechanical means using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument
- G10H3/22—Instruments in which the tones are generated by electromechanical means using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument using electromechanically actuated vibrators with pick-up means
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10D—STRINGED MUSICAL INSTRUMENTS; WIND MUSICAL INSTRUMENTS; ACCORDIONS OR CONCERTINAS; PERCUSSION MUSICAL INSTRUMENTS; AEOLIAN HARPS; SINGING-FLAME MUSICAL INSTRUMENTS; MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR
- G10D1/00—General design of stringed musical instruments
- G10D1/04—Plucked or strummed string instruments, e.g. harps or lyres
- G10D1/05—Plucked or strummed string instruments, e.g. harps or lyres with fret boards or fingerboards
- G10D1/08—Guitars
- G10D1/085—Mechanical design of electric guitars
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/155—Musical effects
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/155—Musical effects
- G10H2210/265—Acoustic effect simulation, i.e. volume, spatial, resonance or reverberation effects added to a musical sound, usually by appropriate filtering or delays
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/461—Transducers, i.e. details, positioning or use of assemblies to detect and convert mechanical vibrations or mechanical strains into an electrical signal, e.g. audio, trigger or control signal
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/461—Transducers, i.e. details, positioning or use of assemblies to detect and convert mechanical vibrations or mechanical strains into an electrical signal, e.g. audio, trigger or control signal
- G10H2220/525—Piezoelectric transducers for vibration sensing or vibration excitation in the audio range; Piezoelectric strain sensing, e.g. as key velocity sensor; Piezoelectric actuators, e.g. key actuation in response to a control voltage
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H3/00—Instruments in which the tones are generated by electromechanical means
- G10H3/12—Instruments in which the tones are generated by electromechanical means using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument
- G10H3/24—Instruments in which the tones are generated by electromechanical means using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument incorporating feedback means, e.g. acoustic
- G10H3/26—Instruments in which the tones are generated by electromechanical means using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument incorporating feedback means, e.g. acoustic using electric feedback
Definitions
- the present invention relates to a processing of acoustic data picked up on a musical instrument having an acoustically radiating structure. More specifically, provision is made to supply one or more actuators of the radiating structure of the instrument with a signal generated from the acoustic data captured and processed, with a view to enriching the vibratory properties and in particular the sound resulting from the instrument with desired sound effects (echo, reverb, distortion, equalization, etc.).
- desired sound effects echo, reverb, distortion, equalization, etc.
- string musical instruments have a radiating structure (soundboard and possibly sound box) coupled to a bridge carrying the strings. It is then proposed in the context of the present invention to cause the radiating structure to resonate with a particular effect, in addition to the playing of the musician. For example in the case of an echo (or "delay" in English), the musician plays a note which the radiating structure amplifies and diffuses, but in addition, one or more actuators acting on the radiating structure then apply a vibration to the structure to replay this note at regular time intervals with a decrease in amplitude to simulate the echo effect.
- a radiating structure soundboard and possibly sound box
- WO 2016/209143 A1 describes a method and process for determining the parameters of a control algorithm to synthesize and generate a variety of sounds and vibrations not normally available on a stringed instrument.
- WO 97/12359 A1 describes a hybrid active vibration attenuation technique for noise canceling headphones.
- WO 2016/209143 A1 And WO 97/12359 A1 do not, however, describe the aforementioned transformations of the signal.
- the radiating structure of the instrument itself (typically the CAI resonance box of a guitar for example), is used as a "diffuser” or "high- speaker” of the sound signal transformed by a device DEV of the “effects pedalboard” type.
- one or more MIC sensors are mounted on the sound box of the guitar (for example at the soundhole). This (these) sensor(s) capture(s) the acoustic vibrations of the radiating structure.
- the digital signal corresponding to this acoustic signal is transmitted to the input E of a device DEV applying the desired effect(s) and controlling, via its output S, actuators ACT applied against the resonance box CAI to make the box vibrate according to the effects chosen by the user of the device DEV.
- the sound radiated by the instrument is thus the sum of the acoustic sound played by the musician and its transformations by the DEV device (without the need to pass the captured signal through an amplification chain, as done conventionally and illustrated on the figure 1 ).
- the transformations thus applied are generally digital audio effects (reverberation (or “reverb”), chorus, distortion, equalization) injected in “feedforward", that is to say that the processing does not take into account the feedback emitted by the actuators on the sensors.
- the sound radiated has a poor quality, for example compared to another instrument or to that obtained by a conventional amplification chain of the type illustrated in the figure 1 .
- the physical latency of processing does not exceed a few microseconds.
- the vibroacoustic transfer function H2 between the actuators and one or more acoustic microphones positioned at any point in space can be estimated in real time.
- the aforementioned preselection of a particular processing for a sound effect chosen by the user can be carried out statically by an application on a smartphone, typically via a wireless connection (bluetooth for example), or dynamically directly on the instrument (for example with potentiometers like on electric guitars but to directly adjust effects and not volumes).
- the acoustic pressure p presented on the figures 3 to 6 can be measured by a microphone (that of the smartphone used as a user interface for example). This measurement can then be used (in addition to the transfer function H1) in the determination of the gains of the feedforward, or even for the determination of the gains coupled in feedback/feedforward, for an enrichment of the final rendering, to the ear of the musician.
- the feedback control mode is not represented on the picture 3 simply illustrating "acoustic paths", but rather on the figure 6 illustrating an implementation of the invention.
- the transfer function H1 between the sensor and the actuators is measured initially with muted strings (without the musician playing on the strings).
- This transfer function presents a series of peaks in the frequency space, as well as a average amplitude per frequency band (nine bands for example). It is thus a measurement of the transfer function between actuators and sensors, in open loop, the vibratory properties of the radiating structure then being estimated (frequencies, resonance quality factors, amplitudes at the sensors and at the actuators, and /or other properties). Then, from these measurements, it is deduced from the characteristics of vibration to the CAP sensor which make it possible to refine the control of the feedback to be applied (thanks to methods of automatic estimation of parameters described later). The feedback controller is then programmed from these measurements and estimates. As will be seen below, it is also reprogrammed automatically for each new feedforward processing.
- the feedforward type gains are adjusted.
- the values of these gains update the transfer function as explained above (since the characteristics of the sound at the pickup will be influenced by the type of effect chosen, such as for example an echo causing the structure to vibrate after the musician's attack ), which also updates the gains of the controller by feedback.
- the controller adjusts the feedback type gains (linked to the 6dB increase of each control gain for example) to obtain stable control. Indeed, if this feedback was not taken into account, the control would generally be unstable. If the musician further changes his sound level by transforming the feedforward gain, the feedback gain is recalculated and applied to the system (device and actuators/sensor).
- the transfer function is estimated dynamically, in particular as a function of the effect or the combination of effects chosen by the user.
- the amplitudes by bands of this better guitar are targeted by the feedforward gains, these gains updating by elsewhere the characteristics to the sensor.
- the frequencies and dampings of the best guitar are then targeted by the feedback type controller on the device integrating these gains, by placing the pole of the closed loop system for example. Without the feedback/feedforward combination, the frequencies and dampings are accessible but not the amplitudes per band and instabilities can be generated.
- the instrument can "sound to the ear" of the user as a chosen target instrument.
- This system depends on each radiating structure, the position and quantity of sensors and actuators, and the disturbance.
- the capture is carried out using a single piezoelectric sensor (ceramic PZT or PVDF or even MFC for example) under the saddle of the bridge of a guitar or at the interface between the strings and the bridge of a violin.
- a single piezoelectric sensor ceramic PZT or PVDF or even MFC for example
- Another embodiment may provide multiple separate pickups on the bridge, one at the interface with each string.
- actuation is such that it produces radiated sound of the quality of a good loudspeaker while allowing the vibration characteristics of the body to be measured.
- the position and the quantity of actuators can be determined by optimization on a numerical simulation by multi-physics finite elements for example.
- actuation is at the bridge, using two ACT inertial electrodynamic actuators mounted in parallel on either side of the bridge with controllable phase shift or mounted to accommodate a stereo signal.
- the parameters A, B, C and G are estimated for example from numerical calculation on the simulation of the complete electromechanical system with the finite element method.
- Another approach consists in estimating them experimentally, from the transfer function in open loop between sensor(s) and actuator(s) for A, B and C and an admittance measurement at the easel with an impact hammer or “ vibrating pot” and accelerometer for G. The estimation is then done for example with the Rational Fractional Polynomial (RFP) method.
- RFP Rational Fractional Polynomial
- x(t) not being directly accessible (since the measurement gives only y(t)), it is estimated at any time, for example using state observers, like the Luenberger observer.
- / w VS id ⁇ HAS ⁇ BK G ⁇ 1
- Id represents the identity function
- the controlled vibration of the radiating structure thus has the dynamics of (A - BK) and no longer that of A alone.
- the K vector is calculated to reach a certain vibrational target, such as resonance frequencies and dampings.
- the proposed controller introduces, in addition in the command, the characteristics of the vibration taken into account at the sensor (allowing to inject a gain in feedforward transforming the radiated acoustic pressure p but generating feedback).
- an average per frequency band of the transfer function H1 (and potentially of the transfer function H2 illustrated in the drawings) is carried out.
- nine bands (Hz) can be chosen: [20, 100]; [100, 200]; [200, 400]; [400, 800]; [800, 1600]; [1600, 3200]; [3200, 6400]; [6400, 12800]; [12800, 20000].
- the modification of each of these bands thus constitutes the target of the feedforward command. Once this command has been determined, the vector C is calculated.
- the feedback command is calculated differently compared to the aforementioned first approach, called “classic” (in the sense that it could appear immediately).
- this is an exemplary embodiment to illustrate the characteristics taken into account at the CAP sensor, as illustrated in the figure 6 , directly for the CTL FF feedforward control, but indirectly also for the CTL FB feedback control and vice versa.
- the feedforward control is considered here as applying a modification of the vibration characteristics to the sensor.
- step S1 aiming for example at the connection of the device DIS to the instrument/sensor/actuators system, it is measured, in practice, the transfer function H1 in open loop feedforward at step S2, which makes it possible to deduce at step S3 the parameters vibrations of the radiating structure and in particular the shape of the transfer function H1 and, from there, in step S4 the parameters of the feedback control.
- step S5 the musician can program a particular sound and/or effect setting, in which case the parameters of the feedforward control are updated at step S6, as well as the other parameters estimated at steps S3 and S4.
- the sound adjustment can be carried out automatically, for example according to the particular attack of the musician, or other.
- the effect may not be chosen directly and restrictively by the musician, but may be programmed dynamically according to the playing of the musician.
- the device DIS can perform real-time processing in step S7 to apply the sound and/or effect setting programmed by the user, for playback at step S8 by the instrument itself.
- the method above takes particular account of the feedforward control parameters in the estimation of the vibration parameters and the calculation of the feedback control gains.
- the present invention then makes it possible to drastically reduce the instabilities and to obtain the sound level and more generally the targeted acoustic qualities, thanks to a hybrid feedback/feedforward controller, that is to say that the conventional digital audio effects and the processing of the intrinsic feedback to the instrument are calculated together to feed back the vibration signal to one or more ACT actuators of the radiating structure of the instrument.
- a radiating structure has been described above, of the resonance box type of a stringed instrument (guitar type, or even violin or piano).
- the invention can also be applied to other musical instruments such as, for example, drum skins and drums, or even wind instruments.
- the invention can be applied to any radiating structure (having a radiating plate or table coupled possibly but not necessarily to a sound box), or more generally to any electroacoustic system. It can be for example a loudspeaker, a computer case (or even a mobile device (smartphone or portable speaker) broadcasting sounds and music) conventionally having a sensor and a driven actuator within the meaning of the present invention.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Electrophonic Musical Instruments (AREA)
Description
La présente invention concerne un traitement de données acoustiques captées sur un instrument de musique disposant d'une structure rayonnante acoustiquement. Plus particulièrement, il est prévu d'alimenter un ou plusieurs actionneurs de la structure rayonnante de l'instrument avec un signal élaboré à partir des données acoustiques captées et traitées, et ce en vue d'enrichir les propriétés vibratoires et notamment le son issu de l'instrument avec des effets sonores souhaités (écho, réverbération, distorsion, égalisation, etc.).The present invention relates to a processing of acoustic data picked up on a musical instrument having an acoustically radiating structure. More specifically, provision is made to supply one or more actuators of the radiating structure of the instrument with a signal generated from the acoustic data captured and processed, with a view to enriching the vibratory properties and in particular the sound resulting from the instrument with desired sound effects (echo, reverb, distortion, equalization, etc.).
Par exemple, les instruments de musique à cordes comportent une structure rayonnante (table d'harmonie et éventuellement caisse de résonance) couplée à un chevalet portant les cordes. Il est alors proposé dans le cadre de la présente invention de faire résonner la structure rayonnante avec un effet particulier, outre le jeu du musicien. Par exemple dans le cas d'un écho (ou « delay » en anglais), le musicien joue une note que la structure rayonnante amplifie et diffuse, mais en outre, un ou plusieurs actionneurs agissant sur la structure rayonnante appliquent ensuite une vibration à la structure pour rejouer cette note à intervalles de temps réguliers avec une diminution d'amplitude pour simuler l'effet d'écho.For example, string musical instruments have a radiating structure (soundboard and possibly sound box) coupled to a bridge carrying the strings. It is then proposed in the context of the present invention to cause the radiating structure to resonate with a particular effect, in addition to the playing of the musician. For example in the case of an echo (or "delay" in English), the musician plays a note which the radiating structure amplifies and diffuses, but in addition, one or more actuators acting on the radiating structure then apply a vibration to the structure to replay this note at regular time intervals with a decrease in amplitude to simulate the echo effect.
Cette approche se distingue du cas des effets appliqués classiquement en jouant typiquement sur une guitare électrique connectée à un amplificateur via un câble (ou « jack »). En référence à la
Dans le cas de l'approche au sens de la présente invention, la structure rayonnante de l'instrument, elle-même (typiquement la caisse de résonance CAI d'une guitare par exemple), est utilisée comme « diffuseur » ou « haut-parleur » du signal sonore transformé par un dispositif DEV de type « pédalier d'effets ».In the case of the approach within the meaning of the present invention, the radiating structure of the instrument, itself (typically the CAI resonance box of a guitar for example), is used as a "diffuser" or "high- speaker” of the sound signal transformed by a device DEV of the “effects pedalboard” type.
Plus particulièrement dans l'exemple de la
De façon générale, dans le contexte de la
- Intégrer des capteurs et actionneurs à ces instruments
- Appliquer des traitements sur les signaux captés
- et renvoyer ces signaux captés aux actionneurs.
- Integrate sensors and actuators into these instruments
- Apply processing to the captured signals
- and returning these sensed signals to the actuators.
Le son rayonné par l'instrument est ainsi la somme du son acoustique joué par le musicien et de ses transformations par le dispositif DEV (sans nécessité de passer le signal capté dans une chaîne d'amplification, comme effectué classiquement et illustré sur la
Les transformations ainsi appliquées sont généralement des effets audionumériques (réverbération (ou « reverb »), chorus, distorsion, égalisation) injectés en « feedforward », c'est-à-dire que les traitements ne prennent pas en compte la rétroaction émise par les actionneurs sur les capteurs.The transformations thus applied are generally digital audio effects (reverberation (or "reverb"), chorus, distortion, equalization) injected in "feedforward", that is to say that the processing does not take into account the feedback emitted by the actuators on the sensors.
Les transformations appliquées avec ces techniques n'obtiennent pas les effets désirés.Transformations applied with these techniques do not achieve the desired effects.
Les effets audionumériques induisent des instabilités (effet Larsen). On entend ainsi une fréquence non souhaitée se superposant au signal souhaité.Digital audio effects induce instabilities (Larsen effect). This means an undesired frequency superimposed on the desired signal.
Le son rayonné a une mauvaise qualité, par exemple comparée à un autre instrument ou à celle obtenue par une chaîne d'amplification classique du type illustré sur la
Ces deux défauts proviennent du fait que des caractéristiques de la structure rayonnante et/ou de son couplage avec l'excitation par les cordes ne sont pas prises en compte. En effet, les caractéristiques vibratoires de la structure rayonnante transforment les signaux émis par les actionneurs de manière inégale selon les fréquences. Ceci est dû notamment aux régions de la caisse où les modes de résonance induisent des modifications d'amplitude d'une fréquence à une autre. Cette caractéristique inégale est imposée par le fabricant de l'instrument et est indicatrice de la qualité de l'instrument lorsqu'il est joué en pinçant les cordes. En revanche, lorsque l'excitation se fait par les actionneurs, cela induit une qualité sonore inégale selon les notes jouées. De plus, le couplage important entre les cordes et la caisse à certaines fréquences induit une rétroaction forte sur les capteurs après émission par les actionneurs. Cette rétroaction change les fréquences et amortissements des résonances de la caisse. Le fait de ne pas prendre en compte cette rétroaction est ainsi une source d'erreur et d'instabilité des sons ciblés.These two defects come from the fact that the characteristics of the radiating structure and/or of its coupling with the excitation by the strings are not taken into account. Indeed, the vibratory characteristics of the radiating structure transform the signals emitted by the actuators in a uneven across frequencies. This is due in particular to the regions of the body where the resonance modes induce amplitude modifications from one frequency to another. This uneven characteristic is imposed by the manufacturer of the instrument and is indicative of the quality of the instrument when played by plucking the strings. On the other hand, when the excitation is done by the actuators, this induces an uneven sound quality depending on the notes played. Moreover, the strong coupling between the strings and the body at certain frequencies induces a strong feedback on the sensors after emission by the actuators. This feedback changes the frequencies and damping of the body resonances. The fact of not taking this feedback into account is thus a source of error and instability of the targeted sounds.
La présente invention telle que définie par les revendications vient améliorer la situation.The present invention as defined by the claims improves the situation.
D'autres avantages et caractéristiques de l'invention apparaitront à la lecture de la description détaillée ci-après d'exemples de réalisation de l'invention, et à l'examen des dessins annexés sur lesquels :
- la
figure 1 illustre le montage classique d'un instrument connecté à un pédalier d'effets, lui-même connecté à un amplificateur, - la
figure 2 illustre un montage au sens de l'invention d'un capteur et d'un ou plusieurs actionneurs sur un instrument connecté à un dispositif gérant les actionneurs notamment en fonction d'une consigne d'un utilisateur du dispositif, - la
figure 3 illustre la transformation du timbre d'un instrument, ici par simple contrôle de type feedforward modifiant la pression acoustique rayonnée p (chemin primaire depuis l'excitation de la corde), et montre en particulier que le chemin secondaire (de l'actionneur au capteur) peut induire une instabilité, en l'absence de contrôle de la rétroaction ; - la
figure 4 illustre un ajustement d'un contrôle de rétroaction type « feedback » (FB) suite à la mesure de la fonction de transfert entre capteur et actionneur en boucle ouverte ; - la
figure 5 illustre un ajustement de contrôle de type feedforward (FF), en fonction de l'effet choisi par le musicien ; - la
figure 6 illustre un ajustement en parallèle du contrôle de rétroaction, actualisé pour prendre en compte les nouvelles valeurs du contrôle feedforward imposées par la consigne de l'effet choisi par le musicien ; - la
figure 7 illustre un ordinogramme représentant les étapes d'un exemple de procédé au sens de la présente invention ; - la
figure 8 illustre un exemple de dispositif pour la mise en oeuvre de l'invention ; - la
figure 9 illustre un exemple de réalisation avantageux d'un équipement pour une guitare, connecté à un dispositif au sens de l'invention ; - les
figures 10A, 10B et 10C illustrent des traitements opérés dans un exemple de réalisation pour obtenir des paramètres déterminés à partir de la fonction de transfert H1 précitée, en vue du contrôle feedforward.
- there
figure 1 illustrates the classic assembly of an instrument connected to an effects pedalboard, itself connected to an amplifier, - there
figure 2 illustrates an assembly within the meaning of the invention of a sensor and one or more actuators on an instrument connected to a device managing the actuators in particular according to an instruction from a user of the device, - there
picture 3 - there
figure 4 illustrates an adjustment of a "feedback" (FB) type feedback control following the measurement of the transfer function between sensor and actuator in open loop; - there
figure 5 illustrates a feedforward (FF) control adjustment, depending on the effect chosen by the musician; - there
figure 6 illustrates a parallel adjustment of the feedback control, updated to take into account the new values of the feedforward control imposed by the setpoint of the effect chosen by the musician; - there
figure 7 illustrates a flowchart representing the steps of an exemplary method within the meaning of the present invention; - there
figure 8 illustrates an example of a device for implementing the invention; - there
figure 9 illustrates an advantageous embodiment of equipment for a guitar, connected to a device within the meaning of the invention; - THE
figures 10A, 10B and 10C illustrate processing carried out in an exemplary embodiment to obtain parameters determined from the aforementioned transfer function H1, with a view to feedforward control.
Comme illustré sur la
- d'un capteur piézoélectrique CAP sous le sillet (partie sous le chevalet portant les cordes),
- d'un ou plusieurs (par exemple deux) actionneurs ACT électrodynamiques montés ici en parallèle sur chaque côté du chevalet, et
- d'un dispositif DIS (connecté par son entrée E au capteur, et sa sortie S aux actionneurs).
- a CAP piezoelectric sensor under the saddle (part under the bridge carrying the strings),
- one or more (for example two) electrodynamic ACT actuators mounted here in parallel on each side of the bridge, and
- a DIS device (connected by its input E to the sensor, and its output S to the actuators).
En référence à la
- un préamplificateur PRA pour le capteur (via l'entrée E du dispositif),
- un convertisseur analogique-numérique rapide CAN,
- un microcontrôleur CTL,
- un convertisseur numérique-analogique rapide CNA et un amplificateur de puissance AP excitant les actionneurs ACT (via la sortie S du dispositif).
- a PRA preamplifier for the sensor (via the E input of the device),
- a fast CAN analog-to-digital converter,
- a CTL microcontroller,
- a fast digital-analog converter CNA and a power amplifier AP exciting the actuators ACT (via the output S of the device).
La latence physique des traitements n'excède pas quelques microsecondes.The physical latency of processing does not exceed a few microseconds.
Ainsi, le dispositif DIS opère pratiquement en temps-réel (à latence très faible comme par exemple quelques microsecondes entre l'entrée E et la sortie S). Le dispositif DIS comporte un microcontrôleur ou plus généralement un circuit de traitement CTL incluant typiquement :
- une mémoire MEM stockant des données d'instructions d'un programme informatique au sens de l'invention (et éventuellement d'autres données non permanentes, de calcul), et
- un processeur PROC lisant le contenu de la mémoire MEM pour exécuter le programme informatique, en mettant ainsi en oeuvre des algorithmes de traitements audionumériques effectués par échantillon, ces algorithmes étant informés par une estimation des propriétés de la structure rayonnante, obtenues comme détaillé ci-après.
- a memory MEM storing instruction data of a computer program within the meaning of the invention (and possibly other non-permanent, calculation data), and
- a processor PROC reading the contents of the memory MEM to execute the computer program, thus implementing digital audio processing algorithms performed per sample, these algorithms being informed by an estimate of the properties of the radiating structure, obtained as detailed below .
La présente invention propose un traitement de type feedback/feedforward (FB/FF), dans lequel :
- une fonction de transfert H1 entre le capteur CAP et les actionneurs ACT est estimée initialement en boucle ouverte comme illustré sur la
figure 4 , - un traitement acoustique (par exemple un effet ou une combinaison d'effets) est présélectionné par un utilisateur via une interface homme/machine (IHM) que comporte le dispositif DIS,
- le contrôleur CTL ajuste éventuellement la fonction de transfert estimée, en fonction de l'effet programmé,
- lorsque l'utilisateur joue de l'instrument, l'effet programmé est appliqué pour mettre en oeuvre les actionneurs, en mode feedforward (flèche F1 de la
figure 3 ), - ensuite, la vibration que fait opérer les actionneurs sur l'instrument et notamment sur les cordes est prise en compte (flèche F2 de la
figure 3 ) en tenant compte de la fonction de transfert ajustée, et en contrôlant en particulier le signal que capte le capteur CAP (par exemple en prévoyant un contrôle au niveau de la pré-amplification PRA par le processeur PROC comme illustré sur lafigure 8 ), - le son ou la vibration capté par le capteur CAP est ainsi ajusté et analysé en mode feedback pour appliquer l'effet désiré (CTL FF) avec la prise en compte de l'activation des actionneurs sur la vibration des cordes et plus généralement de la structure rayonnante, cette vibration venant s'ajouter au jeu naturel du musicien et à l'effet acoustique désiré.
- a transfer function H1 between the sensor CAP and the actuators ACT is initially estimated in open loop as illustrated in the
figure 4 , - an acoustic treatment (for example an effect or a combination of effects) is preselected by a user via a man/machine interface (HMI) that comprises the device DIS,
- the CTL controller possibly adjusts the estimated transfer function, depending on the programmed effect,
- when the user plays the instrument, the programmed effect is applied to activate the actuators, in feedforward mode (arrow F1 on the
picture 3 ), - then, the vibration caused by the actuators on the instrument and in particular on the strings is taken into account (arrow F2 of the
picture 3 ) taking into account the adjusted transfer function, and in particular controlling the signal picked up by the CAP sensor (for example by providing control at the level of the pre-amplification PRA by the processor PROC as illustrated in figurefigure 8 ), - the sound or vibration picked up by the CAP sensor is thus adjusted and analyzed in feedback mode to apply the desired effect (CTL FF) taking into account the activation of the actuators on the vibration of the strings and more generally of the structure radiant, this vibration adding to the natural playing of the musician and the desired acoustic effect.
Il est possible en outre d'estimer en temps réel la fonction de transfert vibroacoustique H2 entre les actionneurs et un ou plusieurs microphones acoustiques positionnés en des points quelconques de l'espace pour mesurer la pression p (proche des oreilles du musicien, de l'auditeur, ou encore d'une prise de son par exemple d'un smartphone intégrant les moyens informatiques d'un dispositif au sens de l'invention). Ainsi par exemple, la présélection précitée d'un traitement particulier pour un effet sonore choisi par l'utilisateur peut s'effectuer statiquement par une application sur smartphone, typiquement via une connexion sans fil (bluetooth par exemple), ou dynamiquement directement sur l'instrument (par exemple avec des potentiomètres comme sur des guitares électriques mais pour régler directement des effets et non pas des volumes).It is also possible to estimate in real time the vibroacoustic transfer function H2 between the actuators and one or more acoustic microphones positioned at any point in space to measure the pressure p (close to the ears of the musician, the listener, or even a sound recording, for example from a smartphone integrating the computer means of a device within the meaning of the invention). Thus, for example, the aforementioned preselection of a particular processing for a sound effect chosen by the user can be carried out statically by an application on a smartphone, typically via a wireless connection (bluetooth for example), or dynamically directly on the instrument (for example with potentiometers like on electric guitars but to directly adjust effects and not volumes).
Ainsi, la pression acoustique p présentée sur les
Il convient de noter que le mode de contrôle en feedback n'est pas représenté sur la
Dans une réalisation particulière illustrée sur la
Par ailleurs, en référence maintenant à la
Si le guitariste choisit par exemple d'augmenter le niveau sonore de 6dB (niveau sonore doublé), le dispositif mesure les modifications de la fonction de transfert H1 en boucle ouverte feedforward avec le signal au capteur augmenté de 6dB. Il estime ainsi les nouvelles valeurs d'amplitudes en fréquence, ainsi que leur écart aux valeurs initiales. On comprendra ainsi que la fonction de transfert est estimée préférentiellement:
- pour plusieurs bandes de fréquences (une dizaine typiquement), et
- en fonction de plusieurs niveaux d'amplitude sonore (caractérisant par exemple le niveau d'excitation à l'attaque du musicien).
- for several frequency bands (about ten typically), and
- according to several levels of sound amplitude (characterizing for example the level of excitation at the attack of the musician).
Le contrôleur ajuste les gains de type feedback (liés à l'augmentation de 6dB de chaque gain de contrôle par exemple) pour obtenir un contrôle stable. En effet, si la prise en compte de cette rétroaction n'était pas effectuée, le contrôle serait généralement instable. Si le musicien change encore son niveau sonore en transformant le gain feedforward, le gain du feedback est recalculé et appliqué au système (dispositif et actionneurs/capteur).The controller adjusts the feedback type gains (linked to the 6dB increase of each control gain for example) to obtain stable control. Indeed, if this feedback was not taken into account, the control would generally be unstable. If the musician further changes his sound level by transforming the feedforward gain, the feedback gain is recalculated and applied to the system (device and actuators/sensor).
On comprendra ainsi que la fonction de transfert est estimée dynamiquement, notamment en fonction de l'effet ou de la combinaison d'effets choisie par l'utilisateur.It will thus be understood that the transfer function is estimated dynamically, in particular as a function of the effect or the combination of effects chosen by the user.
Si le musicien souhaite que son instrument ait le même timbre qu'un autre instrument, comme par exemple une guitare de meilleure qualité qui a été préalablement analysée, les amplitudes par bandes de cette meilleure guitare sont ciblées par les gains feedfoward, ces gains réactualisant par ailleurs les caractéristiques au capteur. Les fréquences et amortissements de la meilleure guitare sont alors ciblés par le contrôleur type feedback sur le dispositif intégrant ces gains, par placement de pôle du système en boucle fermée par exemple. Sans la combinaison feedback/feedforward, les fréquences et amortissements sont accessibles mais pas les amplitudes par bande et des instabilités peuvent être générées.If the musician wants his instrument to have the same timbre as another instrument, such as a guitar of better quality which has been previously analyzed, the amplitudes by bands of this better guitar are targeted by the feedforward gains, these gains updating by elsewhere the characteristics to the sensor. The frequencies and dampings of the best guitar are then targeted by the feedback type controller on the device integrating these gains, by placing the pole of the closed loop system for example. Without the feedback/feedforward combination, the frequencies and dampings are accessible but not the amplitudes per band and instabilities can be generated.
Dans ce cas notamment, il peut être utile d'estimer la seconde fonction de transfert précitée H2 afin d'affiner les paramètres de calcul de la rétroaction (vibratoires mais aussi sonores), en utilisant alors au moins un microphone pour capter la pression acoustique p dans l'air à proximité de la structure rayonnante de l'instrument (par exemple, simplement par le microphone d'un smartphone à proximité opérant le traitement de l'invention). Ainsi, l'instrument peut « sonner à l'oreille » de l'utilisateur comme un instrument cible choisi.In this case in particular, it may be useful to estimate the aforementioned second transfer function H2 in order to refine the parameters for calculating the feedback (vibratory but also sound), then using at least one microphone to pick up the acoustic pressure p in the air close to the radiating structure of the instrument (for example, simply by the microphone of a nearby smartphone operating the processing of the invention). Thus, the instrument can "sound to the ear" of the user as a chosen target instrument.
A titre d'exemple purement illustratif et non limitatif, le système instrument/capteur/actionneurs incluant le contrôle peut être formalisé, dans une première approche classique, comme suit :
Ce système dépend de chaque structure rayonnante, de la position et la quantité de capteurs et d'actionneurs, et de la perturbation.This system depends on each radiating structure, the position and quantity of sensors and actuators, and the disturbance.
Dans un mode de réalisation particulier, la captation s'effectue à l'aide d'un seul capteur piézoélectrique (céramique PZT ou PVDF ou encore MFC par exemple) sous le sillet du chevalet d'une guitare ou à l'interface entre les cordes et le chevalet d'un violon. Une autre réalisation peut prévoir des capteurs multiples séparés sur le chevalet, un à l'interface avec chaque corde.In a particular embodiment, the capture is carried out using a single piezoelectric sensor (ceramic PZT or PVDF or even MFC for example) under the saddle of the bridge of a guitar or at the interface between the strings and the bridge of a violin. Another embodiment may provide multiple separate pickups on the bridge, one at the interface with each string.
L'actionnement est tel qu'il produit un son rayonné de la qualité d'une bonne enceinte acoustique tout en permettant de mesurer les caractéristiques vibratoires de la caisse. Pour cela, la position et la quantité d'actionneurs peut être déterminée par optimisation sur une simulation numérique par éléments finis multi-physiques par exemple. Dans un mode de réalisation particulier illustré sur la
Dans les expressions ci-dessus, les paramètres A, B, C et G sont estimés par exemple à partir de calcul numérique sur la simulation du système électromécanique complet avec la méthode des éléments finis. Une autre approche consiste à les estimer expérimentalement, à partir de la fonction de transfert en boucle ouverte entre capteur(s) et actionneur(s) pour A, B et C et une mesure d'admittance au chevalet avec marteau d'impact ou « pot vibrant » et accéléromètre pour G. L'estimation se fait alors par exemple avec la méthode Rational Fractional Polynomial (RFP). D'autre part, x(t) n'étant pas directement accessible (puisque la mesure donne seulement y(t)), il est estimé à tout instant, par exemple à l'aide d'observateurs d'état, comme l'observateur de Luenberger.In the expressions above, the parameters A, B, C and G are estimated for example from numerical calculation on the simulation of the complete electromechanical system with the finite element method. Another approach consists in estimating them experimentally, from the transfer function in open loop between sensor(s) and actuator(s) for A, B and C and an admittance measurement at the easel with an impact hammer or “ vibrating pot” and accelerometer for G. The estimation is then done for example with the Rational Fractional Polynomial (RFP) method. On the other hand, x(t) not being directly accessible (since the measurement gives only y(t)), it is estimated at any time, for example using state observers, like the Luenberger observer.
Une fonction de transfert y/w du système peut s'écrire alors :
La vibration contrôlée de la structure rayonnante a ainsi la dynamique de (A - BK) et plus celle de A seul. Le vecteur K est calculé pour atteindre une certaine cible vibratoire, comme les fréquences et amortissements des résonances. On pourra par exemple utiliser des algorithmes de placement de pôles de (A - BK).The controlled vibration of the radiating structure thus has the dynamics of (A - BK) and no longer that of A alone. The K vector is calculated to reach a certain vibrational target, such as resonance frequencies and dampings. One could for example use pole placement algorithms of (A - BK).
Dans une deuxième approche présentée plus haut en référence aux
On a illustré sur les
Dans ce qui suit, la commande en feedback est calculée différemment par rapport à la première approche précitée, dite « classique » (dans le sens où elle pourrait apparaitre immédiatement).In what follows, the feedback command is calculated differently compared to the aforementioned first approach, called “classic” (in the sense that it could appear immediately).
Dans cette deuxième approche, les équations (1) et (2) restent inchangées mais l'équation (3) devient :
La fonction de transfert y/w du système s'écrit pour le système contrôlé :
La caisse contrôlée a ainsi la dynamique de (A + BC - BK) et plus celle de (A - BK) avec le contrôleur selon la première approche classique. Le vecteur K est calculé pour :
- assurer la stabilité pour toutes les modifications apportées au vecteur C,
- atteindre une cible vibratoire donnée en plaçant par exemple les pôles de (A + BC - BK), les fréquences et amortissements des résonances étant contrôlées par le vecteur K et les amplitudes par bande étant contrôlées par la matrice C.
- provide stability for all changes to vector C,
- reach a given vibratory target by placing for example the poles of (A + BC - BK), the frequencies and damping of the resonances being controlled by the vector K and the amplitudes per band being controlled by the matrix C.
Bien entendu, il s'agit d'un exemple de réalisation pour illustrer les caractéristiques prises en compte au capteur CAP, comme illustré sur la
En référence maintenant à la
Sinon (flèche « non » en sortie du test S5), le dispositif DIS peut opérer un traitement en temps réel à l'étape S7 pour appliquer le réglage de son et/ou d'effet programmés par l'utilisateur, pour une restitution à l'étape S8 par l'instrument lui-même.Otherwise ("no" arrow at the output of the test S5), the device DIS can perform real-time processing in step S7 to apply the sound and/or effect setting programmed by the user, for playback at step S8 by the instrument itself.
Ainsi, le procédé ci-avant prend en compte particulièrement les paramètres de contrôle feedforward dans l'estimation des paramètres vibratoires et du calcul des gains de contrôle en feedback.Thus, the method above takes particular account of the feedforward control parameters in the estimation of the vibration parameters and the calculation of the feedback control gains.
La présente invention permet alors de réduire drastiquement les instabilités et d'obtenir le niveau sonore et plus généralement les qualités acoustiques ciblées, grâce à un contrôleur hybride feedback/feedforward, c'est-à-dire que les effets audionumériques classiques et le traitement de la rétroaction intrinsèque à l'instrument sont calculés ensemble pour réinjecter le signal de vibration à un ou plusieurs actionneurs ACT de la structure rayonnante de l'instrument.The present invention then makes it possible to drastically reduce the instabilities and to obtain the sound level and more generally the targeted acoustic qualities, thanks to a hybrid feedback/feedforward controller, that is to say that the conventional digital audio effects and the processing of the intrinsic feedback to the instrument are calculated together to feed back the vibration signal to one or more ACT actuators of the radiating structure of the instrument.
Parmi les avantages de la technique mise en oeuvre dans le cadre de la présente invention, on peut citer:
- une augmentation du niveau sonore et un enrichissement du timbre de l'instrument acoustique,
- l'injection des traitements audionumériques dans un instrument acoustique en évitant les instabilités de type effet Larsen,
- l'atteinte des propriétés vibratoires de la structure rayonnante cibles que sont les fréquences, amortissements des résonances et amplitudes par bande fréquentielle, pour ainsi améliorer significativement les qualités acoustiques de l'instrument,
- un seul capteur et un seul actionneur pouvant être prévus pour effectuer la totalité des transformations.
- an increase in the sound level and an enrichment of the timbre of the acoustic instrument,
- the injection of digital audio processing into an acoustic instrument avoiding Larsen effect type instabilities,
- the achievement of the vibratory properties of the radiating structure targets which are the frequencies, damping of the resonances and amplitudes by frequency band, to thus significantly improve the acoustic qualities of the instrument,
- a single sensor and a single actuator can be provided to perform all the transformations.
Bien entendu, la présente invention ne se limite pas la forme de réalisation décrite ci-avant à titre d'exemple ; elle s'étend à d'autres variantes.Of course, the present invention is not limited to the embodiment described above by way of example; it extends to other variants.
Ainsi, on a décrit ci-avant une structure rayonnante, de type caisse de résonance d'un instrument à cordes (type guitare, ou encore violon ou piano). Toutefois, l'invention peut s'appliquer aussi à d'autres instruments de musique tels que par exemple des peaux et fûts de batteries, ou encore des instruments à vent. Plus généralement encore, l'invention peut s'appliquer à toute structure rayonnante (disposant d'une plaque ou table rayonnante couplée possiblement mais non nécessairement à une caisse de résonance), ou plus généralement à tout système électroacoustique. Il peut s'agir par exemple d'une enceinte acoustique, d'un boîtier d'ordinateur (ou même d'un appareil mobile (smartphone ou enceinte portative) diffusant des sons et de la musique) disposant classiquement d'un capteur et d'un actionneur piloté au sens de la présente invention.Thus, a radiating structure has been described above, of the resonance box type of a stringed instrument (guitar type, or even violin or piano). However, the invention can also be applied to other musical instruments such as, for example, drum skins and drums, or even wind instruments. More generally still, the invention can be applied to any radiating structure (having a radiating plate or table coupled possibly but not necessarily to a sound box), or more generally to any electroacoustic system. It can be for example a loudspeaker, a computer case (or even a mobile device (smartphone or portable speaker) broadcasting sounds and music) conventionally having a sensor and a driven actuator within the meaning of the present invention.
Claims (9)
- A method implemented by computer means, for processing sound data originating from at least one sensor mounted on an acoustically radiating structure of a music instrument and for activating at least one actuator applied against the acoustically radiating structure,the sensor (CAP) sensing an acoustic signal originating from the vibration of the radiating structure, said radiating structure carrying at least one actuator controlled by said computer means and involved in the vibration of the radiating structure,the method including:a) measuring a transfer function (H1) of the actuator, radiating structure, and sensor assembly,b) controlling activation of the actuator (ACT) to make the radiating structure vibrate, according to a selected setpoint:- while taking account of the measured transfer function, and- while taking account of the acoustic signal sensed by the sensor in a feedback mode, and wherein the activation of the actuator is controlled in a hybrid "feedback/feedforward" mode,and wherein the selected setpoint (S5) includes a command of at least one sound effect from among a sound amplitude change, an equalisation, an echo, a reverberation, a distortion, a phase change, a frequency change, an amplitude modulation, and a combination of these sound effects,the method including one or more iteration(s) of the steps:- on command of the sound effect selected by the user (S5), adjusting feedforward-type gains (S6) and gains of a feedback control (S4), according to the selected sound effect setpoint,- updating (S3) said transfer function measured with the adjusted gains,- controlling (S7) the activation of the actuator (ACT) to make (S8) the radiating structure vibrate, according to the setpoint corresponding to the selected sound effect, while taking account of the updated transfer function and of the acoustic signal sensed by the sensor in the feedback mode.
- The method according to claim 1, wherein, in step a):- said transfer function (H1) is measured in open loop (S2), and- on this basis, vibratory parameters of the structure are estimated (S3) to calculate feedback control gains (S4).
- The method according to one of the preceding claims, wherein the processing of the sound data is performed on a sample basis, at a latency lower than one hundred microseconds.
- The method according to one of the preceding claims, wherein, the radiating structure including a sound box of a string musical instrument, said transfer function is measured with the strings being muted.
- The method according to one of the preceding claims, wherein, the radiating structure including a sound box of a string musical instrument, two actuators are provided arranged on either side of the bridge carrying the strings.
- The method according to claim 2, wherein a microphone is further provided to sense an acoustic pressure (p) in the air proximate to the radiating structure, the method further including measuring a second transfer function (H2) of the actuator, radiating structure, and microphone assembly,
and wherein the activation of the actuator is controlled in a feedback/feedforward mode, with a refined estimation of the feedback control gains further based on said second transfer function (H2). - The method according to one of the preceding claims, wherein, the radiating structure including a sound box of a real musical instrument, said computer means are configured to confer vibratory and sound features of a selected musical instrument on said real musical instrument.
- A computer program including instructions for the implementation of the method according to one of the preceding claims, when this program is executed by a processor (PROC).
- A device (DIS) including a processing circuit configured for the implementation of the method according to one of claims 1 to 7.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1751403A FR3063173B1 (en) | 2017-02-22 | 2017-02-22 | INSTRUMENT OF ACOUSTIC MUSIC, PERFECTED |
PCT/FR2017/052778 WO2018154188A1 (en) | 2017-02-22 | 2017-10-10 | Acoustic musical instrument enhanced with feedback and injection actuators |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3586328A1 EP3586328A1 (en) | 2020-01-01 |
EP3586328B1 true EP3586328B1 (en) | 2023-09-06 |
Family
ID=58992999
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17793990.7A Active EP3586328B1 (en) | 2017-02-22 | 2017-10-10 | Augmented acoustic music instrument with feedforward and feedback actuators . |
Country Status (6)
Country | Link |
---|---|
US (1) | US10783864B2 (en) |
EP (1) | EP3586328B1 (en) |
JP (1) | JP7004733B2 (en) |
CN (1) | CN111108547B (en) |
FR (1) | FR3063173B1 (en) |
WO (1) | WO2018154188A1 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR3063173B1 (en) * | 2017-02-22 | 2019-06-07 | Hyvibe | INSTRUMENT OF ACOUSTIC MUSIC, PERFECTED |
FR3069932B1 (en) | 2017-08-01 | 2019-09-06 | Hyvibe | PERFECTED SOUND RESTITUTION FROM A DEVICE WITH VIBRANT MECHANICAL ACTUATOR |
CN111210800B (en) * | 2020-02-21 | 2022-09-09 | 京东方科技集团股份有限公司 | Musical instrument sound deadening system and method |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5796920A (en) * | 1994-08-19 | 1998-08-18 | Harris Corporation | Multiprocessor system and method for identification and adaptive control of dynamic systems |
US6320113B1 (en) * | 1995-07-19 | 2001-11-20 | Georgia Tech Research Corporation | System for enhancing the sound of an acoustic instrument |
FR2739214B1 (en) * | 1995-09-27 | 1997-12-19 | Technofirst | METHOD AND DEVICE FOR ACTIVE HYBRID MITIGATION OF VIBRATION, ESPECIALLY MECHANICAL, SOUND OR SIMILAR VIBRATION |
US7305094B2 (en) * | 2001-01-12 | 2007-12-04 | University Of Dayton | System and method for actively damping boom noise in a vibro-acoustic enclosure |
US7279631B2 (en) * | 2002-07-16 | 2007-10-09 | Line 6, Inc. | Stringed instrument with embedded DSP modeling for modeling acoustic stringed instruments |
JP5707876B2 (en) * | 2010-11-09 | 2015-04-30 | ヤマハ株式会社 | Musical instrument |
CN103151033B (en) * | 2011-09-14 | 2017-08-04 | 雅马哈株式会社 | Keyboard instrument |
FR2983026A1 (en) * | 2011-11-22 | 2013-05-24 | Parrot | AUDIO HELMET WITH ACTIVE NON-ADAPTIVE TYPE NOISE CONTROL FOR LISTENING TO AUDIO MUSIC SOURCE AND / OR HANDS-FREE TELEPHONE FUNCTIONS |
US9099069B2 (en) * | 2011-12-09 | 2015-08-04 | Yamaha Corporation | Signal processing device |
ITAN20120023A1 (en) * | 2012-03-13 | 2013-09-14 | Viscount Internat S P A | SYSTEM TO REPRODUCE THE SOUND OF A ROPE INSTRUMENT. |
FR2998086B1 (en) * | 2012-11-15 | 2015-02-06 | Ecole Norm Superieure Lyon | ASSEMBLY AND METHOD FOR AUTOMATICALLY PLAYING A FROST STRING MUSIC INSTRUMENT |
JP6004027B2 (en) * | 2015-03-17 | 2016-10-05 | ヤマハ株式会社 | Musical instrument |
WO2016152219A1 (en) * | 2015-03-24 | 2016-09-29 | ヤマハ株式会社 | Instrument and method capable of generating additional vibration sound |
SE544164C2 (en) * | 2015-06-22 | 2022-02-15 | Modern Ancient Instr Networked Ab | Method to control the timbre of a target stringed instrument in real-time |
FR3063173B1 (en) * | 2017-02-22 | 2019-06-07 | Hyvibe | INSTRUMENT OF ACOUSTIC MUSIC, PERFECTED |
-
2017
- 2017-02-22 FR FR1751403A patent/FR3063173B1/en active Active
- 2017-10-10 US US16/486,677 patent/US10783864B2/en active Active
- 2017-10-10 EP EP17793990.7A patent/EP3586328B1/en active Active
- 2017-10-10 CN CN201780089922.6A patent/CN111108547B/en active Active
- 2017-10-10 JP JP2019546392A patent/JP7004733B2/en active Active
- 2017-10-10 WO PCT/FR2017/052778 patent/WO2018154188A1/en unknown
Non-Patent Citations (2)
Title |
---|
DONOVAN LIAM B ET AL: "Active Control of a String Instrument Bridge Using the Posicast Technique", AES CONVENTION 138; MAY 2015, AES, 60 EAST 42ND STREET, ROOM 2520 NEW YORK 10165-2520, USA, 6 May 2015 (2015-05-06), XP040670899 * |
JOHN Y HUNG: "Feedback Control With Posicast", IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, IEEE SERVICE CENTER, PISCATAWAY, NJ, USA, vol. 50, no. 1, 1 February 2003 (2003-02-01), XP011073808, ISSN: 0278-0046 * |
Also Published As
Publication number | Publication date |
---|---|
WO2018154188A1 (en) | 2018-08-30 |
EP3586328A1 (en) | 2020-01-01 |
FR3063173A1 (en) | 2018-08-24 |
US10783864B2 (en) | 2020-09-22 |
JP7004733B2 (en) | 2022-01-21 |
JP2020508495A (en) | 2020-03-19 |
CN111108547A (en) | 2020-05-05 |
US20200058278A1 (en) | 2020-02-20 |
FR3063173B1 (en) | 2019-06-07 |
CN111108547B (en) | 2023-08-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3662360B1 (en) | Improved sound playback from a device with a vibrating mechanical actuator | |
JP6020109B2 (en) | Apparatus and method for calculating transfer characteristics | |
EP3586328B1 (en) | Augmented acoustic music instrument with feedforward and feedback actuators . | |
US7812243B2 (en) | Stringed instrument with embedded DSP modeling for modeling acoustic stringed instruments | |
NL1030038C2 (en) | Earphone`s frequency response characteristic compensating method for e.g. MP3 players, involves extracting filter coefficient by comparing measured response characteristic with reference frequency characteristic of target curve | |
US9280964B2 (en) | Device and method for processing signals associated with sound | |
WO2010136661A1 (en) | Method and device for narrow-band noise suppression in a vehicle passenger compartment | |
EP2047455A2 (en) | Device for producing signals representative of sounds of a keyboard and stringed instrument | |
CN102194451A (en) | Signal processing device and stringed instrument | |
TWI317574B (en) | Audio amplification apparatus with howling canceler | |
US8796530B2 (en) | Musical instrument with acoustic transducer | |
KR102531296B1 (en) | Audio signal correction method | |
FR2890280A1 (en) | Audio processing unit for sound reproducing stereo system, has psychoacoustic model linearizing response curve of loudspeaker enclosure according to direction of perception of sound by user | |
CN115910009A (en) | Electronic device, method, and computer program | |
JP2018113686A (en) | Method for distorting frequency of sound signal | |
JP2022550746A (en) | Modal reverberation effect in acoustic space | |
FR2569077A1 (en) | HELMHOLTZ RESONATOR SIMULATOR | |
JP6728846B2 (en) | Performance signal generation device and performance signal generation method | |
FR2958068A1 (en) | Method for synthesizing audio signal from note signal representative of sequence of note levels on cord of e.g. bass guitar, involves producing synthesized audio signal by mixing harmonized tonal signal and contact audio signal | |
JP2021157016A (en) | Musical instrument adjustment device, adjustment method, and manufacturing method | |
FR3130438A1 (en) | Process for the digital simulation of the sound of a wind musical instrument by modal decomposition. | |
FR2963844A1 (en) | Method for determining parameters defining two filters respectively applicable to loudspeakers in room, involves comparing target response with acoustic response generated, at point, by loudspeakers to which filters are respectively applied | |
ITLE20110014A1 (en) | DEVICE FOR THE USE OF CORRECT AMPLIFICATION OR RECORDING OF TAMBURELLI SOUNDS, FRAME DRUMS AND MUSICAL INSTRUMENTS WITH SIMILAR PERCUSSIONS | |
FR2826770A1 (en) | Studio musical sound generator, has sound digital order input and sampled sound banks selection mechanism, transmitting selected sounds for reproduction at distance |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20190821 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: MAMOU-MANI, ADRIEN |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20200825 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20230327 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602017073842 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20230906 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231207 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20231107 Year of fee payment: 7 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231206 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20231207 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20231030 Year of fee payment: 7 Ref country code: DE Payment date: 20231208 Year of fee payment: 7 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1609620 Country of ref document: AT Kind code of ref document: T Effective date: 20230906 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240106 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240106 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20240108 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602017073842 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20231031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20231010 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20231010 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20231031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20231031 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230906 |