EP3925233B1 - Audio signal processing method and device - Google Patents

Audio signal processing method and device Download PDF

Info

Publication number
EP3925233B1
EP3925233B1 EP19828302.0A EP19828302A EP3925233B1 EP 3925233 B1 EP3925233 B1 EP 3925233B1 EP 19828302 A EP19828302 A EP 19828302A EP 3925233 B1 EP3925233 B1 EP 3925233B1
Authority
EP
European Patent Office
Prior art keywords
linearity
audio signal
audio
human ear
linear
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19828302.0A
Other languages
German (de)
French (fr)
Other versions
EP3925233A1 (en
Inventor
Marko DVECKO
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MozzaikIo d o o
Original Assignee
MozzaikIo d o o
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MozzaikIo d o o filed Critical MozzaikIo d o o
Priority to HRP20230332TT priority Critical patent/HRP20230332T1/en
Priority claimed from PCT/HR2019/000027 external-priority patent/WO2020165616A1/en
Publication of EP3925233A1 publication Critical patent/EP3925233A1/en
Application granted granted Critical
Publication of EP3925233B1 publication Critical patent/EP3925233B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/002Damping circuit arrangements for transducers, e.g. motional feedback circuits
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/04Circuits for transducers, loudspeakers or microphones for correcting frequency response
    • H04R3/08Circuits for transducers, loudspeakers or microphones for correcting frequency response of electromagnetic transducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S1/00Two-channel systems
    • H04S1/002Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/09Electronic reduction of distortion of stereophonic sound systems

Definitions

  • the present invention refers to an audio signal processing method for enhancing the quality and/or other characteristic of an audio signal.
  • This method corrects a non-linearity of electro-acoustic transducers in an audio chain by taking into account also a non-linear psychoacoustical characteristics of the human ear by adding non-linearities in the audio chain in a controlled manner.
  • the present invention relates to a device/apparatus for the implementation of said method and audio chain configured to correct the non-linearity of electroacoustic transducers, taking into account also the non-linear psychoacoustical characteristics of the human ear.
  • the audio chain contains at least one apparatus for the implementation of the audio signal processing method.
  • the audio chain before the electroacoustic converter displays an important features. It is not known why some audio chain components with greater distortions produce better sound than components with lower distortion. Some amplifiers have incorporated vacuum tubes in order to sound better, whereas other employ a small feedback loop to intensify non-linearities of the components.
  • the audio chain distortions before the electroacoustic transducer do not mean that it will sound better or worse. Two different electroacoustic transducers that sound good on their audio chains, will sound worse when they swap places. One of the reasons thereof is that the audio chain before the electroacoustic transducer has non-linearities that reduce its non-linearities which makes it sound better than on the other audio chain.
  • Technical problem that gets solved with the present invention is a method and an apparatus for audio signal processing in audio chain, that correct non-linearity of electroacoustic transducers in audio chain, taking into account also the non-linear psychoacoustic feature of the human ear.
  • Non-linearities of the electroacoustic transducers have been known for some time now. Non-linear distortions characterize the entire electroacoustic reproduction chain, from the sound recording process on the sound recording medium all the way to the reproduction of sound from the sound recording medium, the amplifier and the loudspeaker itself. There are many publications documenting these non-linearities. The application of non-linearities in musical instruments in order to change the sound has also been known for a while. People do not perceive some non-linearities in the sound, whereas others are perceived, even though they have the same acoustic energy as described in the article Amplifier Musicality - A Study of Amplifier Harmonic Distortion Spectrum Analysis by Jean Hiraga.
  • the document US5133015 discloses the process and the apparatus for audio signal processing, more precisely, the technique that permits various audio signal distortion grades comprising the audio signal distortion to a certain grade.
  • the document US2011255701 discloses the electronic circuit and the audio enhancement method, particularly the electronic circuit that can introduce a predictive and controllable harmonic distortion that increases with an increased signal amplitude.
  • the document US2015249889 discloses the system and the method for digital audio signal processing by extending the loudspeaker frequency response and reducing or eliminating non-linear loudspeaker distortion.
  • An audio signal can be extended by applying a digital linear filter, based on a modified loudspeaker frequency response.
  • a non-linear distortion of a loudspeaker can be cancelled or reduced by a digital non-linear filter based on a reverse parametric model of the loudspeaker.
  • WO 2018/075442 A1 relates to a system for creating a pre-distorted input signal for an audio transducer with the aim of compensating a non-linear behaviour of the transducer.
  • a model of the transducer is either provided theoretically or optimised and an inverse formulation of the model is provided to be implemented inside the non-linear module.
  • US 2006/133620 A1 deals with correcting non-linearities occurring inside the loudspeaker and linked to its construction.
  • a predistortion filter is implemented by approximating non-linear transducer model using an invertible polynomial series model.
  • the present invention relates to an audio signal processing method in an audio chain that correct a non-linearity of electroacoustic transducers in the audio chain, taking into consideration also a non-linear psychoacoustical characteristics of the human ear by adding non-linearities in the audio chain in a controlled manner, in order to obtain a better acoustic image and more details when reproducing the sound by using approximation of the quadratic and a fifth degree polynomial function in some range.
  • a method is defined as provided in appended claim 1, and comprises approximating of the non-linear psychoacoustical characteristic of the human ear by a fifth-degree polynomial and adding of at least one non-linear element in front of at least one electroacoustic transducer in the audio chain, whereby the non-linear element has a function of adding a non-linearity in the audio chain that corrects the non-linearity of at least one electroacoustic transducer and/or the non-linearity of the approximated psychoacoustical characteristic of the human ear for a pressure change by the human ear up to p ⁇ .
  • the audio chain for implementing of said audio signal processing method is configured to correct the non-linearity of electroacoustic transducers in the audio chain, taking into account also the non-linear psychoacoustical characteristic of the human ear.
  • Said audio chain contains at least one apparatus for implementing of the audio signal processing method.
  • the aforementioned apparatus has the function of adding the non-linearity to the audio chain that corrects the non-linearity of at least one electroacoustic transducer and/or the non-linearity of the approximate psychoacoustical characteristic of the human ear for the pressure change by the human ear up to p ⁇ .
  • a method of the present invention takes into consideration one non-linearity of an electroacoustic transducer and non-linearity of the human ear.
  • an audio signal processing method in an audio chain which corrects the non-linearity of the electroacoustic transducers in the audio chain, taking into account also the non-linear psychoacoustical characteristic of the human ear, comprises approximating the psychoacoustical characteristics of the human ear by a fifth degree polynomial function, and adding of at least one non-linear element 4 in front of at least one electroacoustic transducer in the audio chain, said non-linear element 4 has a function to add a non-linearity in the audio chain that corrects the non-linearity of at least one electroacoustic transducer and/or the non-linearity of the approximated psychoacoustical characteristic of the human ear for a pressure change by the human ear up to p ⁇ .
  • the non-linear element 4 reduces the non-linearity of the electroacoustic transducer by applying a quadratic non-linearity which is an inverse function of ax + bx 2 where x is a relative membrane excursion or a relative force on a membrane of the electroacoustic transducer, a and b are positive constants.
  • the non-linear element 4 reduces the non-linearity of the psychoacoustical characteristic of the human ear by applying the hyperbolic function x 2 1 ⁇ x and x 2 1 + x , where x is the relative pressure by the human ear.
  • the non-linear element 4 reduces the non-linearity of the psychoacoustical characteristic of the human ear by applying the function x 1.5 , where x is the relative pressure by the human ear.
  • Said non-linearity within the electroacoustic transducer affects the quality of sound.
  • the air by the membrane changes the pressure by adiabatic process.
  • the volume of air being compressed is unknown. However, changes in air pressure can be measured.
  • a larger volume of air being compressed requires a greater membrane excursion for the same pressure and vice versa.
  • the air pressure changes by adiabatic process the same membrane excursion in the direction that increases the pressure, will create greater pressure change that the excursion in the opposite direction.
  • V 0 the initial volume we compress
  • V ⁇ the volume change that occurs by moving the membrane.
  • V ⁇ has the negative sign because the volume decreases as the membrane moves forward.
  • the force on the membrane is the sum of the forces on both sides of the membrane. Since we listen to the sound only from one side of the membrane, we will monitor the pressure on that side.
  • the pressure difference is ⁇ 1 P ⁇ and the electroacoustic transducer has a surface 1.27 2 ⁇ cm 2 and an ideal dispersion in all directions without sound reflection
  • the acoustic power at the membrane is equal to the power at the spherical surface at some distance from the membrane.
  • the electroacoustic transducer has a smaller membrane surface, a greater pressure will be on the membrane for the same loudness at the same distance. This will increase the adiabatic distortion of the electroacoustic transducer. It is sufficient to adjust the non-linear element to reduce at least three times the quadratic non-linearity of the electroacoustic transducer to feel a significant enhancement of sound.
  • SET (Single Ended Triode) tube amplifiers are known to have a non-linearity greater than 1% at rated power and are not audible to the human ear.
  • Jean Hiraga wrote an article that received a lot of attention and criticism called Amplifier Musicality - A Study of Amplifier Harmonic Distortion Spectrum Analysis where he describes the harmonic structure of the non-linearity of various amplifiers and subjectively evaluates their sound.
  • their non-linearity overrides details of sound that we no longer hear.
  • Hyperbolic function 1/(1 - x) ( Figure 1a ) has the non-linearity with such a harmonic distortion structure that each component is smaller than the previous one for the constant value ( Figure 1b ). If the harmonic structure of the human ear is significantly disturbed, we will hear it as a change of sound. We will approximate the psychoacoustic feature of the human ear by a fifth-degree polynomial function: x ⁇ a x 2 ⁇ b x 3 ⁇ c x 4 ⁇ d x 5
  • a, b, c and d are real positive numbers and x is the relative pressure by the human ear.
  • x is the relative pressure by the human ear.
  • a we use the non-linearity x + a x 2 which, with an approximation of the characteristic of the human ear, gives: x ⁇ 2 a 2 + b x 3 ⁇ a 3 + 3 ab + c x 4 ⁇ 3 a 2 b + 4 ac + d x 5 ⁇ .. where we removed the member x 2 and disturbed the harmonic structure of the human ear.
  • Approximated function of the psychoacoustic feature of the human ear is: x ⁇ 10 ⁇ 44.5 20 x 2 ⁇ 10 ⁇ 79.5 20 x 3 ⁇ 10 ⁇ 101 20 x 4 ⁇ 10 ⁇ 130 20 x 5 .
  • the coefficient of the x 5 member of the approximated function of the psychoacoustical characteristic of the human ear is very small, it can be ignored, as well as the bigger members. In order to hear enough details, it is necessary to reduce at least two times the non-linearities introduced by the x 2 , x 3 and x 4 members of the approximated psychoacoustic characteristics of the human ear.
  • the inverse function of the approximation of the psychoacoustical characteristic of the human ear using the hyperbolic curves is: x + 0.003472 x 2 1 ⁇ 0.06061 x + 0.002484 x 2 1 + 0.01313 x , which, when developed into Taylor series, makes the first five members: x + 10 ⁇ 44.5 20 x 2 + 10 ⁇ 75 20 x 3 + 10 ⁇ 97.6 20 x 4 + 10 ⁇ 122.3 20 x 5 .
  • an apparatus for the implementation of the method comprises at least one non-linear element 4 in the audio chain that has the function of adding the non-linearity to the audio chain that corrects the non-linearity of at least one electroacoustic transducer and/or the non-linearity of the approximate psychoacoustical characteristic of the human ear for the pressure change by the human ear to p ⁇ .
  • Figure 7 schematically illustrates an apparatus 19 for implementing a general method of adding non-linearities in the audio signal in accordance with the present invention.
  • An input audio signal 1 routes into a non-isolated part of the audio signal 1 and at least one isolated audio signal 1; said isolated audio signals 1 are being processed by using the non-linear element 4 in at least one isolated non-linear audio signal 7, and in an adder 8 the non-isolated part of audio signal 1 is combined/merged with at least one isolated non-linear audio signal 7 into a processed output audio signal 9.
  • the branch creating non-linearities comprises: an optional filter 2 before the non-linear element 4, an optional amplifier/attenuator 3 before the non non-linear element 4, the non-linear element 4, an optional amplifier/attenuator 5 after the non-linear element 4 and an optional filter 6 after the non-linear element 4.
  • the non-linear element 4 will have a quadratic function - x 2 or hyperbolic functions x 2 1 ⁇ x and x 2 1 + x .
  • a method for audio signal processing in the audio chain carried out by using the apparatus 19 illustrated in figure 7 the method correcting the non-linearity of the electroacoustic transducers in the audio chain taking into account also the non-linear psychoacoustical characteristic of the human ear, comprises the following steps: splitting of an input audio signal 1 into a non-isolated part of the audio signal 1 and at least one isolated audio signal 1; modifying of at least one isolated audio signal 1 in the non-linear element 4 by adding non-linearities; optionally amplification/attenuation of at least one isolated audio signal in the amplifier/attenuator 3 before the non-linear element 4 and optionally amplification/attenuation of at least one isolated audio signal in the amplifier/attenuator 5 after the non-linear element 4, and optionally filtering of at least one isolated audio signal in the filter 2 before the non-linear element 4 and optionally filtering of at least one isolated audio signal in the filter 6 after the linear element 4, and obtaining at least one isolated non-linear
  • Figure 8 schematically illustrates one embodiment of a non-linear square element 4.
  • the non-linear element 4 Before the non-linear element 4 there is the amplifier/attenuator 3 having positive value a, the non-linear element 4 having the quadratic function - x 2 and the amplifier/attenuator 5 after the non-linear element 4, said amplifier/attenuator 5 has positive value b .
  • the quadratic non-linear element 4 is derived from a signal multiplier 10 that multiplies the output signal after the amplifier/attenuator 3 with itself and changes its sign in a signal inverter 11.
  • Figure 9 schematically illustrates the embodiment of a non-linear hyperbolic element 4.
  • the amplifier/attenuator 3 before the non-linear element 4 has positive value a, the non-linear element 4 having hyperbolic function x 2 1 ⁇ x and the amplifier/attenuator 5 after the non-linear element 4 for the positive value b .
  • the hyperbolic non-linear element 4 is derived from the signal inverter 11, a source 12 of the value of the constant 1, a signal adder 13, a signal scaler 14 and the signal multiplier 10.
  • the signal adder 13 output is 1 - x where the signal further enters the signal scaler 14 that splits the signal x ⁇ (1 - x) which the signal multiplier 10 multiplies by x and x 2 1 ⁇ x is obtained.
  • Figure 10 schematically illustrates the derivation of the non-linear hyperbolic element 4, the amplifier/attenuator 3 being before the non-linear element 4 and having positive value a, non-linear element 4 having hyperbolic function x 2 1 + x and amplifier/attenuator 5 after the non-linear element 4 having positive value b .
  • the hyperbolic non-linear element 4 is derived from the source 12 of the value of the constant 1, the signal adder 13, the signal scaler 14, the signal multiplier 10 and the signal inverter 11.
  • x 2 1 ⁇ x where the signal further enters the signal scaler 14 that splits the signal x ⁇ (1 + x ) which the signal multiplier 10 multiplies by x and x 2 1 + x is obtained.
  • Figure 11 illustrates the preferred audio chain embodiment comprising at least one apparatus 19 and of the method for audio signal processing in said audio chain.
  • the audio chain comprises a pre-amplifier 16 of an input audio signal 15 connected to a first apparatus 19 for audio signal processing by using the hyperbolic non-linearities, an audio crossover 18 connected to the first apparatus 19 (after the first apparatus 19), the audio crossover 18 that splits the processed audio signal in a second apparatus 19 into two signal branches by frequency range.
  • At least two second apparatuses 19 for audio signal processing by using quadratic non-linearity are connected to the audio crossover 18 (after the audio crossover), and to each of the two said second apparatuses 19 a respective power amplifier 20 is connected, as well as a two electroacoustic transducers 21 which are connected to the respective power amplifier 20.
  • the original input audio signal 15 enters the pre-amplifier 16 that controls loudness.
  • the signal from the pre-amplifier 16 goes to the first apparatus 19 for audio signal processing by using hyperbolic non-linearities.
  • the processed signal from the first apparatus 19 goes to the audio crossover 18 that splits the signal into more branches by frequency range. After the audio crossover 18, the signal from each branch goes to the second associated apparatus 19 for audio signal processing by using quadratic non-linearity.
  • the processed signal from each second associated apparatus 19 goes to the associated power amplifier 20 that routes the amplified signal to an associated electroacoustic transducer 21.
  • Each of the second apparatuses 19 for signal processing by using quadratic non-linearity is configured to reduce at least three times the quadratic non-linearity of the electroacoustic transducers 21, taking into account the amplification of the power amplifier 20 that affects the required amount of non-linearity. If the amplification is higher, larger quadratic non-linearity is required on the associated second apparatuses 19.
  • the audio signal processing method in audio chain as illustrated in figure 11 that is carried out with the apparatus 19, and which method corrects the non-linearity of electroacoustic transducers in audio chain taking into account also the non-linear psychoacoustical characteristic of the human ear, comprises the following steps: amplification/attenuation of the input signal 15 in the adjustable preamplifier 16; audio signal processing in the first apparatus 19 by applying hyperbolic non-linearity; splitting audio signals into two branches by frequency range in the audio crossover 18; processing the split audio signals in each branch in the second apparatus 19 by applying quadratic non-linearity; power amplification of the split audio signals in each branch in power amplifiers 20, and routing audio signals of each branch to the associated electroacoustic transducer 21.
  • the other embodiment of the apparatus 19 and of the method within audio chain is illustrated in figure 12 .
  • the input audio signal 15 enters the pre-amplifier 16 that controls loudness.
  • the signal from the pre-amplifier 16 flows to the first apparatus 19 for audio signal processing by using quadratic and hyperbolic non-linearities.
  • the processed signal from the first apparatus 19 flows to the power amplifier 20 which delivers the amplified signal to the audio crossover 18 that splits the signal into more branches by frequency range. After the audio crossover 18, the signal from each branch flows to the corresponding electroacoustic transducer 21.
  • the apparatus 19 applies the filters 2 before the non-linear element 4 and/or filters 6 after the non-linear element 4 so that it adjusts quadratic non-linearity for different frequency ranges.
  • the apparatus 19 is designed to use quadratic and hyperbolic non-linearities by simultaneously adding them to the input audio signal 1 within the adder 8 or is made as a chain of apparatuses 19 connected in a series connection.
  • the audio signal processing method in audio chain shown on the figure 12 that is carried out with the apparatus 19, and which method corrects the non-linearity of electroacoustic transducers in audio chain taking into account also the non-linear psychoacoustical characteristic of the human ear, comprises the following steps: amplification/attenuation of the input signal 15 in the adjustable preamplifier 16; audio signal processing in the first apparatus 19 by using quadratic and hyperbolic non-linearities; amplification of the audio signal in power amplifier 20; splitting audio signals into two branches by frequency range in the audio crossover 18; and routing signals of each branch to the associated electroacoustic transducer 21.
  • the audio signal can be processed either in an analogue format or in a digital format.
  • the present invention relates also to a computer program adapted to run on a processor and to perform the method steps according to the present invention when carried out on a computer device.
  • Figure 13 illustrates an embodiment of the apparatus 19 using as non-linear elements an analogue multiplier 24 to obtain quadratic characteristic and analogue multipliers/scalers 25 to obtain hyperbolic characteristics.
  • the input audio signal 1 arrives at an inverting input stage 23 after which the signal flows to different branches with non-linear elements 4.
  • the first branch has the input filter 2 constructed as an adjustable first-order high-pass RC filter, an adjustable amplifier/attenuator 3 constructed by using operational amplifiers, resistors and a potentiometer and a non-linear element 4 made as the analogue multiplier 24.
  • the second and the third signal processing branches are implemented from a joint adjustable amplifier/attenuator 3 for easier adjusting, constructed by using operational amplifiers, resistors and a potentiometer, as well as single non-linear elements 4 made by using analogue multipliers/scalers 25 having the characteristic x ⁇ y 1 ⁇ z .
  • the outputs of three branches of non-linear parts of the signal 7 enter the adder 8 made of a resistor network that converts the non-linear output voltage signals 7, as well as the audio signal after the input stage 23, into a sum of currents that make up the output audio signal 9, where the output inverting stage 26 converts them into the output voltage 9a.
  • the inverse psychoacoustic feature of the human ear can be approximated also by other functions and derivations of the non-linear element 4 can be performed by applying non-linearities of electronic elements such as diodes, transistors and vacuum tubes.
  • the implementation of the non-linear element 4 by applying vacuum diodes is illustrated in Figure 14 .
  • the linear component was removed by applying an inverting amplifier 28 and a resistor 29 that converts the output voltage of the inverting amplifier 28 into a current which is summed up by the current of the vacuum diode 27.
  • the DC component was removed by applying constant voltage +Vb and a resistor 30.
  • the sum of the currents of the vacuum diode 27, the resistor 29 and a resistor 30 is converted to an output voltage on an inverting amplifier 31.
  • Transmission characteristics of the entire circuit is (( a - x ) 1.5 - b + c x ) ⁇ d, a, b, c and d being positive values.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Details Of Audible-Bandwidth Transducers (AREA)
  • Stereophonic System (AREA)
  • Input Circuits Of Receivers And Coupling Of Receivers And Audio Equipment (AREA)
  • Signal Processing Not Specific To The Method Of Recording And Reproducing (AREA)

Description

    Technical Field of the Invention
  • The present invention refers to an audio signal processing method for enhancing the quality and/or other characteristic of an audio signal. This method corrects a non-linearity of electro-acoustic transducers in an audio chain by taking into account also a non-linear psychoacoustical characteristics of the human ear by adding non-linearities in the audio chain in a controlled manner. Furthermore, the present invention relates to a device/apparatus for the implementation of said method and audio chain configured to correct the non-linearity of electroacoustic transducers, taking into account also the non-linear psychoacoustical characteristics of the human ear. The audio chain contains at least one apparatus for the implementation of the audio signal processing method.
  • Technical Problem
  • Nowadays, the audio chain before the electroacoustic converter displays impeccable features. It is not known why some audio chain components with greater distortions produce better sound than components with lower distortion. Some amplifiers have incorporated vacuum tubes in order to sound better, whereas other employ a small feedback loop to intensify non-linearities of the components. The audio chain distortions before the electroacoustic transducer do not mean that it will sound better or worse. Two different electroacoustic transducers that sound good on their audio chains, will sound worse when they swap places. One of the reasons thereof is that the audio chain before the electroacoustic transducer has non-linearities that reduce its non-linearities which makes it sound better than on the other audio chain.
  • Technical problem that gets solved with the present invention is a method and an apparatus for audio signal processing in audio chain, that correct non-linearity of electroacoustic transducers in audio chain, taking into account also the non-linear psychoacoustic feature of the human ear.
  • State of the art
  • Non-linearities of the electroacoustic transducers have been known for some time now. Non-linear distortions characterize the entire electroacoustic reproduction chain, from the sound recording process on the sound recording medium all the way to the reproduction of sound from the sound recording medium, the amplifier and the loudspeaker itself. There are many publications documenting these non-linearities. The application of non-linearities in musical instruments in order to change the sound has also been known for a while. People do not perceive some non-linearities in the sound, whereas others are perceived, even though they have the same acoustic energy as described in the article Amplifier Musicality - A Study of Amplifier Harmonic Distortion Spectrum Analysis by Jean Hiraga. The document US5133015 discloses the process and the apparatus for audio signal processing, more precisely, the technique that permits various audio signal distortion grades comprising the audio signal distortion to a certain grade. The document US2011255701 discloses the electronic circuit and the audio enhancement method, particularly the electronic circuit that can introduce a predictive and controllable harmonic distortion that increases with an increased signal amplitude. The document US2015249889 discloses the system and the method for digital audio signal processing by extending the loudspeaker frequency response and reducing or eliminating non-linear loudspeaker distortion. An audio signal can be extended by applying a digital linear filter, based on a modified loudspeaker frequency response. A non-linear distortion of a loudspeaker can be cancelled or reduced by a digital non-linear filter based on a reverse parametric model of the loudspeaker.
  • WO 2018/075442 A1 relates to a system for creating a pre-distorted input signal for an audio transducer with the aim of compensating a non-linear behaviour of the transducer. A model of the transducer is either provided theoretically or optimised and an inverse formulation of the model is provided to be implemented inside the non-linear module.
  • In addition, publication "Synthesis of polynomial-based nonlinear device and harmonic shifting technique for virtual bass system", by WEE-TONG LIM ET AL in CIRCUITS AND SYSTEMS, 2009. ISCAS 2009. IEEE INTERNATIONAL SYMPOSIUM ON, IEEE, PISCATAWAY, NJ, USA, 24 May 2009 (2009-05-24), pages 1871-1874, is directed at increasing the bass audio perception from a low frequency signal.
  • Finally, US 2006/133620 A1 deals with correcting non-linearities occurring inside the loudspeaker and linked to its construction. A predistortion filter is implemented by approximating non-linear transducer model using an invertible polynomial series model.
  • Most of the known conventional approaches related to audio signal processing with the view to enhancing the quality and/or other characteristics of audio signal do not take into consideration also the non-linear psychoacoustical characteristic of the human ear.
  • Summary of the Invention
  • The present invention relates to an audio signal processing method in an audio chain that correct a non-linearity of electroacoustic transducers in the audio chain, taking into consideration also a non-linear psychoacoustical characteristics of the human ear by adding non-linearities in the audio chain in a controlled manner, in order to obtain a better acoustic image and more details when reproducing the sound by using approximation of the quadratic and a fifth degree polynomial function in some range.
  • According to the present invention, a method is defined as provided in appended claim 1, and comprises approximating of the non-linear psychoacoustical characteristic of the human ear by a fifth-degree polynomial and adding of at least one non-linear element in front of at least one electroacoustic transducer in the audio chain, whereby the non-linear element has a function of adding a non-linearity in the audio chain that corrects the non-linearity of at least one electroacoustic transducer and/or the non-linearity of the approximated psychoacoustical characteristic of the human ear for a pressure change by the human ear up to p Δ.
  • The audio chain for implementing of said audio signal processing method, according to the present invention, is configured to correct the non-linearity of electroacoustic transducers in the audio chain, taking into account also the non-linear psychoacoustical characteristic of the human ear. Said audio chain contains at least one apparatus for implementing of the audio signal processing method. The aforementioned apparatus has the function of adding the non-linearity to the audio chain that corrects the non-linearity of at least one electroacoustic transducer and/or the non-linearity of the approximate psychoacoustical characteristic of the human ear for the pressure change by the human ear up to p Δ.
  • In addition a computer program is provided as defined in appended claim 12.
  • The method of the present invention, and the computer program reduce limitations of the electroacoustic transducers as well as of the human ear by adding non-linearities that, ultimately reduce non-linearities of an entire audio chain with the human ear, i.e. adding non-linearities to the audio chain so that an audio chain characteristic reduces the non-linearity of the human ear polynomial approximation to the change of pressures p Δ = ±1Pa.
  • Brief Description of the Drawings
  • In the following, the invention shall be described in detail with reference to the drawings, wherein:
    • Figure 1a is a diagram of the hyperbolic function 1 1 x
      Figure imgb0001
      with asymptotes;
    • Figure 1b illustrates a harmonic spectrum of a distorted sinusoidal signal with an amplitude 0.57 of the function shown on the Figure 1a;
    • Figure 2a is a diagram of the hyperbolic function x + 1 50 1 x
      Figure imgb0002
      with asymptotes;
    • Figure 2b illustrates a harmonic spectrum of a distorted sinusoidal signal with an amplitude 0.57 of the function shown on the Figure 2a;
    • Figure 3a illustrates a diagram of the approximated psychoacoustical characteristic of the human ear
      Figure imgb0003
    • Figure 3b illustrates a harmonic spectrum of a distorted sinusoidal signal with an amplitude 2 of the function shown on the Figure 3a;
    • Figure 4a is an inverse approximated psychoacoustical characteristic of the human ear
      Figure imgb0004
      Figure imgb0005
    • Figure 4b illustrates a harmonic spectrum of a distorted sinusoidal signal with an amplitude 2 of the function shown on the Figure 4a;
    • Figure 5a illustrates a diagram of an inverse approximation of the psychoacoustical characteristic of the human ear by hyperbolic functions x + 0.003472 x 2 1 0.06061 x + 0.002484 x 2 1 + 0.01313 x
      Figure imgb0006
      ;
    • Figure 5b illustrates a harmonic spectrum of a distorted sinusoidal signal with an amplitude 2 of the function shown on the Figure 5a;
    • Figure 6a illustrates an approximation diagram of the inverse psychoacoustical characteristic of the human ear employing a vacuum diode x + ((a - x)1.5 - a 1.5 + 1.5 · a 0.5 x) · b, where a = 5.31423 and b = 0.0366175;
    • Figure 6b illustrates a harmonic spectrum of a distorted sinusoidal signal with an amplitude 2 of the function shown on the Figure 6a;
    • Figure 7 schematically illustrates an apparatus for implementing a method of adding non-linearities in an audio signal in accordance with the present invention;
    • Figure 8 schematically illustrates derivation of a non-linear square element of the function -ax 2;
    • Figure 9 schematically illustrates derivation of a non-linear hyperbolic element of the function ax 2 b x
      Figure imgb0007
      ;
    • Figure 10 schematically illustrates derivation of a non-linear hyperbolic element of the function ax 2 b + x
      Figure imgb0008
      ;
    • Figure 11 schematically illustrates an audio chain according to a preferred way of performing the present invention;
    • Figure 12 schematically illustrates an audio chain according to another performance method of the present invention;
    • Figure 13 illustrates one of the embodiments of an apparatus for an audio signal processing according to the present invention by using quadratic and hyperbolic non-linearities; and
    • Figure 14 illustrates implementation of a non-linear element employing a vacuum diode.
    Detailed Description of the invention
  • A method of the present invention takes into consideration one non-linearity of an electroacoustic transducer and non-linearity of the human ear.
  • According to the present invention, an audio signal processing method in an audio chain, which corrects the non-linearity of the electroacoustic transducers in the audio chain, taking into account also the non-linear psychoacoustical characteristic of the human ear, comprises approximating the psychoacoustical characteristics of the human ear by a fifth degree polynomial function, and adding of at least one non-linear element 4 in front of at least one electroacoustic transducer in the audio chain, said non-linear element 4 has a function to add a non-linearity in the audio chain that corrects the non-linearity of at least one electroacoustic transducer and/or the non-linearity of the approximated psychoacoustical characteristic of the human ear for a pressure change by the human ear up to p Δ. According to the present method, the non-linear element 4 reduces the non-linearity of the electroacoustic transducer by applying a quadratic non-linearity which is an inverse function of ax + bx 2 where x is a relative membrane excursion or a relative force on a membrane of the electroacoustic transducer, a and b are positive constants.
  • According to the one embodiment of the invention, the non-linear element 4 reduces the non-linearity of the psychoacoustical characteristic of the human ear x - a x 2 - b x 3 - c x 4 - d x 5 by applying the function which reduces at least two times the non-linearities introduced by the members x 2 , x 3 and x 4, wherein the constants a = 10 44.5 20 , b = 10 79.5 20 , c = 10 101 20
    Figure imgb0009
    and d = 10 130 20
    Figure imgb0010
    stay within the tolerances ±30% for each constant and x is a relative pressure by the human ear.
  • According to the other embodiment of the invention, the non-linear element 4 reduces the non-linearity of the psychoacoustical characteristic of the human ear by applying the hyperbolic function x 2 1 x
    Figure imgb0011
    and x 2 1 + x
    Figure imgb0012
    , where x is the relative pressure by the human ear.
  • According to another embodiment of the invention, the non-linear element 4 reduces the non-linearity of the psychoacoustical characteristic of the human ear by applying the function x 1.5, where x is the relative pressure by the human ear.
  • The present method will be further described in more detail and in accordance with the embodiment of the audio chain according to the present invention.
  • The non-linearity within the electroacoustic transducer is defined by an adiabatic process defined as: p V n = const
    Figure imgb0013
  • Said non-linearity within the electroacoustic transducer affects the quality of sound. In the case of the electroacoustic transducer that produces sound by moving the membrane, the air by the membrane changes the pressure by adiabatic process. The volume of air being compressed is unknown. However, changes in air pressure can be measured. A larger volume of air being compressed requires a greater membrane excursion for the same pressure and vice versa. As the air pressure changes by adiabatic process, the same membrane excursion in the direction that increases the pressure, will create greater pressure change that the excursion in the opposite direction. We will consider two ideal cases. In both cases the mass of the membrane is negligibly small, and it is rigid. In the first case, the membrane excursion is linear and the volume of the compressed air changes linearly with the membrane excursion. We will use the adiabatic process of air. The initial air pressure is atmospheric pressure. Adiabatic equation for air is: p V 1.4 = const
    Figure imgb0014
  • As the membrane moves, the volume changes, which changes the air pressure adiabatically: p = const V 1.4 .
    Figure imgb0015
  • Air pressure by the membrane is: p = const V 0 V Δ 1.4
    Figure imgb0016
    where V 0 is the initial volume we compress, and V Δ the volume change that occurs by moving the membrane. V Δ has the negative sign because the volume decreases as the membrane moves forward. The initial conditions will be: const = p 0, V 0 = 1, and the volume change V Δ = d, where p0 is atmospheric pressure and dr relative membrane excursion. Consequently, we can write: p = p 0 1 d r 1.4 .
    Figure imgb0017
  • If we expand the function into Taylor series according to the relative excursion d, the first five members are: p = p 0 1 + 1.4 x + 1.68 x 2 + 1.904 x 3 + 2.0944 x 4 + ,
    Figure imgb0018
    p = p 0 + p Δ ,
    Figure imgb0019
    where p Δ is the pressure change: p Δ = p 0 1.4 x + 1.68 x 2 + 1.904 x 3 + 2.0944 x 4 + .
    Figure imgb0020
  • For the pressure change of p Δ = 1Pa the relative membrane excursion is: d r p Δ 1.4 p 0 = 1 1.4 10 5 = 7.14 10 6 .
    Figure imgb0021
  • If we put it in Taylor series, the members after the quadratic member are negligible: p 0 1.904 x 3 + 2.0944 x 4 + 0 .
    Figure imgb0022
  • The greatest non-linearity at normal loudness is the quadratic function of the pressure change p Δ p 0 1.4 x + 1.68 x 2 .
    Figure imgb0023
  • In the second case we have the force on the electroacoustic transducer membrane and the air volume that changes linearly with the membrane excursion. For easier calculation, we will use an isothermal process defined for ideal gas as: p V = const .
    Figure imgb0024
  • The force on the membrane is the sum of the forces on both sides of the membrane. Since we listen to the sound only from one side of the membrane, we will monitor the pressure on that side. The force for the membrane surface is: F = A 0 p 1 p 2 ,
    Figure imgb0025
    where p 1 is the pressure on the side of the membrane facing us, p 2 is the pressure on the opposite side of the membrane and A 0 is the surface for the membrane that is constant. Pressure p1, p2 is: p 1 = const v 0 v Δ , p 2 = const v 0 + v Δ
    Figure imgb0026
    where V 0 is the initial volume we compress, and V Δ the volume change that occurs by moving the membrane. The initial conditions will be const = p 0 , V 0 = 1 and V Δ = d, where p 0 is atmospheric pressure, anddr the relative membrane excursion in the direction of listening. We get the equations for p1, p2: p 1 = p 0 1 d r , p 2 = p 0 1 + d r
    Figure imgb0027
  • The force on the membrane is: F = A p 0 1 1 d r 1 1 + d r .
    Figure imgb0028
  • If we assume that the relative force isFr = F/(A 0 p 0), then it is: F r = 1 1 d r 1 1 + d r ,
    Figure imgb0029
    and the relative membrane excursion is: d r = F r 2 + 1 1 F r .
    Figure imgb0030
  • The pressure on the listening side is then p 1 = p 0/(1 - d) which results in: p 1 = p 0 1 F r 2 + 1 1 F r .
    Figure imgb0031
  • Developed into Taylor series per the relative force Fr , we get the pressure on the side of the membrane facing us: p 1 = p 0 1 + x 2 + x 2 4 + x 4 16 + x 6 32 + ,
    Figure imgb0032
    wherein the pressure p1 on the side of the membrane facing us is disclosed as: p 1 = p 0 + p Δ
    Figure imgb0033
    and the pressure change p Δ on the side of listening is: p Δ = p 0 x 2 + x 2 4 + x 4 16 + x 6 32 + .
    Figure imgb0034
  • For the pressure change of p Δ = 1Pa the relative membrane excursion is: F r 2 p Δ p 0 = 2 10 5 = 2 10 5 .
    Figure imgb0035
  • For such a small relative force we can ignore the impact of the bigger members of Taylor series: p 0 x 4 16 + x 6 32 + 0 .
    Figure imgb0036
  • The greatest non-linearity at normal loudness is the quadratic function of pressure change p Δ p 0 x 2 + x 2 4 .
    Figure imgb0037
  • In both cases, we can approximate the air pressure change on the membrane by quadratic function ax + bx 2 where x is the relative membrane excursion in the first case or relative pressure on membrane in the second case. If we consider a normal loudness with the pressure change ±1Pa by the human ear, the pressure on the membrane is greater, because the pressure decreases with the distance. The smaller the surface of the electroacoustic transducer membrane, other parameters being identical, the greater the pressure on it by the same loudness at the same distance. Assuming that, at 2 meters from the electroacoustic transducer, the pressure difference is ±1 and the electroacoustic transducer has a surface 1.272 π cm 2 and an ideal dispersion in all directions without sound reflection, then the acoustic power at the membrane is equal to the power at the spherical surface at some distance from the membrane. By a sphere at a 2 meters distance, this is 4 · 22 π m 2, which makes 160000π cm 2. A sound power is: P = I A = const
    Figure imgb0038
    where P is a power, I is an intensity and A is a surface area. If intensity lis proportional to the square of the pressure change I p 1 2
    Figure imgb0039
    then we can write p 1 2 A 1 = p 2 2 A 2
    Figure imgb0040
    meaning that the pressure on the membrane in the direction of listening is p Δ = ± 1 Pa 160000 1.27 2 = ± 314.96 Pa .
    Figure imgb0041
  • As the pressure on the membrane increases, the electroacoustic transducer works in a non-linear area, influencing the quality of sound we hear. For the calculated loudness p Δ = p 0(ax + bx 2) x p Δ ap 0 ,
    Figure imgb0042
  • And the ratio of the quadratic component bx 2 to the linear component ax is bx 2 ax = bx a = bp Δ a 2 p 0 .
    Figure imgb0043
  • In the first case is a = 1.4, b = 1.68 and p Δ = 314.96Pa, the quadratic component is 0.27% of the linear component, which is not to be ignored. In the second case is a = 1/2, b = 1/4, p Δ = 314.96Paand the quadratic component is 0.31% of the linear component, which is also not to be ignored. To reduce the quadratic non-linearity of the electroacoustic transducer in the chain before it, we incorporate the non-linear element that corrects the non-linearity of the audio chain behind it: y = a x + bx 2
    Figure imgb0044
    where a and b are positive constants. The easiest way to correct the non-linearity of the electroacoustic transducer is by using the non-linear element that approximates the inverse function x + bx 2 which makes: y 1 = b x + 1 1 2 b .
    Figure imgb0045
  • Developed into Taylor series, we get x - bx 2 + 2b 2 x 3 - 5b 3 x 4 +...
  • We will take the first two members of Taylor series: y 1 x bx 2 ,
    Figure imgb0046
  • And we will ignore the remaining members, because their impact is negligible when x is very small. To obtain the characteristics of the non-linear element and the audio chain after it, in a(x + bx 2) we replace x with x - bx 2 and get a(x - 2b 2 x 3 + b 3 x 4), where |-2b 2 x 3 + b 3 x 4| « |bx 2| is when x is very small. That way we reduced distortions by low values x, which is the case by listening of the audio chain at normal loudness, where the pressure change by the human ear is up to p Δ = ±1Pa. If the electroacoustic transducer has a smaller membrane surface, a greater pressure will be on the membrane for the same loudness at the same distance. This will increase the adiabatic distortion of the electroacoustic transducer. It is sufficient to adjust the non-linear element to reduce at least three times the quadratic non-linearity of the electroacoustic transducer to feel a significant enhancement of sound.
  • SET (Single Ended Triode) tube amplifiers are known to have a non-linearity greater than 1% at rated power and are not audible to the human ear. Jean Hiraga wrote an article that received a lot of attention and criticism called Amplifier Musicality - A Study of Amplifier Harmonic Distortion Spectrum Analysis where he describes the harmonic structure of the non-linearity of various amplifiers and subjectively evaluates their sound. In addition to not hearing the non-linearity of SET tube amplifiers, their non-linearity overrides details of sound that we no longer hear. If we assume that the human ear has a similar non-linearity and we do not hear it, then we would not hear it even if the non-linearity were in a part of the audio chain. It is known that the frequency sine wave f 1 and the same one with added frequencies f 2, f 3 , f 4 , f 3 , f 6 that are 2, 3, 4, 5, 6 time greater than f 1 where the amplitudes are: f 1 at 0db, f 2 at -40db, f 3 at -50db, f 4 at -60db, f 5 at -70db and f 6 at -80db will sound the same to the human ear (Figure 2b). Hyperbolic function 1/(1 - x) (Figure 1a) has the non-linearity with such a harmonic distortion structure that each component is smaller than the previous one for the constant value (Figure 1b). If the harmonic structure of the human ear is significantly disturbed, we will hear it as a change of sound. We will approximate the psychoacoustic feature of the human ear by a fifth-degree polynomial function: x a x 2 b x 3 c x 4 d x 5
    Figure imgb0047
  • Where a, b, c and d are real positive numbers and x is the relative pressure by the human ear. To determine the values of a, b, c, and d, we add non-linearities to the audio signal until we have reached the distortion of the harmonic structure of the human ear we hear. To determine the coefficient a, we use the non-linearity x + a x 2 which, with an approximation of the characteristic of the human ear, gives: x 2 a 2 + b x 3 a 3 + 3 ab + c x 4 3 a 2 b + 4 ac + d x 5 ..
    Figure imgb0048
    where we removed the member x 2 and disturbed the harmonic structure of the human ear. To determine the coefficient b, we use the non-linearity x + b x 3 which, with an approximation of the characteristic of the human ear, gives: x a x 2 2 ab + c x 4 3 b 2 + d x 5 ..
    Figure imgb0049
    where we removed the member x 3 and disturbed the harmonic structure of the human ear. To determine the coefficient c, we use the non-linearity x + c x 4 which, with an approximation of the characteristic of the human ear, gives: x a x 2 b x 3 2 ac + d x 5 ..
    Figure imgb0050
    where we removed the member x 4 and disturbed the harmonic structure of the human ear. To determine the coefficient d, we use the non-linearity x + d x 5 which, with an approximation of the characteristic of the human ear, gives: x a x 2 b x 3 c x 4 ..
    Figure imgb0051
    where we removed the member x 5 and disturbed the harmonic structure of the human ear. The members a = 10 44.5 20 , b = 10 79.5 20 , c = 10 101 20
    Figure imgb0052
    and d = 10 130 20
    Figure imgb0053
    within the tolerances ±30% for each member were obtained through hearing tests. Approximated function of the psychoacoustic feature of the human ear is: x 10 44.5 20 x 2 10 79.5 20 x 3 10 101 20 x 4 10 130 20 x 5 .
    Figure imgb0054
  • By applying the Lagrange-Bürmann formula, we get the following inverse function of the approximation of the human ear: x + 10 44.5 20 x 2 + 10 75 20 x 3 + 10 97.6 20 x 4 + 10 122.3 20 x 5 + ..
    Figure imgb0055
  • Since the coefficient of the x 5 member of the approximated function of the psychoacoustical characteristic of the human ear is very small, it can be ignored, as well as the bigger members. In order to hear enough details, it is necessary to reduce at least two times the non-linearities introduced by the x 2 , x 3 and x 4 members of the approximated psychoacoustic characteristics of the human ear. The inverse function of the approximation of the psychoacoustic feature of the human ear can be derived using the hyperbolic curves a x 2 1 b x
    Figure imgb0056
    and c x 2 1 + d x
    Figure imgb0057
    , where a = 0.00372, b = 0.06061, c = 0.002484 and d = 0.01313 (Figure 5a). The inverse function of the approximation of the psychoacoustical characteristic of the human ear using the hyperbolic curves is: x + 0.003472 x 2 1 0.06061 x + 0.002484 x 2 1 + 0.01313 x ,
    Figure imgb0058
    which, when developed into Taylor series, makes the first five members: x + 10 44.5 20 x 2 + 10 75 20 x 3 + 10 97.6 20 x 4 + 10 122.3 20 x 5 .
    Figure imgb0059
  • In order to see how the non-linearity of the human ear decreases, in the approximate psychoacoustic feature of the human ear x 10 44.5 20 x 2 10 79.5 20 x 3 10 101 20 x 4 10 130 20 x 5
    Figure imgb0060
    we replace x with x + 10 44.5 20 x 2 + 10 75 20 x 3 + 10 97.6 20 x 4 + 10 122.3 20 x 5
    Figure imgb0061
    and obtain the first five members: x + 10 120.5 20 x 3 + 10 146.5 20 x 4 + 10 177.5 20 x 5 .
    Figure imgb0062
  • Since 2 0 10 44.5 20 , 2 10 120.5 20 10 79.5 20
    Figure imgb0063
    and 2 10 146.5 20 10 101 20
    Figure imgb0064
    , we reduced at least two times the non-linearities introduced by the x 2, x 3 and x 4 members of the approximated psychoacoustic characteristics of the human ear.
  • According to the present invention, an apparatus for the implementation of the method comprises at least one non-linear element 4 in the audio chain that has the function of adding the non-linearity to the audio chain that corrects the non-linearity of at least one electroacoustic transducer and/or the non-linearity of the approximate psychoacoustical characteristic of the human ear for the pressure change by the human ear to p Δ.
  • Figure 7 schematically illustrates an apparatus 19 for implementing a general method of adding non-linearities in the audio signal in accordance with the present invention. An input audio signal 1 routes into a non-isolated part of the audio signal 1 and at least one isolated audio signal 1; said isolated audio signals 1 are being processed by using the non-linear element 4 in at least one isolated non-linear audio signal 7, and in an adder 8 the non-isolated part of audio signal 1 is combined/merged with at least one isolated non-linear audio signal 7 into a processed output audio signal 9. The branch creating non-linearities comprises: an optional filter 2 before the non-linear element 4, an optional amplifier/attenuator 3 before the non non-linear element 4, the non-linear element 4, an optional amplifier/attenuator 5 after the non-linear element 4 and an optional filter 6 after the non-linear element 4. The non-linear element 4 will have a quadratic function -x 2 or hyperbolic functions x 2 1 x
    Figure imgb0065
    and x 2 1 + x
    Figure imgb0066
    .
  • A method for audio signal processing in the audio chain carried out by using the apparatus 19 illustrated in figure 7, the method correcting the non-linearity of the electroacoustic transducers in the audio chain taking into account also the non-linear psychoacoustical characteristic of the human ear, comprises the following steps: splitting of an input audio signal 1 into a non-isolated part of the audio signal 1 and at least one isolated audio signal 1; modifying of at least one isolated audio signal 1 in the non-linear element 4 by adding non-linearities; optionally amplification/attenuation of at least one isolated audio signal in the amplifier/attenuator 3 before the non-linear element 4 and optionally amplification/attenuation of at least one isolated audio signal in the amplifier/attenuator 5 after the non-linear element 4, and optionally filtering of at least one isolated audio signal in the filter 2 before the non-linear element 4 and optionally filtering of at least one isolated audio signal in the filter 6 after the linear element 4, and obtaining at least one isolated non-linear audio signal 7; and combining a non-isolated part of the audio signal 1 with at least one isolated non-linear audio signal 7 in the adder 8 into the output audio signal 9.
  • Figure 8 schematically illustrates one embodiment of a non-linear square element 4. Before the non-linear element 4 there is the amplifier/attenuator 3 having positive value a, the non-linear element 4 having the quadratic function -x 2 and the amplifier/attenuator 5 after the non-linear element 4, said amplifier/attenuator 5 has positive value b. The quadratic non-linear element 4 is derived from a signal multiplier 10 that multiplies the output signal after the amplifier/attenuator 3 with itself and changes its sign in a signal inverter 11. The total transfer function of the circuit on the figure 8 is -(ax)2 b = -a 2 bx 2 . By adjusting the values a and b, we can control how much of the quadratic non-linearity we will add to a linear part of the signal.
  • Figure 9 schematically illustrates the embodiment of a non-linear hyperbolic element 4. The amplifier/attenuator 3 before the non-linear element 4 has positive value a, the non-linear element 4 having hyperbolic function x 2 1 x
    Figure imgb0067
    and the amplifier/attenuator 5 after the non-linear element 4 for the positive value b. The hyperbolic non-linear element 4 is derived from the signal inverter 11, a source 12 of the value of the constant 1, a signal adder 13, a signal scaler 14 and the signal multiplier 10. At the signal adder 13 output is 1 - x where the signal further enters the signal scaler 14 that splits the signal x ÷ (1 - x) which the signal multiplier 10 multiplies by x and x 2 1 x
    Figure imgb0068
    is obtained. The total transfer function of the circuit on the figure 9 is ax 2 1 ax b = a 2 x 2 1 ax b .
    Figure imgb0069
  • By adjusting the values a and b we can obtain any function cx 2 1 dx
    Figure imgb0070
    where c and d are arbitrary positive values.
  • Figure 10 schematically illustrates the derivation of the non-linear hyperbolic element 4, the amplifier/attenuator 3 being before the non-linear element 4 and having positive value a, non-linear element 4 having hyperbolic function x 2 1 + x
    Figure imgb0071
    and amplifier/attenuator 5 after the non-linear element 4 having positive value b. The hyperbolic non-linear element 4 is derived from the source 12 of the value of the constant 1, the signal adder 13, the signal scaler 14, the signal multiplier 10 and the signal inverter 11. At the signal adder 13 output is x 2 1 x
    Figure imgb0072
    where the signal further enters the signal scaler 14 that splits the signal x ÷ (1 + x) which the signal multiplier 10 multiplies by x and x 2 1 + x
    Figure imgb0073
    is obtained. The total transfer function of the circuit on the figure 10 is ax 2 1 + ax b = a 2 x 2 1 + ax b .
    Figure imgb0074
  • By adjusting the values a and b we can obtain any function c x 2 1 + d x
    Figure imgb0075
    where c and d are arbitrary positive values.
  • Figure 11 illustrates the preferred audio chain embodiment comprising at least one apparatus 19 and of the method for audio signal processing in said audio chain. The audio chain comprises a pre-amplifier 16 of an input audio signal 15 connected to a first apparatus 19 for audio signal processing by using the hyperbolic non-linearities, an audio crossover 18 connected to the first apparatus 19 (after the first apparatus 19), the audio crossover 18 that splits the processed audio signal in a second apparatus 19 into two signal branches by frequency range. At least two second apparatuses 19 for audio signal processing by using quadratic non-linearity are connected to the audio crossover 18 (after the audio crossover), and to each of the two said second apparatuses 19 a respective power amplifier 20 is connected, as well as a two electroacoustic transducers 21 which are connected to the respective power amplifier 20. The original input audio signal 15 enters the pre-amplifier 16 that controls loudness. The signal from the pre-amplifier 16 goes to the first apparatus 19 for audio signal processing by using hyperbolic non-linearities. The processed signal from the first apparatus 19 goes to the audio crossover 18 that splits the signal into more branches by frequency range. After the audio crossover 18, the signal from each branch goes to the second associated apparatus 19 for audio signal processing by using quadratic non-linearity. The processed signal from each second associated apparatus 19 goes to the associated power amplifier 20 that routes the amplified signal to an associated electroacoustic transducer 21. Each of the second apparatuses 19 for signal processing by using quadratic non-linearity is configured to reduce at least three times the quadratic non-linearity of the electroacoustic transducers 21, taking into account the amplification of the power amplifier 20 that affects the required amount of non-linearity. If the amplification is higher, larger quadratic non-linearity is required on the associated second apparatuses 19. The first apparatus 19 for signal processing by using hyperbolic non-linearities is configured to reduce at least two times the non-linearity of the psychoacoustic feature of the human ear within the area of the pressure change p Δ = ±1Pa, taking into account the amplification of the power amplifier 20, an efficiency of the electroacoustic transducer 21 and a distance the human ear is at from the electroacoustic transducers. If the amplification is greater and/or the efficiency of the electroacoustic transducer is greater and/or the distance of the human ear from the electroacoustic transducer is smaller, larger hyperbolic non-linearities on the first signal processing apparatus 19 are also required.
  • The audio signal processing method in audio chain as illustrated in figure 11, that is carried out with the apparatus 19, and which method corrects the non-linearity of electroacoustic transducers in audio chain taking into account also the non-linear psychoacoustical characteristic of the human ear, comprises the following steps: amplification/attenuation of the input signal 15 in the adjustable preamplifier 16; audio signal processing in the first apparatus 19 by applying hyperbolic non-linearity; splitting audio signals into two branches by frequency range in the audio crossover 18; processing the split audio signals in each branch in the second apparatus 19 by applying quadratic non-linearity; power amplification of the split audio signals in each branch in power amplifiers 20, and routing audio signals of each branch to the associated electroacoustic transducer 21.
  • The other embodiment of the apparatus 19 and of the method within audio chain is illustrated in figure 12. The input audio signal 15 enters the pre-amplifier 16 that controls loudness. The signal from the pre-amplifier 16 flows to the first apparatus 19 for audio signal processing by using quadratic and hyperbolic non-linearities. The processed signal from the first apparatus 19 flows to the power amplifier 20 which delivers the amplified signal to the audio crossover 18 that splits the signal into more branches by frequency range. After the audio crossover 18, the signal from each branch flows to the corresponding electroacoustic transducer 21. The signal processing apparatus 19 by using quadratic and hyperbolic non-linearities is configured to reduce at least three times the quadratic non-linearity of the electroacoustic transducers 21, taking into account the amplification of the power amplifier 20 that affects the required amount of quadratic non-linearities. Also, the apparatus 19 is configured to reduce at least two times the non-linearity of the psychoacoustic feature of the human ear within an area of pressure change p Δ = ±1Pa, taking into account the amplification of the power amplifier 20, the efficiency of the electroacoustic transducer 21 and the distance the human ear is at from the electroacoustic transducers. If the amplification is greater and/or the efficiency of the electroacoustic transducer is greater and/or the distance of the human ear from the electroacoustic transducer is smaller, larger hyperbolic non-linearities on the apparatus 19 are also required. As the apparatus 19 reduces quadratic non-linearities for several electroacoustic transducers that have different quadratic non-linearities and work in different frequency ranges, the apparatus applies the filters 2 before the non-linear element 4 and/or filters 6 after the non-linear element 4 so that it adjusts quadratic non-linearity for different frequency ranges. The apparatus 19 is designed to use quadratic and hyperbolic non-linearities by simultaneously adding them to the input audio signal 1 within the adder 8 or is made as a chain of apparatuses 19 connected in a series connection.
  • The audio signal processing method in audio chain shown on the figure 12, that is carried out with the apparatus 19, and which method corrects the non-linearity of electroacoustic transducers in audio chain taking into account also the non-linear psychoacoustical characteristic of the human ear, comprises the following steps: amplification/attenuation of the input signal 15 in the adjustable preamplifier 16; audio signal processing in the first apparatus 19 by using quadratic and hyperbolic non-linearities; amplification of the audio signal in power amplifier 20; splitting audio signals into two branches by frequency range in the audio crossover 18; and routing signals of each branch to the associated electroacoustic transducer 21.
  • According to the method of the present invention, the apparatus 19 reduces by two times the non-linearity of the approximated psychoacoustical characteristic of the human ear and/or by 3 times the quadratic non-linearity of the electroacoustic transducer, and the pressure change by the human ear up to p Δ = +1Pa.
  • Furthermore, according to the method of the present invention, the audio signal can be processed either in an analogue format or in a digital format.
  • The present invention relates also to a computer program adapted to run on a processor and to perform the method steps according to the present invention when carried out on a computer device.
  • Figure 13 illustrates an embodiment of the apparatus 19 using as non-linear elements an analogue multiplier 24 to obtain quadratic characteristic and analogue multipliers/scalers 25 to obtain hyperbolic characteristics. The input audio signal 1 arrives at an inverting input stage 23 after which the signal flows to different branches with non-linear elements 4. The first branch has the input filter 2 constructed as an adjustable first-order high-pass RC filter, an adjustable amplifier/attenuator 3 constructed by using operational amplifiers, resistors and a potentiometer and a non-linear element 4 made as the analogue multiplier 24. The second and the third signal processing branches are implemented from a joint adjustable amplifier/attenuator 3 for easier adjusting, constructed by using operational amplifiers, resistors and a potentiometer, as well as single non-linear elements 4 made by using analogue multipliers/scalers 25 having the characteristic x y 1 z
    Figure imgb0076
    . The outputs of three branches of non-linear parts of the signal 7 enter the adder 8 made of a resistor network that converts the non-linear output voltage signals 7, as well as the audio signal after the input stage 23, into a sum of currents that make up the output audio signal 9, where the output inverting stage 26 converts them into the output voltage 9a.
  • The inverse psychoacoustic feature of the human ear can be approximated also by other functions and derivations of the non-linear element 4 can be performed by applying non-linearities of electronic elements such as diodes, transistors and vacuum tubes. Figure 6a illustrates an approximation of the non-linearity of the inverse function of the human ear 10 44.5 20 x 2 + 10 75 20 x 3 + 10 97.6 20 x 4 + 10 122.3 20 x 5
    Figure imgb0077
    by non-linearity x 1.5, which corresponds to the current/voltage characteristic of the vacuum diode I = k · U 1.5 . The approximation on the figure 6a is characterized by x + ((a - x)1.5 - a 1.5 + 1.5 · a 0.5 x) · b, being a = 5.31423 and b = 0.0366175 (full line) and when developed in Taylor series, the first five members are obtained: x + 10 44.5 20 x 2 + 10 74.6 20 x 3 + 10 97.6 20 x 4 + 10 118.1 20 x 5 .
    Figure imgb0078
  • In order to see how the non-linearity of the human ear decreases, in the approximate psychoacoustic feature of the human ear x 10 44.5 20 x 2 10 79.5 20 x 3 10 101 20 x 4 10 130 20 x 5
    Figure imgb0079
    we replace x with x + 10 45 20 x 2 + 10 74.6 20 x 3 + 10 97.6 20 x 4 + 10 118.1 20 x 5
    Figure imgb0080
    and obtain the first five members: x + 10 100 20 x 3 10 145.6 20 x 4 + 10 126.5 20 x 5 .
    Figure imgb0081
  • Since 2 0 10 44.5 20 , 2 10 100 20 10 79.5 20
    Figure imgb0082
    and 2 10 145.6 20 10 101 20
    Figure imgb0083
    , we reduced at least two times the non-linearities introduced by the x 2, x 3 and x 4 members of the approximated psychoacoustic characteristics of the human ear.
  • The implementation of the non-linear element 4 by applying vacuum diodes is illustrated in Figure 14. The input signal flows to a resistor network connected to a constant voltage -Va, that adds a DC component to the input signal that flows to voltage followers made by the means of operational amplifiers. After the voltage followers, the signal flows to a vacuum diode 27 that has a current/voltage characteristic I = k · U 1.5 . The linear component was removed by applying an inverting amplifier 28 and a resistor 29 that converts the output voltage of the inverting amplifier 28 into a current which is summed up by the current of the vacuum diode 27. The DC component was removed by applying constant voltage +Vb and a resistor 30. The sum of the currents of the vacuum diode 27, the resistor 29 and a resistor 30 is converted to an output voltage on an inverting amplifier 31. Transmission characteristics of the entire circuit is ((a - x)1.5 - b + c x) · d, a, b, c and d being positive values.
  • The use of the invention
  • We use an audio signal processing method and apparatus in an audio chain to reduce an unwanted non-linearity of electroacoustic transducers as well as of the human ear. Due to the adjustability of the apparatus to various electroacoustic transducers and to the human ear, the apparatus is widely used in an audio industry.

Claims (12)

  1. An audio signal processing method in an audio chain that corrects a non-linearity of electroacoustic transducers in the audio chain, taking into account a non-linear psychoacoustical characteristic of the human ear, the method comprises:
    - adding of at least one non-linear element (4) in front of at least one electroacoustic transducer in the audio chain, each non-linear element (4) is adding a non-linearity in the audio chain that corrects the non-linearity of at least one electroacoustic transducer and pre-compensates a polynomial approximation of non-linearity of the human ear to a pressure change up to p Δ, wherein a correction of the non-linearity of the electroacoustic transducer is performed by applying a quadratic non-linearity function which is an inverse function of a'x' + b'x' 2 where x' is a relative membrane excursion or a relative force on a membrane of the electroacoustic transducer, where a' and b' are positive constants,
    characterized by that the non-linear element (4) pre-compensates the non-linear psychoacoustical characteristic of the human ear expressed as a fifth-degree polynomial function x - a x 2 - b x 3 - c x 4 - d x 5 , wherein a, b, c and d are real positive numbers determined by an approximation of the characteristic of the human ear within the tolerances ±30% for each member and x is a relative pressure by the human ear, by applying an inverse function to the fifth-degree polynomial function which reduces at least two times the non-linearities introduced by the members x 2 , x 3 and x 4.
  2. The method according to claim 1, wherein the non-linear element (4) pre-compensates the non-linearity of the psychoacoustical characteristic of the human ear by using the hyperbolic function x 2 1 x
    Figure imgb0084
    and x 2 1 + x
    Figure imgb0085
    to express the inverse function, where x is the relative pressure by the human ear.
  3. The method according to claim 1, wherein the non-linear element (4) pre-compensates the non-linearity of the psychoacoustical characteristic of the human ear by using the function x 1.5 to express the inverse function, where x is the relative pressure by the human ear.
  4. The method according to claim 1, wherein the non-linear element (4) pre-compensates the non-linearity of the psychoacoustical characteristic of the human ear by using the Lagrange- Bürmann formula to express the inverse function, where x is the relative pressure by the human ear.
  5. The method according to claim 1, wherein determined members are
    Figure imgb0086
    Figure imgb0087
  6. The method according to any of the claims 1-5, wherein the method comprises the following steps:
    (a) routing of an input audio signal (1) to a non-isolated part of the input audio signal (1) and at least one isolated audio signal (1);
    (b) modifying at least one isolated audio signal (1) in the non-linear element (4) by adding non-linearities;
    (c) amplification/attenuation of at least one isolated audio signal in an amplifier/attenuator (3) before the non-linear element (4) and amplification/attenuation of at least one isolated audio signal in an amplifier/attenuator (5) after the non-linear element (4), and filtering of at least one isolated audio signal in a filter (2) before the non-linear element (4) and filtering of at least one isolated audio signal in a filter (6) after the linear element (4), and obtaining at least one isolated non-linear audio signal (7); and
    (d) combining the non-isolated part of the audio signal (1) and at least one isolated non-linear audio signal (7) in an adder (8) into an output audio signal (9).
  7. The method according to any of claims the 1-5, wherein the method comprises the following steps:
    (a) amplification/attenuation of an input signal (15) in an adjustable preamplifier (16);
    (b) audio signal processing in a first apparatus (19) by applying hyperbolic non-linearity;
    (c) splitting audio signals into two branches by frequency range in an audio crossover (18);
    (d) processing the split audio signals in each branch in at least one second apparatus (19) by applying quadratic non-linearity;
    (e) amplification of a power of the split audio signals in each branch in power amplifiers (20), and
    (f) routing audio signals of each branch to an associated electroacoustic transducer (21).
  8. The method according to any of the claims 1-5, wherein the method comprises the following steps:
    (a) amplification/attenuation of the input signal (15) in the adjustable preamplifier (16);
    (b) audio signal processing in the first apparatus (19) by applying quadratic and hyperbolic non-linearity;
    (c) audio signal power amplification in the power amplifier (20);
    (d) splitting audio signals into two branches by frequency range in the audio crossover (18); and
    (e) routing audio signals of each branch to the associated electroacoustic transducer (21).
  9. The method according to claim 8, wherein the first apparatus (19) reduces at least 3 times the quadratic non-linearity of the electroacoustic transducers (21).
  10. The method according to claim 7, wherein each of the second apparatus (19) reduces at least 3 times the quadratic non-linearity of the electroacoustic transducers (21).
  11. The method according to any of the preceding claims, wherein the pressure change by the human ear is up to p Δ = ±1Pa.
  12. A computer program adapted for execution on a processor and for performing the method steps according to any of claims 1 to 11 when executed on a computer device.
EP19828302.0A 2019-02-13 2019-10-22 Audio signal processing method and device Active EP3925233B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
HRP20230332TT HRP20230332T1 (en) 2019-02-13 2019-10-22 Audio signal processing method and device

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
HRP20190292AA HRP20190292A2 (en) 2019-02-13 2019-02-13 Device and method used for audio signal analysis
HRP20191903AA HRPK20191903B3 (en) 2019-02-13 2019-10-21 Method and device for audio signal processing
PCT/HR2019/000027 WO2020165616A1 (en) 2019-02-13 2019-10-22 Audio signal processing method and device

Publications (2)

Publication Number Publication Date
EP3925233A1 EP3925233A1 (en) 2021-12-22
EP3925233B1 true EP3925233B1 (en) 2023-03-01

Family

ID=72046114

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19828302.0A Active EP3925233B1 (en) 2019-02-13 2019-10-22 Audio signal processing method and device

Country Status (3)

Country Link
EP (1) EP3925233B1 (en)
CN (1) CN113424557A (en)
HR (2) HRP20190292A2 (en)

Also Published As

Publication number Publication date
HRP20190292A2 (en) 2020-08-21
EP3925233A1 (en) 2021-12-22
HRPK20191903B3 (en) 2022-09-02
CN113424557A (en) 2021-09-21
HRP20191903A2 (en) 2021-02-19

Similar Documents

Publication Publication Date Title
EP1791390B1 (en) Ultra directional speaker system and signal processing method thereof
US10015593B2 (en) Digital signal processor for audio extensions and correction of nonlinear distortions in loudspeakers
Klippel The mirror filter-a new basis for reducing nonlinear distortion and equalizing response in woofer systems
CN107231590B (en) Techniques for tuning distortion response of a speaker
KR20050023841A (en) Device and method of reducing nonlinear distortion
US20090161879A1 (en) Sound Signal Processing Device, Method of Processing Sound Signal, Sound Reproducing System, Method of Designing Sound Signal Processing Device
KR101981575B1 (en) An Audio Quality Enhancement Method And Device For Ultra Directional Speaker
EP3068048B1 (en) Power amplifier and input signal adjusting method
US7995774B2 (en) Sound field control apparatus and sound field control method
CN102547517A (en) Bass signal harmonic generating method and device and sound playing equipment
EP3925233B1 (en) Audio signal processing method and device
US11856385B2 (en) Audio signal processing method and device
US20180255397A1 (en) A method of an audio signal correction
JPS63234699A (en) Sound field correcting device
US4995113A (en) Device for processing an audio-frequency electrical signal
RU2778274C1 (en) Audio signal processing method
US20120033829A1 (en) Audio phase corrector
US20030016837A1 (en) Stereo sound circuit device for providing three-dimensional surrounding effect
JP2008236198A (en) Modulator for super-directional speaker
JPH1155782A (en) Distortion removal device, coefficient deciding method for the same, processing speaker system, multiprocessor and amplifier
KR101882140B1 (en) Complex speaker system capable of ultra directional and non directional simultaneous signal output
JPWO2009008068A1 (en) Automatic sound field correction device
Payal et al. Equalization of Nonlinear Propagation Distortion in Cylindrical Waveguides
KR101128353B1 (en) Method of processing a signal and a High efficiency and directivity speaker system using a Block-based Detecting Signal
Başay et al. Optimization of Parametric Equalizer Filters in In-Vehicle Audio Systems with Genetic Algorithm

Legal Events

Date Code Title Description
REG Reference to a national code

Ref country code: HR

Ref legal event code: TUEP

Ref document number: P20230332T

Country of ref document: HR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210720

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20221017

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 1551848

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230315

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602019025960

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20230426

REG Reference to a national code

Ref country code: HR

Ref legal event code: T1PR

Ref document number: P20230332

Country of ref document: HR

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230601

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1551848

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230602

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

REG Reference to a national code

Ref country code: HR

Ref legal event code: ODRP

Ref document number: P20230332

Country of ref document: HR

Payment date: 20231005

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230703

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230701

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20231010

Year of fee payment: 5

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602019025960

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: HR

Payment date: 20231005

Year of fee payment: 5

Ref country code: DK

Payment date: 20231010

Year of fee payment: 5

Ref country code: DE

Payment date: 20231009

Year of fee payment: 5

26N No opposition filed

Effective date: 20231204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230301

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20231031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231022

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20231022

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231022

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231022

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231031

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231031

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231022