EP2539892A1 - Compression de flux audio multicanal - Google Patents
Compression de flux audio multicanalInfo
- Publication number
- EP2539892A1 EP2539892A1 EP11708920A EP11708920A EP2539892A1 EP 2539892 A1 EP2539892 A1 EP 2539892A1 EP 11708920 A EP11708920 A EP 11708920A EP 11708920 A EP11708920 A EP 11708920A EP 2539892 A1 EP2539892 A1 EP 2539892A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- sources
- source
- spatial
- space
- signals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000007906 compression Methods 0.000 title claims description 27
- 230000006835 compression Effects 0.000 title claims description 26
- 238000000034 method Methods 0.000 claims description 37
- 238000004590 computer program Methods 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 5
- 230000000875 corresponding effect Effects 0.000 description 20
- 230000000873 masking effect Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 7
- 230000004907 flux Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 238000000354 decomposition reaction Methods 0.000 description 4
- 230000008447 perception Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000015556 catabolic process Effects 0.000 description 3
- 230000002596 correlated effect Effects 0.000 description 3
- 238000006731 degradation reaction Methods 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 244000309464 bull Species 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000004377 microelectronic Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 101000822695 Clostridium perfringens (strain 13 / Type A) Small, acid-soluble spore protein C1 Proteins 0.000 description 1
- 101000655262 Clostridium perfringens (strain 13 / Type A) Small, acid-soluble spore protein C2 Proteins 0.000 description 1
- 101000655256 Paraclostridium bifermentans Small, acid-soluble spore protein alpha Proteins 0.000 description 1
- 101000655264 Paraclostridium bifermentans Small, acid-soluble spore protein beta Proteins 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000010420 art technique Methods 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000006735 deficit Effects 0.000 description 1
- 230000003292 diminished effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/18—Vocoders using multiple modes
- G10L19/20—Vocoders using multiple modes using sound class specific coding, hybrid encoders or object based coding
Definitions
- the present invention generally relates to multi-channel audio stream compression - i.e., including a plurality of audio signals - for processing by an audio system including a plurality of loudspeakers to reproduce a scene. spatialized sound.
- the compression means apply to audio streams encoded according to a 5.1, 6.1, 7.1, 10.2, 22.2 multichannel coding format, or else according to an ambiophonic coding format commonly referred to by the acronym " HOA "for” Higher Order Ambisonics ".
- the HOA surround encoding format is particularly detailed in the document Daniel, J. Acoustic field representation, application to the transmission and reproduction of complex sound scenes in a multimedia context. 2000, Thesis of the University Pierre and Marie Curie (Paris VI): Paris.
- the compression performed on the audio streams may in particular be introduced prior to a transmission step, broadcast, or storage for example on an optical disk.
- Another possible alternative is to mix the different streams to obtain a mono or stereo signal.
- This technique is used in particular in the coding "MPEG Surround” at low bit rate, that is to say whose rate is typically of the order of 64 kbits / s for 5 to 7 channels. This operation is conventionally described as "downmix” in English.
- the mono or stereo signal can then be encoded according to a conventional compression scheme to obtain a compressed stream. Spatial information is further calculated and added to the compressed stream.
- This spatial information is for example the delay between two channels (in English, "ICTD” for “Inter-Channel Time Difference”), the energy difference between two channels (in English “ICLD” for “Inter-Channel Level Difference” ), the correlation between two channels (in English “ICC” for “Inter-Channel Coherence”).
- the coding of the mono or stereo signal resulting from the "downmix” operation is carried out on the basis of the unsuitable hypothesis of a monophonic or stereophonic perception and thus does not take into account the characteristics specific to a spatial perception of the multi signal.
- -channel especially in the case where the audio stream has a large number of channels, typically greater than or equal to 7.
- the inaudible degradation on the signal resulting from the "downmix” operation can become audible on a multi-speaker rendering device of the multi-channel stream resulting from the "upmix” processing, in particular because of the binaural unmasking phenomenon.
- a multi-speaker rendering device of the multi-channel stream resulting from the "upmix” processing in particular because of the binaural unmasking phenomenon.
- the present invention aims to improve the situation.
- a method of compressing an audio stream comprising a plurality of signals.
- the audio stream describes a sound scene produced by a plurality of sources in a space.
- the method comprises the following steps:
- the compression method proposes a solution for exploiting the psychoceptive and cognitive properties of a listener's spatial audio perception to compress the multichannel audio stream. These properties include the spatial masking of a predominant source on other sources, reducing an auditor's ability to locate them.
- the invention makes it possible to reduce the presence in the audio stream of the rendition information sound not exploited by the auditory system of the listener, without presenting risks of introduction of audible artifacts in the spatialized rendering system, unlike compression techniques of the prior art.
- the method according to the invention makes it possible to exploit the interactions between the different sources, since the spatial resolution of each source is determined, not only according to the characteristics of said source, but also according to those of the other sources of space. Compared to other compression techniques treating each signal separately, the compression ratio obtained is potentially higher.
- the signals of the audio stream include information representing the sound scene in a spherical harmonic base.
- the method may comprise a step of transposing the information included in the signals of the audio stream representing the sound scene into a spherical harmonics base, thus making it possible to convert the stream.
- the compressed stream can also be generated by subdividing the space into subspaces, and truncating, for each of the subspaces, an order of representation of the signals in the base of spherical harmonics, up to obtain a spatial resolution substantially equal to the maximum value of the spatial resolutions associated with the sources present in the subspace under consideration.
- the truncation of the order of representation of the signals makes it possible to reduce the spatial resolution of the representation of the signals.
- the sound scene can be described by a set of signals corresponding to the coefficients of the decomposition of the acoustic wave on the basis of spherical harmonics.
- This representation has the property of scalability, in the sense that the coefficients are hierarchical and that the coefficients of the first orders contain a complete description of the sound scene. Higher order coefficients only specify spatial information.
- the truncation of the order of representation amounts in this case to eliminating the components of the higher orders until reaching the determined resolution.
- the subdivision of the space into subspaces can be dynamic over time.
- a dynamic subdivision makes it possible to group adjacent sources of spatial resolutions perceived in a similar manner in the same subspace.
- the various steps of the compression methods are determined by instructions of computer programs.
- the invention also relates to computer programs on an information medium, these programs being capable of being implemented respectively in a computer, these programs respectively comprising instructions adapted to the implementation of the steps of the compression methods which have just been described.
- These programs can use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other form desirable shape.
- the invention also relates to a computer-readable information medium, comprising instructions of a computer program as mentioned above.
- the information carrier may be any entity or device capable of storing the program.
- the medium may comprise storage means, such as a ROM, for example a CD ROM or a microelectronic circuit ROM, or a magnetic recording medium, for example a floppy disk or a disk. hard.
- the information medium may be a transmissible medium such as an electrical or optical signal, which may be conveyed via an electrical or optical cable, by radio or by other means.
- the program according to the invention can be downloaded in particular on an Internet type network.
- the information carrier may be an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the methods in question.
- a multichannel audio stream compression device adapted to the implementation of the method according to the first aspect.
- the device includes an input for receiving a multichannel audio stream describing a sound scene produced by a plurality of sources in a space, and an output for delivering a compressed stream.
- the device further comprises:
- a source identification unit coupled to the input, adapted to identify the sources, from the stream, and to determine for each of the identified sources a frequency band, an energy level and a spatial position in the 'space ;
- a spatial resolution determination unit coupled to the identification unit, adapted to determine, for each identified source, a spatial resolution corresponding to a variation of position of said source in the weakest space that a listener is likely to perceive, according to
- a compressed stream generation unit coupled to the spatial resolution determining unit, adapted to form the compressed stream from the information necessary to render each identified source with at least the corresponding spatial resolution, and to deliver the compressed stream over the exit.
- the generation unit may be adapted to produce the compressed stream from the signals when the latter include information representing the sound scene in a base of spherical harmonics in:
- the generation unit may be configured to adapt the subdivision of the space into subspaces over time.
- the device further comprises a conversion unit adapted to transpose information included in the signals of the audio stream into a spherical harmonic base.
- FIG. 1 illustrates, by a block diagram, the main steps of the compression method applied to a multichannel audio stream
- FIG. 2 illustrates, by a block diagram, the steps of an embodiment of the compression method, in a base of spherical harmonics, for example in the HOA domain, applied to a multichannel audio stream;
- Figure 3 shows, in a block diagram, a multichannel audio stream compression device;
- Figure 4 shows, in a block diagram, a multichannel audio stream compression device, according to another embodiment
- FIG. 5 illustrates, in a schematic diagram, a processing device for implementing the compression method.
- a sound scene SCE is considered, that is to say a real acoustic field, formed by sound signals emitted by a plurality of sources SR, or a synthetic acoustic field obtained by artificial spatialization of monophonic signals.
- the signal emitted by a sound source or source can be represented by a spatial distribution of energy in a frequency band.
- the corresponding source is then called an extended source, in the opposite case the source is said to be point.
- the sound stage is picked up by a limited number of sound sensors, to form a multi-channel audio stream F comprising a plurality of signals S.
- the scene can be synthesized by spatialization of monophonic signals.
- the stream F can be subdivided into time T frames.
- the stream F can be considered as a description or representation over time of the sound stage SCE.
- the spatial components of the SCE sound scene can be represented in the HOA domain by spatial components projected into a spherical harmonic base.
- the term "ambisonic" is used to define the step of obtaining these spatial components of the field in the base of spherical harmonics. This encoding thus makes it possible to represent the sound scene in the form of surround signals.
- FIG. 1 shows the main steps of the compression method applied to stream F.
- a step 10 by spatio-frequency analysis of the signals S, the sources SR are identified, and for each identified source SR, a frequency band of the source or the central frequency of said frequency band is determined, a level of energy and a spatial position.
- each of the signals S constituting the flux F it will be possible in particular to perform a time / frequency analysis of each of the signals S constituting the flux F to extract a frequency band energy level for each frame T.
- each identified SR source is associated with the following quantities: its frequency band of the source or the center frequency of said frequency band, its energy level and its spatial position.
- the frequency band of the source or the center frequency of said frequency band can be obtained directly, following the time / frequency analysis used to identify each SR source.
- a spatial resolution RS is calculated for each of the sources SR identified during step 10, by implementing a psychoacoustic model.
- the RS spatial resolution calculated for a source corresponds to an optimal resolution beyond which an average listener does not perceive a significant increase in the level of precision in the location of said source.
- the RS spatial resolution also corresponds to a maximum spatial degradation applicable to the corresponding SR source, without significant impairment of the capabilities of a listener to locate said source SR, in the presence of other SR sources.
- the spatial resolution RS is equal to 1 degree for one of the sources SR, it will be considered that the listener is not able to locate said source SR with an accuracy greater than 1 degree.
- each source SR corresponds to a specific RS spatial resolution.
- the spatial resolution RS of one of the sources SR can also be defined as the minimum audible angle associated with said source RS, in the sense, for example, of the Mills experiment of 1958, presented in the AW Mills document, "On the Minimum Audible Angle, "The Journal of the Acoustical Society of America, vol. 30, Apr. 1958, pp. 237-246. According to this definition, the minimum audible angle of the source SR is substantially equivalent to the measurement made, under the same conditions as those described in the Mills experiment, for a target source within the meaning of AW Mills, having the same characteristics that the source RS.
- the spatial resolution RS associated with one of the sources SR is a function notably of the following parameters:
- the psychoacoustic model can therefore be described by a function f (s c , sd ) 5 sd 2 , sd N ), where s 0 represents the source SR for which we wish to obtain the spatial resolution RS, and sdj, sd 2 , sd N represents all or part of the other SR sources.
- SR sources may each be described by a tuple ⁇ f c, i, ⁇ , ⁇ , where f c is the center frequency, the I energy level, the angular position ⁇ azimuth ⁇ and the elevational angular position .
- the psychoacoustic model can also be constructed from models describing the capabilities of a listener according to the parameters described above, and / or from test results. For the construction of the model, it is furthermore possible to assume that the listener is always facing the source SR for which the spatial resolution RS is calculated, in which case the listener's ability to separate the sources is Max.
- a compressed stream F c containing compressed signals S c is generated, so that the compressed stream F c contains the information necessary for the reproduction of each source SR with the corresponding spatial resolution RS, calculated during the first time.
- Step 20 This also amounts to generating the compressed stream F c by reducing the amount of spatial information initially contained in the stream F for each source SR, until the information necessary for the restitution of each source SR is maintained with at least the corresponding RS spatial resolution. It should therefore be noted that the compressed stream Fc therefore has a smaller amount of information than the stream F.
- FIG. 2 illustrates the steps of an embodiment of the compression method, in a base of spherical harmonics, for example in the HOA domain, applied to the flux F.
- the method may comprise a step 100 of transforming flux F into a base of spherical harmonics.
- This step 100 is optional if the flux F is already encoded in a base of spherical harmonics.
- this transformation may correspond to a projection of the information included in the signals S in a base of spherical harmonics.
- step 100 an acoustic wave corresponding to that which would be obtained by an audio reproduction system fed by the signals S of the flux F is simulated.
- the simulated acoustic wave is then decomposed on the basis of the harmonics. spherical, by projection in this base, or by simulation of a synthetic sound recording by an encoding device HOA as a sphere of microphones.
- This last possibility is for example described in the document Moreau, S. "Study and realization of advanced tools of spatial encoding for sound spatialization technique Higher Order Ambisonics: 3D microphone and distance control" University of Maine, Le Mans , France, 2006. Decomposition coefficients C are thus obtained forming signals S H O A corresponding to signals S in an encoding format HOA.
- the method comprises a step 110 of time / frequency analysis of the signals HQ A for extracting, for each signal S H OA > for each frame T, and for each frequency band, a level of energy E.
- the method comprises a step 120 in which one calculates, for each frame T and for each frequency band, a spatial projection Pr energy levels E on a sphere.
- a model is thus obtained for determining the energy level E as a function of the direction, for each frame T and for each frequency band.
- it will be possible to calculate the spatial projection Pr of the energy levels E by performing an inverse transformation of the SHOA signals in a domain of space variables. For example, an acoustic waveform corresponding to the SHOA signals is reconstructed by linear combination of spherical harmonics weighted by the values of the HOA components. A spatial evolution of the acoustic wave on a sphere is thus obtained.
- the spatial projection Pr of the energy levels is then constructed by spatially sampling the sphere, the number of samples chosen being a function of the desired resolution.
- the method comprises a step 130 during which, for each frame T, the SR sources are identified, their spatial position and their respective energy. For this, we search all the directions of the spatial projection Pr for which the energy level E is non-zero. Then, for each direction in which the energy level is non-zero, one calculates the correlation with the energy levels present in the neighboring directions. For example, for each frequency band, the energy fluctuations in time are determined, possibly taking into account the T frames preceding and / or following said frame T, for each direction. To increase the accuracy In time, it is possible to calculate the correlation over overlapping time ranges, and then to sub-sample the results thus obtained for the frequency band.
- step 130 it is thus possible to describe the sound scene SCE in the form of a set of SR sources whose position, spatial extent and energy are known.
- a subset of the SR sources identified in step 130 is selected. For example, only the audible SR sources for an average listener will be selected. To determine, if a source is audible, it will be possible in particular to implement a simultaneous energy masking analysis taking into account the binaural unmasking.
- a step 140 it is determined, using a psycho-acoustic spatial masking model, for each source SR identified during step 130 and possibly selected during step 135, the spatial resolution RS corresponding.
- the masking power in each region of the space and in each frequency band of each source SR identified on the other identified SR sources is evaluated. More specifically, for each source SR identified, in particular according to its position, the frequency band, and its energy level, the spatial resolution RS with which the source SR is perceived is determined.
- a step 150 the compressed stream F c comprising the compressed signals Se is generated, so that the compressed stream F c comprises the information necessary for the reproduction of each source SR with at least the corresponding spatial resolution RS, calculated during step 140.
- This operation amounts to compressing the stream F by adapting the spatial resolution of the SHOA signals as a function of the RS spatial resolution obtained for each identified SR source.
- the space is decomposed into a set of subspaces, so that the union of the subspaces is substantially equal to the space. For each of these subspaces, we construct a sub-base of spherical harmonics. For example, a suitable construction method may be that described in the Pomberger H. & Zotter F.
- a dynamic decomposition has the advantage of being able to group in the same subspace adjacent sources whose perceived spatial resolution is substantially equal. For each of the subspaces, the order of representation in the base of the spherical harmonics of the S HOAI signals is then truncated until a spatial resolution corresponding to the maximum value of the RS spatial resolutions associated with the SR sources present in the sub-space is obtained. -space considered.
- Figure 3 shows, in a block diagram, a multichannel audio stream compression device 200, according to one embodiment.
- the device 200 is particularly suitable for implementing the method according to the invention.
- the device 200 includes an input 210 for receiving the multi-channel audio stream F describing the sound scene SCE produced by a plurality of SR sources in a space.
- the device 200 delivers on an output 260 the compressed stream F c .
- the device 200 comprises an identification unit 220 of the sources SR coupled to the input 210 so as to receive the stream F.
- the identification unit 220 is adapted to identify the sources SR from the stream F, and to determine for each identified SR source a frequency band, an energy level and a spatial position in the space.
- the identification unit 220 outputs, on an output, the frequency band, the energy level and the spatial position in the space of each identified source SR.
- the identification unit 220 may be configured to identify only the audible SR sources.
- the device 200 comprises a determination unit 230 of the spatial resolution RS, coupled to the output of the identification unit 220, corresponding to the variation of position of said source in the weakest space that an auditor is likely to to perceive.
- the determination unit 230 using for example a psychoacoustic model 240, provides on an output the spatial resolution RS for each identified source SR, based on: o the frequency band, the energy level, and the spatial position of said source; and,
- the device 200 comprises a generation unit 250, coupled to the output of the identification unit 220, adapted to form the compressed stream FC from the information necessary to restore each source SR identified with at least the corresponding RS spatial resolution.
- FIG. 4 shows, in a block diagram, a multichannel audio stream compression device 300, according to one embodiment. As shown in Fig. 4, the device 300 includes an input 310 for receiving the multi-channel audio stream F describing the sound scene SCE produced by a plurality of SR sources in a space. The device 300 delivers on an output 390 the compressed FC stream.
- the device 300 may comprise a conversion unit 320 adapted to transpose information included in the signals S of the audio stream F representing the sound scene SCE into a spherical harmonics base, when the stream F comprises signals S intended to feed directly loudspeakers, such as S-type signals 5.1, 6.1, 7.1, 10.2, 22.2.
- the conversion unit 320 outputs S H Q A signals described in a base of spherical harmonics.
- the device 300 includes an identification unit 330 of the sources SR coupled to the output of the conversion unit 320 to receive the signals S HOA -
- the identification unit 330 is adapted to identify the sources SR from the stream F , and for determining for each of the identified SR sources a frequency band, an energy level and a spatial position in space.
- the identification unit 330 is configured to calculate a spatial projection of the energy levels of the sources on a sphere and to search the directions of the spatial projection whose energy level is non-zero.
- the identification unit 330 delivers, on an output, the frequency band, the energy level and the spatial position in the space of each identified source SR.
- the identification unit 330 may be configured to identify only the audible SR sources.
- the device 300 comprises a determination unit 340 of the spatial resolution RS, coupled to the output of the identification unit 330, corresponding to the variation of position of said source in the weakest space that an auditor is likely to have. to perceive.
- the determining unit 340 using, for example, a psychoacoustic model 350, delivers on an output the spatial resolution RS for each identified source SR, based on: o the frequency band, the energy level, and the spatial position of said source; and,
- the device 300 includes a generation unit 360, coupled to the output of the identification unit 340, adapted to form the compressed stream FC from the information necessary to restore each source SR identified with at least the corresponding RS spatial resolution.
- the generation unit 360 is particularly adapted to produce the compressed stream F c by subdividing the space into subspaces, and by truncating, for each of the subspaces, an order of representation of the signals in the base of the spherical harmonics, to obtain a spatial resolution substantially equal to the maximum value of the spatial resolutions associated with the sources present in the subspace under consideration.
- the subdivision of the space into subspaces can also be dynamic over time.
- FIG. 5 represents a processing device 400 for implementing the compression method according to the invention.
- the device 400 comprises an interface 420 coupled to an input 410 for receiving the stream F and an output F for delivering the compressed stream F c .
- the interface 420 is for example an interface for accessing a communication network, a storage device, and / or a support reader.
- the device 400 also comprises a processor 440 coupled to a memory 450.
- the processor 440 is configured to communicate with the interface 420.
- the processor is adapted to execute computer programs, included in the memory 450, respectively comprising instructions adapted to the implementation of the steps of compression processes that have just been described.
- the memory 450 may be a combination of elements chosen from the following list: a RAM, a ROM, for example a CD ROM or a microelectronic circuit ROM, or else a magnetic recording means, for example a diskette or a disk hard, a transmissible medium such as an electrical or optical signal, which can be routed via an electrical or optical cable, by radio or by other means.
- the computer program can be downloaded in particular on an Internet type network.
- the memory 450 may be an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the processes in question.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Mathematical Physics (AREA)
- Stereophonic System (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1051420 | 2010-02-26 | ||
PCT/FR2011/050282 WO2011104463A1 (fr) | 2010-02-26 | 2011-02-10 | Compression de flux audio multicanal |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2539892A1 true EP2539892A1 (fr) | 2013-01-02 |
EP2539892B1 EP2539892B1 (fr) | 2014-04-02 |
Family
ID=42670337
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP11708920.1A Active EP2539892B1 (fr) | 2010-02-26 | 2011-02-10 | Compression de flux audio multicanal |
Country Status (3)
Country | Link |
---|---|
US (1) | US9058803B2 (fr) |
EP (1) | EP2539892B1 (fr) |
WO (1) | WO2011104463A1 (fr) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
RU2741763C2 (ru) * | 2014-07-02 | 2021-01-28 | Квэлкомм Инкорпорейтед | Уменьшение корреляции между фоновыми каналами амбиофонии высшего порядка (ноа) |
Families Citing this family (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2665208A1 (fr) | 2012-05-14 | 2013-11-20 | Thomson Licensing | Procédé et appareil de compression et de décompression d'une représentation de signaux d'ambiophonie d'ordre supérieur |
US9190065B2 (en) | 2012-07-15 | 2015-11-17 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for three-dimensional audio coding using basis function coefficients |
US9288603B2 (en) | 2012-07-15 | 2016-03-15 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for backward-compatible audio coding |
US9473870B2 (en) | 2012-07-16 | 2016-10-18 | Qualcomm Incorporated | Loudspeaker position compensation with 3D-audio hierarchical coding |
US9761229B2 (en) * | 2012-07-20 | 2017-09-12 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for audio object clustering |
US9479886B2 (en) | 2012-07-20 | 2016-10-25 | Qualcomm Incorporated | Scalable downmix design with feedback for object-based surround codec |
US9685163B2 (en) * | 2013-03-01 | 2017-06-20 | Qualcomm Incorporated | Transforming spherical harmonic coefficients |
US9466305B2 (en) * | 2013-05-29 | 2016-10-11 | Qualcomm Incorporated | Performing positional analysis to code spherical harmonic coefficients |
US11146903B2 (en) | 2013-05-29 | 2021-10-12 | Qualcomm Incorporated | Compression of decomposed representations of a sound field |
US9384741B2 (en) * | 2013-05-29 | 2016-07-05 | Qualcomm Incorporated | Binauralization of rotated higher order ambisonics |
US9466302B2 (en) * | 2013-09-10 | 2016-10-11 | Qualcomm Incorporated | Coding of spherical harmonic coefficients |
US9489955B2 (en) | 2014-01-30 | 2016-11-08 | Qualcomm Incorporated | Indicating frame parameter reusability for coding vectors |
US9922656B2 (en) | 2014-01-30 | 2018-03-20 | Qualcomm Incorporated | Transitioning of ambient higher-order ambisonic coefficients |
US9852737B2 (en) | 2014-05-16 | 2017-12-26 | Qualcomm Incorporated | Coding vectors decomposed from higher-order ambisonics audio signals |
US10770087B2 (en) | 2014-05-16 | 2020-09-08 | Qualcomm Incorporated | Selecting codebooks for coding vectors decomposed from higher-order ambisonic audio signals |
US9620137B2 (en) | 2014-05-16 | 2017-04-11 | Qualcomm Incorporated | Determining between scalar and vector quantization in higher order ambisonic coefficients |
US9847088B2 (en) * | 2014-08-29 | 2017-12-19 | Qualcomm Incorporated | Intermediate compression for higher order ambisonic audio data |
US9747910B2 (en) | 2014-09-26 | 2017-08-29 | Qualcomm Incorporated | Switching between predictive and non-predictive quantization techniques in a higher order ambisonics (HOA) framework |
US10405126B2 (en) * | 2017-06-30 | 2019-09-03 | Qualcomm Incorporated | Mixed-order ambisonics (MOA) audio data for computer-mediated reality systems |
EP3762923B1 (fr) * | 2018-03-08 | 2024-07-10 | Nokia Technologies Oy | Codage audio |
CA3110137A1 (fr) | 2018-08-21 | 2020-02-27 | Dolby International Ab | Procedes, appareil et systemes pour la generation, le transport et le traitement de trames de lecture immediate (ipfs) |
US11430451B2 (en) * | 2019-09-26 | 2022-08-30 | Apple Inc. | Layered coding of audio with discrete objects |
US11363402B2 (en) | 2019-12-30 | 2022-06-14 | Comhear Inc. | Method for providing a spatialized soundfield |
US11743670B2 (en) | 2020-12-18 | 2023-08-29 | Qualcomm Incorporated | Correlation-based rendering with multiple distributed streams accounting for an occlusion for six degree of freedom applications |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1709743A1 (fr) * | 2004-01-30 | 2006-10-11 | France Telecom S.A. | Quantification vectorielle en dimension et resolution variables |
WO2009067741A1 (fr) * | 2007-11-27 | 2009-06-04 | Acouity Pty Ltd | Compression de la bande passante de représentations paramétriques du champ acoustique pour transmission et mémorisation |
WO2010076460A1 (fr) * | 2008-12-15 | 2010-07-08 | France Telecom | Codage perfectionne de signaux audionumériques multicanaux |
-
2011
- 2011-02-10 US US13/581,012 patent/US9058803B2/en active Active
- 2011-02-10 EP EP11708920.1A patent/EP2539892B1/fr active Active
- 2011-02-10 WO PCT/FR2011/050282 patent/WO2011104463A1/fr active Application Filing
Non-Patent Citations (1)
Title |
---|
See references of WO2011104463A1 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
RU2741763C2 (ru) * | 2014-07-02 | 2021-01-28 | Квэлкомм Инкорпорейтед | Уменьшение корреляции между фоновыми каналами амбиофонии высшего порядка (ноа) |
Also Published As
Publication number | Publication date |
---|---|
US20120314878A1 (en) | 2012-12-13 |
EP2539892B1 (fr) | 2014-04-02 |
WO2011104463A1 (fr) | 2011-09-01 |
US9058803B2 (en) | 2015-06-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2539892B1 (fr) | Compression de flux audio multicanal | |
AU2016266052B2 (en) | Audio apparatus and audio providing method thereof | |
EP2374123B1 (fr) | Codage perfectionne de signaux audionumeriques multicanaux | |
TWI744341B (zh) | 使用近場/遠場渲染之距離聲相偏移 | |
EP2374124B1 (fr) | Codage perfectionne de signaux audionumériques multicanaux | |
EP2002424B1 (fr) | Dispositif et procede de codage scalable d'un signal audio multi-canal selon une analyse en composante principale | |
EP2005420B1 (fr) | Dispositif et procede de codage par analyse en composante principale d'un signal audio multi-canal | |
CN102422348B (zh) | 音频格式转码器 | |
EP1989920B1 (fr) | Codage et décodage audio | |
EP3427260B1 (fr) | Codage et décodage optimisé d'informations de spatialisation pour le codage et le décodage paramétrique d'un signal audio multicanal | |
EP2304721B1 (fr) | Synthese spatiale de signaux audio multicanaux | |
EP3475943B1 (fr) | Procede de conversion et d'encodage stereophonique d'un signal audio tridimensionnel | |
KR20170109023A (ko) | 몰입형 오디오를 캡처하고, 인코딩하고, 분산하고, 디코딩하기 위한 시스템 및 방법 | |
TR201811059T4 (tr) | Ses kaynaklarının parametrik birleşik kodlaması. | |
EP3079074A1 (fr) | Procédé de traitement de données pour l'estimation de paramètres de mixage de signaux audio, procédé de mixage, dispositifs, et programmes d'ordinateurs associés | |
EP1992198A2 (fr) | Optimisation d'une spatialisation sonore binaurale a partir d'un encodage multicanal | |
JP2022518663A (ja) | 拡散補償を用いたDirACベースの空間音声符号化に関する符号化、復号化、シーン処理および他の手順を行う装置、方法およびコンピュータプログラム | |
FR3046489A1 (fr) | Encodeur ambisonique ameliore d'une source sonore a pluralite de reflexions | |
EP4042418B1 (fr) | Détermination de corrections à appliquer a un signal audio multicanal, codage et décodage associés | |
KR20220157848A (ko) | 다채널 오디오 신호 처리 장치 및 방법 | |
WO2009081002A1 (fr) | Traitement d'un flux audio 3d en fonction d'un niveau de presence de composantes spatiales | |
FR3034892A1 (fr) | Procede de traitement de donnees pour l'estimation de parametres de mixage de signaux audio, procede de mixage, dispositifs, et programmes d'ordinateurs associes |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20120820 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: NICOL, ROZENN Inventor name: DANIEL, ADRIEN |
|
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: ORANGE |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602011005897 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G10L0019000000 Ipc: G10L0019008000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04S 3/00 20060101ALI20131009BHEP Ipc: G10L 19/008 20130101AFI20131009BHEP Ipc: G10L 19/20 20130101ALI20131009BHEP |
|
INTG | Intention to grant announced |
Effective date: 20131029 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 660536 Country of ref document: AT Kind code of ref document: T Effective date: 20140415 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602011005897 Country of ref document: DE Effective date: 20140515 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 660536 Country of ref document: AT Kind code of ref document: T Effective date: 20140402 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20140402 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140702 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140802 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140703 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140702 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140804 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602011005897 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 5 |
|
26N | No opposition filed |
Effective date: 20150106 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602011005897 Country of ref document: DE Effective date: 20150106 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20141119 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150210 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150228 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150228 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150210 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 7 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20110210 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 8 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140402 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240123 Year of fee payment: 14 Ref country code: GB Payment date: 20240123 Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240123 Year of fee payment: 14 |