EP3061271B1 - Système de synthèse de champ d'ondes - Google Patents

Système de synthèse de champ d'ondes Download PDF

Info

Publication number
EP3061271B1
EP3061271B1 EP14781270.5A EP14781270A EP3061271B1 EP 3061271 B1 EP3061271 B1 EP 3061271B1 EP 14781270 A EP14781270 A EP 14781270A EP 3061271 B1 EP3061271 B1 EP 3061271B1
Authority
EP
European Patent Office
Prior art keywords
sound
assembly
sound transducers
reference point
transducers
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP14781270.5A
Other languages
German (de)
English (en)
Other versions
EP3061271A1 (fr
Inventor
Frank Stefan SCHMIDT
Helmut Oellers
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Holoplot GmbH
Original Assignee
Holoplot GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Holoplot GmbH filed Critical Holoplot GmbH
Priority to PL14781270T priority Critical patent/PL3061271T3/pl
Publication of EP3061271A1 publication Critical patent/EP3061271A1/fr
Application granted granted Critical
Publication of EP3061271B1 publication Critical patent/EP3061271B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/02—Spatial or constructional arrangements of loudspeakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/02—Systems employing more than two channels, e.g. quadraphonic of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/401—2D or 3D arrays of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/13—Application of wave-field synthesis in stereophonic audio systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation

Definitions

  • the present invention relates to a device of sound transducers according to the principle of wave field synthesis.
  • the method of wave field synthesis is therefore usually reduced to a horizontal series of transducers placed around the listener. This also reduces the playback to this horizontal level, correct spatial reproduction is no longer possible.
  • the cylindrical propagation of the wavefronts then requires that the acoustics of the playback room must be completely suppressed.
  • a module for building a system for wave field synthesis is out MAUER STEPHAN ET AL: "Design and Realization of a Reference Loudspeaker Panel for Wave Field Synthesis", AES CONVENTION 130 (May 2011 ) known.
  • the data-based approach of wavefield synthesis makes use of the fact that the impulse responses for each transducer are predicted and stored for discrete source positions in order to shift the virtual sound sources abruptly from one position to the next [5].
  • the object of the invention is therefore to describe a device which is portable for practical reasons and in which the computing power in the central unit does not grow with the number of sound transducers.
  • the device of sound transducers according to the principle of wave field synthesis is not designed as a closed unit, as described, for example, in [6], but rather in a decentralized manner.
  • the individual modules are usually executed the same way.
  • An enclosing housing may allow a modular design. This has the advantage that the modules are interchangeable and that they only have to be assigned to a position in the coordinate system during the setup process of the system. In addition, they can be preassembled and pre-wired for live PA in groups to ensure a quick setup of the system.
  • All audio signals can then be routed in a common line to each module.
  • the decentralized structure of the system also allows the data for the delay times and levels for each individual transducer to be transmitted very effectively when the model-based approach of wave field synthesis is used. All audio channels of the system are then routed to all modules in a data stream.
  • the additional amount of data to be transmitted to the modules for the calculation of the signals for each individual transducer in a second data stream is comparatively very small.
  • the synthesis of content, ie the audio signals themselves, and form, ie the associated data, is then no longer carried out according to the invention in a central unit, but autonomously in each modular unit. Because of the modular design, no more differentiated data or individual audio signals for each individual transducer must be transmitted.
  • the data stream which is fed from the central unit to all modules, only contains the vector of each virtual sound source to be displayed to a single reference point in the system.
  • the vector of a in all modules, the same reference point of the relevant module to this common reference point is known, because it results from the edge lengths of the modules or modules and their position within the array of transducers.
  • the vectors of each individual transducer are stored to this reference point.
  • the vector addition of the reference point of the arrangement of sound transducers for Coordinate origin plus vector of the reference point of the module to the reference point of the arrangement of sound transducers plus vector of the respective sound transducer to the reference point of the module gives the exact position of the relevant sound transducer to the coordinate origin of the system.
  • the audio signals are convoluted into the respective impulse responses and the output of this convolution is sent to the individual output amplifiers.
  • the modular structure of the wave field synthesis system creates another fundamental advantage. Since the amount of data to be transferred and the computational effort in the central unit is independent of the number of modules or modules connected, the system becomes freely scalable. So not only the usual reduction of the Be easily overcome on the horizontal level of the listener. Even very large acoustic curtains with directional effects down to the bass range and tightly focused concave wavefronts can be realized.
  • modules could also be assembled into a physical structure, such as a cube or cuboid, in which virtual sound sources emit to the outside.
  • Fig. 1 shows a modular device of sound transducers according to the principle of wave field synthesis (1).
  • her virtual sound sources (2) are shown, the position of which is given in a coordinate system with respect to the coordinate origin (3).
  • the coordinate origin may be at the position of a listener in the playback room, but it may be set arbitrarily.
  • the vector of a reference point (4) of the device must be known from sound transducers to this coordinate origin.
  • the respective reference point in each of the modules (5) in the Device of sound transducers given by the placement of the module in the system and the edge length of the modules.
  • the position of each individual transducer (6) is given to each individual transducer.
  • the position of each virtual sound source can be determined for each individual transducer by adding the individual vectors.
  • Fig.2 In Fig.2 is shown that all audio signals and data are routed to each module. This can be done via separate lines (1) and (2) or all information can also be transmitted via a common protocol to the modules.
  • the amount of data is relatively small because only the position of the virtual sources in the coordinate system and their assignment to the audio signals must be transmitted. This allows an update of the positions in very short time intervals.
  • the signals of all input sources delayed and added up from all according to the module position in the arrangement of sound transducers of all input sources can be fed to the corresponding power amplifier for the few transducers in the module.
  • the audio signal is folded on the playback side in a renderer for each elementary wave in the spatial impulse response of the recording room [2].
  • the starting points of the elementary waves should be close together.
  • the virtual sound sources can only arise in the area of the arrangement of sound transducers. Therefore, their number becomes very large when a two-dimensional sound transducer surface is built up.
  • the requirements for the renderer prior art systems increase, the control of a large number of transducers requires a high computational effort.
  • the principle of wave field synthesis was therefore usually reduced to a horizontal transducer array.
  • the wave field synthesis is usually on the listener's horizontal plane is reduced, the third dimension is lost in the reproduction of the sound events.
  • the necessary computing power can be distributed decentrally, because the amount of data to be transmitted between the subsystems does not increase with the number of sound transducers.
  • the system becomes freely scalable.
  • the synthesis of wavefronts from the audio signals and the associated data for the individual transducers contained within the respective module is executed, wherein the geometric position of a reference point within the coordinate system for the Model-based approach of wave field synthesis for each individual assembly is determined by their placement in the array of transducers and the edge length of the individual assemblies and the position of each transducer in this coordinate system is defined by its arrangement to this reference point of the assembly, so that alone from the Arrangement of the assemblies in the arrangement of sound transducers can determine the position of each individual transducer in the coordinate system from the vector addition to the respective parent reference point.
  • the assemblies are enclosed by a module housing or are formed of equal size segments in a structure of components.
  • the arrangement of transducers is freely scalable in size because the computing power in the central unit does not increase with the number of transducers in the system.
  • all the audio signals and the data for the synthesis of the wavefronts are fed to all assemblies of the device, wherein in each assembly, the data are processed, resulting from the position of the respective assembly within the array of sound transducers.
  • the position of the individual transducers within an assembly is stored relative to a fixed reference point of the assembly in the assembly.
  • the position of a fixed reference point of each module is determined to the position of a reference point of the device from sound transducers by informing the module at which position it is installed within the device of sound transducers and they are stored therefrom with the aid of Dimensions of the individual modules, which can also be designed as a module that can determine the position of its reference point to the central reference point of the device from sound transducers.
  • the assemblies are fitted differently densely with sound transducers.
  • the effort can be reduced in the reproductive areas, which are less important for the human perception of sound events.
  • the assemblies can be constructed in a closed plane, closed row.
  • the assemblies can also be constructed so that they are not arranged in a closed plane or closed row.
  • the sound transducers are associated with sub-surfaces, which can form a body that can radiate the wavefronts in a common system in different directions.
  • a system for image reproduction is applied to the same carrier system that carries the sound transducer.
  • the modules or modules are combined in pre-assembled units. This allows a faster setup of the system.
  • a decentralized device constructed from acoustic transducers according to the principle of wave field synthesis on multiple modules, each having a plurality of sound transducers and an assembly control,
  • each module controller is arranged to generate drive signals for the sound transducers of its assembly of audio signals and associated data for the form for the synthesis of the wavefronts.
  • This structure also enables a system for image reproduction to be applied to a support system carrying the sound transducers.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Algebra (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Physics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Stereophonic System (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)

Claims (10)

  1. Dispositif à structure décentralisée composé de transducteurs acoustiques selon le principe de la synthèse de champ d'ondes, comprenant plusieurs ensembles qui comprennent respectivement plusieurs transducteurs acoustiques et un dispositif de commande d'ensemble,
    dans lequel chaque dispositif de commande d'ensemble est agencé pour réaliser, au moyen d'une approche par modèle, une synthèse des fronts d'onde à partir de signaux audio et des données de forme associées pour les transducteurs acoustiques contenus dans les ensembles à l'intérieur de l'ensemble respectif et pour commander les transducteurs acoustiques à l'intérieur de l'ensemble respectif avec des signaux de commande qui correspondent à la synthèse,
    caractérisé en ce
    que les ensembles sont équipés des transducteurs acoustiques selon une densité variable.
  2. Dispositif à structure décentralisée composé de transducteurs acoustiques selon la revendication 1, dans lequel le dispositif de commande d'ensemble utilise une position géométrique respective (6) d'un point de référence (5) de l'ensemble dans un système de coordonnées pour l'approche par modèle de la synthèse de champ d'ondes, la position géométrique (6) de chaque ensemble individuel est déterminée par son placement dans l'agencement de transducteurs acoustiques et la longueur de bord des différents ensembles et/ou la position géométrique (6) de chaque transducteur acoustique individuel est définie dans ce système de coordonnées par son agencement par rapport à ce point de référence (5) de l'ensemble, de sorte que, rien qu'à partir de l'agencement des ensembles dans l'agencement composé de transducteurs acoustiques, la position de chaque transducteur acoustique individuel dans le système de coordonnées se détermine à partir d'une addition vectorielle au point de référence (6) supérieur respectif.
  3. Dispositif à structure décentralisée composé de transducteurs acoustiques selon l'une des revendications précédentes,
    caractérisé en ce
    que les ensembles sont entourés d'un boîtier de module respectif et/ou sont formés de segments de mêmes dimensions dans une structure de composants.
  4. Dispositif à structure décentralisée composé de transducteurs acoustiques selon l'une des revendications précédentes,
    caractérisé en ce
    que la taille de l'agencement composé de transducteurs acoustiques est librement modulable.
  5. Dispositif à structure décentralisée composé de transducteurs acoustiques selon l'une des revendications précédentes,
    caractérisé en ce
    que tous les signaux audio et les données associées sont acheminés vers tous les ensembles du dispositif pour la synthèse des fronts d'onde, dans lequel, dans chaque ensemble, sont traitées les données résultant de la position de l'ensemble respectif au sein de l'agencement composé de transducteurs acoustiques.
  6. Dispositif à structure décentralisée composé de transducteurs acoustiques selon l'une des revendications précédentes,
    caractérisé en ce
    que la position des différents transducteurs acoustiques au sein d'un ensemble est mémorisée par rapport à un point de référence fixe de l'ensemble dans l'ensemble.
  7. Dispositif à structure décentralisée composé de transducteurs acoustiques selon l'une des revendications précédentes,
    caractérisé en ce
    qu'il peut déterminer la position d'un point de référence fixe de chaque ensemble par rapport à la position d'un point de référence du dispositif composé de transducteurs acoustiques, en informant l'ensemble de la position à laquelle il est installé à l'intérieur du dispositif composé de transducteurs acoustiques et en déterminant à partir de là la position de son point de référence par rapport au point de référence central du dispositif composé de transducteurs acoustiques à l'aide des dimensions stockées des différents ensembles, qui peuvent également être mis en oeuvre sous forme de module.
  8. Dispositif à structure décentralisée composé de transducteurs acoustiques selon l'une des revendications précédentes,
    caractérisé en ce
    que les ensembles peuvent également être disposés dans un plan non fermé ou dans une rangée non fermée.
  9. Dispositif à structure décentralisée composé de transducteurs acoustiques selon l'une des revendications précédentes,
    caractérisé en ce
    que les transducteurs acoustiques peuvent être affectés à des surfaces partielles qui peuvent rayonner les fronts d'onde respectivement dans une direction différente.
  10. Dispositif à structure décentralisée composé de transducteurs acoustiques selon l'une des revendications précédentes,
    caractérisé en ce
    que les ensembles ou modules sont regroupés dans des unités prémontées.
EP14781270.5A 2013-08-10 2014-09-12 Système de synthèse de champ d'ondes Active EP3061271B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PL14781270T PL3061271T3 (pl) 2013-08-10 2014-09-12 Układ syntezy pola falowego

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102013013377.7A DE102013013377A1 (de) 2013-08-10 2013-08-10 Dezentraler Aufbau eines Wellenfeldsynthese Systems
PCT/IB2014/001806 WO2015036845A1 (fr) 2013-08-10 2014-09-12 Système à synthèse de front d'ondes

Publications (2)

Publication Number Publication Date
EP3061271A1 EP3061271A1 (fr) 2016-08-31
EP3061271B1 true EP3061271B1 (fr) 2018-04-04

Family

ID=51662155

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14781270.5A Active EP3061271B1 (fr) 2013-08-10 2014-09-12 Système de synthèse de champ d'ondes

Country Status (7)

Country Link
US (1) US9716961B2 (fr)
EP (1) EP3061271B1 (fr)
DE (2) DE102013013377A1 (fr)
ES (1) ES2674771T3 (fr)
PL (1) PL3061271T3 (fr)
TR (1) TR201808776T4 (fr)
WO (1) WO2015036845A1 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6979665B2 (ja) 2018-08-31 2021-12-15 株式会社ドリーム 指向性制御システム
CN111322978B (zh) * 2019-11-08 2021-02-02 北京航空航天大学 一种非理想平面装配偏差的计算方法
DE102020203659A1 (de) 2020-03-20 2021-09-23 Holoplot Gmbh Schallwandler-Anordnung und Verfahren zum Betrieb einer Schallwandler-Anordnung
IT202000009928A1 (it) 2020-05-05 2021-11-05 Powersoft S P A Apparato per l’amplificazione acustica
DE102021207302A1 (de) 2021-07-09 2023-01-12 Holoplot Gmbh Verfahren und Vorrichtung zur Beschallung mindestens eines Publikumsbereiches
CN113965842A (zh) * 2021-12-01 2022-01-21 费迪曼逊多媒体科技（上海）有限公司 一种基于wfs波场合成技术的可变声学家庭影院音响***
DE102022129642A1 (de) 2022-11-09 2024-05-16 Holoplot Gmbh Verfahren zur richtungsabhängigen Korrektur des Frequenzganges von Schallwellenfronten

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996014723A1 (fr) * 1994-11-08 1996-05-17 Duran B.V. Systeme de haut-parleurs a sensibilite directionnelle controlee
WO2011119401A2 (fr) * 2010-03-23 2011-09-29 Dolby Laboratories Licensing Corporation Techniques destinées à générer des signaux audio perceptuels localisés

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IL102370A (en) 1992-06-30 1995-03-30 Yissum Res Dev Co Process for modifying particulate solids and particulate solids prepared thereby
DE10319708A1 (de) 2003-05-02 2004-11-25 Tu Bergakademie Freiberg Alkalihaltige Gläser mit modifizierten Glasoberflächen und Verfahren zu ihrer Herstellung
DE102004002532A1 (de) 2004-01-17 2005-09-22 Helmut Oellers Frontalmatrix-Wellenfeldsynthese (FMWFS)
DE102005008366A1 (de) * 2005-02-23 2006-08-24 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und Verfahren zum Ansteuern einer Wellenfeldsynthese-Renderer-Einrichtung mit Audioobjekten
DE102009010278B4 (de) * 2009-02-16 2018-12-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Lautsprecher

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996014723A1 (fr) * 1994-11-08 1996-05-17 Duran B.V. Systeme de haut-parleurs a sensibilite directionnelle controlee
WO2011119401A2 (fr) * 2010-03-23 2011-09-29 Dolby Laboratories Licensing Corporation Techniques destinées à générer des signaux audio perceptuels localisés

Also Published As

Publication number Publication date
WO2015036845A1 (fr) 2015-03-19
PL3061271T3 (pl) 2018-10-31
DE102013013377A1 (de) 2015-02-12
EP3061271A1 (fr) 2016-08-31
DE112014003702A5 (de) 2016-04-28
US9716961B2 (en) 2017-07-25
US20160192103A1 (en) 2016-06-30
TR201808776T4 (tr) 2018-07-23
ES2674771T3 (es) 2018-07-03

Similar Documents

Publication Publication Date Title
EP3061271B1 (fr) Système de synthèse de champ d'ondes
EP2080411B1 (fr) Dispositif et procédé pour produire un certain nombre de signaux de haut-parleur pour un réseau de haut-parleurs définissant un espace de restitution
DE69525163T2 (de) Tonaufnahme- und wiedergabesysteme
DE69312765T2 (de) Verfahren und Vorrichtung für künstliche Raumklangeffekte von digitalen Audiosignalen
EP2189010B1 (fr) Système et procédé pour déterminer un signal de composante avec une grande précision
EP1878308B1 (fr) Dispositif et procede de production et de traitement d'effets sonores dans des systemes de reproduction sonore spatiale a l'aide d'une interface graphique d'utilisateur
EP1851998B1 (fr) Dispositif et procédé pour fournir des données dans un système a dispositifs de rendu multiples
WO2015004526A2 (fr) Dispositif variable permettant d'orienter des fronts d'onde acoustique
DD242954A3 (de) Grossraumbeschallungssystem
EP1880577B1 (fr) Dispositif et procede permettant de generer un signal de haut-parleur sur la base d'une source audio d'apparition aleatoire
DE112019000390T5 (de) Akustische vorrichtung
EP2754151B2 (fr) Dispositif, procédé et système électroacoustique de prolongement d'un temps de réverbération
EP2939445B1 (fr) Production de signaux audio 3d
DE102005001395B4 (de) Verfahren und Vorrichtung zur Transformation des frühen Schallfeldes
WO2015022579A2 (fr) Procédé pour faire fonctionner un réseau de transducteurs électroacoustiques à synthèse de front d'ondes
EP2182744A1 (fr) Retransmission d'un champ sonore dans une zone de sonorisation ciblée
DE102019208631A1 (de) Vorrichtung und Verfahren zur Beschallung eines räumlichen Bereichs
DE102021207302A1 (de) Verfahren und Vorrichtung zur Beschallung mindestens eines Publikumsbereiches
DE733972C (de) Lautsprecheranordnung fuer die Stereo-Tonwiedergabe
DE102011108788B4 (de) Verfahren zur Verarbeitung eines Audiosignals, Audiowiedergabesystem und Verarbeitungseinheit zur Bearbeitung von Audiosignalen
EP2503799B1 (fr) Procédé et système de calcul de fonctions HRTF par synthèse locale virtuelle de champ sonore
EP2571290B1 (fr) Synthèse de champ sonore locale par l'intermédiaire d'un corps diffusant virtuel
DE102016125886B4 (de) Vorrichtung und Verfahren zur effizienten Berechnung einer Auralisation
DE102022129642A1 (de) Verfahren zur richtungsabhängigen Korrektur des Frequenzganges von Schallwellenfronten
CH708800A2 (de) Verfahren und Vorrichtung zur Verarbeitung von Klangsignalen.

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20160613

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIN1 Information on inventor provided before grant (corrected)

Inventor name: OELLERS, HELMUT

Inventor name: SCHMIDT, FRANK, STEFAN

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04S 7/00 20060101AFI20170928BHEP

Ipc: H04R 5/02 20060101ALI20170928BHEP

INTG Intention to grant announced

Effective date: 20171024

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: HOLOPLOT GMBH

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 986832

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180415

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502014007865

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: GEVERS SA, CH

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2674771

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20180703

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 502014007865

Country of ref document: DE

Representative=s name: MAIKOWSKI & NINNEMANN PATENTANWAELTE PARTNERSC, DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180704

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180704

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180705

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180806

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502014007865

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

26N No opposition filed

Effective date: 20190107

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20180930

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: BOVARD SA NEUCHATEL CONSEILS EN PROPRIETE INTE, CH

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180912

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180912

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180930

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20190924

Year of fee payment: 6

Ref country code: TR

Payment date: 20190906

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PL

Payment date: 20190828

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: AT

Payment date: 20190918

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20191023

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180404

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20140912

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180804

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 986832

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200912

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200913

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200912

REG Reference to a national code

Ref country code: SE

Ref legal event code: EUG

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20220117

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200913

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200912

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200912

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20230920

Year of fee payment: 10

Ref country code: GB

Payment date: 20230921

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230918

Year of fee payment: 10

Ref country code: DE

Payment date: 20230824

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20230929

Year of fee payment: 10

Ref country code: CH

Payment date: 20231001

Year of fee payment: 10