EP3248389B1 - Audio system mit konfigurierbaren zonen - Google Patents
Audio system mit konfigurierbaren zonen Download PDFInfo
- Publication number
- EP3248389B1 EP3248389B1 EP14784172.0A EP14784172A EP3248389B1 EP 3248389 B1 EP3248389 B1 EP 3248389B1 EP 14784172 A EP14784172 A EP 14784172A EP 3248389 B1 EP3248389 B1 EP 3248389B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- zone
- program content
- sound program
- audio
- listening area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003491 array Methods 0.000 claims description 100
- 238000000034 method Methods 0.000 claims description 34
- 238000012545 processing Methods 0.000 claims description 5
- 238000004519 manufacturing process Methods 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 3
- 230000005236 sound signal Effects 0.000 description 13
- 238000009877 rendering Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 230000001413 cellular effect Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 239000000203 mixture Substances 0.000 description 4
- 238000009826 distribution Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000001934 delay Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000004377 microelectronic Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/12—Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R27/00—Public address systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
Definitions
- An audio system that is configurable to output audio beams representing channels for one or more pieces of sound program content into separate zones based on the positioning of users, audio sources, and/or speaker arrays is disclosed. Other embodiments are also described.
- Speaker arrays may reproduce pieces of sound program content to a user through the use of one or more audio beams.
- a set of speaker arrays may reproduce front left, front center, and front right channels for a piece of sound program content (e.g., a musical composition or an audio track for a movie).
- speaker arrays provide a wide degree of customization through the production of audio beams, conventional speaker array systems must be manually configured each time a new speaker array is added to the system, a speaker array is moved within a listening environment/area, an audio source is added/changed, or any other change is made to the listening environment.
- US2012170762 shows a spatial sound energy distribution control apparatus. It creates different sound zones wherein in a personal zone a speech signal is reproduced and in another zone, a masking sound is reproduced. This helps to separate desired speech signals from undesired noise.
- An audio system includes one or more speaker arrays that emit sound corresponding to one or more pieces of sound program content into associated zones within a listening area.
- the zones correspond to areas within the listening area in which associated pieces of sound program content are designated to be played within.
- a first zone may be defined as an area where multiple users are situated in front of a first audio source (e.g., a television).
- the sound program content produced and/or received by the first audio source is associated with and played back into the first zone.
- a second zone may be defined as an area where a single user is situated proximate to a second audio source (e.g., a radio).
- the sound program content produced and/or received by the second audio source is associated with the second zone.
- one or more beam pattern attributes may be generated.
- the beam pattern attributes define a set of beams that are used to generate audio beams for channels of sound program content to be played in each zone.
- the beam pattern attributes may indicate gain values, delay values, beam type pattern values, and beam angle values that may be used to generate beams for each zone.
- the beam pattern attributes may be updated as changes are detected within the listening area. For example, changes may be detected within the audio system (e.g., movement of a speaker array) or within the listening area (e.g., movement of users). Accordingly, sound produced by the audio system may continually account for the variable conditions of the listening environment. By adapting to these changing conditions, the audio system is capable of reproducing sound that accurately represents each piece of sound program content in various zones.
- FIG. 1A shows a view of an audio system 100 within a listening area 101.
- the audio system 100 may include an audio source 103A and a set of speaker arrays 105.
- the audio source 103A may be coupled to the speaker arrays 105 to drive individual transducers 109 in the speaker array 105 to emit various sound beam patterns for the users 107.
- the speaker arrays 105 may be configured to generate audio beam patterns that represent individual channels for multiple pieces of sound program content. Playback of these pieces of sound program content may be aimed at separate audio zones 113 within the listening area 101.
- the speaker arrays 105 may generate and direct beam patterns that represent front left, front right, and front center channels for a first piece of sound program content to a first zone 113A.
- one or more of the same speaker arrays 105 used for the first piece of sound program content may simultaneously generate and direct beam patterns that represent front left and front right channels for a second piece of sound program content to a second zone 113B.
- Different sets of speaker arrays 105 may be selected for each of the first and second zones 113A and 113B. The techniques for driving these speaker arrays 105 to produce audio beams for separate pieces of sound program content and corresponding separate zones 113 will be described in greater detail below.
- the listening area 101 is a room or another enclosed space.
- the listening area 101 may be a room in a house, a theatre, etc.
- the listening area 101 may be an outdoor area or location, including an outdoor arena.
- the speaker arrays 105 may be placed in the listening area 101 to produce sound that will be perceived by the set of users 107.
- FIG 2A shows a component diagram of an example audio source 103A according to one embodiment.
- the audio source 103A is a television; however, the audio source 103A may be any electronic device that is capable of transmitting audio content to the speaker arrays 105 such that the speaker arrays 105 may output sound into the listening area 101.
- the audio source 103A may be a desktop computer, a laptop computer, a tablet computer, a home theater receiver, a set-top box, a personal video player, a DVD player, a Blu-ray player, a gaming system, and/or a mobile device (e.g., a smartphone).
- the audio system 100 may include multiple audio sources 103 that are coupled to the speaker arrays 105.
- the audio sources 103A and 103B may be both coupled to the speaker arrays 105.
- the audio sources 103A and 103B may simultaneously drive each of the speaker arrays 105 to output sound corresponding to separate pieces of sound program content.
- the audio source 103A may be a television that utilizes the speaker arrays 105A-105C to output sound into the zone 113A while the audio source 103B may be a radio that utilizes the speaker arrays 105A and 105C to output sound into the zone 113B.
- the audio source 103B may be similarly configured as shown in Figure 2A in relation to the audio source 103B.
- the audio source 103A may include a hardware processor 201 and/or a memory unit 203.
- the processor 201 and the memory unit 203 are generically used here to refer to any suitable combination of programmable data processing components and data storage that conduct the operations needed to implement the various functions and operations of the audio source 103A.
- the processor 201 may be an applications processor typically found in a smart phone, while the memory unit 203 may refer to microelectronic, non-volatile random access memory.
- An operating system may be stored in the memory unit 203 along with application programs specific to the various functions of the audio source 103A, which are to be run or executed by the processor 201 to perform the various functions of the audio source 103A.
- a rendering strategy unit 209 may be stored in the memory unit 203. As will be described in greater detail below, the rendering strategy unit 209 may be used to generate beam attributes for each channel of pieces of sound program content to be played in the listening area 101. These beam attributes may be used to output audio beams into corresponding audio zones 113 within the listening area 101.
- the audio source 103A may include one or more audio inputs 205 for receiving audio signals from external and/or remote devices.
- the audio source 103A may receive audio signals from a streaming media service and/or a remote server.
- the audio signals may represent one or more channels of a piece of sound program content (e.g., a musical composition or an audio track for a movie).
- a single signal corresponding to a single channel of a piece of multichannel sound program content may be received by an input 205 of the audio source 103A.
- a single signal may correspond to multiple channels of a piece of sound program content, which are multiplexed onto the single signal.
- the audio source 103A may include a digital audio input 205A that receives digital audio signals from an external device and/or a remote device.
- the audio input 205A may be a TOSLINK connector or a digital wireless interface (e.g., a wireless local area network (WLAN) adapter or a Bluetooth receiver).
- the audio source 103A may include an analog audio input 205B that receives analog audio signals from an external device.
- the audio input 205B may be a binding post, a Fahnestock clip, or a phono plug that is designed to receive a wire or conduit and a corresponding analog signal.
- pieces of sound program content may be stored locally on the audio source 103A.
- one or more pieces of sound program content may be stored within the memory unit 203.
- the audio source 103A may include an interface 207 for communicating with the speaker arrays 105 or other devices (e.g., remote audio/video streaming services).
- the interface 207 may utilize wired mediums (e.g., conduit or wire) to communicate with the speaker arrays 105.
- the interface 207 may communicate with the speaker arrays 105 through a wireless connection as shown in Figure 1A and Figure 1B .
- the network interface 207 may utilize one or more wireless protocols and standards for communicating with the speaker arrays 105, including the IEEE 802.11 suite of standards, cellular Global System for Mobile Communications (GSM) standards, cellular Code Division Multiple Access (CDMA) standards, Long Term Evolution (LTE) standards, and/or Bluetooth standards.
- GSM Global System for Mobile Communications
- CDMA Code Division Multiple Access
- LTE Long Term Evolution
- the speaker arrays 105 may receive audio signals corresponding to audio channels from the audio source 103A through a corresponding interface 212. These audio signals may be used to drive one or more transducers 109 in the speaker arrays 105.
- the interface 212 may utilize wired protocols and standards and/or one or more wireless protocols and standards, including the IEEE 802.11 suite of standards, cellular Global System for Mobile Communications (GSM) standards, cellular Code Division Multiple Access (CDMA) standards, Long Term Evolution (LTE) standards, and/or Bluetooth standards.
- the speaker arrays 105 may include digital-to-analog converters 217, power amplifiers 211, delay circuits 213, and beamformers 215 for driving transducers 109 in the speaker arrays 105.
- one or more components of the audio source 103A may be integrated within the speaker arrays 105.
- one or more of the speaker arrays 105 may include the hardware processor 201, the memory unit 203, and the one or more audio inputs 205.
- Figure 3A shows a side view of one of the speaker arrays 105 according to one embodiment.
- the speaker arrays 105 may house multiple transducers 109 in a curved cabinet 111.
- the cabinet 111 is cylindrical; however, in other embodiments the cabinet 111 may be in any shape, including a polyhedron, a frustum, a cone, a pyramid, a triangular prism, a hexagonal prism, or a sphere.
- FIG 3B shows an overhead, cutaway view of a speaker array 105 according to one embodiment.
- the transducers 109 in the speaker array 105 encircle the cabinet 111 such that the transducers 109 cover the curved face of the cabinet 111.
- the transducers 109 may be any combination of full-range drivers, mid-range drivers, subwoofers, woofers, and tweeters.
- Each of the transducers 109 may use a lightweight diaphragm, or cone, connected to a rigid basket, or frame, via a flexible suspension that constrains a coil of wire (e.g., a voice coil) to move axially through a cylindrical magnetic gap.
- a coil of wire e.g., a voice coil
- a magnetic field is created by the electric current in the voice coil, making it a variable electromagnet.
- the coil and the transducers' 109 magnetic system interact, generating a mechanical force that causes the coil (and thus, the attached cone) to move back and forth, thereby reproducing sound under the control of the applied electrical audio signal coming from an audio source, such as the audio source 103A.
- electromagnetic dynamic loudspeaker drivers are described for use as the transducers 109, those skilled in the art will recognize that other types of loudspeaker drivers, such as piezoelectric, planar electromagnetic and electrostatic drivers are possible.
- Each transducer 109 may be individually and separately driven to produce sound in response to separate and discrete audio signals received from an audio source 103A.
- the speaker arrays 105 may produce numerous directivity/beam patterns that accurately represent each channel of a piece of sound program content output by the audio source 103.
- the speaker arrays 105 may individually or collectively produce one or more of the directivity patterns shown in Figure 4 .
- FIG. 1A and Figure 1B Although shown in Figure 1A and Figure 1B as including three speaker arrays 105, a different number of speaker arrays 105 may be used. For example, as shown in Figure 5A two speaker arrays 105 may be used while as shown in Figure 5B four speaker arrays 105 may be used within the listening area 101. The number, type, and positioning of speaker arrays 105 may vary over time. For example, a user 107 may move a speaker array 105 and/or add a speaker array 105 to the system 100 during playback of a movie. Further, although shown as including one audio source 103A ( Figure 1A ) or two audio sources 103A and 103B ( Figure 1B ), similar to the speaker arrays 105, the number, type, and positioning of audio sources 103 may vary over time.
- the layout of the speaker arrays 105, the audio sources 103, and the users 107 may be determined using various sensors and/or input devices as will be described in greater detail below. Based on the determined layout of the speaker arrays 105, the audio sources 103, and/or the users 107, audio beam attributes may be generated for each channel of pieces of sound program content to be played in the listening area 101. These beam attributes may be used to output audio beams into corresponding audio zones 113 as will be described in greater detail below.
- FIG. 6 a method 600 for driving one or more speaker arrays 105 to generate sound for one or more zones 113 in the listening area 101 based on one or more pieces of sound program content will now be discussed.
- Each operation of the method 600 may be performed by one or more components of the audio sources 103A/103B and/or the speaker arrays 105.
- one or more of the operations of the method 600 may be performed by the rendering strategy unit 209 of an audio source 103.
- Figure 7 shows a component diagram of the rendering strategy unit 209 according to one embodiment. Each element of the rendering strategy unit 209 shown in Figure 7 will be described in relation to the method 600 described below.
- one or more components of an audio source 103 may be integrated within one or more speaker arrays 105.
- one of the speaker arrays 105 may be designated as a master speaker array 105.
- the operations of the method 600 may be solely or primarily performed by this master speaker array 105 and data generated by the master speaker array 105 may be distributed to other speaker arrays 105 as will be described in greater detail below in relation to the method 600.
- the operations of the method 600 are described and shown in a particular order, in other embodiments, the operations may be performed in a different order. In some embodiments, two or more operations may be performed concurrently or during overlapping time periods.
- the method 600 may begin at operation 601 with receipt of one or more audio signals representing pieces of sound program content.
- the one or more pieces of sound program content may be received by one or more of the speaker arrays 105 (e.g., a master speaker array 105) and/or an audio source 103 at operation 601.
- signals corresponding to the pieces of sound program content may be received by one or more of the audio inputs 205 and/or the content re-distribution and routing unit 701 at operation 601.
- the pieces of sound program content may be received at operation 601 from various sources, including streaming internet services, set-top boxes, local or remote computers, personal audio and video devices, etc.
- the signals may originate or may be generated by an audio source 103 and/or a speaker array 105.
- each of the audio signals may represent a piece of sound program content (e.g., a musical composition or an audio track for a movie) that is to be played to the users 107 in respective zones 113 of the listening area 101 through the speaker arrays 105.
- each of the pieces of sounds program content may include one or more audio channels.
- a piece of sound program content may include five channels of audio, including a front left channel, a front center channel, a front right channel, a left surround channel, and a right surround channel.
- 5.1, 7.1, or 9.1 multichannel audio streams may be used.
- Each of these channels of audio may be represented by corresponding signals or through a single signal received at operation 601.
- the method 600 may determine one or more parameters that describe 1) characteristics of the listening area 101; 2) the layout/location of the speaker arrays 105; 3) the location of the users 107; 4) characteristics of the pieces of sound program content; 5) the layout of the audio sources 103; and/or 6) characteristics of each audio zone 113. For example, at operation 603 the method 600 may determine characteristics of the listening area 101.
- These characteristics may include the size and geometry of the listening area 101 (e.g., the position of walls, floors, and ceilings in the listening area 101) and/or reverberation characteristics of the listening area 101, and/or the positions of objects within the listening area 101 (e.g., the position of couches, tables, etc.). In one embodiment, these characteristics may be determined through the use of the user inputs 709 (e.g., a mouse, a keyboard, a touch screen, or any other input device) and/or sensor data 711 (e.g., still image or video camera data and an audio beacon data).
- the user inputs 709 e.g., a mouse, a keyboard, a touch screen, or any other input device
- sensor data 711 e.g., still image or video camera data and an audio beacon data
- images from a camera may be utilized to determine the size of and obstacles in the listing area 101
- data from an audio beacon that utilizes audible or inaudible test sounds may indicate reverberation characteristics of the listening area 101
- the user 107 may utilize an input device 709 to manually indicate the size and layout of the listening area 101.
- the input devices 709 and sensors that produce the sensor data 711 may be integrated with an audio source 103 and/or a speaker array 105 or part of an external device (e.g., a mobile device in communication with an audio source 103 and/or a speaker array 105).
- the method 600 may determine the layout and positioning of the speaker arrays 105 in the listening area 101 and/or in each zone 113 at operation 605.
- operation 605 may be performed through the use of the user inputs 709 and/or sensor data 711.
- test sounds may be sequentially or simultaneously emitted by each of the speaker arrays 105 and sensed by a corresponding set of microphones. Based on these sensed sounds, operation 605 may determine the layout and positioning of each of the speaker arrays 105 in the listening area 101 and/or in the zones 113.
- the user 107 may assist in determining the layout and positioning of speaker arrays 105 in the listening area 101 and/or in the zones 113 through the use of the user inputs 709.
- the user 107 may manually indicate the locations of the speaker arrays 105 using a photo or video stream of the listening area 101.
- This layout and positioning of the speaker arrays 105 may include the distance between speaker arrays 105, the distance between speaker arrays 105 and one or more users 107, the distance between the speaker arrays 105 and one or more audio sources 103, and/or the distance between the speaker arrays 105 and one or more objects in the listening area 101 or the zones 113 (e.g., walls, couches, etc.).
- the method 600 may determine the position of each user 107 in the listening area 101 and/or in each zone 113 at operation 607.
- operation 607 may be performed through the use of the user inputs 709 and/or sensor data 711.
- captured images/videos of the listening area 101 and/or the zones 113 may be analyzed to determine the positioning of each user 107 in the listening area 101 and/or in each zone 113.
- the analysis may include the use of facial recognition to detect and determine the positioning of the users 107.
- microphones may be used to detect the locations of users 107 in the listening area 101 and/or in the zones 113.
- the positioning of users 107 may be relative to one or more speaker arrays 105, one or more audio sources 103, and/or one or more objects in the listening area 101 or the zones 113.
- other types of sensors may be used to detect the location of users 107, including global positioning sensors, motion detection sensors, microphones, etc.
- the method 600 may determine characteristics regarding the one or more received pieces of sound program content at operation 609.
- the characteristics may include the number of channels in each piece of sound program content, the frequency range of each piece of sound program content, and/or the content type of each piece of sound program content (e.g., music, dialogue, or sound effects). As will be described in greater detail below, this information may be used to determine the number or type of speaker arrays 105 necessary to reproduce the pieces of sound program content.
- the method 600 may determine the positions of each audio source 103 in the listening area 101 and/or in each zone 113 at operation 611.
- operation 611 may be performed through the use of the user inputs 709 and/or sensor data 711.
- captured images/videos of the listening area 101 and/or the zones 113 may be analyzed to determine the positioning of each of the audio sources 103 in the listening area 101 and/or in each zone 113.
- the analysis may include the use of pattern recognition to detect and determine the positioning of the audio sources 103.
- the positioning of the audio sources 103 may be relative to one or more speaker arrays 105, one or more users 107, and/or one or more objects in the listening area 101 or the zones 113.
- the method 600 may determine/define zones 113 within the listening area 113.
- the zones 113 represent segments of the listening area 101 that are associated with corresponding pieces of sound program content.
- a first piece of sound program content may be associated with the zone 113A as described above and shown in Figure 1A and Figure 1B while a second piece of sound program content may be associated with the zone 113B.
- the first piece of sound program content is designated to be played in the zone 113A while the second piece of sound program content is designated to be played in the zones 113B.
- zones 113 may be defined by any shape and may be any size. In some embodiments, the zones 113 may be overlapping and/or may encompass the entire listening area 101.
- the determination/definition of zones 113 in the listening area 101 may be automatically configured based on the determined locations of users 107, the determined locations of audio sources 103, and/or the determined locations of speaker arrays 105. For example, upon determining that the users 107A and 107B are located proximate to the audio source 103A (e.g., a television) while the users 107C and 107D are located proximate to the audio source 103B (e.g., a radio), operation 613 may define a first zone 113A around the users 107A and 107B and a second zone 113B around the users 107C and 107D. In other embodiments, the user 107 may manually define zones using the user inputs 709.
- the audio source 103A e.g., a television
- the users 107C and 107D are located proximate to the audio source 103B (e.g., a radio)
- operation 613 may define a first zone 113A around the users
- a user 107 may utilize a keyboard, mouse, touch screen, or another input device to indicate the parameters of one or more zones 113 in the listening area 101.
- the definition of zones 113 may include a size, shape, and/or a position relative to another zone and/or another object (e.g., a user 107, an audio source 103, a speaker array 105, a wall in the listening area 101, etc.) This definition may also include the association of pieces of sound program content with each zone 113.
- each of the operations 603, 605, 607, 609, 611, and 613 may be performed concurrently. However, in other embodiments, one or more of the operations 603, 605, 607, 609, 611, and 613 may be performed consecutively or in an otherwise non-overlapping fashion. In one embodiment, one or more of the operations 603, 605, 607, 609, 611, and 613 may be performed by the playback zone/mode generator 705 of the rendering and strategy unit 209.
- the method 600 may move to operation 615.
- pieces of sound program content received at operation 601 may be remixed to produce one or more audio channels for each piece of sound program content.
- each piece of sound program content received at operation 601 may include multiple audio channels.
- audio channels may be extracted for these pieces of sound program content based on the capabilities and requirements of the audio system 100 (e.g., the number, type, and positioning of the speaker arrays 105).
- the remixing at operation 615 may be performed by the mixing unit 703 of the content re-distribution and routing unit 701.
- each piece of sound program content at operation 615 may take into account the parameters/characteristics derived through operations 603, 605, 607, 609, 611, and 613. For example, operation 615 may determine that there are an insufficient number of speaker arrays 105 to represent ambience or surround audio channels for a piece of sound program content. Accordingly, operation 615 may mix the one or more pieces of sound program content received at operation 601 without ambience and/or surround channels.
- operation 615 may extract ambience and/or surround channels from the one or more pieces of sound program content received at operation 601.
- operation 617 may generate a set of audio beam attributes corresponding to each channel of the pieces of the sound program content that will be output into each corresponding zone 113.
- the attributes may include gain values, delay values, beam type pattern values (e.g., cardioid, omnidirectional, and figure-eight beam type patterns), and/or beam angle values (e.g., 0°-180°).
- Each set of beam attributes may be used to generate corresponding beam patterns for channels of the one or more pieces of sound program content.
- the beam attributes correspond to each of Q audio channels for one or more pieces of sound program content and N speaker arrays 105.
- QxN matrices of gain values, delays values, beam type pattern values, and beam angle values are generated.
- These beam attributes allow the speaker arrays 105 to generate audio beams for corresponding pieces of sound program content that are focused in associated zones 113 within the listening area 101.
- the beam attributes may be adjusted to cope with these changes.
- the beam attributes may be generated at operation 617 using the beam forming algorithm unit 707.
- Figure 9A shows an example audio system 100 according to one embodiment.
- the speaker arrays 105A-105D may output sound corresponding to a five channel piece of sound program content into the zone 113A.
- the speaker array 105A outputs a front left beam and a front left center beam
- the speaker array 105B outputs a front right beam and a front right center beam
- the speaker array 105C outputs a left surround beam
- the speaker array 105D outputs a right surround beam.
- the front left center and the front right center beams may collectively represent a front center channel while the other four beams produced by the speaker arrays 105A-105D represent corresponding audio channels for a five channel piece of sound program content.
- operation 615 may generate a set of beam attributes based on one or more of the factors described above.
- the sets of beam attributes produce corresponding beams based on the changing conditions of the listening environment.
- Figure 9A corresponds to a single piece of sound program content played in a single zone (e.g., zone 113A)
- the speaker arrays 105A-105D may simultaneously produce audio beams for another piece of sound program content to be played in another zone (e.g., the zone 113B).
- the speaker arrays 105A-105D produce six beams patterns to represent the five channel piece of sound program content described above in the zone 113A while the speaker arrays 105A and 105C may produce an additional two beam patterns to represent a second piece of sound program content with two channels in the zone 113B.
- operation 615 may produce beam attributes corresponding to the seven channels being played through the speaker arrays 105A-105D (i.e., five channels for the first piece of sound program content and two channels for the second piece of sound program content).
- the sets of beam attributes produce corresponding beams based on the changing conditions of the listening environment.
- the beam attributes may be relative to each corresponding zone 113, set of users 107 within the zone 113, and a corresponding piece of sound program content.
- the beam attributes for the first piece of sound program content described above in relation to Figure 9A may be generated in relation to the characteristics of the zone 113A, the positioning of the speaker arrays 105 relative to the users 107A and 107B, and the characteristics of the first piece of sound program content.
- the beam attributes for the second piece of sound program content may be relative to the characteristics of the zone 113B, the positioning of the speaker arrays 105 relative to the users 107C and 107D, and the characteristics of the second piece of sound program content. Accordingly, each of the first and second pieces of sound program content may be played in each corresponding audio zone 113A and 113B relative to the conditions of each respective zone 113A and 113B.
- operation 619 may transmit each of the sets of beam attributes to corresponding speaker arrays 105.
- the speaker array 105A in Figure 9B may receive three sets of beam pattern attributes corresponding to each front left beam and front left center beam for the first piece of sound program content and beam pattern attributes for the second piece of sound program content.
- the speaker arrays 105 may use these beam attributes to continually output sound for each piece of sound program content received at operation 601 in each corresponding zone 113.
- each piece of sound program content may be transmitted to corresponding speaker arrays 105 along with associated sets of beam pattern attributes. In other embodiments, these pieces of sound program content may be transmitted separately from the sets of beam pattern attributes to each speaker array 105.
- the speaker arrays 105 may drive each of the transducers 109 to generate corresponding beam patterns in corresponding zones 113 at operation 621.
- the speaker arrays 105A-105D may produce beam patterns in the zones 113A and 113B for two pieces of sound program content.
- each speaker array 105 may include corresponding digital-to-analog converters 217, power amplifiers 211, delay circuits 213, and beamformers 215 for driving transducers 109 to produce beam patterns based on these beam pattern attributes and pieces of sound program content.
- the method 600 may determine if anything in the sound system 100, the listening area 101, and/or in the zones 113 has changed from the performance of operation 603, 605, 607, 609, 611, and 613.
- changes may include the movement of a speaker array 105, the movement of a user 107, the change in a piece of sound program content, the movement of another object in the listening area 101 and/or in a zone 113, the movement of an audio source 103, the redefinition of a zone 113, etc.
- Changes may be determined at operation 623 through the use of the user inputs 709 and/or sensor data 711. For example, images of the listening area 101 and/or the zones 113 may be continually examined to determine if changes have occurred.
- the method 600 may return to operations 603, 605, 607, 609, 611, and/or 613 to determine one or more parameters that describe 1) characteristics of the listening area 101; 2) the layout/location of the speaker arrays 105; 3) the location of the users 107; 4) characteristics of the pieces of sound program content; 5) the layout of the audio sources 103; and/or 6) characteristics of each audio zone 113.
- new beam pattern attributes may be constructed using similar techniques described above.
- the method 600 may continue to output beam patterns based on the previously generated beam pattern attributes at operation 621.
- operation 623 may determine whether another triggering event has occurred. For example, other triggering events may include the expiration of a time period, the initial configuration of the audio system 100, etc. Upon detection of one or more of these triggering events, operation 623 may direct the method 600 to move to operations 603, 605, 607, 609, 611, and 613 to determine parameters of the listening environment as described above.
- the method 600 may produce beam pattern attributes based on the position/layout of speaker arrays 105, the positioning of users 107, the characteristics of the listening area 101, the characteristics of pieces of sound program content, and/or any other parameter of the listening environment. These beam pattern attributes may be used for driving the speaker arrays 105 to produce beams representing channels of one or more pieces of sound program content in separate zones 113 of the listening area. As changes occur in the listening area 101 and/or the zones 113, the beam pattern attributes may be updated to reflect the changed environment. Accordingly, sound produced by the audio system 100 may continually account for the variable conditions of the listening area 101 and the zones 113. By adapting to these changing conditions, the audio system 100 is capable of reproducing sound that accurately represents each piece of sound program content in various zones 113.
- an embodiment of the invention may be an article of manufacture in which a machine-readable medium (such as microelectronic memory) has stored thereon instructions which program one or more data processing components (generically referred to here as a "processor") to perform the operations described above.
- a machine-readable medium such as microelectronic memory
- data processing components program one or more data processing components (generically referred to here as a "processor") to perform the operations described above.
- some of these operations might be performed by specific hardware components that contain hardwired logic (e.g ., dedicated digital filter blocks and state machines). Those operations might alternatively be performed by any combination of programmed data processing components and fixed hardwired circuit components.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Circuit For Audible Band Transducer (AREA)
- Stereophonic System (AREA)
- Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
Claims (15)
- Verfahren zum Antreiben von Lautsprecheranordnung (105A, 105B, 105c), umfassend:Empfangen eines ersten Tonprogramminhalts durch eine erste Audioquelle (103A) und eines zweiten Tonprogramminhalts durch eine zweite Audioquelle (103B),wobei der erste Tonprogramminhalt designiert ist, um in einer ersten Zone (113A) innerhalb eines Hörbereichs und der zweite Tonprogramminhalt designiert ist, um in einer zweiten Zone (113B) innerhalb des Hörbereichs abgespielt zu werden;Bestimmen von Parametern, die die erste Zone (113A) basierend auf einem ersten Standort der ersten Audioquelle (103A) beschreiben;Bestimmen von Parametern, die die zweite Zone (113B) basierend auf einem zweiten Standort der zweiten Audioquelle (103B) beschreiben;Bestimmen von Parametern, die Standorte einer ersten Lautsprecheranordnung (105A) aufweisend erste Wandler in einem ersten Kabinett und einer zweiten Lautsprecheranordnung (105B) aufweisend zweite Wandler in einem zweiten Kabinett, das relativ zu dem ersten Kabinett bewegbar ist, beschreiben;Erzeugen von einem oder mehreren Sätzen von Audiostrahlmusterattributen basierend auf den bestimmten Parametern, die die erste Zone (113A), die zweite Zone (113B), und die Standorte der ersten Lautsprecheranordnung (105A) und der zweiten Lautsprecheranordnung (105B) beschreiben;Antreiben der ersten Lautsprecheranordnung (105A) und der zweiten Lautsprecheranordnung (105B) mit dem einen oder den mehreren Sätzen von Audiostrahlmusterattributen, so dass jede Lautsprecheranordnung jeweilige Audiostrahlmuster entsprechend einem oder mehreren Kanälen des ersten Tonprogramminhalts und des zweiten Tonprogramminhalts in die erste Zone (113A) und die zweite Zone (113B) des Hörbereichs lenkt.
- Verfahren nach Anspruch 1, wobei jeder Satz von Audiostrahlmusterattributen in dem einen oder den mehreren Sätzen von Audiostrahlmusterattributen einen oder mehrere Verstärkungswerte, Verzögerungswerte, Strahltypmusterwerte, oder Strahlwinkelwerte beinhaltet, die verwendet werden zum Erzeugen entsprechender Audiostrahlen für jeden Kanal des ersten Tonprogramminhalts und des zweiten Tonprogramminhalts.
- Verfahren nach Anspruch 1, wobei die Parameter, die die Standorte der ersten Lautsprecheranordnung und der zweiten Lautsprecheranordnung beschreiben, den Standort jedes der Lautsprecheranordnungen relativ zu jeder Zone beinhalten, und wobei die Parameter, die die erste Zone und die zweite Zone beschreiben, den Standort jeder Audioquelle relative zu den jeweiligen Zonen beinhalten.
- Verfahren nach Anspruch 1, ferner umfassend:
Bestimmen von Parametern für den Tonprogramminhalt, wobei der eine oder die mehreren Sätze von Audiostrahlmusterattributen erzeugt werden basierend auf den Parametern für den Tonprogramminhalt, wobei die Parameter für den Tonprogramminhalt einen oder mehrere einer Anzahl von Kanälen in jedem Tonprogramminhalt, einen Frequenzbereich jedes Tonprogramminhalts, oder einen Inhaltstyp jedes Tonprogramminhalts beinhalten. - Verfahren nach Anspruch 1, ferner umfassend:
Bestimmen von Parametern für den Hörbereich, wobei der eine oder die mehreren Sätze von Audiostrahlmusterattributen erzeugt werden basierend auf den Parametern für den Hörbereich, wobei die Parameter des Hörbereichs eines oder mehrere von 1) einer Größe und Geometrie des Hörbereichs; 2) Nachhalleigenschaften des Hörbereichs; oder 3) dem Standort von Benutzern in dem Hörbereich beinhalten. - Verfahren nach Anspruch 5, ferner umfassend:
Definieren jeder der ersten Zone und der zweiten Zone in dem Hörbereich, wobei die Definition jeder Zone einen oder mehrere von dem Standort der Zone in dem Hörbereich, einer Größer der Zone, einer Form der Zone, oder einem Tonprogramminhalt von dem ersten Tonprogramminhalt und dem zweiten Tonprogramminhalt beinhaltet, die mit der Zone verknüpft sind. - Verfahren nach Anspruch 1, ferner umfassend:Erfassen einer Bewegung der ersten Lautsprecheranordnung;Bestimmen, als Reaktion auf Erfassen der Bewegung, von neuen Parametern, die die Zonen und die Lautsprecheranordnungen beschreiben;Erzeugen eines oder mehrerer neuer Sätze von Audiostrahlmusterattributen basierend auf den bestimmten neuen Parametern; undAntreiben der ersten Lautsprecheranordnung und der zweiten Lautsprecheranordnung mit dem einen oder den mehreren neuen Sätzen von Audiostrahlmusterattributen, so dass jede Lautsprecheranordnung jeweilige Audiostrahlen entsprechend einem oder mehrerer Kanälen des ersten Tonprogramminhalts und des zweiten Tonprogramminhalts zu der ersten Zone und der zweiten Tone in dem Hörbereich lenkt.
- Rechenvorrichtung zum Antreiben von Lautsprecheranordnungen, umfassend:eine erste Schnittstelle zum Empfangen eines ersten Tonprogramminhalts durch eine erste Audioquelle und eine zweite Schnittstelle zum Empfangen eines zweiten Tonprogramminhalts durch eine zweite Audioquelle, wobei der erste Tonprogramminhalt designiert ist, um in einer ersten Zone innerhalb eines Hörbereichs und der zweite Tonprogramminhalt designiert ist, um in einer zweiten Zone innerhalb des Hörbereichs abgespielt zu werden;einen Hardwareprozessor; undeine Speichereinheit zum Speichern von Anweisungen, die, wenn sie durch den Hardwareprozessor ausgeführt werden:Parameter bestimmen, die die erste Zone basierend auf einem ersten Standort der ersten Audioquelle beschreiben;Parameter bestimmen, die die zweite Zone basierend auf einem zweiten Standort der zweiten Audioquelle beschreiben;Parameter bestimmen, die Standorte einer ersten Lautsprecheranordnung aufweisend erste Wandler in einem ersten Kabinett und einer zweiten Lautsprecheranordnung aufweisend zweite Wandler in einem zweiten Kabinett, das relativ zu dem ersten Kabinett bewegbar ist, beschreiben;einen oder mehrere Sätze von Audiostrahlmusterattributen basierend auf den bestimmten Parametern erzeugen, die die erste Zone, die zweite Zone, und die Standorte der ersten Lautsprecheranordnung und der zweiten Lautsprecheranordnung beschreiben; undein oder mehrere Antriebssignale erzeugen zum Antreiben der ersten Lautsprecheranordnung und der zweiten Lautsprecheranordnung mit dem einen oder den mehreren Sätzen von Audiostrahlmusterattributen, so dass jede Lautsprecheranordnung jeweilige Audiostrahlmuster entsprechend einem oder mehreren Kanälen des ersten Tonprogramminhalts und des zweiten Tonprogramminhalts in die erste Zone und die zweite Zone des Hörbereichs lenkt.
- Rechenvorrichtung nach Anspruch 8, wobei jeder Satz von Audiostrahlmusterattributen in dem einen oder den mehreren Sätzen von Audiostrahlmusterattributen einen oder mehrere Verstärkungswerte, Verzögerungswerte, Strahltypmusterwerte, oder Strahlwinkelwerte beinhaltet, die verwendet werden zum Erzeugen entsprechender Audiostrahlen für jeden Kanal des ersten Tonprogramminhalts und des zweiten Tonprogramminhalts.
- Rechenvorrichtung nach Anspruch 8, wobei die Parameter, die die Standorte der ersten Lautsprecheranordnung und der zweiten Lautsprecheranordnung beschreiben, den Standort jedes der Lautsprecheranordnungen relativ zu jeder Zone beinhalten, und wobei die Parameter, die die erste Zone und die zweite Zone beschreiben, den Standort jeder Audioquelle relativ zu den jeweiligen Zonen beinhalten.
- Rechenvorrichtung nach Anspruch 8, wobei die Speichereinheit weitere Anweisungen beinhaltet, die, wenn sie durch den Hardwareprozessor ausgeführt werden:
Parameter für den Tonprogramminhalt bestimmen, wobei der eine oder die mehreren Sätze von Audiostrahlmusterattributen erzeugt werden basierend auf den Parametern für den Tonprogramminhalt, wobei die Parameter für den Tonprogramminhalt einen oder mehrere einer Anzahl von Kanälen in jedem Tonprogramminhalt, einen Frequenzbereich jedes Tonprogramminhalts, oder einen Inhaltstyp jedes Tonprogramminhalts beinhalten. - Rechenvorrichtung nach Anspruch 8, wobei die Speichereinheit weitere Anweisungen beinhaltet, die, wenn sie durch den Hardwareprozessor ausgeführt werden:
Parameter für den Hörbereich bestimmen, wobei der eine oder die mehreren Sätze von Audiostrahlmusterattributen erzeugt werden basierend auf den Parametern für den Hörbereich, wobei die Parameter des Hörbereichs eins oder mehrere von 1) einer Größe und Geometrie des Hörbereichs; 2) Nachhalleigenschaften des Hörbereichs; oder 3) dem Standort von Benutzern in dem Hörbereich beinhalten. - Rechenvorrichtung nach Anspruch 8, wobei die Speichereinheit weitere Anweisungen beinhaltet, die, wenn sie durch den Hardwareprozessor ausgeführt werden:
jede der ersten Zone und der zweiten Zone in dem Hörbereich definiert, wobei die Definition jeder Zone einen oder mehrere von dem Standort der Zone in dem Hörbereich, einer Größer der Zone, einer Form der Zone, oder einem Tonprogramminhalt von dem ersten Tonprogramminhalt und dem zweiten Tonprogramminhalt beinhaltet, die mit der Zone verknüpft sind. - Rechenvorrichtung nach Anspruch 8, wobei die Speichereinheit weitere Anweisungen beinhaltet, die, wenn sie durch den Hardwareprozessor ausgeführt werden:eine Bewegung der ersten Lautsprecheranordnung erfasst;als Reaktion auf Erfassen der Bewegung neue Parameter bestimmt, die die Zonen und die Lautsprecheranordnungen beschreiben;einen oder mehrere neue Sätze von Audiostrahlmusterattributen erzeugt basierend auf den bestimmten neuen Parametern; undein oder mehrere Antriebssignale erzeugt zum Antreiben der ersten Lautsprecheranordnung und der zweiten Lautsprecheranordnung mit dem einen oder den mehreren neuen Sätzen von Audiostrahlmusterattributen, so dass jede Lautsprecheranordnung jeweilige Audiostrahlen entsprechend einem oder mehreren Kanälen des ersten Tonprogramminhalts und des zweiten Tonprogramminhalts zu der ersten Zone und der zweiten Zone in dem Hörbereich lenkt.
- Herstellungsgegenstand umfassend ein nicht-flüchtiges maschinenlesbares Speichermedium, das Anweisungen speichert, die, wenn sie durch ein Datenverarbeitungssystem ausgeführt werden, das Datenverarbeitungssystem veranlassen, ein Verfahren nach einem der Ansprüche 1-7 durchzuführen.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US2014/057884 WO2016048381A1 (en) | 2014-09-26 | 2014-09-26 | Audio system with configurable zones |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3248389A1 EP3248389A1 (de) | 2017-11-29 |
EP3248389B1 true EP3248389B1 (de) | 2020-06-17 |
Family
ID=51703419
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14784172.0A Active EP3248389B1 (de) | 2014-09-26 | 2014-09-26 | Audio system mit konfigurierbaren zonen |
Country Status (6)
Country | Link |
---|---|
US (2) | US10609484B2 (de) |
EP (1) | EP3248389B1 (de) |
JP (1) | JP6362772B2 (de) |
KR (4) | KR101926013B1 (de) |
CN (2) | CN111654785B (de) |
WO (1) | WO2016048381A1 (de) |
Families Citing this family (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101926013B1 (ko) | 2014-09-26 | 2018-12-07 | 애플 인크. | 구성가능한 구역을 구비한 오디오 시스템 |
IL243513B2 (en) | 2016-01-07 | 2023-11-01 | Noveto Systems Ltd | A system and method for voice communication |
US11388541B2 (en) | 2016-01-07 | 2022-07-12 | Noveto Systems Ltd. | Audio communication system and method |
WO2018127901A1 (en) * | 2017-01-05 | 2018-07-12 | Noveto Systems Ltd. | An audio communication system and method |
WO2018045133A1 (en) * | 2016-08-31 | 2018-03-08 | Harman International Industries, Incorporated | Variable acoustics loudspeaker |
US10631115B2 (en) | 2016-08-31 | 2020-04-21 | Harman International Industries, Incorporated | Loudspeaker light assembly and control |
US10405125B2 (en) * | 2016-09-30 | 2019-09-03 | Apple Inc. | Spatial audio rendering for beamforming loudspeaker array |
US9955253B1 (en) * | 2016-10-18 | 2018-04-24 | Harman International Industries, Incorporated | Systems and methods for directional loudspeaker control with facial detection |
US10127908B1 (en) | 2016-11-11 | 2018-11-13 | Amazon Technologies, Inc. | Connected accessory for a voice-controlled device |
EP4322551A3 (de) * | 2016-11-25 | 2024-04-17 | Sony Group Corporation | Wiedergabevorrichtung, wiedergabeverfahren, informationsverarbeitungsvorrichtung, informationsverarbeitungsverfahren und programm |
US10255032B2 (en) * | 2016-12-13 | 2019-04-09 | EVA Automation, Inc. | Wireless coordination of audio sources |
US10366692B1 (en) * | 2017-05-15 | 2019-07-30 | Amazon Technologies, Inc. | Accessory for a voice-controlled device |
US10531196B2 (en) * | 2017-06-02 | 2020-01-07 | Apple Inc. | Spatially ducking audio produced through a beamforming loudspeaker array |
US10499153B1 (en) * | 2017-11-29 | 2019-12-03 | Boomcloud 360, Inc. | Enhanced virtual stereo reproduction for unmatched transaural loudspeaker systems |
KR102115222B1 (ko) * | 2018-01-24 | 2020-05-27 | 삼성전자주식회사 | 사운드를 제어하는 전자 장치 및 그 동작 방법 |
EP3579584A1 (de) | 2018-06-07 | 2019-12-11 | Nokia Technologies Oy | Steuerung der darstellung einer räumlichen audioszene |
US10484809B1 (en) | 2018-06-22 | 2019-11-19 | EVA Automation, Inc. | Closed-loop adaptation of 3D sound |
US10440473B1 (en) | 2018-06-22 | 2019-10-08 | EVA Automation, Inc. | Automatic de-baffling |
US10524053B1 (en) | 2018-06-22 | 2019-12-31 | EVA Automation, Inc. | Dynamically adapting sound based on background sound |
US10531221B1 (en) | 2018-06-22 | 2020-01-07 | EVA Automation, Inc. | Automatic room filling |
US10511906B1 (en) | 2018-06-22 | 2019-12-17 | EVA Automation, Inc. | Dynamically adapting sound based on environmental characterization |
US10708691B2 (en) | 2018-06-22 | 2020-07-07 | EVA Automation, Inc. | Dynamic equalization in a directional speaker array |
US20190391783A1 (en) * | 2018-06-22 | 2019-12-26 | EVA Automation, Inc. | Sound Adaptation Based on Content and Context |
US20190394602A1 (en) * | 2018-06-22 | 2019-12-26 | EVA Automation, Inc. | Active Room Shaping and Noise Control |
WO2020044728A1 (ja) * | 2018-08-31 | 2020-03-05 | 株式会社ドリーム | 指向性制御システム |
KR102608680B1 (ko) * | 2018-12-17 | 2023-12-04 | 삼성전자주식회사 | 전자장치 및 그 제어방법 |
WO2020206177A1 (en) * | 2019-04-02 | 2020-10-08 | Syng, Inc. | Systems and methods for spatial audio rendering |
US11659332B2 (en) | 2019-07-30 | 2023-05-23 | Dolby Laboratories Licensing Corporation | Estimating user location in a system including smart audio devices |
EP4005234A1 (de) * | 2019-07-30 | 2022-06-01 | Dolby Laboratories Licensing Corporation | Wiedergabe von audio über mehrere lautsprecher mit mehreren aktivierungskriterien |
EP4005233A1 (de) | 2019-07-30 | 2022-06-01 | Dolby Laboratories Licensing Corporation | Anpassbare räumliche audiowiedergabe |
US11968268B2 (en) | 2019-07-30 | 2024-04-23 | Dolby Laboratories Licensing Corporation | Coordination of audio devices |
EP4005235A1 (de) | 2019-07-30 | 2022-06-01 | Dolby Laboratories Licensing Corporation | Dynamikverarbeitung über vorrichtungen mit unterschiedlichen wiedergabefähigkeiten |
KR20220044204A (ko) | 2019-07-30 | 2022-04-06 | 돌비 레버러토리즈 라이쎈싱 코오포레이션 | 분산형 오디오 디바이스들을 위한 음향 반향 소거 제어 |
CN114521334B (zh) * | 2019-07-30 | 2023-12-01 | 杜比实验室特许公司 | 音频处理***、方法和介质 |
JP7443870B2 (ja) | 2020-03-24 | 2024-03-06 | ヤマハ株式会社 | 音信号出力方法および音信号出力装置 |
KR102168812B1 (ko) * | 2020-05-20 | 2020-10-22 | 삼성전자주식회사 | 사운드를 제어하는 전자 장치 및 그 동작 방법 |
DE102020207041A1 (de) * | 2020-06-05 | 2021-12-09 | Robert Bosch Gesellschaft mit beschränkter Haftung | Kommunikationsverfahren |
WO2022173684A1 (en) * | 2021-02-09 | 2022-08-18 | Dolby Laboratories Licensing Corporation | Echo reference generation and echo reference metric estimation according to rendering information |
US11930328B2 (en) * | 2021-03-08 | 2024-03-12 | Sonos, Inc. | Operation modes, audio layering, and dedicated controls for targeted audio experiences |
WO2024054834A2 (en) * | 2022-09-07 | 2024-03-14 | Sonos, Inc. | Spatial imaging on audio playback devices |
WO2024054837A1 (en) * | 2022-09-07 | 2024-03-14 | Sonos, Inc. | Primary-ambient playback on audio playback devices |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040151325A1 (en) * | 2001-03-27 | 2004-08-05 | Anthony Hooley | Method and apparatus to create a sound field |
Family Cites Families (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6577738B2 (en) * | 1996-07-17 | 2003-06-10 | American Technology Corporation | Parametric virtual speaker and surround-sound system |
JPH10262300A (ja) * | 1997-03-19 | 1998-09-29 | Sanyo Electric Co Ltd | 音声再生装置 |
JPH1127604A (ja) * | 1997-07-01 | 1999-01-29 | Sanyo Electric Co Ltd | 音声再生装置 |
US7346332B2 (en) | 2002-01-25 | 2008-03-18 | Ksc Industries Incorporated | Wired, wireless, infrared, and powerline audio entertainment systems |
US8103009B2 (en) | 2002-01-25 | 2012-01-24 | Ksc Industries, Inc. | Wired, wireless, infrared, and powerline audio entertainment systems |
US7853341B2 (en) | 2002-01-25 | 2010-12-14 | Ksc Industries, Inc. | Wired, wireless, infrared, and powerline audio entertainment systems |
US7783061B2 (en) * | 2003-08-27 | 2010-08-24 | Sony Computer Entertainment Inc. | Methods and apparatus for the targeted sound detection |
GB0304126D0 (en) * | 2003-02-24 | 2003-03-26 | 1 Ltd | Sound beam loudspeaker system |
US8290603B1 (en) | 2004-06-05 | 2012-10-16 | Sonos, Inc. | User interfaces for controlling and manipulating groupings in a multi-zone media system |
JP4114583B2 (ja) * | 2003-09-25 | 2008-07-09 | ヤマハ株式会社 | 特性補正システム |
JP4349123B2 (ja) | 2003-12-25 | 2009-10-21 | ヤマハ株式会社 | 音声出力装置 |
US7483538B2 (en) | 2004-03-02 | 2009-01-27 | Ksc Industries, Inc. | Wireless and wired speaker hub for a home theater system |
JP4501559B2 (ja) | 2004-07-07 | 2010-07-14 | ヤマハ株式会社 | スピーカ装置の指向性制御方法およびオーディオ再生装置 |
JP4949638B2 (ja) * | 2005-04-14 | 2012-06-13 | ヤマハ株式会社 | オーディオ信号供給装置 |
US8031891B2 (en) * | 2005-06-30 | 2011-10-04 | Microsoft Corporation | Dynamic media rendering |
JP2007124129A (ja) | 2005-10-26 | 2007-05-17 | Sony Corp | 音響再生装置および音響再生方法 |
JP4867367B2 (ja) * | 2006-01-30 | 2012-02-01 | ヤマハ株式会社 | 立体音響再生装置 |
JP4816307B2 (ja) * | 2006-07-28 | 2011-11-16 | ヤマハ株式会社 | オーディオシステム |
US8483853B1 (en) | 2006-09-12 | 2013-07-09 | Sonos, Inc. | Controlling and manipulating groupings in a multi-zone media system |
JP2008160265A (ja) | 2006-12-21 | 2008-07-10 | Mitsubishi Electric Corp | 音響再生システム |
JP2008263293A (ja) * | 2007-04-10 | 2008-10-30 | Yamaha Corp | 放音装置 |
JP5266674B2 (ja) | 2007-07-03 | 2013-08-21 | トヨタ自動車株式会社 | スピーカシステム |
EP2056627A1 (de) * | 2007-10-30 | 2009-05-06 | SonicEmotion AG | Verfahren und Vorrichtung für erhöhte Klangfeldwiedergabepräzision in einem bevorzugtem Zuhörbereich |
WO2011135283A2 (en) * | 2010-04-26 | 2011-11-03 | Cambridge Mechatronics Limited | Loudspeakers with position tracking |
NZ587483A (en) * | 2010-08-20 | 2012-12-21 | Ind Res Ltd | Holophonic speaker system with filters that are pre-configured based on acoustic transfer functions |
JP5821172B2 (ja) | 2010-09-14 | 2015-11-24 | ヤマハ株式会社 | スピーカ装置 |
US9578440B2 (en) | 2010-11-15 | 2017-02-21 | The Regents Of The University Of California | Method for controlling a speaker array to provide spatialized, localized, and binaural virtual surround sound |
KR101785379B1 (ko) | 2010-12-31 | 2017-10-16 | 삼성전자주식회사 | 공간 음향에너지 분포 제어장치 및 방법 |
US20140006017A1 (en) * | 2012-06-29 | 2014-01-02 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for generating obfuscated speech signal |
RU2602346C2 (ru) | 2012-08-31 | 2016-11-20 | Долби Лэборетериз Лайсенсинг Корпорейшн | Рендеринг отраженного звука для объектно-ориентированной аудиоинформации |
CN103916730B (zh) * | 2013-01-05 | 2017-03-08 | 中国科学院声学研究所 | 一种能够改善音质的声场聚焦方法及*** |
US10091583B2 (en) * | 2013-03-07 | 2018-10-02 | Apple Inc. | Room and program responsive loudspeaker system |
KR101752288B1 (ko) * | 2013-03-14 | 2017-06-29 | 애플 인크. | 스피커 어레이를 사용한 강력한 누화 제거 |
CN103491397B (zh) * | 2013-09-25 | 2017-04-26 | 歌尔股份有限公司 | 一种实现自适应环绕声的方法和*** |
US9913011B1 (en) | 2014-01-17 | 2018-03-06 | Apple Inc. | Wireless audio systems |
US9560445B2 (en) * | 2014-01-18 | 2017-01-31 | Microsoft Technology Licensing, Llc | Enhanced spatial impression for home audio |
US9348824B2 (en) | 2014-06-18 | 2016-05-24 | Sonos, Inc. | Device group identification |
US9671997B2 (en) | 2014-07-23 | 2017-06-06 | Sonos, Inc. | Zone grouping |
AU2017202717B2 (en) | 2014-09-26 | 2018-05-17 | Apple Inc. | Audio system with configurable zones |
KR101926013B1 (ko) | 2014-09-26 | 2018-12-07 | 애플 인크. | 구성가능한 구역을 구비한 오디오 시스템 |
-
2014
- 2014-09-26 KR KR1020177011481A patent/KR101926013B1/ko active IP Right Grant
- 2014-09-26 JP JP2017516655A patent/JP6362772B2/ja not_active Expired - Fee Related
- 2014-09-26 KR KR1020187034845A patent/KR102114226B1/ko active IP Right Grant
- 2014-09-26 WO PCT/US2014/057884 patent/WO2016048381A1/en active Application Filing
- 2014-09-26 KR KR1020207014166A patent/KR102302148B1/ko active IP Right Grant
- 2014-09-26 EP EP14784172.0A patent/EP3248389B1/de active Active
- 2014-09-26 KR KR1020217028911A patent/KR102413495B1/ko active IP Right Grant
- 2014-09-26 CN CN202010494045.4A patent/CN111654785B/zh active Active
- 2014-09-26 CN CN201480083576.7A patent/CN107148782B/zh active Active
-
2017
- 2017-08-23 US US15/684,790 patent/US10609484B2/en active Active
-
2020
- 2020-02-24 US US16/799,440 patent/US11265653B2/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040151325A1 (en) * | 2001-03-27 | 2004-08-05 | Anthony Hooley | Method and apparatus to create a sound field |
Also Published As
Publication number | Publication date |
---|---|
US20170374465A1 (en) | 2017-12-28 |
CN107148782B (zh) | 2020-06-05 |
CN111654785B (zh) | 2022-08-23 |
US10609484B2 (en) | 2020-03-31 |
CN107148782A (zh) | 2017-09-08 |
KR101926013B1 (ko) | 2018-12-07 |
JP6362772B2 (ja) | 2018-07-25 |
KR20170094125A (ko) | 2017-08-17 |
CN111654785A (zh) | 2020-09-11 |
KR102302148B1 (ko) | 2021-09-14 |
KR20200058580A (ko) | 2020-05-27 |
JP2017532898A (ja) | 2017-11-02 |
KR20210113445A (ko) | 2021-09-15 |
WO2016048381A1 (en) | 2016-03-31 |
KR20180132169A (ko) | 2018-12-11 |
US11265653B2 (en) | 2022-03-01 |
KR102114226B1 (ko) | 2020-05-25 |
EP3248389A1 (de) | 2017-11-29 |
KR102413495B1 (ko) | 2022-06-24 |
US20200213735A1 (en) | 2020-07-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11265653B2 (en) | Audio system with configurable zones | |
US11979734B2 (en) | Method to determine loudspeaker change of placement | |
KR102182526B1 (ko) | 빔형성 라우드스피커 어레이를 위한 공간적 오디오 렌더링 | |
US9900723B1 (en) | Multi-channel loudspeaker matching using variable directivity | |
US10149046B2 (en) | Rotationally symmetric speaker array | |
KR101676634B1 (ko) | 오브젝트―기반 오디오를 위한 반사된 사운드 렌더링 | |
AU2014236850A1 (en) | Robust crosstalk cancellation using a speaker array | |
US10104490B2 (en) | Optimizing the performance of an audio playback system with a linked audio/video feed | |
AU2018214059B2 (en) | Audio system with configurable zones | |
US11190870B2 (en) | Rotationally symmetric speaker array | |
JP6716636B2 (ja) | 設定可能なゾーンを有するオーディオシステム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20170613 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: APPLE INC. |
|
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1245548 Country of ref document: HK |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20180912 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20200213 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602014066738 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1282794 Country of ref document: AT Kind code of ref document: T Effective date: 20200715 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200917 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200918 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20200617 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200917 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1282794 Country of ref document: AT Kind code of ref document: T Effective date: 20200617 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201019 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20201017 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602014066738 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
26N | No opposition filed |
Effective date: 20210318 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20200926 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20200930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200926 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200930 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200926 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200926 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200930 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200617 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230526 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230802 Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: HK Ref legal event code: WD Ref document number: 1245548 Country of ref document: HK |