EP4111447A4 - Method and apparatus for providing noise suppression to an intelligent personal assistant - Google Patents

Method and apparatus for providing noise suppression to an intelligent personal assistant Download PDF

Info

Publication number
EP4111447A4
EP4111447A4 EP21792203.8A EP21792203A EP4111447A4 EP 4111447 A4 EP4111447 A4 EP 4111447A4 EP 21792203 A EP21792203 A EP 21792203A EP 4111447 A4 EP4111447 A4 EP 4111447A4
Authority
EP
European Patent Office
Prior art keywords
noise suppression
personal assistant
intelligent personal
providing noise
providing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21792203.8A
Other languages
German (de)
French (fr)
Other versions
EP4111447A1 (en
Inventor
Haiming Huang
Michael Courtney
Jan Van Ee
Khanh Nguyen
Jeremy Mickelsen
Arsham Hatambeiki
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Universal Electronics Inc
Original Assignee
Universal Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Universal Electronics Inc filed Critical Universal Electronics Inc
Publication of EP4111447A1 publication Critical patent/EP4111447A1/en
Publication of EP4111447A4 publication Critical patent/EP4111447A4/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78Detection of presence or absence of voice signals
    • G10L25/84Detection of presence or absence of voice signals for discriminating voice from noise
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/005Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S1/00Beacons or beacon systems transmitting signals having a characteristic or characteristics capable of being detected by non-directional receivers and defining directions, positions, or position lines fixed relatively to the beacon transmitters; Receivers co-operating therewith
    • G01S1/02Beacons or beacon systems transmitting signals having a characteristic or characteristics capable of being detected by non-directional receivers and defining directions, positions, or position lines fixed relatively to the beacon transmitters; Receivers co-operating therewith using radio waves
    • G01S1/08Systems for determining direction or position line
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S3/00Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
    • G01S3/02Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using radio waves
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/08Speech classification or search
    • G10L2015/088Word spotting
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166Microphone arrays; Beamforming
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/20Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Otolaryngology (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Health & Medical Sciences (AREA)
  • Quality & Reliability (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Selective Calling Equipment (AREA)
  • User Interface Of Digital Computer (AREA)
EP21792203.8A 2020-04-24 2021-04-08 Method and apparatus for providing noise suppression to an intelligent personal assistant Pending EP4111447A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/858,011 US11335361B2 (en) 2020-04-24 2020-04-24 Method and apparatus for providing noise suppression to an intelligent personal assistant
PCT/US2021/026346 WO2021216292A1 (en) 2020-04-24 2021-04-08 Method and apparatus for providing noise suppression to an intelligent personal assistant

Publications (2)

Publication Number Publication Date
EP4111447A1 EP4111447A1 (en) 2023-01-04
EP4111447A4 true EP4111447A4 (en) 2023-09-20

Family

ID=78222664

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21792203.8A Pending EP4111447A4 (en) 2020-04-24 2021-04-08 Method and apparatus for providing noise suppression to an intelligent personal assistant

Country Status (3)

Country Link
US (3) US11335361B2 (en)
EP (1) EP4111447A4 (en)
WO (1) WO2021216292A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120134507A1 (en) * 2010-11-30 2012-05-31 Dimitriadis Dimitrios B Methods, Systems, and Products for Voice Control
US20140270194A1 (en) * 2013-03-12 2014-09-18 Comcast Cable Communications, Llc Removal of audio noise
US20170178664A1 (en) * 2014-04-11 2017-06-22 Analog Devices, Inc. Apparatus, systems and methods for providing cloud based blind source separation services
CN107665714A (en) * 2016-07-28 2018-02-06 海信集团有限公司 Projector equipment noise cancellation method, device and projector equipment
US20180350357A1 (en) * 2017-06-06 2018-12-06 Cypress Semiconductor Corporation System and methods for audio pattern recognition
US20190069080A1 (en) * 2017-08-28 2019-02-28 Bose Corporation User-controlled beam steering in microphone array
US20190349677A1 (en) * 2016-11-16 2019-11-14 Nokia Technologies Oy Distributed Audio Capture and Mixing Controlling

Family Cites Families (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7092881B1 (en) * 1999-07-26 2006-08-15 Lucent Technologies Inc. Parametric speech codec for representing synthetic speech in the presence of background noise
US6963833B1 (en) * 1999-10-26 2005-11-08 Sasken Communication Technologies Limited Modifications in the multi-band excitation (MBE) model for generating high quality speech at low bit rates
US7058572B1 (en) * 2000-01-28 2006-06-06 Nortel Networks Limited Reducing acoustic noise in wireless and landline based telephony
US6469657B1 (en) * 2000-10-17 2002-10-22 Itt Manufacturing Enterprises, Inc. FFT-based filtering for low-quality signal direction finding
US6996523B1 (en) * 2001-02-13 2006-02-07 Hughes Electronics Corporation Prototype waveform magnitude quantization for a frequency domain interpolative speech codec system
US6931373B1 (en) * 2001-02-13 2005-08-16 Hughes Electronics Corporation Prototype waveform phase modeling for a frequency domain interpolative speech codec system
JP4178319B2 (en) * 2002-09-13 2008-11-12 インターナショナル・ビジネス・マシーンズ・コーポレーション Phase alignment in speech processing
US7642963B2 (en) * 2007-01-08 2010-01-05 Bae Systems Information And Electronic Systems Integration Inc. Soldier/ground vehicle passive ranging system utilizing compact spatiotemporal processor
US8005238B2 (en) 2007-03-22 2011-08-23 Microsoft Corporation Robust adaptive beamforming with enhanced noise suppression
GB2466671B (en) * 2009-01-06 2013-03-27 Skype Speech encoding
GB2466670B (en) * 2009-01-06 2012-11-14 Skype Speech encoding
DE112009005489T5 (en) * 2009-12-31 2012-10-18 Nokia Corporation A device
TWI459828B (en) * 2010-03-08 2014-11-01 Dolby Lab Licensing Corp Method and system for scaling ducking of speech-relevant channels in multi-channel audio
KR20140026229A (en) * 2010-04-22 2014-03-05 퀄컴 인코포레이티드 Voice activity detection
US8964998B1 (en) * 2011-06-07 2015-02-24 Sound Enhancement Technology, Llc System for dynamic spectral correction of audio signals to compensate for ambient noise in the listener's environment
US10107887B2 (en) 2012-04-13 2018-10-23 Qualcomm Incorporated Systems and methods for displaying a user interface
CN103426441B (en) * 2012-05-18 2016-03-02 华为技术有限公司 Detect the method and apparatus of the correctness of pitch period
US20150365762A1 (en) 2012-11-24 2015-12-17 Polycom, Inc. Acoustic perimeter for reducing noise transmitted by a communication device in an open-plan environment
US9338551B2 (en) 2013-03-15 2016-05-10 Broadcom Corporation Multi-microphone source tracking and noise suppression
US9147397B2 (en) * 2013-10-29 2015-09-29 Knowles Electronics, Llc VAD detection apparatus and method of operating the same
CN103632677B (en) * 2013-11-27 2016-09-28 腾讯科技(成都)有限公司 Noisy Speech Signal processing method, device and server
IN2014MU00290A (en) * 2014-01-27 2015-09-11 Indian Inst Technology Bombay
US9282399B2 (en) 2014-02-26 2016-03-08 Qualcomm Incorporated Listen to people you recognize
JP6136995B2 (en) * 2014-03-07 2017-05-31 株式会社Jvcケンウッド Noise reduction device
CN105261375B (en) * 2014-07-18 2018-08-31 中兴通讯股份有限公司 Activate the method and device of sound detection
US9390725B2 (en) * 2014-08-26 2016-07-12 ClearOne Inc. Systems and methods for noise reduction using speech recognition and speech synthesis
US9666183B2 (en) * 2015-03-27 2017-05-30 Qualcomm Incorporated Deep neural net based filter prediction for audio event classification and extraction
US9949054B2 (en) * 2015-09-30 2018-04-17 Sonos, Inc. Spatial mapping of audio playback devices in a listening environment
US10152969B2 (en) * 2016-07-15 2018-12-11 Sonos, Inc. Voice detection by multiple devices
US10074380B2 (en) * 2016-08-03 2018-09-11 Apple Inc. System and method for performing speech enhancement using a deep neural network-based signal
US10755718B2 (en) * 2016-12-07 2020-08-25 Interactive Intelligence Group, Inc. System and method for neural network based speaker classification
EP3373602A1 (en) * 2017-03-09 2018-09-12 Oticon A/s A method of localizing a sound source, a hearing device, and a hearing system
US10381020B2 (en) * 2017-06-16 2019-08-13 Apple Inc. Speech model-based neural network-assisted signal enhancement
KR20190011531A (en) * 2017-07-25 2019-02-07 삼성전자주식회사 Display device, remote control device, display system comprising the same and distance measurement method thereof
US11125848B2 (en) * 2017-07-28 2021-09-21 Silicon Laboratories Inc. Systems and methods for multiantenna orientation and direction detection
US11290518B2 (en) * 2017-09-27 2022-03-29 Qualcomm Incorporated Wireless control of remote devices through intention codes over a wireless connection
EP3499915B1 (en) * 2017-12-13 2023-06-21 Oticon A/s A hearing device and a binaural hearing system comprising a binaural noise reduction system
US10553236B1 (en) * 2018-02-27 2020-02-04 Amazon Technologies, Inc. Multichannel noise cancellation using frequency domain spectrum masking
US10755728B1 (en) * 2018-02-27 2020-08-25 Amazon Technologies, Inc. Multichannel noise cancellation using frequency domain spectrum masking
US11217240B2 (en) * 2018-04-05 2022-01-04 Synaptics Incorporated Context-aware control for smart devices
US10939202B2 (en) * 2018-04-05 2021-03-02 Holger Stoltze Controlling the direction of a microphone array beam in a video conferencing system
US11906642B2 (en) * 2018-09-28 2024-02-20 Silicon Laboratories Inc. Systems and methods for modifying information of audio data based on one or more radio frequency (RF) signal reception and/or transmission characteristics
US10573312B1 (en) * 2018-12-04 2020-02-25 Sorenson Ip Holdings, Llc Transcription generation from multiple speech recognition systems

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120134507A1 (en) * 2010-11-30 2012-05-31 Dimitriadis Dimitrios B Methods, Systems, and Products for Voice Control
US20140270194A1 (en) * 2013-03-12 2014-09-18 Comcast Cable Communications, Llc Removal of audio noise
US20170178664A1 (en) * 2014-04-11 2017-06-22 Analog Devices, Inc. Apparatus, systems and methods for providing cloud based blind source separation services
CN107665714A (en) * 2016-07-28 2018-02-06 海信集团有限公司 Projector equipment noise cancellation method, device and projector equipment
US20190349677A1 (en) * 2016-11-16 2019-11-14 Nokia Technologies Oy Distributed Audio Capture and Mixing Controlling
US20180350357A1 (en) * 2017-06-06 2018-12-06 Cypress Semiconductor Corporation System and methods for audio pattern recognition
US20190069080A1 (en) * 2017-08-28 2019-02-28 Bose Corporation User-controlled beam steering in microphone array

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2021216292A1 *

Also Published As

Publication number Publication date
US11790938B2 (en) 2023-10-17
US20220223172A1 (en) 2022-07-14
US11335361B2 (en) 2022-05-17
EP4111447A1 (en) 2023-01-04
US20240005949A1 (en) 2024-01-04
WO2021216292A1 (en) 2021-10-28
US20210335385A1 (en) 2021-10-28

Similar Documents

Publication Publication Date Title
EP4016330A4 (en) Speech dialog processing method and apparatus
EP4016526A4 (en) Sound conversion system and training method for same
EP4252228A4 (en) Method and apparatus for real-time sound enhancement
EP3952426A4 (en) Method and device for canceling sr to be processed
EP4141865A4 (en) Method and apparatus for correcting voice dialogue
EP3753014A4 (en) System and method for prediction based preemptive generation of dialogue content
EP4079083A4 (en) Method and apparatus related to direction-based listen before talk
EP4261676A4 (en) Distributed application processing method and apparatus
EP4111447A4 (en) Method and apparatus for providing noise suppression to an intelligent personal assistant
EP4116839A4 (en) Voice interaction method and electronic device
EP4245081A4 (en) Method and apparatus of enhancement to standalone operation
EP4318464A4 (en) Speech interaction method and apparatus
EP4129161A4 (en) Real-time multi-monitoring apparatus and method using electrocardiographs
EP4250285A4 (en) Speech recognition method and apparatus
EP4153969A4 (en) Capture assembly and method of use thereof
EP4123941A4 (en) Phase noise cancellation method and apparatus
EP4130993A4 (en) Special effect processing method and apparatus
EP4172374A4 (en) Method and device for producing direct reduced metal
EP4118281A4 (en) Attachment configuration of and method for applying decorative laminates
EP4148375A4 (en) Ranging method and apparatus
EP4088486A4 (en) Apparatus and method for converting audio output
EP4123640A4 (en) Voice recognition apparatus and voice recognition method
EP3806027B8 (en) Method and apparatus for noise reduction
EP4148229B8 (en) Shielding apparatus and method of use
AU2021900720A0 (en) Improved method and apparatus for the reduction of pathogens

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220930

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RIC1 Information provided on ipc code assigned before grant

Ipc: G01S 3/02 20060101ALI20230515BHEP

Ipc: G01S 1/08 20060101ALI20230515BHEP

Ipc: H04R 3/00 20060101ALI20230515BHEP

Ipc: H04R 1/40 20060101ALI20230515BHEP

Ipc: G10L 21/0216 20130101ALI20230515BHEP

Ipc: G10L 21/02 20130101ALI20230515BHEP

Ipc: G10K 11/16 20060101ALI20230515BHEP

Ipc: G10L 21/0208 20130101AFI20230515BHEP

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230530

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20230822

RIC1 Information provided on ipc code assigned before grant

Ipc: G01S 3/02 20060101ALI20230816BHEP

Ipc: G01S 1/08 20060101ALI20230816BHEP

Ipc: H04R 3/00 20060101ALI20230816BHEP

Ipc: H04R 1/40 20060101ALI20230816BHEP

Ipc: G10L 21/0216 20130101ALI20230816BHEP

Ipc: G10L 21/02 20130101ALI20230816BHEP

Ipc: G10K 11/16 20060101ALI20230816BHEP

Ipc: G10L 21/0208 20130101AFI20230816BHEP