EP3743914A1 - Haushaltsgerät sowie verfahren und system zur sprachsteuerung eines haushaltsgeräts - Google Patents

Haushaltsgerät sowie verfahren und system zur sprachsteuerung eines haushaltsgeräts

Info

Publication number
EP3743914A1
EP3743914A1 EP18833709.1A EP18833709A EP3743914A1 EP 3743914 A1 EP3743914 A1 EP 3743914A1 EP 18833709 A EP18833709 A EP 18833709A EP 3743914 A1 EP3743914 A1 EP 3743914A1
Authority
EP
European Patent Office
Prior art keywords
voice
user
control device
feedback information
cloud server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP18833709.1A
Other languages
English (en)
French (fr)
Inventor
Yu Liu
Linjie Shen
Liang Wang
Yang ZHAN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BSH Hausgeraete GmbH
Original Assignee
BSH Hausgeraete GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BSH Hausgeraete GmbH filed Critical BSH Hausgeraete GmbH
Publication of EP3743914A1 publication Critical patent/EP3743914A1/de
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/28Constructional details of speech recognition systems
    • G10L15/30Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/28Constructional details of speech recognition systems
    • G10L15/34Adaptation of a single recogniser for parallel processing, e.g. by use of multiple processors or cloud computing
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00Speech synthesis; Text to speech systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/225Feedback of the input speech

Definitions

  • the present invention relates to the field of household appliances, and specifically to voice control of a household appliance.
  • a voice controlled household appliance in the market generally uses several methods: one is connecting the household appliance to a mobile phone by using WIFI, and performing voice control on the household appliance by using a mobile APP, which is complex in operation; and one is adding a voice identification module and a voice database on the household appliance, and also combining online identification, but costs are relatively high.
  • the present invention provides a more convenient household appliance with low costs and a method and a system for voice controlling the household appliance, where the household appliance may be a refrigerator, a washing machine, an oven, or the like.
  • a method for voice controlling a household appliance includes a control device and a voice device, a wireless communication module in a wireless communication connection to a cloud server is disposed on the control device, and the voice device includes a voice collecting module and a voice output module.
  • the method includes the following steps: collecting, by using the voice collecting module, a voice signal input by a user; sending the voice signal to the cloud server by using the wireless communication module for identification; receiving, by using the wireless communication module, a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server; outputting the instruction confirmation information in a voice signal manner by using the voice output module, and asking for feedback information of the user; and instructing, according to the feedback information, the control device whether to execute the control instruction.
  • the foregoing household appliance is not provided with a voice identification module with relatively high costs, but directly identifies user voice online by using the cloud server, obtains the control instruction and the instruction confirmation information according to user semantics, and notifies the user of the instruction confirmation information in a voice manner, and only after the user confirms the instruction confirmation information and gives a feedback, the control device executes the control instruction. It is avoided that a control instruction not conforming to the user's real meaning is generated due to user's pronunciation or grammatical mistake, and this is more accurate.
  • the control device executes the control instruction; or when the feedback information does not conform to user semantics, the control device does not execute the control instruction.
  • the control device controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
  • the feedback information is a key signal generated by the user by triggering different feedback keys
  • the control device determines, according to different key signals, whether the feedback information conforms to the user semantics. If the user performs a near-distance operation, whether the feedback information conforms to the user semantics may be directly confirmed by using a key, and the program design is more simple and direct.
  • the key may be a physical key or a virtual key on a touchscreen.
  • the feedback information is a voice feedback signal of the user
  • the method includes: collecting the voice feedback signal by using the voice collecting module; sending the voice feedback signal to the cloud server by using the wireless communication module for identification and determining; receiving, by using the wireless communication module, a determining result fed back by the cloud server; and choosing, by the control device according to the determining result, to execute the control instruction or control the voice output module to inform the user in a voice signal manner to re-input a voice signal.
  • a household appliance is provided.
  • the household appliance is voice controlled by using the foregoing method.
  • the present invention further provides a system for voice controlling a household appliance, including at least one household appliance and a cloud server.
  • the household appliance is provided with a voice device and a control device, including: a voice collecting module disposed on the voice device, configured to collect a voice signal input by a user; a wireless communication module disposed on the control device, in a wireless communication connection to the cloud server, and configured to: send the voice signal to the cloud server for identification, and receive a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server; and a voice output module disposed on the voice device, configured to output the instruction confirmation information in a voice signal manner to ask for feedback information of the user, where the control device is instructed, according to the feedback information, whether to execute the control instruction.
  • the control device executes the control instruction; or when the feedback information does not conform to user semantics, the control device does not execute the control instruction.
  • the control device controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
  • the household appliance is provided with a feedback key
  • the feedback information is a key signal generated by the user by triggering different feedback keys
  • the control device determines, according to different key signals, whether the feedback information conforms to the user semantics. If the user performs a near- distance operation, whether the feedback information conforms to the user semantics may be directly confirmed by using a key, and the program design is more simple and direct.
  • the feedback information is a voice feedback signal of the user;
  • the voice collecting module collects the voice feedback signal and sends the voice feedback signal to the cloud server by using the wireless communication module for identification, and the cloud server identifies and determines whether the feedback information conforms to the user semantics, and notifies the control device of a determining result; and the control device executes the control instruction according to the determining result or controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
  • FIG. 1 is a schematic diagram of a system for voice controlling a household appliance
  • FIG. 2 is a structural diagram of a system for voice controlling a household appliance
  • FIG. 3 is a flowchart of a method for voice controlling a household appliance
  • FIG. 4 is a preferred flowchart of a method for voice controlling a household appliance.
  • An embodiment of the present invention provides a system for voice controlling a household appliance, including at least one household appliance 1 and a cloud server 100.
  • the household appliance 1 is provided with a voice device 2 and a control device 3.
  • FIG. 1 is a schematic diagram of the system for controlling a household appliance by using voice.
  • the system further includes: a voice collecting module 21 disposed on the voice device 2, configured to collect a voice signal input by a user; a wireless communication module 31 disposed on the control device 3, in a wireless communication connection to the cloud server 100, configured to: send the voice signal to the cloud server 100 for identification, and receive a control instruction and instruction confirmation information that match the voice signal and fed back by the cloud server 100; and a voice output module 22 disposed on the voice device 2, configured to output the instruction confirmation information in a voice signal manner to ask for feedback information of the user, where the control device 3 is instructed, according to the feedback information, whether to execute the control instruction.
  • a voice collecting module 21 disposed on the voice device 2, configured to collect a voice signal input by a user
  • a wireless communication module 31 disposed on the control device 3, in a wireless communication connection to the cloud server 100, configured to: send the voice signal to the cloud server 100 for identification, and receive a control instruction and instruction confirmation information that match the voice signal and fed back by the cloud server 100
  • a voice output module 22 disposed
  • the household appliance 1 is a washing machine, and when the user needs to perform a special washing operation, for example, gives voice "Dehydrate only for ten minutes", the voice collecting module 21 collects the voice signal, and transmits the voice signal to the cloud server 100 by using the wireless communication module 31 disposed on the control device 3.
  • the voice collecting module 21 includes a conversion component that converts an acoustic signal into an electrical signal, for example, a microphone.
  • the voice collecting module 21 may further include a voice processing unit, configured to perform digital processing and noise reduction on the voice signal, to facilitate transmission performed by the wireless communication module 31.
  • the wireless communication module 31 may be directly or indirectly connected to the cloud server, and specifically includes, but is not limited to, wireless transmission manners such as WIFI, Bluetooth, and Zigbee, for data or instruction transmission.
  • wireless transmission manners such as WIFI, Bluetooth, and Zigbee
  • the cloud server 100 After receiving the voice signal, the cloud server 100 identifies the voice signal, matches the identified voice signal "Dehydrate only for ten minutes" with a control instruction stored in the cloud, or recalculates a corresponding control instruction, and then sends the control instruction and instruction confirmation information to the wireless communication module 31.
  • the instruction confirmation information is output in a voice signal manner by using the voice output module 32 to ask for feedback information of the user.
  • control device 3 executes the control instruction; or when the feedback information does not conform to user semantics, the control device 3 does not execute the control instruction.
  • control device 3 controls the voice output module 32 to instruct the user in a voice signal manner to re- input a voice signal.
  • An existing household appliance includes a voice identification module, and needs a smart voice neural network processing chip and a local storage unit.
  • the local storage unit needs storage space to store a lot of command words and corresponding control instructions, but still cannot completely meet diversified semantic requirements of users.
  • the washing machine in this embodiment is not provided with a voice identification module with relatively high costs, but directly identifies user voice online by using the cloud server 100, obtains the control instruction and the instruction confirmation information according to the user semantics, and notifies the user of the instruction confirmation information in a voice manner.
  • a voice identification module and a storage unit do not need to be mounted in the household appliance, thereby reducing costs.
  • control device 3 determines whether to execute the control instruction. Therefore, it can be ensured that a user requirement is accurately expressed, and no misoperation is generated, and this is more secure and reliable.
  • the washing machine 1 may be provided with a feedback key 4, the feedback information is a key signal generated by the user by triggering different feedback keys 4, and the control device 3 determines, according to different key signals, whether the feedback information conforms to the user semantics.
  • the user may still give a feedback by using voice.
  • the feedback information is a voice feedback signal of the user
  • the voice collecting module 21 collects the voice feedback signal and sends the voice feedback signal to the cloud server 100 by using the wireless communication module 31 for identification
  • the cloud server 100 identifies and determines whether the feedback information conforms to the user semantics, and notifies the control device 3 of a determining result
  • the control device 3 executes the control instruction according to the determining result or controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to execute the control instruction.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 not to execute the control instruction.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to control the voice output module 32 to instruct the user in a voice signal manner to re-input a voice signal.
  • FIG. 3 is a flowchart of the method for voice controlling a household appliance.
  • the control method is applied to a washing machine end, and corresponds to the foregoing system for voice controlling a household appliance.
  • a washing machine is in a communication connection to a cloud server, the washing machine includes a control device 3 and a voice device 2, a wireless communication module 31 in a wireless communication connection to the cloud server 100 is disposed on the control device 3, and the voice device 2 includes a voice collecting module 21 and a voice output module 22.
  • the method includes the following steps:
  • Step S102 Collect, by using the voice collecting module 21 , a voice signal input by a user.
  • Step S104 Send the voice signal to the cloud server 100 by using the wireless communication module 31 for identification.
  • Step S106 Receive, by using the wireless communication module 31 , a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server 100.
  • Step S108 Output the instruction confirmation information in a voice signal manner by using the voice output module 22, and ask for feedback information of the user.
  • Step S110 Instruct, according to the feedback information, the control device 3 whether to execute the control instruction.
  • control device 3 executes the control instruction; or when the feedback information does not conform to user semantics, the control device 3 does not execute the control instruction.
  • control device 3 controls the voice output module 32 to instruct the user in a voice signal manner to re- input a voice signal.
  • the washing machine 1 may be provided with a feedback key 4, the feedback information is a key signal generated by the user by triggering different feedback keys 4, and the control device 3 determines, according to different key signals, whether the feedback information conforms to the user semantics. If the feedback information conforms to the user semantics, it is directly confirmed by using the key, so that the program design is more simple and direct.
  • FIG. 4 is a preferred flowchart of a method for voice controlling a household appliance. As shown in FIG. 4, following the foregoing steps, the method further includes:
  • Step S1 Collect the voice feedback signal by using the voice collecting module 21.
  • Step S114 Send the voice feedback signal to the cloud server 100 by using the wireless communication module 31 for identification and determining.
  • Step S116 Receive, by using the wireless communication module 31, a determining result fed back by the cloud server 100.
  • Step S118. choose, by the control device 3 according to the determining result, to execute the control instruction or control the voice output module 32 to instruct the user in a voice signal manner to re-input a voice signal.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to execute the control instruction.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 not to execute the control instruction.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to control the voice output module 32 to instruct the user in a voice signal manner to re-input a voice signal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Theoretical Computer Science (AREA)
  • Telephonic Communication Services (AREA)
  • Control Of Washing Machine And Dryer (AREA)
  • Selective Calling Equipment (AREA)
EP18833709.1A 2018-01-26 2018-12-07 Haushaltsgerät sowie verfahren und system zur sprachsteuerung eines haushaltsgeräts Pending EP3743914A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810075595.5A CN110085219A (zh) 2018-01-26 2018-01-26 家用电器及通过语音控制该家用电器的方法和***
PCT/IB2018/059760 WO2019145769A1 (en) 2018-01-26 2018-12-07 Household appliance and method and system for voice controlling household appliance

Publications (1)

Publication Number Publication Date
EP3743914A1 true EP3743914A1 (de) 2020-12-02

Family

ID=65019544

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18833709.1A Pending EP3743914A1 (de) 2018-01-26 2018-12-07 Haushaltsgerät sowie verfahren und system zur sprachsteuerung eines haushaltsgeräts

Country Status (3)

Country Link
EP (1) EP3743914A1 (de)
CN (1) CN110085219A (de)
WO (1) WO2019145769A1 (de)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210012266A (ko) * 2019-07-24 2021-02-03 현대자동차주식회사 허브 대화 시스템, 허브 대화 시스템의 제어 방법 및 전자 장치
CN110570855A (zh) * 2019-08-28 2019-12-13 珠海格力电器股份有限公司 通过对话机制控制智能家居设备的***、方法及装置
CN111292746A (zh) * 2020-02-07 2020-06-16 普强时代(珠海横琴)信息技术有限公司 一种基于人机交互的语音输入转换***
CN111221262A (zh) * 2020-03-30 2020-06-02 重庆特斯联智慧科技股份有限公司 一种基于人体特征自适应智能家居调节方法和***
CN112562734B (zh) * 2020-11-25 2021-08-27 中检启迪(北京)科技有限公司 一种基于语音检测的语音交互方法及其装置

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7949529B2 (en) * 2005-08-29 2011-05-24 Voicebox Technologies, Inc. Mobile systems and methods of supporting natural language human-machine interactions
CN202453859U (zh) * 2011-12-20 2012-09-26 安徽科大讯飞信息科技股份有限公司 一种用于家电的语音交互装置
US9390716B2 (en) * 2013-04-19 2016-07-12 Panasonic Intellectual Property Corporation Of America Control method for household electrical appliance, household electrical appliance control system, and gateway
US10726831B2 (en) * 2014-05-20 2020-07-28 Amazon Technologies, Inc. Context interpretation in natural language processing using previous dialog acts
CN104110895A (zh) * 2014-07-28 2014-10-22 芜湖美的厨卫电器制造有限公司 热水器***、热水器及其控制方法、智能终端和服务器
CN105898584A (zh) * 2015-08-12 2016-08-24 乐视致新电子科技(天津)有限公司 一种语音信息反馈方法、装置及一种电视机
CN105329187B (zh) * 2015-11-05 2018-06-22 深圳市几米软件有限公司 蓝牙按键触发实现安全操作的智能车载***及控制方法
CN105929700A (zh) * 2016-04-26 2016-09-07 海信(山东)空调有限公司 智能控制方法和装置
CN106292321A (zh) * 2016-08-30 2017-01-04 无锡小天鹅股份有限公司 洗衣机及其控制方法和控制***
CN106385347A (zh) * 2016-09-09 2017-02-08 珠海格力电器股份有限公司 一种家电设备控制方法和装置
CN206117701U (zh) * 2016-09-30 2017-04-19 无锡小天鹅股份有限公司 家用电器及其控制***
CN106452997A (zh) * 2016-09-30 2017-02-22 无锡小天鹅股份有限公司 家用电器及其控制***
CN107220292A (zh) * 2017-04-25 2017-09-29 上海庆科信息技术有限公司 智能对话装置、反馈式智能语音控制***及方法
CN107274902A (zh) * 2017-08-15 2017-10-20 深圳诺欧博智能科技有限公司 用于家电的语音控制装置和方法

Also Published As

Publication number Publication date
CN110085219A (zh) 2019-08-02
WO2019145769A1 (en) 2019-08-01

Similar Documents

Publication Publication Date Title
EP3743914A1 (de) Haushaltsgerät sowie verfahren und system zur sprachsteuerung eines haushaltsgeräts
RU2605578C1 (ru) Способ и устройство управления интеллектуальным прибором на основе предварительного заданного режима сценария
CN106385347A (zh) 一种家电设备控制方法和装置
CN104808559B (zh) 一种无线开关控制方法、***及相关设备
US20160132029A1 (en) Method for configuring and controlling smart home products
WO2018041029A1 (zh) 用于家庭语音控制中心的智能路由器及其信号传输方法
CN106019993A (zh) 烹饪***
EP3157003B1 (de) Endgerätesteuerungsverfahren und -vorrichtung, sprachsteuerungsvorrichtung und endgerät
CN107615775A (zh) 设置降噪耳机的方法、终端及降噪耳机
CN103885350A (zh) 一种语音控制家庭电器的方法和装置
US10481569B2 (en) Household appliance control method and device, and central processing device
CN103914972A (zh) 一种家电控制装置及其红外学习方法
KR20140135318A (ko) 모바일 단말을 이용한 전기기기 제어 시스템 및 방법
CN105185094A (zh) 智能语音遥控器
WO2019184585A1 (zh) 一种基于WiFi感知控制家用电器的方法及***
CN107181991B (zh) 无线麦克风和无线麦克风***的中控***
CN106023566B (zh) 一种基于语音识别的蓝牙遥控装置、***及方法
CN106790936B (zh) 一种通话模式的切换方法及穿戴设备
CN106707978B (zh) 通过通讯录转移智能家居控制权的方法及通讯录
CN204965739U (zh) 智能语音遥控器
RU2009136414A (ru) Устройство и способ для управления и контроля устройств бытовой техники
US9497576B2 (en) NFC configuration method, NFC data transmission method, controller, and NFC controller
CN104871241A (zh) 语音识别设备
CN106057197B (zh) 一种语音定时操作方法、装置及***
CN104853371A (zh) 一种移动终端监控方法、监控***及相应的移动终端

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200826

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20220622