WO2023276335A1 - Control device for controlling voice interface and thermal appliance equipped with such control device - Google Patents
Control device for controlling voice interface and thermal appliance equipped with such control device Download PDFInfo
- Publication number
- WO2023276335A1 WO2023276335A1 PCT/JP2022/013619 JP2022013619W WO2023276335A1 WO 2023276335 A1 WO2023276335 A1 WO 2023276335A1 JP 2022013619 W JP2022013619 W JP 2022013619W WO 2023276335 A1 WO2023276335 A1 WO 2023276335A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- signal
- voice
- input
- control device
- unit
- Prior art date
Links
- 238000000034 method Methods 0.000 claims abstract description 41
- 238000012790 confirmation Methods 0.000 claims abstract description 38
- 230000004044 response Effects 0.000 claims abstract description 5
- 230000005540 biological transmission Effects 0.000 claims abstract 3
- 238000010438 heat treatment Methods 0.000 claims description 201
- 238000004364 calculation method Methods 0.000 claims description 41
- 230000008569 process Effects 0.000 claims description 24
- 238000001514 detection method Methods 0.000 claims description 22
- 230000000007 visual effect Effects 0.000 claims description 19
- 239000003086 colorant Substances 0.000 claims description 18
- 230000005236 sound signal Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 12
- 238000013459 approach Methods 0.000 claims description 5
- 230000004913 activation Effects 0.000 claims description 3
- 230000007704 transition Effects 0.000 claims description 2
- 238000010411 cooking Methods 0.000 description 34
- 230000006698 induction Effects 0.000 description 24
- 238000004891 communication Methods 0.000 description 17
- 238000010586 diagram Methods 0.000 description 16
- 238000012545 processing Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 14
- 230000008859 change Effects 0.000 description 8
- 230000009471 action Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 4
- 238000009434 installation Methods 0.000 description 4
- 239000004973 liquid crystal related substance Substances 0.000 description 4
- 238000003825 pressing Methods 0.000 description 4
- 238000009429 electrical wiring Methods 0.000 description 2
- 238000013403 standard screening design Methods 0.000 description 2
- 206010024796 Logorrhoea Diseases 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000002485 combustion reaction Methods 0.000 description 1
- 239000004615 ingredient Substances 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 229910001120 nichrome Inorganic materials 0.000 description 1
- 235000013547 stew Nutrition 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- F24C3/00—Stoves or ranges for gaseous fuels
- F24C3/12—Arrangement or mounting of control or safety devices
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- F24C7/00—Stoves or ranges heated by electric energy
- F24C7/02—Stoves or ranges heated by electric energy using microwaves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B6/00—Heating by electric, magnetic or electromagnetic fields
- H05B6/02—Induction heating
- H05B6/10—Induction heating apparatus, other than furnaces, for specific applications
- H05B6/12—Cooking devices
Definitions
- the present disclosure relates to a control device for controlling an audio interface, and a thermal appliance equipped with such a control device.
- a voice interface is a user interface that allows a user to give an instruction (voice command) using voice to a device or the like, operate the device or the like according to the contents of the voice command, and obtain the output from the device. Therefore, voice interfaces are superior to conventional user interfaces represented by GUIs (Graphical User Interfaces) in terms of operability and convenience.
- GUIs Graphic User Interfaces
- Patent Document 1 discloses a heating cooker that recognizes voice and enables operation based on the character string of the recognition result. According to the technique of Patent Document 1, a technique is disclosed for recognizing a voice uttered by a user, switching to the next screen based on the result, and changing the control of the device.
- a change in the heating state here means a change in thermal power, such as starting heating, changing thermal power, or stopping heating.
- the present disclosure provides a technology related to control of a voice interface for operating a thermal appliance such as a heating cooker by voice.
- a control device controls a voice interface for operating a thermal appliance by voice.
- the control device includes an input interface that receives an input signal from the outside, and if the input signal is a voice signal, determines whether the voice signal represents one of a plurality of prepared operation words. and an output interface for outputting control signals to the outside.
- the computing unit receives a voice signal as a first input signal from the input interface, and when determining that the voice signal represents a predetermined operation word among the plurality of operation words, executes a voice command corresponding to the predetermined operation word.
- a first control signal requesting confirmation is output via the output interface.
- the computing unit receives a second input signal via the input interface after transmitting the first control signal, and when determining that the second input signal is an acknowledgment signal confirming execution of the voice command, instructs execution of the voice command. and outputs a second control signal through the output interface.
- a thermal device includes the control device described above, one or more heating units that generate heat, a control unit that controls the heating power of the heating units, a microphone, and user operations and/or actions. and one or more sensors for detection.
- the input interface of the control device receives each output signal of the microphone and one or more sensors as input signals
- the output interface of the control device outputs the control signal to the control unit
- the control unit receives the control signal It controls the operation of one or more heating units accordingly.
- a computer program is executed by a computer of a control device that controls a voice interface for operating a heating cooker by voice.
- the control device includes an input interface that receives an input signal from the outside, and, when the input signal is a voice signal, determines whether the voice signal represents one of a plurality of operation words prepared in advance. It has an arithmetic unit, which is a computer, for judging, and an output interface for outputting a control signal to the outside.
- the computer program causes the arithmetic unit of the control device to receive an audio signal as a first input signal from the input interface; A process of outputting a first control signal requesting confirmation of execution of a voice command corresponding to a predetermined operation word via an output interface, and receiving a second input signal via an input interface after transmitting the first control signal. and outputting a second control signal instructing execution of the voice command through the output interface when the second input signal is determined to be an acknowledgment signal confirming execution of the voice command.
- a technique for controlling a voice interface for operating a cooking device by voice.
- FIG. 1 is a top view of kitchen equipment in which a heating cooker 1 incorporating a control device 100 is installed.
- FIG. 2 shows a heating cooker incorporating the control device of the present disclosure;
- FIG. 1 is a block diagram showing a control system of an induction heating cooker according to an exemplary embodiment
- Partial schematic diagram of operation unit and display unit 4 is a flow chart showing the procedure of processing executed by the computing unit of the control device
- 4 is a flow chart showing the procedure of processing executed by the computing unit of the control device
- FIG. 11 is a diagram showing a display example of the display section for requesting the user to confirm the execution of the voice command
- FIG. 10 is a diagram showing a display section displaying a character image indicating that the thermal power has been adjusted to 4 according to the voice command as a result of the instruction to execute the voice command
- Diagram showing how to request execution confirmation according to another example A diagram for explaining an example of confirming a user's execution request using a lamp that can be lit in any color
- a graph showing an example waveform of an acknowledgment signal using a proximity sensor A graph showing an example waveform of a signal that does not correspond to an acknowledgment signal
- FIG. 2 shows a set of two types of gestures corresponding to executing and canceling voice commands, respectively;
- the advantages of allowing a user to operate a device with voice commands are many. For example, it can be operated hands-free, so there is no need to touch the device directly. The user can operate the device from a remote location without checking the device screen. In addition, since it can be controlled quickly by voice, it can be handled immediately even if an immediate operation is required from a remote location. In addition, even setting items that exist in the lower layers of the hierarchy can be easily called up and input by voice, enabling a variety of operations other than those performed while looking at the device screen, reducing the user's input effort. be able to.
- the user When operating a device with such a voice command, conventionally, the user first utters a predetermined voice called a wake-up word, and then utters an operation word according to the content of the operation to be performed.
- the device constantly receives audio signals from the microphone and determines whether there is a wake-up word in the speech content. When the wakeup word is recognized, the device activates its own system, waits for the voice of the subsequent operation word, and when the operation word is recognized, performs the operation corresponding to the operation word.
- the device After being activated by the wakeup word, the device may, for some reason, recognize an operation command corresponding to an action different from the action intended by the user. Alternatively, even though the user is not speaking, the device may mistake the voice noise for the user's voice and recognize the voice noise as an operation command not intended by the user. Especially in the latter case, the recognition of the wakeup word itself may also occur without the user's intention. That is, there is a possibility that activation and execution of the device can be realized regardless of the user's intention. For example, if the device is a lighting fixture and the operation is to turn on the lighting, the influence of the user's lack of involvement is minor. On the other hand, if the device is a cooking device with a heating function, the influence of the user's lack of involvement may increase.
- the inventors of the present application thought that it would be preferable to impose a startup condition specific to the heating cooker when operating the heating cooker with a voice command. Specifically, the inventor thought that it would be preferable for the user, who is within a visual range of the heating cooker, to allow or confirm the execution of the voice command corresponding to the operation word, and then cause the heating cooker to execute the operation. By operating the heating cooker in such a procedure, even if the heating cooker recognizes an operation command not intended by the user, it is possible to prevent the heating cooker from starting to operate unconditionally. As the “range in which the heating cooker can be visually recognized”, for example, a close range in which the user can directly touch and operate the heating cooker can be considered.
- thermo equipment which is equipment that handles thermal power and heat.
- a thermal appliance has a heating portion, such as a coil, a heating wire, a combustion tube, etc., that generates heat in another object or itself.
- a heating cooker is taken as an example of a thermal appliance.
- the control device is used to control a voice interface for operating the cooking device by voice.
- Heating cookers include, for example, IH (Induction Heating) cooking heaters that inductively heat a cooking container using electric power, gas cookers that heat the cooking container by burning gas, and heating wires with relatively high electrical resistance such as nichrome wires.
- the cooking device is an IH cooking heater.
- FIG. 1A is a top view of kitchen equipment in which a heating cooker 1 incorporating a control device 100 is installed.
- the user 200 exists relatively close to the heating cooker 1 and can visually recognize the heating cooker 1 .
- the user 200 operates the heating cooker 1 by voice from this position. It is assumed that the heating cooker 1 is in a waiting state for waiting for voice input.
- FIG. 1B shows a scene in which the user 200 issues an operation word.
- User 200 wants to use heating coil 8 on the right side of heating coils 7 to 9 that are IH heaters of heating cooker 1 .
- the operation words "right IH” and "ignite” are sequentially uttered.
- a voice uttered by user 200 is acquired by microphone 50 of cooking device 1 and sent to control device 100 .
- the control device 100 recognizes the wake-up word and the operation word from the voice signal by the voice recognition function.
- heating cooker 1 may have a voice recognition function.
- the "wake-up word” is a word that triggers the cooker 1 and the control device 100 to start their own systems and wait for the following sound.
- An “operation word” refers to a word or phrase expressed by a voice uttered by user 200 in order to operate cooking device 1 .
- An internal command for operating the heating cooker 1 is associated in advance with the operation word, so that the heating cooker 1 can be operated based on the operation word.
- the cooking device 1 is caused to perform various operations by voice, there are a plurality of types of operation words, and a plurality of types of internal commands corresponding to each operation word. Based on the fact that various internal commands can be issued in the cooking device 1 even when the user 200 directly operates the cooking device 1 without using voice, the internal Commands are described as "voice commands".
- the control device 100 When the voice of the user 200 is detected after recognizing the wakeup word, the control device 100 recognizes the operation word with the voice recognition function and determines whether or not there is a voice command corresponding to the operation word. Specifically, the control device 100 determines the voice command by referring to the data file based on the recognized operation word. The data file stores a table in which each of various operation words and each of various voice commands are associated in advance. If the corresponding voice command exists, the user 200 is requested to confirm whether the voice command can be executed (execution confirmation).
- FIG. 1C shows the user 200 pressing the push button sensor 52 to instruct execution in response to the requested execution confirmation.
- the controller 100 asks the user 200 for execution confirmation by voice from the cooker 1 as shown, or by letters, numbers, symbols, graphics, colors and/or lights as described below.
- control device 100 determines that the user 200 confirms execution of the voice command, and determines that heating coil 8 corresponding to “right IH” of heating cooker 1 should be ignited.
- the voice command shown is transmitted to the heating cooker 1. Thereby, the user 200 can perform a desired operation on the heating cooker 1 using voice commands.
- FIG. 1D shows how the heating coil 8 on the right side of the heating cooker 1 is ignited by executing the voice command.
- FIG. 1D shows how the heating coil 8 on the right side of the heating cooker 1 is ignited by executing the voice command.
- the user 200 is asked to confirm execution before an operation word is recognized and the corresponding voice command is executed.
- the execution can be confirmed only by the user 200 who is present within a visible range of the heating cooker 1, such as pressing a push button provided on the heating cooker 1 to confirm the execution.
- FIG. 2 shows a user 200 who is present in a range where the heating cooker 1 cannot be visually recognized. Even if the cooker 1 asks the user 200 to confirm the execution, the user 200 cannot confirm the execution. By predetermining a period (length of time) for accepting an execution confirmation, the control device 100 does not output a voice command to the heating cooker 1 when the period elapses. can be avoided.
- FIG. 3A shows the heating cooker 1 incorporating the control device 100 of the present disclosure.
- the configuration shown in FIG. 3A is the same as the configuration in FIG. 1B.
- the heating cooker 1 has a sensor 52 that detects execution confirmation by the user 200 and a microphone 50 that acquires the voice of the user 200 for voice recognition.
- Sensors 52 are, for example, one or more switches, proximity sensors, gesture sensors capable of accepting selection of letters, numbers, symbols, graphics and/or colors. Although only one sensor 52 is shown in the drawing, the number of sensors 52 may be plural. For example, a sensor 52 is provided for each of the heating coils 7 to 9 to be operated, and only when the sensor 52 corresponding to the heating coil to be operated detects confirmation of execution, the control device 100 outputs a voice command to operate that heating coil. may It should be noted that if the sensor 52 that accepts execution confirmation is hardware itself that requires user contact, such as a push button, or a sensor that is attached to such hardware, the sensor 52 is connected to each of the heating coils 7-9. is more preferably common to Also, it is more preferable that the number of sensors 52 is one. As a result, it is possible to reduce the points of contact with hands soiled by cooking.
- FIG. 3A the control device 100 is built in the heating cooker 1, but other configuration examples are also conceivable.
- FIG. 3B shows a configuration example in which the control device 100 and the heating cooker 1 are accommodated in separate housings and connected to each other via the communication line 140.
- the control device 100 receives the output signal, which is the detection result of the sensor 52 , and the audio signal from the microphone 50 via the communication line 140 . Based on the output signal of sensor 52 , control device 100 determines whether or not to transmit a voice command to cooking device 1 .
- FIG. 3C shows a configuration example in which the control device 100 is installed in the server device 150.
- the server device 150 has the functions of the control device 100 described above.
- Server device 150 can receive sensor output signals and audio signals from microphone 50 via communication network 160 .
- the communication network 160 may be a wired LAN or wireless LAN communication network installed at home, or may be a public communication network typified by the Internet.
- the server device 150 is, for example, a home energy management system (HEMS) controller.
- HEMS home energy management system
- the server device 150 is a server device provided on the Internet by the manufacturer of the heating cooker 1, for example.
- the voice recognition process and the process of asking the user 200 for execution confirmation need not be performed within one control device 100 .
- an external server device may perform the voice recognition process, and the control device 100 may receive the voice recognition result.
- the control device 100 may determine the voice command according to the recognition result of the server device, and request the user 200 to confirm the execution.
- at least part of the communication between the cooking device 1 and the communication network 160 may be performed wirelessly.
- wired communication and wireless communication can be performed according to known communication standards.
- wired communication may be performed in compliance with the Ethernet (registered trademark) standard, the USB (registered trademark) standard, or the like.
- Wireless communication can be performed in compliance with the IEEE 802.11 standard for LAN (Local Area Network), so-called 4G/5G, 4th/5th generation mobile communication systems, and the like.
- FIG. 9 Details Hereinafter, configurations of the control device 100 and the heating cooker 1 will be described with reference to FIGS. 4 to 8. FIG. After that, the operation of the control device 100 will be described with reference to FIGS. 9 to 18. FIG. The following description is based on the configuration example shown in FIG. 3A. As an example, it is assumed that the control device 100 recognizes wakeup words and operation words, and issues voice commands.
- FIG. 4 is a hardware configuration diagram of the control device 100. As shown in FIG. The control device 100 has an arithmetic unit 102 , a storage unit 104 , an input interface (I/F) 106 and an output interface (I/F) 108 .
- I/F input interface
- I/F output interface
- the arithmetic unit 102 is an arithmetic circuit that executes processing described later, and includes signal processing circuits such as a CPU and a microcontroller (microcomputer).
- the storage unit 104 is one or more storage devices to which data can be written and read. Examples of such storage devices are ROM, RAM, flash memory, hard disk drives, SSDs. In this embodiment, the storage unit 104 includes a RAM 104a and a flash memory 104b.
- the input I/F 106 and the output I/F 108 are connected to an internal bus (not shown) of the heating cooker 1.
- the input I/F 106 receives the sensor output signal and the audio signal output from the microphone 50 of the heating cooker 1 .
- the output I/F 108 outputs a control signal to the controller of the heating cooker 1, which will be described later.
- the storage unit 104 will be described in more detail below.
- the RAM 104a holds computer programs executed by the computing unit 102 .
- the RAM 104a holds a speech recognition engine 110 and a control program 112.
- the flash memory 104b stores various data. Specifically, the flash memory 104b stores wakeup word data 120, operation word group data 122, and a data file .
- the wakeup word data 120 is data specifying a wakeup word.
- the wakeup word may be a fixed word or may be changeable by the user 200 .
- Operation word group data 122 is a set of a plurality of operation words that can be used in cooking device 1 .
- the operation word group data 122 stores operation words such as "left IH”, “right IH”, “center IH”, “heat power 7", “slow fire”, “stop”, “up”, and “down”.
- the data file 124 is a table that associates each of a plurality of operation words with each of a plurality of voice commands.
- Table 1 shows an example of data file 124 .
- the arithmetic unit 102 can recognize various words including wakeup words.
- the calculation unit 102 can recognize words uttered by the user 200 included in the speech signal received via the input I/F 106. Any existing speech recognition technology can be used for recognition processing by the speech recognition engine 110 . A detailed description of the speech recognition technology is omitted.
- the calculation unit 102 refers to the wakeup word data 120 and determines whether or not the recognized word is the wakeup word.
- the calculation unit 102 also refers to the operation word group data 122 to determine whether or not the recognized word is an operation word. If it is an operation word and if execution confirmation by the user 200 is obtained, the operation unit 102 further refers to the data file 124 and reads out a voice command for executing an action corresponding to the operation word. Send to the heating cooker 1.
- FIG. 5 ⁇ heating cooker ⁇
- FIG. 5 is a perspective view of the induction heating cooker 1 according to an exemplary embodiment.
- FIG. 6 is a block diagram showing the control system of the induction heating cooker 1 according to the embodiment.
- FIG. 7 is a diagram schematically showing the configuration of the induction heating cooker 1. As shown in FIG.
- the X-axis, Y-axis and/or Z-axis are displayed in some of the drawings according to the present disclosure.
- the X-axis direction indicates the width direction (longitudinal direction) of the heating cooker
- the Y-axis direction indicates the depth direction (lateral direction).
- the Z-axis direction indicates the height direction.
- the positive direction of the X-axis is defined as the right direction
- the negative direction is defined as the left direction.
- the positive direction of the Y-axis is the rearward direction
- the negative direction is the forward direction.
- the induction heating cooker 1 has a main body 3 and a top plate 5 on which a container is placed on the upper surface of the main body 3.
- the container contains, for example, a container, which is an object to be heated, which contains ingredients to be cooked, such as stew.
- Heating coils 7, 8, 9 are placed. Heating coils 7-9 generate an induction magnetic field to inductively heat the container. Although the heating cooker 1 has three heating coils 7 to 9, it may have one, two, or four or more heating coils. One or more heating coils may be collectively referred to herein as a "heating section.”
- the induction heating cooker 1 is provided with, for example, physically operable operation units 19, 20, and 21 for operating the heating coils 7, 8, and 9, respectively. That is, each of the heating coils 7, 8, 9 "corresponds" to each of the operating portions 19, 20, 21. As shown in FIG. Thus, the components provided for each of the heating coils 7, 8, 9 are referred to herein as components "corresponding" to the heating coils.
- the substance of the operation units 19, 20, and 21 is a set of multiple switches, each of which functions as the sensor 52 described above. Therefore, in FIG. 5, reference numerals "52" indicating the sensor are written together with the reference numerals of the operation units 19, 20, and 21. As shown in FIG.
- Electrical wiring is provided so that output signals of the operation units 19 , 20 , 21 functioning as the sensor 52 are transmitted to the input I/F 106 of the control device 100 .
- a data communication path is formed so that data indicating that each switch of operation units 19, 20, and 21 has been pressed is transmitted to input I/F 106 via control unit 31 of heating cooker 1, which will be described later.
- An electrical wiring is provided or a data communication path is formed so that the output signal of the microphone 50 of the heating cooker 1, that is, the audio signal is similarly transmitted to the input I/F 106 of the control device 100.
- ring-shaped light-emitting portions 15 and 16 are arranged on the top plate 5 on the outer sides of the heating coils 7 and 8, respectively.
- An arc-shaped light-emitting portion 17 is arranged on the top plate 5 in front of the heating coil 9 ( ⁇ Y side).
- the light-emitting units 15-17 emit light, for example, when the corresponding heating coils 7-9 are energized.
- the light emitting units 15 to 17 each have, for example, an LED light emitting board (not shown).
- a temperature sensor 18 is arranged below the top plate 5 inside the markers 11 to 13 .
- a detection value detected by the temperature sensor 18 is sent to the control unit 31 .
- the control unit 31 adjusts the amount of current flowing through the heating coils 7 to 9 while referring to the temperature detection value, and determines the timing of assist guidance of the cooking method.
- operation sections 19, 20, and 21 are arranged on the front side (-Y side) of the top plate 5 of the induction heating cooker 1, operation sections 19, 20, and 21 are arranged.
- the operating units 19, 20, 21 are used by the user 200 to operate the heating coils 7-9, respectively.
- the operating part 19 is provided to operate the heating coil 7
- the operating part 20 is provided to operate the heating coil 8
- the operating part 21 is provided to operate the heating coil 9 .
- the operating part 19 corresponds to the heating coil 7
- the operating part 20 corresponds to the heating coil 8
- the operating part 21 corresponds to the heating coil 9 .
- Display sections 23, 24, and 25 are arranged on the front side of the top plate 5 of the induction heating cooker 1, between the heating coils 7-9 and the operation sections 19-21, respectively.
- the display units 23, 24 and 25 respectively display the states of the operation targets of the operation units 19-21. Operations of the display units 23 to 25 are controlled by a control unit 31, which will be described later.
- the display units 23 to 25 each include, for example, a matrix-dot liquid crystal display device.
- the matrix dot liquid crystal display device is, for example, a full dot liquid crystal display panel having a band shape extending in the width direction of the top plate 5 .
- the display units 23 to 25 respectively display the state of the operation target, the contents of the operation of the heating coils 7 to 9, etc. as image objects.
- the display unit 23 displays the details of the operation of the heating coil 7
- the display unit 24 displays the details of the operation of the heating coil 8
- the display unit 25 displays the details of the operation of the heating coil 9 .
- Image objects are characters and/or images.
- the image object is the word "heat”.
- the induction heating cooker 1 indicates that the heating operation can be performed using the heating coils 7-9 corresponding to the display portions 23-25.
- the display units 23 to 25 may display an image object of characters "start” indicating the start of heating together with the characters "heating”. After the heating is started, the display units 23-25 may display image objects such as numbers and icons indicating the magnitude of the heating amount (thermal power) of the heating coils 7-9.
- the display units 23 to 25 may be segment display liquid crystal display devices. Text and/or images displayed using one or more segments fall under the category of image objects described above.
- the main body 3 is equipped with a speaker 27 that outputs information on heating of the heating coils 7-9.
- Speaker 27 is arranged on the front side of induction heating cooker 1 and outputs voice guidance to user 200 .
- the induction heating cooker 1 includes a control section 31 and a storage section 33 inside the main body 3 .
- the control unit 31 includes signal processing circuits such as a CPU and a microcontroller (microcomputer).
- the storage unit 33 is a storage device such as ROM, RAM, hard disk drive, and SSD.
- the storage unit 33 stores computer programs for operating the induction heating cooker 1 .
- the control unit 31 is configured to perform various functions described later by executing the computer program.
- the control unit 31 that executes the computer program includes, at each time, a coil control unit 35 that controls the amount of current flowing through the heating coils 7 to 9, a guidance information control unit 37 that controls the display areas of the display units 23 to 25, guidance information and a cooking guidance control section 47 that controls the information output of cooking guidance.
- a coil control unit 35 that controls the amount of current flowing through the heating coils 7 to 9
- a guidance information control unit 37 that controls the display areas of the display units 23 to 25, guidance information
- a cooking guidance control section 47 that controls the information output of cooking guidance.
- part or all of the coil control unit 35, the guidance information control unit 37, and the cooking guidance control unit 47 may not be realized by software, and may be composed of one or more CPUs, microprocessors, and FPGAs.
- the output signals of the operation units 19 to 21 are input to the control unit 31.
- the controller 31 sets the heating amounts of the heating coils 7 to 9 according to the operation.
- the control unit 31 functioning as a coil control unit 35 controls the start or stop of heating of the heating coil 7 according to an operation instruction from the operation unit 19 .
- the coil control unit 35 supplies high-frequency current to the heating coils 7 to 9 to heat the container placed on the top plate 5 .
- the coil control unit 35 controls the amount of heating from the heating coils 7-9 by controlling the amount of current flowing through the heating coils 7-9.
- the output signals of the operation units 19 to 21 are input to the control unit 31, they are also used to control the operation of the control unit 31 functioning as the guidance information control unit 37 and the cooking guidance control unit 39.
- the cooking guidance control unit 39 sends cooking guidance information to the guidance information control unit 37 at the timing when appropriate conditions are met according to a predetermined heating sequence or cooking sequence.
- Appropriate conditions include whether or not the temperature detected by the temperature sensor 18 satisfies a predetermined temperature condition, or whether or not a predetermined time has elapsed since the detected temperature reached a predetermined temperature. is the condition of These conditions are set for each assist menu for cooking guidance.
- the cooking guidance control unit 39 instructs the guidance information control unit 37 to display cooking guidance corresponding to the conditions from the display units 23-25.
- These heating sequence, cooking sequence, and cooking guidance are stored in the storage unit 33 .
- the control unit 31 Upon receiving the control signal, the control unit 31 analyzes the control command included in the control signal. When the control device 100 recognizes the operation word after recognizing the wakeup word, the control device 100 specifies the heating coil to be operated and specifies the operation content by the control command.
- the operating sections 19 to 21 each include a first operating section 51, a second operating section 53, a third operating section 55, and a fourth operating section 57.
- the first operation unit 51 to the fourth operation unit 57 may be, for example, touch switches including capacitive switches, or push button switches.
- the first operation section 51 to fourth operation section 57 set the heating operation of the corresponding heating coils 7 to 9 .
- the first operation unit 51 is printed with a clock pattern and is mainly used to select timer settings.
- the second operation unit 53 and the third operation unit 55 are printed with arrow patterns, such as “ ⁇ ” and “>” symbols, respectively, and are mainly used for menu selection and setting the heating power amount and timer time.
- used for The fourth operating portion 57 is printed with a pattern indicating the heating area corresponding to the operating portion, and functions as a multifunction switch to which different functions are assigned depending on the situation.
- the power switch 22 has a function of turning on the power of the induction heating cooker 1 .
- the power switch 22 may further have a function of shutting off the power of the induction heating cooker 1 . Aside from the power switch 22, a switch for cutting off the power may be provided.
- FIG. 9 is a flow chart showing the procedure of basic processing executed by the calculation unit 102 of the control device 100. As shown in FIG. In this embodiment, this flowchart is executed after the wakeup word is recognized. Since the wakeup word recognition process does not necessarily have to be executed by the calculation unit 102, the wakeup word recognition process is shown in parentheses as an optional process in FIG.
- step S10 the calculation unit 102 acquires an input signal via the input I/F 106.
- step S12 when it is determined that the input signal is the voice signal from the microphone 50 of the cooking device 1 and the voice signal includes the operation word as a result of voice recognition, the calculation unit 102 outputs I/ A control signal is output via F108.
- the control signal is a signal requesting confirmation of execution of the voice command corresponding to the operation word.
- the calculation unit 102 After transmitting the control signal in step S14, the calculation unit 102 again acquires the input signal via the input I/F 106 in step S14.
- step S16 when it is determined that the input signal is the detection result of the sensor 52 of the heating cooker 1 and is an acknowledgment signal confirming the execution of the voice command, the calculation unit 102 executes the voice command. Outputs a commanding control signal.
- the heating cooker 1 executes the indicated voice command. As a result, an operation corresponding to the operation word input by voice by the user 200 is realized.
- FIG. 10 is a flow chart showing the procedure of applied processing executed by the calculation unit 102 of the control device 100.
- FIG. This example also includes wakeup word recognition processing.
- step S20 the calculation unit 102 waits in a sleep state or standby state until an audio signal is input to the input I/F 106.
- the process transitions to step S22.
- step S22 the calculation unit 102 executes voice recognition processing to determine whether or not the wakeup word is included in the voice signal. If not included, the process returns to step S20. If it is included, the process proceeds to step S24.
- step S24 the calculation unit 102 activates the system including other components so that it and the control device 100 can operate, and waits for the input of the next audio signal.
- step S26 if the waiting time elapses until the audio signal is input, the process returns to step S20 and waits in a sleep state until a new audio signal is input again. If an audio signal is input to the input I/F 106 before the lapse of the fixed time, the process proceeds to step S28.
- step S28 the computing unit 102 executes voice recognition processing to extract words, refers to the operation word group data 122, and determines whether or not the voice signal contains an operation word. If the operation word is included, the process proceeds to step S30, and if not included, the process returns to step S26.
- step S ⁇ b>30 the calculation unit 102 transmits a control signal requesting execution confirmation from the output I/F 108 .
- control unit 31 of heating cooker 1 requests execution confirmation from user 200 by at least one of various methods described later.
- the control unit 31 of the heating cooker 1 inputs a signal indicating the confirmation result to the input I/F 106 .
- the calculation unit 102 determines the type of input signal received at the input I/F 106, and executes one of a plurality of processes according to the result.
- the computing unit 102 issues a voice command corresponding to the operation word that the user 200 desires to execute, and It is transmitted to the control unit 31 of the heating cooker 1 from F106. Thereby, the heating cooker 1 is operated by voice.
- the input signal received at the input I/F 106 is a retry request signal indicating a desire to re-input the operation word
- the process returns to step S26.
- the calculation unit 102 waits for a re-input of the voice signal including the operation word while standing by for a certain period of time.
- the calculation unit 102 determines that the input signal received by the input I/F 106 is different from either the acknowledgment signal or the retry request signal, or it is a release signal indicating that the voice operation is to be released. In this case, the calculation unit 102 cancels the processing up to that point and returns to the processing of step S20.
- a process for requesting the user 200 to confirm the execution of the voice command corresponding to the operation word is newly provided, and when the user 200 instructs the execution of the voice command, a voice is sent to the heating cooker 1. I decided to run the command. Therefore, in the following, a method for confirming execution will be described with a plurality of specific examples.
- An example using the display unit 24 (FIGS. 5 to 8) is given, but the display unit 23 and/or the display unit 25 may be used. In that case, the operation unit 19 and/or 21 may be used instead of the operation unit 20 for execution confirmation.
- FIG. 11 shows an example of an image displayed on the display unit 24 when the heating coil 8 is used with the medium heat power 5.
- the characters "timer”, "thermal power adjustment”, and “off” are displayed below the display section 24, the characters “timer”, "thermal power adjustment”, and “off” are displayed.
- the user 200 uses the operation unit 20 to request execution confirmation from the user 200 .
- the user 200 presses the first operation unit 51 if he wants to use the "timer" function.
- the user 200 presses the second operating section 53 or the third operating section 55 to increase or decrease the heating power using the "thermal power adjustment" function, and presses the fourth operating section 57 to end heating. Just press it.
- step S30 of FIG. 10 is transmitted from the calculation unit 102 to the control unit 31 via the output I/F 108.
- FIG. 12 is a display example of the display unit 24 for requesting the user 200 to confirm the execution of the voice command.
- the control unit 31 asks the user 200 to confirm the execution by displaying a message “Are you sure you want to change the thermal power from 5 to 4?” on the display unit 24 .
- the control unit 31 also switches the display in the lower part of the display unit 24 to display characters 24a of "cancel” requesting cancellation of the voice operation, characters 24b of "re-input voice” requesting re-input of the operation word, and Characters 24c of "execute” are displayed to instruct execution of the corresponding voice command.
- the user 200 selects one of "cancel”, “re-input voice” and "execute” using the first operation unit 51, the second operation unit 53 or the third operation unit 55, and the fourth operation unit 57.
- An output signal detection signal
- the fourth operation unit 57 is associated with the characters 24c of "execute” that instruct execution of the voice command.
- the first operation part 51, the second operation part 53 and the third operation part 55 are associated with the characters 24a and 24b other than the character 24c of "execute", and cannot be used to confirm the execution of the voice command.
- FIG. 13 shows the display unit 24 displaying a character image indicating that the thermal power has been adjusted to 4 according to the voice command as a result of the instruction to execute the voice command.
- FIG. 14 shows a method of requesting execution confirmation according to another example.
- Arithmetic unit 102 transmits to control unit 31 of heating cooker 1 a control signal for displaying an image including characters “To execute the result, pronounce 'confirm'”, and instructs user 200 to execute the command. Request confirmation.
- the user 200 does not use the operation unit 20, but utters "OK” himself and causes the microphone 50 to detect it, thereby instructing the execution of the voice command.
- the microphone 50 also functions as the sensor 52 . If the utterance "confirm" is not detected for a certain period of time, it is assumed that the user 200 has not instructed the execution of the voice command to change the thermal power to 4, and the processing up to that point is cancelled. That is, in FIG.
- step S32 the process returns from step S32 to step S20.
- the word "confirmed" above is an example.
- the words to be spoken may be predetermined or random combinations of letters, numbers, symbols, graphic shapes, and the like.
- the time for detecting the utterance may not be constant, and may be randomly selected from a plurality of time values prepared in advance.
- the candidate words to be presented may be prepared in advance and stored in the storage unit 33 .
- FIG. 15 is a diagram for explaining an example of confirming an execution request from the user 200 using a lamp 61 that can be lit in any color.
- the calculation unit 102 sends a control signal to the control unit 31 of the heating cooker 1 to turn on the lamp 61 in a predetermined color, and a message to be displayed on the display unit 24 (“To execute the result, change the color of the confirmation lamp. Speak out.") to transmit a control signal.
- the predetermined color to be lit may be randomly determined by the calculation unit 102 .
- the calculation unit 102 randomly selects one color from three colors of red, blue, and yellow, and transmits color data specifying the selected color, such as RGB values, to the heating cooker 1 .
- the calculation unit 102 holds the color data.
- the audio signal received by the output I/F 108 after the lighting instruction includes a word indicating a color
- the RGB value of the color is calculated, or the conversion table prepared in advance is referred to. Extract the value and compare it with the color data you had. If both match, the signal received by the output I/F 108 is determined to be an acknowledgment signal. Accordingly, the calculation unit 102 transmits a voice command to change the heating power to 4 to the control unit 31 of the heating cooker 1 . Instead of inputting the color name by voice, one of a plurality of switches each associated with a color may be pressed.
- FIG. 16 shows the heating cooker 1 with the proximity sensor 63.
- the proximity sensor 63 is, for example, an ultrasonic sensor that emits ultrasonic waves and detects the reflected waves to detect the distance to an object to be detected in a non-contact manner.
- Proximity sensor 63 is an example of sensor 52 (FIGS. 1B-1D, FIGS. 3A-3C). In this embodiment, it is assumed that the object to be detected is the user's 200 hand.
- the installation position of the proximity sensor 63 may be the wall surface above the heating cooker 1 or the like, and does not need to be embedded in the heating cooker 1 .
- FIG. 17A is a graph showing a waveform example of an acknowledgment signal using the proximity sensor 63.
- FIG. The horizontal axis of the graph in FIG. 17A is time, and the vertical axis is the distance to the object (hand) to be detected.
- the present inventors found that the user 200 intentionally touches the proximity sensor 63 when the hand approaches to less than the reference distance (Td) and the approaching state continues for the reference period (Tt) or longer in the waveform of the proximity sensor 63 . It is determined that the hand is held over 63 .
- FIG. 17B is a graph showing a waveform example of a signal that does not correspond to the acknowledgment signal.
- the calculation unit 102 transmits a control signal to the cooking device 1 to cause the display unit 24 to display an image (including text) instructing the user to bring the hand closer to the proximity sensor 63, After that, a control signal for starting the detection operation by the proximity sensor 63 may be transmitted. Based on whether or not the proximity sensor 63 has detected the gesture described above within a predetermined time after the image is displayed, the calculation unit 102 may determine whether or not there is an acknowledgment signal.
- the ultrasonic proximity sensor 63 is an example. Proximity sensors such as infrared type, capacitance type, and electromagnetic wave type may be used as long as they can detect the approach of a human body.
- a gesture sensor is, for example, a sensor that captures the shape and movement of a hand using an infrared camera and obtains a series of movements, that is, a gesture. By predetermining a gesture corresponding to voice command execution and a gesture corresponding to cancellation of voice command execution, it is possible to determine whether or not the gesture of user 200 means an execution request.
- An example of installation of the gesture sensor can be considered to be the same as the example of installation of the proximity sensor 63 in FIG. 16, so illustration is omitted, and reference numeral "73" shown in FIG. 16 is used for explanation for convenience.
- the installation position of the gesture sensor 73 may be a wall surface above the heating cooker 1 or the like, and does not need to be embedded in the heating cooker 1 .
- FIG. 18 shows two sets of gestures corresponding to execution and cancellation of voice commands, respectively.
- FIG. 18A shows an example in which a gesture of moving the hand from left to right is associated with "execute voice command", and a gesture of moving the hand from left to right is associated with “cancel voice command”. be.
- FIG. 18B shows an example in which the gesture of moving the hand from top to bottom is associated with "execute voice command", and the gesture of moving the hand from bottom to top is associated with “cancel voice command”.
- (c) of FIG. 18 is an example in which a gesture of drawing a clockwise circle is associated with "execute voice command” and a gesture of drawing a counterclockwise circle is associated with "cancel voice command”.
- the calculation unit 102 When using the gesture sensor 73 , the calculation unit 102 causes the display unit 24 to display an image (including characters) instructing the cooking device 1 to perform a predetermined exercise in the vicinity of the gesture sensor 73 . A control signal may be transmitted, and then a control signal for starting the detection operation by the gesture sensor 73 may be transmitted. Based on whether the gesture sensor 73 has detected the gesture described above within a predetermined time after the image is displayed, the calculation unit 102 may determine whether or not there is an acknowledgment signal.
- an example of requesting execution confirmation by displaying an image on the display unit and an example of requesting execution confirmation using the color of light by turning on a lamp were given. All of these can be said to be aspects of requesting confirmation of execution using stimuli to human vision, and in that sense, the display unit and the lamp are collectively referred to as a "presentation unit that presents visual stimuli.” be able to. "Visual stimuli" are letters, numbers, symbols, graphics, colors and/or lights.
- the operation unit may be used to allow the user to input whether or not execution confirmation is necessary.
- Such a common operation unit may be all or part of the operation units 19 to 21, or may be one or more switches independent of the operation units 19 to 21.
- Output signals (detection signals) of one or more sensors provided in each operation unit may be transmitted to the control device 100 .
- a plurality of lamps 61 may be provided and lit in the same color. This makes it easier for the user to visually recognize.
- the proximity sensor 63 is provided at the lower right corner of the top plate of the heating cooker 1, but it may be provided at the lower left corner of the top plate, or at both the lower right corner and the lower left corner or more. position. Even when a plurality of proximity sensors 63 are provided, the output signal (detection signal) of each proximity sensor 63 may be transmitted to control device 100 . If the proximity sensors 63 are provided at least at the lower right corner and the lower left corner, it becomes easier for the user 200 to input whether or not to confirm the execution, regardless of whether the user is right-handed or left-handed, thereby improving user convenience.
- the embodiment of the induction heating cooker 1 according to the present disclosure has been described above.
- the processing according to the flowchart described above is realized as the operation of the arithmetic unit 102 by a computer program.
- a mounting mode in which the heating cooker 1 and the control device 100 cannot be clearly distinguished and the heating cooker 1 and the control device 100 are integrated is also conceivable.
- the control unit 31 may be regarded as executing all operations of the calculation unit 102 . At this time, it is no longer necessary to transmit and receive signals between the control device 100 and the heating cooker 1, and to that extent, the operations performed by the control section 31 and the calculation section 102 can be omitted.
- a first aspect is a control device (100) for controlling a voice interface for operating a thermal appliance by voice.
- the control device includes an input interface (106) for receiving an input signal from the outside, and if the input signal is a voice signal, whether the voice signal represents one of a plurality of operation words prepared in advance. It has a calculation unit (102) for determining whether or not, and an output interface (108) for outputting a control signal to the outside.
- the computing unit receives a voice signal as a first input signal from the input interface (S10), and when determining that the voice signal represents a predetermined operation word among a plurality of operation words, outputs a voice corresponding to the predetermined operation word.
- the second aspect is a controller (100) based on the first aspect.
- the calculation unit (102) waits for the input of the operation word without outputting the second control signal. Move to standby state.
- a third aspect is a control device (100) based on the second aspect.
- a fourth aspect is a control device (100) based on any of the first to third aspects.
- the calculation unit (102) receives the second input signal via the input interface within a predetermined time after transmitting the first control signal, the second input signal is the execution of the voice command. and if the second input signal is not received through the input interface within a predetermined time after the first control signal is transmitted, input of a new first input signal It shifts to the waiting waiting state.
- a fifth aspect is a control device (100) based on the first aspect.
- the predetermined operation word is associated with a voice command for adjusting the thermal power of the thermal equipment.
- a sixth aspect is a control device (100) according to any of the first through fifth aspects.
- the control device (100) further includes a storage unit that stores a data file that associates each of the plurality of operation words with each of the plurality of voice commands.
- a seventh aspect is a thermal equipment (1).
- the thermal equipment (1) comprises a control device (100) according to the sixth aspect, one or more heating units (7, 8, 9) for generating heat, and controlling the heating power of the heating units.
- control unit (31) for controlling, a microphone (50), and one or more sensors (52, 51, 53, 55, 57, 63, 73) for detecting user operations and/or actions.
- An input interface (106) of the control device (100) receives the respective output signals of the microphone and one or more sensors as input signals.
- the output interface (108) outputs the control signal to the control section (31).
- a control unit (31) controls the operation of one or more heating units according to the control signal.
- An eighth aspect is a thermal appliance (1) according to the seventh aspect. In the eighth aspect, when a predetermined activation word is input to the microphone in a sleep state in which the voice interface is not activated, the control device shifts to a standby mode to wait for input of an operation word.
- a ninth aspect is a thermal appliance (1) according to the seventh or eighth aspects.
- the thermal equipment (1) further comprises a presentation part (23, 24, 25, 61) for presenting visual stimuli.
- a control unit (31) in response to receiving the first control signal, causes the presentation unit to present visual stimuli including letters, numbers, symbols, graphics, colors and/or lights to execute voice commands to the user. Request confirmation.
- the computing unit of the control device determines the presence or absence of the acknowledgment signal based on the detection results of the one or more sensors and the presented visual stimulus.
- a tenth aspect is a thermal appliance (1) according to the ninth aspect.
- the presentation units (23, 24, 25, 61) are display devices (23, 24, 25).
- a control unit (31) causes the display device to display an image including one or more of letters, numbers, symbols, graphics and/or colors as a visual stimulus.
- One or more sensors (52, 51, 53, 55, 57, 63, 73) accept selections of letters, numbers, symbols, graphics and/or colors, and output selection results as detection results.
- An eleventh aspect is a thermal appliance (1) according to the tenth aspect.
- the control section (31) randomly determines letters, numbers, symbols, figures and/or colors included in the image.
- a twelfth aspect is a thermal appliance (1) according to either the tenth or eleventh aspect.
- the one or more sensors are a plurality of switches (51, 53, 55, 57).
- the plurality of switches includes a switch associated with the displayed image and one or more unassociated switches, and a signal specifying the switch operated by the user among the plurality of switches is used as a detection result.
- a control unit (31) determines the presence or absence of an acknowledgment signal based on the displayed image and whether or not it is a switch associated with the image.
- a thirteenth aspect is a thermal appliance (1) according to the tenth aspect.
- the thermal equipment (1) further comprises a storage device pre-stored with a plurality of presentation candidate words (33).
- a control unit (31) randomly selects one of a plurality of presentation candidate words, and causes display devices (23, 24, 25) to display the selected presentation candidate word as a visual stimulus.
- a fourteenth aspect is a thermal appliance (1) according to the ninth aspect.
- the presentation unit (23, 24, 25, 61) is a lamp (61) capable of emitting light in a color selected from a plurality of colors.
- a control unit (31) causes the lamp to emit light in one color randomly selected from a plurality of colors as a visual stimulus.
- One or more sensors (52, 51, 53, 55, 57, 63, 73) accept color selection and output the selection result as a detection result.
- a fifteenth aspect is a thermal appliance (1) according to the thirteenth aspect.
- the one or more sensors are a plurality of switches (51, 53, 55, 57). Each of the plurality of switches is associated with a plurality of changing colors, and outputs a signal identifying the switch operated by the user among the plurality of switches as a detection result.
- a control unit (31) determines whether or not there is an acknowledgment signal based on the color corresponding to the switch operated by the user and the color of the lamp.
- a sixteenth aspect is a thermal appliance (1) according to the ninth aspect.
- each of the one or more sensors (52, 51, 53, 55, 57, 63, 73) is a proximity sensor (63).
- the presentation units (23, 24, 25, 61) are display devices (23, 24, 25).
- the computing unit (102) of the control device (100) causes the display device to display an image instructing the user to approach the proximity sensor with the hand as a visual stimulus, and within a predetermined time after the display of the image, the proximity sensor is positioned close to the object. The presence or absence of an acknowledgment signal is determined based on whether or not proximity is detected.
- a seventeenth aspect is a thermal appliance (1) according to the ninth aspect.
- each of the one or more sensors (52, 51, 53, 55, 57, 63, 73) is a gesture sensor (73).
- the presentation units (23, 24, 25, 61) are display devices (23, 24, 25).
- the computing unit (102) of the control device (100) causes the display device to display an image instructing the gesture sensor to perform a predetermined movement as a visual stimulus, and the gesture sensor is activated within a predetermined time after the display of the image. determines the presence or absence of an acknowledgment signal based on whether the has detected a predetermined motion.
- An eighteenth aspect is a thermal appliance (1) according to any of the seventh to seventeenth aspects.
- the one or more heating units (7, 8, 9) is a plurality of heating units.
- the input interface (106) includes a microphone (50) and one or more sensors (52, 51, 53, 55, 57, 63, 73) are received as input signals.
- a nineteenth aspect is a thermal appliance (1) according to any eighth aspect. In the nineteenth aspect, if the arithmetic unit (102) of the control device (100) does not receive the second input signal via the input interface (106) within a predetermined time after transmitting the first control signal, , clears the operation word and voice command, and shifts to the sleep state.
- a twentieth aspect is a computer program (112) executed by a computer of a control device (100) for controlling a voice interface for operating a thermal appliance (1) by voice.
- the control device comprises an input interface (106) for receiving an input signal from the outside, and one of a plurality of operation words prepared in advance as a voice signal when the input signal is a voice signal. It comprises an arithmetic unit (102), which is a computer, for determining whether or not one is represented, and an output interface (108) for outputting a control signal to the outside.
- a computer program (112) causes an arithmetic unit (102) to receive a voice signal as a first input signal from an input interface, and determines that the voice signal represents a predetermined operation word among a plurality of operation words. a process of outputting a first control signal requesting execution confirmation of a voice command corresponding to a predetermined operation word via an output interface; and receiving a second input signal via an input interface after transmitting the first control signal. and, if the second input signal is determined to be an acknowledgment signal confirming execution of the voice command, a process of outputting a second control signal instructing execution of the voice command via the output interface.
- the exemplary control device of the present disclosure is applicable to applications in which a heating cooker is operated using voice commands.
- heating cooker 3 main body 5 top plate 7, 8, 9 heating coil 11, 12, 13 marker 15, 16, 17 light emitting unit 18 temperature sensor 19, 20, 21 operation input unit 22 power switch 23, 24, 25 display unit 27 speaker 31 control unit 33 storage unit 50 microphone 52 sensor 100 control device 102 calculation unit 104 storage unit 106 input interface (input I/F) 108 output interface (output I/F) 150 server device 160 communication network
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Combustion & Propulsion (AREA)
- Theoretical Computer Science (AREA)
- Mechanical Engineering (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Chemical & Material Sciences (AREA)
- Acoustics & Sound (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Electric Stoves And Ranges (AREA)
- Induction Heating Cooking Devices (AREA)
- Electric Ovens (AREA)
- Cookers (AREA)
Abstract
Provided is a technique regarding control of a voice interface (I/F) for operating a thermal appliance by voice. This control device for controlling the voice I/F comprises: an input I/F for receiving an input signal from the outside; an arithmetic unit for determining, when the input signal is a voice signal, whether or not the voice signal indicates a prepared operation word; and an output I/F for outputting a control signal to the outside. Upon receiving a voice input signal from the input I/F and having determined that the signal indicates a predetermined operation word, the arithmetic unit outputs via the output I/F a control signal for requesting execution of a voice command corresponding to the predetermined operation word be confirmed. Upon receiving a second input signal via the input I/F subsequent to the transmission of the control signal and having determined that the second input signal is a confirmation response signal affirming the execution of the voice command, the arithmetic unit outputs via the output I/F a control signal for instructing the execution of the voice command.
Description
本開示は、音声インタフェースを制御する制御装置、及びそのような制御装置を備えた熱機器に関する。
The present disclosure relates to a control device for controlling an audio interface, and a thermal appliance equipped with such a control device.
近年、音声認識、意味分析技術の進展に伴い、音声インタフェースを備える端末・機器・ロボット、音声インタフェースを利用したサービスが飛躍的に増加している。音声インタフェースは、ユーザが機器等に音声を用いた指示(音声コマンド)を与えることにより、機器等を音声コマンドの内容に応じて操作し、機器からその出力を得るユーザインタフェースである。そのため、音声インタフェースは、GUI(Graphical User Interface)に代表される従来のユーザインタフェースに比較して、その操作性や利便性の点で優位にある。
In recent years, with the progress of speech recognition and semantic analysis technology, terminals, devices, robots equipped with voice interfaces, and services using voice interfaces have increased dramatically. A voice interface is a user interface that allows a user to give an instruction (voice command) using voice to a device or the like, operate the device or the like according to the contents of the voice command, and obtain the output from the device. Therefore, voice interfaces are superior to conventional user interfaces represented by GUIs (Graphical User Interfaces) in terms of operability and convenience.
特許文献1は、音声を認識し、認識結果の文字列に基づく操作を可能とする加熱調理器を開示する。特許文献1の技術によれば、ユーザが発声した音声を認識してその結果をもとに次の画面に切り替えて表示したり、機器の制御を変更したりする技術を開示する。
Patent Document 1 discloses a heating cooker that recognizes voice and enables operation based on the character string of the recognition result. According to the technique of Patent Document 1, a technique is disclosed for recognizing a voice uttered by a user, switching to the next screen based on the result, and changing the control of the device.
加熱調理器という熱を利用する機器を音声で操作可能にする場合、ユーザの意図しない操作が行われないようにすることが求められる。より具体的には、加熱調理器を視認できない位置からユーザが偶然発した音声によって加熱状態が変更されないように音声インタフェースを制御することが求められる。ここでいう加熱状態の変更とは、例えば加熱を開始すること、火力を変更すること、加熱を停止することなどの、火力の変更を意味する。
When making it possible to operate a device that uses heat, such as a heating cooker, by voice, it is required to prevent unintentional operations by the user. More specifically, it is required to control the voice interface so that the heating state is not changed by a voice accidentally uttered by the user from a position where the cooker cannot be visually recognized. A change in the heating state here means a change in thermal power, such as starting heating, changing thermal power, or stopping heating.
本開示は、加熱調理器などの熱機器を音声で操作するための音声インタフェースの制御に関する技術を提供する。
The present disclosure provides a technology related to control of a voice interface for operating a thermal appliance such as a heating cooker by voice.
本開示の一態様にかかる制御装置は、熱機器を音声で操作するための音声インタフェースを制御する。制御装置は、外部から入力信号を受け取る入力インタフェースと、入力信号が音声信号である場合に、音声信号が予め用意された複数の操作ワードのうちのいずれか1つを表しているか否かを判定する演算部と、外部に制御信号を出力する出力インタフェースとを備えている。演算部は、入力インタフェースから第1入力信号として音声信号を受け取り、音声信号が複数の操作ワードのうちの所定の操作ワードを表していると判定すると、所定の操作ワードに対応する音声コマンドの実行確認を要求する第1制御信号を、出力インタフェースを介して出力する。演算部は、第1制御信号の送信後に入力インタフェースを介して第2入力信号を受け取り、第2入力信号が音声コマンドの実行を確認する確認応答信号であると判定すると、音声コマンドの実行を指示する第2制御信号を、出力インタフェースを介して出力する。
A control device according to one aspect of the present disclosure controls a voice interface for operating a thermal appliance by voice. The control device includes an input interface that receives an input signal from the outside, and if the input signal is a voice signal, determines whether the voice signal represents one of a plurality of prepared operation words. and an output interface for outputting control signals to the outside. The computing unit receives a voice signal as a first input signal from the input interface, and when determining that the voice signal represents a predetermined operation word among the plurality of operation words, executes a voice command corresponding to the predetermined operation word. A first control signal requesting confirmation is output via the output interface. The computing unit receives a second input signal via the input interface after transmitting the first control signal, and when determining that the second input signal is an acknowledgment signal confirming execution of the voice command, instructs execution of the voice command. and outputs a second control signal through the output interface.
本開示の一態様にかかる熱機器は、上述の制御装置と、熱を発生させる1以上の加熱部と、加熱部の火力を制御する制御部と、マイクと、ユーザの操作および/または動作を検出する1または複数のセンサとを有している。加熱調理器は、制御装置の入力インタフェースは、マイク及び1または複数のセンサの各出力信号を入力信号として受け取り、制御装置の出力インタフェースは制御信号を制御部に出力し、制御部は制御信号に応じて1以上の加熱部の動作を制御する。
A thermal device according to an aspect of the present disclosure includes the control device described above, one or more heating units that generate heat, a control unit that controls the heating power of the heating units, a microphone, and user operations and/or actions. and one or more sensors for detection. In the heating cooker, the input interface of the control device receives each output signal of the microphone and one or more sensors as input signals, the output interface of the control device outputs the control signal to the control unit, and the control unit receives the control signal It controls the operation of one or more heating units accordingly.
本開示の一態様にかかるコンピュータプログラムは、加熱調理器を音声で操作するための音声インタフェースを制御する制御装置のコンピュータによって実行される。当該制御装置は、外部から入力信号を受け取る入力インタフェースと、入力信号が音声信号である場合に、音声信号が予め用意された複数の操作ワードのうちのいずれか1つを表しているか否かを判定する、コンピュータである演算部と、外部に制御信号を出力する出力インタフェースとを備えている。コンピュータプログラムは、当該制御装置の演算部に、入力インタフェースから第1入力信号として音声信号を受け取らせる処理と、音声信号が複数の操作ワードのうちの所定の操作ワードを表していると判定すると、所定の操作ワードに対応する音声コマンドの実行確認を要求する第1制御信号を、出力インタフェースを介して出力させる処理と、第1制御信号の送信後に入力インタフェースを介して第2入力信号を受け取らせる処理と、第2入力信号が音声コマンドの実行を確認する確認応答信号であると判定すると、音声コマンドの実行を指示する第2制御信号を、出力インタフェースを介して出力させる処理とを実行させる。
A computer program according to one aspect of the present disclosure is executed by a computer of a control device that controls a voice interface for operating a heating cooker by voice. The control device includes an input interface that receives an input signal from the outside, and, when the input signal is a voice signal, determines whether the voice signal represents one of a plurality of operation words prepared in advance. It has an arithmetic unit, which is a computer, for judging, and an output interface for outputting a control signal to the outside. The computer program causes the arithmetic unit of the control device to receive an audio signal as a first input signal from the input interface; A process of outputting a first control signal requesting confirmation of execution of a voice command corresponding to a predetermined operation word via an output interface, and receiving a second input signal via an input interface after transmitting the first control signal. and outputting a second control signal instructing execution of the voice command through the output interface when the second input signal is determined to be an acknowledgment signal confirming execution of the voice command.
本開示によれば、加熱調理器を音声で操作するための音声インタフェースの制御に関する技術が提供される。
According to the present disclosure, a technique is provided for controlling a voice interface for operating a cooking device by voice.
(本願発明者の知見)
ユーザが機器を音声コマンドで操作することの利点は、種々存在する。例えば、ハンズフリーで操作できるため、機器に直接触れる必要がない。ユーザは離れた所から、機器の画面を確認することなく操作できる。また、音声によって素早く制御できるため、離れた位置から咄嗟の操作が必要になった場合でもすぐに対応できる。さらに、深い階層の下方に存在する設定項目であっても音声により簡単に呼び出して入力できるため、機器の画面を見ながら行う操作とは別に多様な操作が可能で、ユーザの入力の手間を減らすことができる。 (Knowledge of the inventor of the present application)
The advantages of allowing a user to operate a device with voice commands are many. For example, it can be operated hands-free, so there is no need to touch the device directly. The user can operate the device from a remote location without checking the device screen. In addition, since it can be controlled quickly by voice, it can be handled immediately even if an immediate operation is required from a remote location. In addition, even setting items that exist in the lower layers of the hierarchy can be easily called up and input by voice, enabling a variety of operations other than those performed while looking at the device screen, reducing the user's input effort. be able to.
ユーザが機器を音声コマンドで操作することの利点は、種々存在する。例えば、ハンズフリーで操作できるため、機器に直接触れる必要がない。ユーザは離れた所から、機器の画面を確認することなく操作できる。また、音声によって素早く制御できるため、離れた位置から咄嗟の操作が必要になった場合でもすぐに対応できる。さらに、深い階層の下方に存在する設定項目であっても音声により簡単に呼び出して入力できるため、機器の画面を見ながら行う操作とは別に多様な操作が可能で、ユーザの入力の手間を減らすことができる。 (Knowledge of the inventor of the present application)
The advantages of allowing a user to operate a device with voice commands are many. For example, it can be operated hands-free, so there is no need to touch the device directly. The user can operate the device from a remote location without checking the device screen. In addition, since it can be controlled quickly by voice, it can be handled immediately even if an immediate operation is required from a remote location. In addition, even setting items that exist in the lower layers of the hierarchy can be easily called up and input by voice, enabling a variety of operations other than those performed while looking at the device screen, reducing the user's input effort. be able to.
このような音声コマンドで機器を操作する場合、従来、ユーザはまずウェイクアップワードという予め決められた音声を発し、その後さらに、操作したい内容に応じた操作ワードを発声する。機器は常にマイクからの音声信号を受け取っており、発話内容にウェイクアップワードが存在するかどうかを判定する。ウェイクアップワードを認識すると、機器は自身のシステムを起動し、続く操作ワードの音声を待ち受け、操作ワードを認識した場合には、その操作ワードに対応する動作を実行する。
When operating a device with such a voice command, conventionally, the user first utters a predetermined voice called a wake-up word, and then utters an operation word according to the content of the operation to be performed. The device constantly receives audio signals from the microphone and determines whether there is a wake-up word in the speech content. When the wakeup word is recognized, the device activates its own system, waits for the voice of the subsequent operation word, and when the operation word is recognized, performs the operation corresponding to the operation word.
ウェイクアップワードによって起動した後、機器が、何らかの要因で、ユーザが意図した動作とは異なる動作に対応する操作コマンドを認識することがある。あるいはユーザが発話していないにもかかわらず、機器は音声ノイズをユーザの音声と取り違え、音声ノイズをユーザが意図していない操作コマンドとして認識することがあり得る。特に後者の場合、ウェイクアップワードの認識自体もユーザが意図しないうちに行われ得る。つまり、機器の起動及び実行がユーザの意思とは無関係に実現される可能性がある。例えば、機器が照明器具であり、操作内容が照明の点灯である場合には、ユーザが関与しないことの影響は軽微である。一方、機器が加熱機能を有する加熱調理器である場合には、ユーザが関与しないことの影響が大きくなる可能性がある。
After being activated by the wakeup word, the device may, for some reason, recognize an operation command corresponding to an action different from the action intended by the user. Alternatively, even though the user is not speaking, the device may mistake the voice noise for the user's voice and recognize the voice noise as an operation command not intended by the user. Especially in the latter case, the recognition of the wakeup word itself may also occur without the user's intention. That is, there is a possibility that activation and execution of the device can be realized regardless of the user's intention. For example, if the device is a lighting fixture and the operation is to turn on the lighting, the influence of the user's lack of involvement is minor. On the other hand, if the device is a cooking device with a heating function, the influence of the user's lack of involvement may increase.
本願発明者は、加熱調理器を音声コマンドで操作する際には、加熱調理器に固有の起動条件を課すことが好ましいと考えた。具体的には、加熱調理器を視認できる範囲にいるユーザが、操作ワードに対応する音声コマンドの実行許可または実行確認をした後に、加熱調理器にその動作を実行させることが好ましいと考えた。このような手順で加熱調理器を動作させることで、ユーザが意図していない操作コマンドを加熱調理器が認識したとしても、加熱調理器が無条件に動作し始めることを回避できる。「加熱調理器を視認できる範囲」として、例えばユーザが加熱調理器に直接触れて操作できるほどの近さの範囲が考えられる。
上述の考え方は、加熱調理器に限られず、例えばストーブにも当てはまる。すなわち上述の考え方は、火力や熱を扱う機器である「熱機器」に適用できる。熱機器は、コイル、電熱線、燃焼筒などの、他の物体または自身に熱を発生させる加熱部を有している。 The inventors of the present application thought that it would be preferable to impose a startup condition specific to the heating cooker when operating the heating cooker with a voice command. Specifically, the inventor thought that it would be preferable for the user, who is within a visual range of the heating cooker, to allow or confirm the execution of the voice command corresponding to the operation word, and then cause the heating cooker to execute the operation. By operating the heating cooker in such a procedure, even if the heating cooker recognizes an operation command not intended by the user, it is possible to prevent the heating cooker from starting to operate unconditionally. As the “range in which the heating cooker can be visually recognized”, for example, a close range in which the user can directly touch and operate the heating cooker can be considered.
The concept described above is not limited to heating cookers, but also applies to stoves, for example. That is, the above concept can be applied to "thermal equipment", which is equipment that handles thermal power and heat. A thermal appliance has a heating portion, such as a coil, a heating wire, a combustion tube, etc., that generates heat in another object or itself.
上述の考え方は、加熱調理器に限られず、例えばストーブにも当てはまる。すなわち上述の考え方は、火力や熱を扱う機器である「熱機器」に適用できる。熱機器は、コイル、電熱線、燃焼筒などの、他の物体または自身に熱を発生させる加熱部を有している。 The inventors of the present application thought that it would be preferable to impose a startup condition specific to the heating cooker when operating the heating cooker with a voice command. Specifically, the inventor thought that it would be preferable for the user, who is within a visual range of the heating cooker, to allow or confirm the execution of the voice command corresponding to the operation word, and then cause the heating cooker to execute the operation. By operating the heating cooker in such a procedure, even if the heating cooker recognizes an operation command not intended by the user, it is possible to prevent the heating cooker from starting to operate unconditionally. As the “range in which the heating cooker can be visually recognized”, for example, a close range in which the user can directly touch and operate the heating cooker can be considered.
The concept described above is not limited to heating cookers, but also applies to stoves, for example. That is, the above concept can be applied to "thermal equipment", which is equipment that handles thermal power and heat. A thermal appliance has a heating portion, such as a coil, a heating wire, a combustion tube, etc., that generates heat in another object or itself.
以下、適宜図面を参照しながら、実施の形態を詳細に説明する。但し、必要以上に詳細な説明は省略する場合がある。例えば、既によく知られた事項の詳細説明や実質的に同一の構成に対する重複説明を省略する場合がある。これは、以下の説明が不必要に冗長になるのを避け、当業者の理解を容易にするためである。なお、発明者は、当業者が本開示を十分に理解するために添付図面および以下の説明を提供するのであって、これらによって特許請求の範囲に記載の主題は限定されることはない。
Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and redundant descriptions of substantially the same configurations may be omitted. This is to avoid unnecessary verbosity in the following description and to facilitate understanding by those skilled in the art. It should be noted that the inventors provide the accompanying drawings and the following description for a full understanding of the present disclosure by those skilled in the art, and not for limiting the claimed subject matter.
(実施形態1)
(1)概要
以下、図1A~図2を参照しながら、本開示の実施形態に係る制御装置及び熱機器の概要を説明する。以下の実施形態の説明では、熱機器の一例として加熱調理器を挙げる。制御装置は、当該加熱調理器を音声で操作するための音声インタフェースを制御するために用いられる。加熱調理器は、例えば電力を用いて調理容器を誘導加熱するIH(Induction Heating)クッキングヒータ、ガスを燃焼させて調理容器を加熱するガス調理器、ニクロム線などの電気抵抗が比較的大きい電熱線を熱源として用いる電気コンロである。以下では、一例として加熱調理器はIHクッキングヒータであるとして説明する。 (Embodiment 1)
(1) Outline Hereinafter, an outline of the control device and the thermal equipment according to the embodiment of the present disclosure will be described with reference to FIGS. 1A to 2. FIG. In the description of the embodiments below, a heating cooker is taken as an example of a thermal appliance. The control device is used to control a voice interface for operating the cooking device by voice. Heating cookers include, for example, IH (Induction Heating) cooking heaters that inductively heat a cooking container using electric power, gas cookers that heat the cooking container by burning gas, and heating wires with relatively high electrical resistance such as nichrome wires. An electric stove used as a heat source. In the following description, as an example, the cooking device is an IH cooking heater.
(1)概要
以下、図1A~図2を参照しながら、本開示の実施形態に係る制御装置及び熱機器の概要を説明する。以下の実施形態の説明では、熱機器の一例として加熱調理器を挙げる。制御装置は、当該加熱調理器を音声で操作するための音声インタフェースを制御するために用いられる。加熱調理器は、例えば電力を用いて調理容器を誘導加熱するIH(Induction Heating)クッキングヒータ、ガスを燃焼させて調理容器を加熱するガス調理器、ニクロム線などの電気抵抗が比較的大きい電熱線を熱源として用いる電気コンロである。以下では、一例として加熱調理器はIHクッキングヒータであるとして説明する。 (Embodiment 1)
(1) Outline Hereinafter, an outline of the control device and the thermal equipment according to the embodiment of the present disclosure will be described with reference to FIGS. 1A to 2. FIG. In the description of the embodiments below, a heating cooker is taken as an example of a thermal appliance. The control device is used to control a voice interface for operating the cooking device by voice. Heating cookers include, for example, IH (Induction Heating) cooking heaters that inductively heat a cooking container using electric power, gas cookers that heat the cooking container by burning gas, and heating wires with relatively high electrical resistance such as nichrome wires. An electric stove used as a heat source. In the following description, as an example, the cooking device is an IH cooking heater.
図1Aは、制御装置100を内蔵した加熱調理器1が設置されたキッチン設備の上面図である。ユーザ200は加熱調理器1の比較的近くに存在しており、加熱調理器1を視認可能である。いま、ユーザ200がこの位置から加熱調理器1を音声で操作する例を考える。加熱調理器1は、音声の入力を待ち受ける待ち受け状態にあるとする。
FIG. 1A is a top view of kitchen equipment in which a heating cooker 1 incorporating a control device 100 is installed. The user 200 exists relatively close to the heating cooker 1 and can visually recognize the heating cooker 1 . Now, consider an example in which the user 200 operates the heating cooker 1 by voice from this position. It is assumed that the heating cooker 1 is in a waiting state for waiting for voice input.
図1Bは、ユーザ200が操作ワードを発しているシーンを示している。ユーザ200は、加熱調理器1のIHヒータである加熱コイル7~9のうちの、右側の加熱コイル8を利用したいとする。
FIG. 1B shows a scene in which the user 200 issues an operation word. User 200 wants to use heating coil 8 on the right side of heating coils 7 to 9 that are IH heaters of heating cooker 1 .
ユーザ200が、所定のウェイクアップワードを発声した後、「右IH」及び「点火して」という操作ワードを順次発声する。ユーザ200が発声した音声は、加熱調理器1のマイク50によって取得され、制御装置100に送られる。本実施形態では、加熱調理器1が音声を受け付けてその音声信号を制御装置100に送ると、制御装置100が音声認識機能によって音声信号からウェイクアップワード及び操作ワードを認識する。制御装置100に代えて、加熱調理器1が音声認識機能を有していてもよい。
After the user 200 utters a predetermined wake-up word, the operation words "right IH" and "ignite" are sequentially uttered. A voice uttered by user 200 is acquired by microphone 50 of cooking device 1 and sent to control device 100 . In this embodiment, when the cooker 1 receives a voice and sends the voice signal to the control device 100, the control device 100 recognizes the wake-up word and the operation word from the voice signal by the voice recognition function. Instead of control device 100, heating cooker 1 may have a voice recognition function.
ここで、「ウェイクアップワード」とは、加熱調理器1及び制御装置100が自身のシステムを起動し、続く音声を待ち受けるトリガとなるワードである。「操作ワード」とは、加熱調理器1を操作するためにユーザ200が発した音声によって表される単語またはフレーズを言う。操作ワードには、加熱調理器1を動作させるための内部コマンドが予め対応付けられており、これにより操作ワードに基づいて加熱調理器1を操作することが可能になる。音声で加熱調理器1に種々の動作を実行させる場合、操作ワードは複数種類存在し、各操作ワードに対応する内部コマンドも複数種類存在する。ユーザ200が音声によらずに加熱調理器1を直接操作した場合にも加熱調理器1では種々の内部コマンドが発行され得ることを踏まえ、以下では、音声に基づく操作ワードに対応付けられた内部コマンドを「音声コマンド」と記述する。
Here, the "wake-up word" is a word that triggers the cooker 1 and the control device 100 to start their own systems and wait for the following sound. An “operation word” refers to a word or phrase expressed by a voice uttered by user 200 in order to operate cooking device 1 . An internal command for operating the heating cooker 1 is associated in advance with the operation word, so that the heating cooker 1 can be operated based on the operation word. When the cooking device 1 is caused to perform various operations by voice, there are a plurality of types of operation words, and a plurality of types of internal commands corresponding to each operation word. Based on the fact that various internal commands can be issued in the cooking device 1 even when the user 200 directly operates the cooking device 1 without using voice, the internal Commands are described as "voice commands".
ウェイクアップワードの認識後にユーザ200の音声を検出すると、制御装置100は音声認識機能によって操作ワードを認識し、その操作ワードに対応する音声コマンドが存在するか否かを判定する。具体的には、制御装置100は、認識した操作ワードに基づいてデータファイルを参照して音声コマンドを決定する。データファイルには、種々の操作ワードの各々と、種々の音声コマンドの各々とが予め対応付けられたテーブルが格納されている。対応する音声コマンドが存在する場合には、その音声コマンドの実行の可否の確認(実行確認)をユーザ200に求める。
When the voice of the user 200 is detected after recognizing the wakeup word, the control device 100 recognizes the operation word with the voice recognition function and determines whether or not there is a voice command corresponding to the operation word. Specifically, the control device 100 determines the voice command by referring to the data file based on the recognized operation word. The data file stores a table in which each of various operation words and each of various voice commands are associated in advance. If the corresponding voice command exists, the user 200 is requested to confirm whether the voice command can be executed (execution confirmation).
図1Cは、求められた実行確認に応答して、押しボタンであるセンサ52を押下して実行を指示するユーザ200を示している。制御装置100はユーザ200に、図示されるように加熱調理器1から音声によって実行確認を求め、または後述するように、文字、数字、記号、図形、色および/または光によって実行確認を求める。センサ52の押下を検出することにより、制御装置100は、ユーザ200から音声コマンドの実行の確認が得られたとして、加熱調理器1の「右IH」に対応する加熱コイル8を点火することを示す音声コマンドを加熱調理器1に送信する。これにより、ユーザ200は音声コマンドを用いて加熱調理器1に所望の操作を行うことができる。
FIG. 1C shows the user 200 pressing the push button sensor 52 to instruct execution in response to the requested execution confirmation. The controller 100 asks the user 200 for execution confirmation by voice from the cooker 1 as shown, or by letters, numbers, symbols, graphics, colors and/or lights as described below. By detecting the pressing of sensor 52 , control device 100 determines that the user 200 confirms execution of the voice command, and determines that heating coil 8 corresponding to “right IH” of heating cooker 1 should be ignited. The voice command shown is transmitted to the heating cooker 1. Thereby, the user 200 can perform a desired operation on the heating cooker 1 using voice commands.
図1Dは、音声コマンドの実行により、加熱調理器1の右側の加熱コイル8が点火された様子を示している。なお加熱調理器1上に本来載置されるべき鍋等の記載は便宜的に省略した。
FIG. 1D shows how the heating coil 8 on the right side of the heating cooker 1 is ignited by executing the voice command. For the sake of convenience, descriptions of pots and the like that should be placed on the heating cooker 1 are omitted.
以上のように、本実施形態によれば、操作ワードが認識され対応する音声コマンドが実行される前に、ユーザ200に実行確認を求める。例えば加熱調理器1に設けられた押しボタンを押下して実行確認するように、加熱調理器1を視認可能な範囲に存在するユーザ200でなければ実行確認ができないようにする。
As described above, according to the present embodiment, the user 200 is asked to confirm execution before an operation word is recognized and the corresponding voice command is executed. For example, the execution can be confirmed only by the user 200 who is present within a visible range of the heating cooker 1, such as pressing a push button provided on the heating cooker 1 to confirm the execution.
一方、操作ワードが音声ノイズ等のため誤って認識された場合にはユーザ200からの実行確認が得られないため、ユーザ200が意図しない音声コマンドの実行を回避できる。例えば図2は、加熱調理器1を視認できない範囲に存在するユーザ200を示している。加熱調理器1がユーザ200に実行確認を求めたとしても、ユーザ200は実行確認を行うことができない。実行確認を受け付ける期間(時間長)を予め決めておくことにより、その期間が経過した時点で制御装置100は加熱調理器1に音声コマンドを出力しないため、ユーザ200が意図しない音声コマンドの実行を回避できる。
On the other hand, if the operation word is erroneously recognized due to voice noise or the like, execution confirmation from the user 200 cannot be obtained, so execution of voice commands not intended by the user 200 can be avoided. For example, FIG. 2 shows a user 200 who is present in a range where the heating cooker 1 cannot be visually recognized. Even if the cooker 1 asks the user 200 to confirm the execution, the user 200 cannot confirm the execution. By predetermining a period (length of time) for accepting an execution confirmation, the control device 100 does not output a voice command to the heating cooker 1 when the period elapses. can be avoided.
図3Aは、本開示の制御装置100を内蔵する加熱調理器1を示している。図3Aに示す構成は、図1Bの構成と同じである。加熱調理器1は、制御装置100及び加熱コイル7~9に加え、ユーザ200による実行確認を検出するセンサ52と、音声認識のためにユーザ200の音声を取得するマイク50とを有している
FIG. 3A shows the heating cooker 1 incorporating the control device 100 of the present disclosure. The configuration shown in FIG. 3A is the same as the configuration in FIG. 1B. In addition to the control device 100 and the heating coils 7 to 9, the heating cooker 1 has a sensor 52 that detects execution confirmation by the user 200 and a microphone 50 that acquires the voice of the user 200 for voice recognition.
センサ52は、例えば、文字、数字、記号、図形および/または色の選択を受け付けることが可能な1または複数のスイッチ、近接センサ、ジェスチャセンサである。図ではセンサ52は1つのみだけが記載されているが、センサ52の数は複数でもよい。例えば操作したい加熱コイル7~9のそれぞれにセンサ52を設け、操作したい加熱コイルに対応するセンサ52が実行確認を検出した場合にのみ、制御装置100はその加熱コイルを動作させる音声コマンドを出力してもよい。なお、実行確認を受け付けるセンサ52が、押しボタンのようにユーザの接触を必要とするハードウェア自体、またはそのようなハードウェアに取り付けられるセンサである場合、センサ52は、各加熱コイル7~9に対し共通であることがより好ましい。また、センサ52の数は一つである方がより好ましい。これにより、調理で汚れた手が接触する箇所を減らすことができる。
Sensors 52 are, for example, one or more switches, proximity sensors, gesture sensors capable of accepting selection of letters, numbers, symbols, graphics and/or colors. Although only one sensor 52 is shown in the drawing, the number of sensors 52 may be plural. For example, a sensor 52 is provided for each of the heating coils 7 to 9 to be operated, and only when the sensor 52 corresponding to the heating coil to be operated detects confirmation of execution, the control device 100 outputs a voice command to operate that heating coil. may It should be noted that if the sensor 52 that accepts execution confirmation is hardware itself that requires user contact, such as a push button, or a sensor that is attached to such hardware, the sensor 52 is connected to each of the heating coils 7-9. is more preferably common to Also, it is more preferable that the number of sensors 52 is one. As a result, it is possible to reduce the points of contact with hands soiled by cooking.
図3Aでは、制御装置100は加熱調理器1に内蔵されていたが、他の構成例も考えられる。図3Bは、制御装置100と加熱調理器1とが別個の筐体に収容され、通信線140を介して互いに接続されている構成例を示している。制御装置100は、センサ52の検出結果である出力信号、及び、マイク50からの音声信号を、通信線140を介して受信する。制御装置100はセンサ52の出力信号に基づいて、音声コマンドを加熱調理器1に送信するか否かを判断する。
In FIG. 3A, the control device 100 is built in the heating cooker 1, but other configuration examples are also conceivable. FIG. 3B shows a configuration example in which the control device 100 and the heating cooker 1 are accommodated in separate housings and connected to each other via the communication line 140. FIG. The control device 100 receives the output signal, which is the detection result of the sensor 52 , and the audio signal from the microphone 50 via the communication line 140 . Based on the output signal of sensor 52 , control device 100 determines whether or not to transmit a voice command to cooking device 1 .
図3Cは、制御装置100が、サーバ装置150に搭載されている構成例を示している。換言すると、サーバ装置150が上述の制御装置100の機能を有している。サーバ装置150は、センサ出力信号、及び、マイク50からの音声信号を、通信ネットワーク160を介して受信可能である。通信ネットワーク160は、自宅に敷設された有線LANまたは無線LANの通信ネットワークであってもよいし、インターネットに代表される公衆通信ネットワークであってもよい。前者の場合、サーバ装置150は、例えばホームエネルギーマネジメントシステム(HEMS)のコントローラである。後者の場合には、サーバ装置150は、例えば加熱調理器1のメーカ等によってインターネット上で提供されるサーバ装置である。
3C shows a configuration example in which the control device 100 is installed in the server device 150. FIG. In other words, the server device 150 has the functions of the control device 100 described above. Server device 150 can receive sensor output signals and audio signals from microphone 50 via communication network 160 . The communication network 160 may be a wired LAN or wireless LAN communication network installed at home, or may be a public communication network typified by the Internet. In the former case, the server device 150 is, for example, a home energy management system (HEMS) controller. In the latter case, the server device 150 is a server device provided on the Internet by the manufacturer of the heating cooker 1, for example.
以上のいずれの構成によっても、上述の動作を実現することができる。なお、音声認識処理、及びユーザ200に実行確認を求める処理は、1つの制御装置100内で行われる必要はない。例えば図3Aの制御装置100が音声認識処理を行う代わりに、外部のサーバ装置が音声認識処理を行い、制御装置100が音声認識結果を受け取ってもよい。制御装置100は、サーバ装置の認識結果に応じて音声コマンドを決定し、実行確認をユーザ200に求めてもよい。さらに図3Cの構成においても、加熱調理器1と通信ネットワーク160との間の通信の少なくとも一部は、無線で行われてもよい。
The above operation can be realized with any of the above configurations. Note that the voice recognition process and the process of asking the user 200 for execution confirmation need not be performed within one control device 100 . For example, instead of the control device 100 of FIG. 3A performing the voice recognition process, an external server device may perform the voice recognition process, and the control device 100 may receive the voice recognition result. The control device 100 may determine the voice command according to the recognition result of the server device, and request the user 200 to confirm the execution. Furthermore, also in the configuration of FIG. 3C, at least part of the communication between the cooking device 1 and the communication network 160 may be performed wirelessly.
上述した有線による通信及び無線による通信は、公知の通信規格にしたがって行われ得る。例えば、有線通信は、イーサネット(登録商標)規格、USB(登録商標)規格等に準拠して行われ得る。無線通信は、LAN(Local Area Network)に関するIEEE802.11規格、移動体通信に関する、いわゆる4G/5Gと呼ばれる、第4世代/第5世代移動通信システム等に準拠して行われ得る。
The above-described wired communication and wireless communication can be performed according to known communication standards. For example, wired communication may be performed in compliance with the Ethernet (registered trademark) standard, the USB (registered trademark) standard, or the like. Wireless communication can be performed in compliance with the IEEE 802.11 standard for LAN (Local Area Network), so-called 4G/5G, 4th/5th generation mobile communication systems, and the like.
(2)詳細
以下、図4~図8を参照しながら、制御装置100及び加熱調理器1の構成を説明する。その後、図9~図18を参照しながら、制御装置100の動作を説明する。以下の説明では、図3Aに示す構成例に準じて説明する。一例として、制御装置100がウェイクアップワード及び操作ワードの認識、及び音声コマンドの発行を行うとする。 (2) Details Hereinafter, configurations of thecontrol device 100 and the heating cooker 1 will be described with reference to FIGS. 4 to 8. FIG. After that, the operation of the control device 100 will be described with reference to FIGS. 9 to 18. FIG. The following description is based on the configuration example shown in FIG. 3A. As an example, it is assumed that the control device 100 recognizes wakeup words and operation words, and issues voice commands.
以下、図4~図8を参照しながら、制御装置100及び加熱調理器1の構成を説明する。その後、図9~図18を参照しながら、制御装置100の動作を説明する。以下の説明では、図3Aに示す構成例に準じて説明する。一例として、制御装置100がウェイクアップワード及び操作ワードの認識、及び音声コマンドの発行を行うとする。 (2) Details Hereinafter, configurations of the
《制御装置》
図4は、制御装置100のハードウェア構成図である。
制御装置100は、演算部102と、記憶部104と、入力インタフェース(I/F)106と、出力インタフェース(I/F)108とを有している。 "Control device"
FIG. 4 is a hardware configuration diagram of thecontrol device 100. As shown in FIG.
Thecontrol device 100 has an arithmetic unit 102 , a storage unit 104 , an input interface (I/F) 106 and an output interface (I/F) 108 .
図4は、制御装置100のハードウェア構成図である。
制御装置100は、演算部102と、記憶部104と、入力インタフェース(I/F)106と、出力インタフェース(I/F)108とを有している。 "Control device"
FIG. 4 is a hardware configuration diagram of the
The
演算部102は、後述の処理を実行する演算回路であり、例えばCPU、マイクロコントローラ(マイコン)などの信号処理回路を含む。
The arithmetic unit 102 is an arithmetic circuit that executes processing described later, and includes signal processing circuits such as a CPU and a microcontroller (microcomputer).
記憶部104は、データの書き込み及び読み出しが可能な、1または複数の記憶装置である。そのような記憶装置の一例は、ROM、RAM、フラッシュメモリ、ハードディスクドライブ、SSDである。本実施形態では、記憶部104は、RAM104a及びフラッシュメモリ104bを含む。
The storage unit 104 is one or more storage devices to which data can be written and read. Examples of such storage devices are ROM, RAM, flash memory, hard disk drives, SSDs. In this embodiment, the storage unit 104 includes a RAM 104a and a flash memory 104b.
入力I/F106及び出力I/F108は、加熱調理器1の内部バス(図示せず)に接続されている。入力I/F106は、センサ出力信号及び加熱調理器1のマイク50から出力された音声信号を受け取る。出力I/F108は、後述の加熱調理器1の制御部に制御信号を出力する。
The input I/F 106 and the output I/F 108 are connected to an internal bus (not shown) of the heating cooker 1. The input I/F 106 receives the sensor output signal and the audio signal output from the microphone 50 of the heating cooker 1 . The output I/F 108 outputs a control signal to the controller of the heating cooker 1, which will be described later.
以下、記憶部104をより詳細に説明する。
RAM104aは、演算部102によって実行されるコンピュータプログラムを保持している。本実施形態では、RAM104aは、音声認識エンジン110と、制御プログラム112とを保持している。
フラッシュメモリ104bは、種々のデータを記憶している。具体的には、フラッシュメモリ104bは、ウェイクアップワードデータ120と、操作ワード群データ122と、データファイル124とを格納している。
ウェイクアップワードデータ120は、ウェイクアップワードを特定するデータである。ウェイクアップワードは、固定されたワードでもよいし、ユーザ200が変更可能であってもよい。
操作ワード群データ122は、加熱調理器1において利用可能な複数の操作ワードの集合である。例えば、操作ワード群データ122は、「左IH」、「右IH」、「中央IH」、「火力7」、「とろ火」、「停止」、「アップ」、「ダウン」等の操作ワードが格納されている。
データファイル124は、複数の操作ワードの各々と複数の音声コマンドの各々とを対応付けたテーブルである。後述する加熱調理器1の制御部31は、音声コマンドによって指定された動作を実行する。表1は、データファイル124の一例を示している。
The storage unit 104 will be described in more detail below.
TheRAM 104a holds computer programs executed by the computing unit 102 . In this embodiment, the RAM 104a holds a speech recognition engine 110 and a control program 112. FIG.
Theflash memory 104b stores various data. Specifically, the flash memory 104b stores wakeup word data 120, operation word group data 122, and a data file .
Thewakeup word data 120 is data specifying a wakeup word. The wakeup word may be a fixed word or may be changeable by the user 200 .
Operationword group data 122 is a set of a plurality of operation words that can be used in cooking device 1 . For example, the operation word group data 122 stores operation words such as "left IH", "right IH", "center IH", "heat power 7", "slow fire", "stop", "up", and "down". It is
The data file 124 is a table that associates each of a plurality of operation words with each of a plurality of voice commands. Acontrol unit 31 of the heating cooker 1, which will be described later, executes an operation designated by a voice command. Table 1 shows an example of data file 124 .
RAM104aは、演算部102によって実行されるコンピュータプログラムを保持している。本実施形態では、RAM104aは、音声認識エンジン110と、制御プログラム112とを保持している。
フラッシュメモリ104bは、種々のデータを記憶している。具体的には、フラッシュメモリ104bは、ウェイクアップワードデータ120と、操作ワード群データ122と、データファイル124とを格納している。
ウェイクアップワードデータ120は、ウェイクアップワードを特定するデータである。ウェイクアップワードは、固定されたワードでもよいし、ユーザ200が変更可能であってもよい。
操作ワード群データ122は、加熱調理器1において利用可能な複数の操作ワードの集合である。例えば、操作ワード群データ122は、「左IH」、「右IH」、「中央IH」、「火力7」、「とろ火」、「停止」、「アップ」、「ダウン」等の操作ワードが格納されている。
データファイル124は、複数の操作ワードの各々と複数の音声コマンドの各々とを対応付けたテーブルである。後述する加熱調理器1の制御部31は、音声コマンドによって指定された動作を実行する。表1は、データファイル124の一例を示している。
The
The
The
Operation
The data file 124 is a table that associates each of a plurality of operation words with each of a plurality of voice commands. A
制御プログラム112を実行し、音声認識エンジン110による音声信号の認識結果を受け取りつつ、フラッシュメモリ104bを参照することにより、演算部102は、ウェイクアップワードを含む各種ワードを認識できる。
By executing the control program 112 and receiving the recognition result of the speech signal by the speech recognition engine 110 and referring to the flash memory 104b, the arithmetic unit 102 can recognize various words including wakeup words.
音声認識エンジン110を実行することにより、演算部102は、入力I/F106を介して受信した音声信号に含まれている、ユーザ200が発したワードを認識することができる。音声認識エンジン110による認識処理には、既存の任意の音声認識技術を利用することができる。音声認識技術の具体的な内容の説明は省略する。
By executing the speech recognition engine 110, the calculation unit 102 can recognize words uttered by the user 200 included in the speech signal received via the input I/F 106. Any existing speech recognition technology can be used for recognition processing by the speech recognition engine 110 . A detailed description of the speech recognition technology is omitted.
演算部102は、ウェイクアップワードデータ120を参照して、認識されたワードがウェイクアップワードであるか否かを判定する。また演算部102は、操作ワード群データ122を参照して、認識したワードが操作ワードであるか否かを判定する。操作ワードである場合で、かつ、ユーザ200の実行確認が得られた場合、演算部102はデータファイル124をさらに参照して、その操作ワードに対応する動作を実行させるための音声コマンドを読み出して加熱調理器1に送信する。
The calculation unit 102 refers to the wakeup word data 120 and determines whether or not the recognized word is the wakeup word. The calculation unit 102 also refers to the operation word group data 122 to determine whether or not the recognized word is an operation word. If it is an operation word and if execution confirmation by the user 200 is obtained, the operation unit 102 further refers to the data file 124 and reads out a voice command for executing an action corresponding to the operation word. Send to the heating cooker 1.
《加熱調理器》
以下、図5から図8を参照しながら、本開示の実施の形態に係る誘導加熱調理器を説明する。 《heating cooker》
Hereinafter, an induction heating cooker according to an embodiment of the present disclosure will be described with reference to FIGS. 5 to 8. FIG.
以下、図5から図8を参照しながら、本開示の実施の形態に係る誘導加熱調理器を説明する。 《heating cooker》
Hereinafter, an induction heating cooker according to an embodiment of the present disclosure will be described with reference to FIGS. 5 to 8. FIG.
図5は、例示的な実施の形態に係る誘導加熱調理器1の斜視図である。図6は、実施の形態に係る誘導加熱調理器1の制御系を示すブロック図である。図7は、誘導加熱調理器1の構成を概略的に示す図である。
FIG. 5 is a perspective view of the induction heating cooker 1 according to an exemplary embodiment. FIG. 6 is a block diagram showing the control system of the induction heating cooker 1 according to the embodiment. FIG. 7 is a diagram schematically showing the configuration of the induction heating cooker 1. As shown in FIG.
本開示にかかる図面の一部にはX軸、Y軸および/またはZ軸が表示されている。誘導加熱調理器の使用時に使用者が誘導加熱調理器に対向したとき、X軸方向は、加熱調理器の幅方向(長手方向)を示し、Y軸方向は奥行き方向(短手方向)を示し、Z軸方向は高さ方向を示す。また、X軸の正の方向を右方、負の方向を左方とする。また、Y軸の正の方向を後方、負の方向を前方とする。
The X-axis, Y-axis and/or Z-axis are displayed in some of the drawings according to the present disclosure. When the user faces the induction heating cooker while using the induction heating cooker, the X-axis direction indicates the width direction (longitudinal direction) of the heating cooker, and the Y-axis direction indicates the depth direction (lateral direction). , the Z-axis direction indicates the height direction. Also, the positive direction of the X-axis is defined as the right direction, and the negative direction is defined as the left direction. Also, the positive direction of the Y-axis is the rearward direction, and the negative direction is the forward direction.
《誘導加熱調理器》
まず、本開示にかかる誘導加熱調理器1の一般的な構成を説明する。 《Induction Heating Cooker》
First, the general configuration of theinduction heating cooker 1 according to the present disclosure will be described.
まず、本開示にかかる誘導加熱調理器1の一般的な構成を説明する。 《Induction Heating Cooker》
First, the general configuration of the
図5に示すように、誘導加熱調理器1は、本体3と、本体3の上面に容器が載置されるトッププレート5とを有する。容器には、例えば、シチューなどの調理対象としての食材を収容する、被加熱物である容器が収容されている。
As shown in FIG. 5, the induction heating cooker 1 has a main body 3 and a top plate 5 on which a container is placed on the upper surface of the main body 3. The container contains, for example, a container, which is an object to be heated, which contains ingredients to be cooked, such as stew.
誘導加熱調理器1の本体3の内部、より具体的には、誘導加熱調理器1のトッププレート5における容器載置領域の下側(-Z側)の位置には、加熱コイル7、8、9が配置されている。加熱コイル7~9は、容器を誘導加熱するために誘導磁界を発生させる。なお、加熱調理器1は3個の加熱コイル7~9を備えるが、1個、2個または4個以上の加熱コイルを備えてもよい。本明細書では、1または複数の加熱コイルを総称して「加熱部」と呼ぶことがある。
Heating coils 7, 8, 9 are placed. Heating coils 7-9 generate an induction magnetic field to inductively heat the container. Although the heating cooker 1 has three heating coils 7 to 9, it may have one, two, or four or more heating coils. One or more heating coils may be collectively referred to herein as a "heating section."
誘導加熱調理器1では、例えば、加熱コイル7、8、9のそれぞれを操作するために物理的に操作可能な操作部19、20、21が設けられている。つまり、加熱コイル7、8、9のそれぞれは、操作部19、20、21のそれぞれと「対応」する。このように、本明細書では、加熱コイル7、8、9のそれぞれに対して設けられた構成要素のことを、加熱コイルに「対応する」構成要素と呼ぶ。
The induction heating cooker 1 is provided with, for example, physically operable operation units 19, 20, and 21 for operating the heating coils 7, 8, and 9, respectively. That is, each of the heating coils 7, 8, 9 "corresponds" to each of the operating portions 19, 20, 21. As shown in FIG. Thus, the components provided for each of the heating coils 7, 8, 9 are referred to herein as components "corresponding" to the heating coils.
なお、後述のように、操作部19、20、21の実体は、複数のスイッチの集合であり、その各々は、上述のセンサ52として機能する。そのため、図5では操作部19、20、21の参照符号に、センサを示す参照符号「52」を併記している。
It should be noted that, as will be described later, the substance of the operation units 19, 20, and 21 is a set of multiple switches, each of which functions as the sensor 52 described above. Therefore, in FIG. 5, reference numerals "52" indicating the sensor are written together with the reference numerals of the operation units 19, 20, and 21. As shown in FIG.
センサ52として機能する操作部19、20、21の出力信号が、制御装置100の入力I/F106に送信されるよう、電気的な配線が設けられている。あるいは、操作部19、20、21の各スイッチが押下されたことを示すデータが、後述する加熱調理器1の制御部31を介して入力I/F106に送信するようデータ通信経路が形成されている。加熱調理器1のマイク50の出力信号、すなわち音声信号も同様に、制御装置100の入力I/F106に送信されるよう、電気的な配線が設けられ、またはデータ通信経路が形成されている。
Electrical wiring is provided so that output signals of the operation units 19 , 20 , 21 functioning as the sensor 52 are transmitted to the input I/F 106 of the control device 100 . Alternatively, a data communication path is formed so that data indicating that each switch of operation units 19, 20, and 21 has been pressed is transmitted to input I/F 106 via control unit 31 of heating cooker 1, which will be described later. there is An electrical wiring is provided or a data communication path is formed so that the output signal of the microphone 50 of the heating cooker 1, that is, the audio signal is similarly transmitted to the input I/F 106 of the control device 100.
図5に示すように、加熱コイル7~9の上側(+Z側)のトッププレート5上には、加熱コイル7、8、9のそれぞれに「対応」して、容器載置領域を示すリング状のマーカ11、12、13が印刷されている。
As shown in FIG. 5, on the top plate 5 on the upper side (+Z side) of the heating coils 7 to 9, there are ring-shaped rings indicating the container mounting areas, "corresponding" to the heating coils 7, 8, and 9, respectively. markers 11, 12 and 13 are printed.
上面視において、トッププレート5上の、加熱コイル7、8のそれぞれの外側には、リング状に光る発光部15、16が配置されている。また、トッププレート5上の、加熱コイル9の前側(-Y側)には、円弧形状の発光部17が配置されている。発光部15~17は、例えば、対応するそれぞれの加熱コイル7~9に電流が流れているときに発光する。発光部15~17は、それぞれ、例えば、不図示のLED発光基板を有する。
When viewed from the top, ring-shaped light-emitting portions 15 and 16 are arranged on the top plate 5 on the outer sides of the heating coils 7 and 8, respectively. An arc-shaped light-emitting portion 17 is arranged on the top plate 5 in front of the heating coil 9 (−Y side). The light-emitting units 15-17 emit light, for example, when the corresponding heating coils 7-9 are energized. The light emitting units 15 to 17 each have, for example, an LED light emitting board (not shown).
また、マーカ11~13内側の、トッププレート5の下側には温度センサ18が配置されている。温度センサ18が検出した検出値は、制御部31へ送られる。制御部31は、温度検出値を参照しながら、加熱コイル7~9に流れる電流量を調整し、調理方法のアシスト案内をするタイミングを決定する。
A temperature sensor 18 is arranged below the top plate 5 inside the markers 11 to 13 . A detection value detected by the temperature sensor 18 is sent to the control unit 31 . The control unit 31 adjusts the amount of current flowing through the heating coils 7 to 9 while referring to the temperature detection value, and determines the timing of assist guidance of the cooking method.
誘導加熱調理器1のトッププレート5の前側(-Y側)には、操作部19、20、21が配置されている。操作部19、20、21は、加熱コイル7~9のそれぞれを操作するためにユーザ200によって利用される。操作部19は加熱コイル7を操作し、操作部20は加熱コイル8を操作し、操作部21は加熱コイル9を操作するために設けられている。本明細書では、操作部19は加熱コイル7に対応し、操作部20は加熱コイル8に対応し、操作部21は加熱コイル9に対応する。
On the front side (-Y side) of the top plate 5 of the induction heating cooker 1, operation sections 19, 20, and 21 are arranged. The operating units 19, 20, 21 are used by the user 200 to operate the heating coils 7-9, respectively. The operating part 19 is provided to operate the heating coil 7 , the operating part 20 is provided to operate the heating coil 8 , and the operating part 21 is provided to operate the heating coil 9 . In this specification, the operating part 19 corresponds to the heating coil 7 , the operating part 20 corresponds to the heating coil 8 , and the operating part 21 corresponds to the heating coil 9 .
誘導加熱調理器1のトッププレート5の前側、加熱コイル7~9と操作部19~21との間には、表示部23、24、25がそれぞれ配置されている。表示部23、24、25は、それぞれ、操作部19~21の操作対象の状態を表示する。表示部23~25の動作は、後述する制御部31によって制御される。
Display sections 23, 24, and 25 are arranged on the front side of the top plate 5 of the induction heating cooker 1, between the heating coils 7-9 and the operation sections 19-21, respectively. The display units 23, 24 and 25 respectively display the states of the operation targets of the operation units 19-21. Operations of the display units 23 to 25 are controlled by a control unit 31, which will be described later.
表示部23~25は、それぞれ、例えば、マトリックス・ドット液晶表示装置を備えている。マトリックス・ドット液晶表示装置は、例えば、トッププレート5の幅方向に延びた帯形状を有する、フルドット液晶表示パネルである。
The display units 23 to 25 each include, for example, a matrix-dot liquid crystal display device. The matrix dot liquid crystal display device is, for example, a full dot liquid crystal display panel having a band shape extending in the width direction of the top plate 5 .
表示部23~25は、それぞれ、操作対象の状態、加熱コイル7~9の動作の内容等を画像オブジェクトで表示する。例えば、表示部23は加熱コイル7の動作の内容を表示し、表示部24は加熱コイル8の動作の内容を表示し、表示部25は加熱コイル9の動作の内容を表示する。
The display units 23 to 25 respectively display the state of the operation target, the contents of the operation of the heating coils 7 to 9, etc. as image objects. For example, the display unit 23 displays the details of the operation of the heating coil 7 , the display unit 24 displays the details of the operation of the heating coil 8 , and the display unit 25 displays the details of the operation of the heating coil 9 .
画像オブジェクトは文字および/または画像である。例えば、画像オブジェクトは「加熱」という文字である。このとき、誘導加熱調理器1では、その表示部23~25に対応する加熱コイル7~9を用いて加熱動作が可能であることを示している。また、表示部23~25は、「加熱」という文字とともに、加熱の開始を示す「スタート」という文字の画像オブジェクトを表示してもよい。加熱が開始された後は、表示部23~25は、加熱コイル7~9の加熱量(火力)の大きさを示す数字、アイコン等の画像オブジェクトを表示してもよい。
Image objects are characters and/or images. For example, the image object is the word "heat". At this time, the induction heating cooker 1 indicates that the heating operation can be performed using the heating coils 7-9 corresponding to the display portions 23-25. In addition, the display units 23 to 25 may display an image object of characters "start" indicating the start of heating together with the characters "heating". After the heating is started, the display units 23-25 may display image objects such as numbers and icons indicating the magnitude of the heating amount (thermal power) of the heating coils 7-9.
なお、表示部23~25は、セグメント表示の液晶表示装置であってもよい。1または複数のセグメントを用いて表示される文字および/または画像は、上述の画像オブジェクトの範疇である。
It should be noted that the display units 23 to 25 may be segment display liquid crystal display devices. Text and/or images displayed using one or more segments fall under the category of image objects described above.
本体3は、加熱コイル7~9の加熱に関する情報を音声出力するスピーカ27を備える。スピーカ27は、誘導加熱調理器1の前面側に配置され、ユーザ200に対して音声案内を出力する。
The main body 3 is equipped with a speaker 27 that outputs information on heating of the heating coils 7-9. Speaker 27 is arranged on the front side of induction heating cooker 1 and outputs voice guidance to user 200 .
図6に示すように、誘導加熱調理器1は、本体3の内部に、制御部31、及び、記憶部33を備える。制御部31は、例えばCPU、マイクロコントローラ(マイコン)などの信号処理回路を含む。記憶部33は、ROM、RAM、ハードディスクドライブ、SSDなどの記憶装置である。記憶部33は、誘導加熱調理器1を動作させるためのコンピュータプログラムを記憶している。制御部31は当該コンピュータプログラムを実行することによって後述する種々の機能を果たすように構成されている。
As shown in FIG. 6 , the induction heating cooker 1 includes a control section 31 and a storage section 33 inside the main body 3 . The control unit 31 includes signal processing circuits such as a CPU and a microcontroller (microcomputer). The storage unit 33 is a storage device such as ROM, RAM, hard disk drive, and SSD. The storage unit 33 stores computer programs for operating the induction heating cooker 1 . The control unit 31 is configured to perform various functions described later by executing the computer program.
コンピュータプログラムを実行した制御部31は、その時々において、加熱コイル7~9に流す電流量を制御するコイル制御部35、表示部23~25の表示領域を制御する案内情報制御部37、案内情報の表示出力を制御する案内情報制御部45、及び、調理案内の情報出力を制御する調理案内制御部47として機能する。ただし、コイル制御部35、案内情報制御部37、および調理案内制御部47の一部または全部は、ソフトウェア的に実現されなくてもよく、1つまたは複数のCPU、マイクロプロセッサ、FPGAから構成されてもよい。
The control unit 31 that executes the computer program includes, at each time, a coil control unit 35 that controls the amount of current flowing through the heating coils 7 to 9, a guidance information control unit 37 that controls the display areas of the display units 23 to 25, guidance information and a cooking guidance control section 47 that controls the information output of cooking guidance. However, part or all of the coil control unit 35, the guidance information control unit 37, and the cooking guidance control unit 47 may not be realized by software, and may be composed of one or more CPUs, microprocessors, and FPGAs. may
操作部19~21の出力信号は制御部31に入力される。制御部31は操作に応じて加熱コイル7~9の加熱量等を設定する。操作部19の操作指示に応じて、コイル制御部35として機能する制御部31は、加熱コイル7の加熱の開始又は停止を制御する。コイル制御部35は、加熱コイル7~9に高周波電流を供給してトッププレート5に載置された容器の加熱を行う。また、コイル制御部35は、加熱コイル7~9に流す電流量を制御することで、加熱コイル7~9からの加熱量を制御する。また、操作部19~21の出力信号は制御部31に入力されているので、案内情報制御部37および調理案内制御部39として機能する制御部31の動作の制御にも利用される。
The output signals of the operation units 19 to 21 are input to the control unit 31. The controller 31 sets the heating amounts of the heating coils 7 to 9 according to the operation. The control unit 31 functioning as a coil control unit 35 controls the start or stop of heating of the heating coil 7 according to an operation instruction from the operation unit 19 . The coil control unit 35 supplies high-frequency current to the heating coils 7 to 9 to heat the container placed on the top plate 5 . In addition, the coil control unit 35 controls the amount of heating from the heating coils 7-9 by controlling the amount of current flowing through the heating coils 7-9. Further, since the output signals of the operation units 19 to 21 are input to the control unit 31, they are also used to control the operation of the control unit 31 functioning as the guidance information control unit 37 and the cooking guidance control unit 39.
調理案内制御部39は、予め定められた加熱シーケンスまたは調理シーケンスにしたがって、適切な条件が成立したタイミングで調理案内情報を案内情報制御部37に送る。適切な条件とは、温度センサ18による検出温度が予め定められた温度条件を満たすか否か、または、検出温度が予め定められた温度に達してから予め定められた時間経過したか否か等の条件である。調理案内するアシストメニューごとに、これらの条件が設定されている。調理案内制御部39が、これらの条件を満たしたと判断すると、調理案内制御部39は、その条件に対応した調理案内を表示部23~25から表示するように案内情報制御部37に指示する。これらの加熱シーケンス、調理シーケンス、及び調理案内は記憶部33に記憶されている。
The cooking guidance control unit 39 sends cooking guidance information to the guidance information control unit 37 at the timing when appropriate conditions are met according to a predetermined heating sequence or cooking sequence. Appropriate conditions include whether or not the temperature detected by the temperature sensor 18 satisfies a predetermined temperature condition, or whether or not a predetermined time has elapsed since the detected temperature reached a predetermined temperature. is the condition of These conditions are set for each assist menu for cooking guidance. When the cooking guidance control unit 39 determines that these conditions are satisfied, the cooking guidance control unit 39 instructs the guidance information control unit 37 to display cooking guidance corresponding to the conditions from the display units 23-25. These heating sequence, cooking sequence, and cooking guidance are stored in the storage unit 33 .
制御部31は、制御信号を受け取ると、制御信号に含まれる制御コマンドを解析する。制御装置100がウェイクアップワードを認識した後、操作ワードを認識したときは、制御装置100は制御コマンドによって、操作対象となる加熱コイルを指定し、操作内容を指定する。
Upon receiving the control signal, the control unit 31 analyzes the control command included in the control signal. When the control device 100 recognizes the operation word after recognizing the wakeup word, the control device 100 specifies the heating coil to be operated and specifies the operation content by the control command.
《表示部と操作部》
次に図8を参照して、表示部23~25および操作部19~21を説明する。操作部19~21は、それぞれ、第1操作部51、第2操作部53、第3操作部55、及び、第4操作部57を備える。第1操作部51~第4操作部57は、例えば、静電容量式のスイッチを含むタッチスイッチでもよいし、押しボタンスイッチでもよい。第1操作部51~第4操作部57は、対応する加熱コイル7~9の加熱動作を設定する。第1操作部51は、時計の模様が印刷されており、主に、タイマー設定を選択するのに用いられる。第2操作部53及び第3操作部55は、それぞれ矢印の模様、例えば「<」、「>」の記号、が印刷されており、主に、メニュー選択および火力量やタイマー時間を設定するのに用いられる。第4操作部57は、操作部と対応する加熱領域を示す模様が印刷されており、状況に応じて異なる機能が割り当てられる多機能スイッチとして機能する。電源スイッチ22は、誘導加熱調理器1の電源を投入する機能を有する。電源スイッチ22は、さらに誘導加熱調理器1の電源を遮断する機能を有していてもよい。電源スイッチ22とは別に、電源を遮断するためのスイッチが設けられていてもよい。 <<Display and operation unit>>
Next, the display units 23-25 and the operation units 19-21 will be described with reference to FIG. The operatingsections 19 to 21 each include a first operating section 51, a second operating section 53, a third operating section 55, and a fourth operating section 57. As shown in FIG. The first operation unit 51 to the fourth operation unit 57 may be, for example, touch switches including capacitive switches, or push button switches. The first operation section 51 to fourth operation section 57 set the heating operation of the corresponding heating coils 7 to 9 . The first operation unit 51 is printed with a clock pattern and is mainly used to select timer settings. The second operation unit 53 and the third operation unit 55 are printed with arrow patterns, such as “<” and “>” symbols, respectively, and are mainly used for menu selection and setting the heating power amount and timer time. used for The fourth operating portion 57 is printed with a pattern indicating the heating area corresponding to the operating portion, and functions as a multifunction switch to which different functions are assigned depending on the situation. The power switch 22 has a function of turning on the power of the induction heating cooker 1 . The power switch 22 may further have a function of shutting off the power of the induction heating cooker 1 . Aside from the power switch 22, a switch for cutting off the power may be provided.
次に図8を参照して、表示部23~25および操作部19~21を説明する。操作部19~21は、それぞれ、第1操作部51、第2操作部53、第3操作部55、及び、第4操作部57を備える。第1操作部51~第4操作部57は、例えば、静電容量式のスイッチを含むタッチスイッチでもよいし、押しボタンスイッチでもよい。第1操作部51~第4操作部57は、対応する加熱コイル7~9の加熱動作を設定する。第1操作部51は、時計の模様が印刷されており、主に、タイマー設定を選択するのに用いられる。第2操作部53及び第3操作部55は、それぞれ矢印の模様、例えば「<」、「>」の記号、が印刷されており、主に、メニュー選択および火力量やタイマー時間を設定するのに用いられる。第4操作部57は、操作部と対応する加熱領域を示す模様が印刷されており、状況に応じて異なる機能が割り当てられる多機能スイッチとして機能する。電源スイッチ22は、誘導加熱調理器1の電源を投入する機能を有する。電源スイッチ22は、さらに誘導加熱調理器1の電源を遮断する機能を有していてもよい。電源スイッチ22とは別に、電源を遮断するためのスイッチが設けられていてもよい。 <<Display and operation unit>>
Next, the display units 23-25 and the operation units 19-21 will be described with reference to FIG. The operating
《制御装置の動作》
図9は、制御装置100の演算部102によって実行される基本的な処理の手順を示すフローチャートである。本実施形態において、本フローチャートはウェイクアップワードが認識された後に実行される。ウェイクアップワードの認識処理は、必ずしも演算部102が実行しなくてもよいため、図9にはウェイクアップワードの認識処理は任意的な処理として括弧書きにより記載している。 <<Operation of the control device>>
FIG. 9 is a flow chart showing the procedure of basic processing executed by thecalculation unit 102 of the control device 100. As shown in FIG. In this embodiment, this flowchart is executed after the wakeup word is recognized. Since the wakeup word recognition process does not necessarily have to be executed by the calculation unit 102, the wakeup word recognition process is shown in parentheses as an optional process in FIG.
図9は、制御装置100の演算部102によって実行される基本的な処理の手順を示すフローチャートである。本実施形態において、本フローチャートはウェイクアップワードが認識された後に実行される。ウェイクアップワードの認識処理は、必ずしも演算部102が実行しなくてもよいため、図9にはウェイクアップワードの認識処理は任意的な処理として括弧書きにより記載している。 <<Operation of the control device>>
FIG. 9 is a flow chart showing the procedure of basic processing executed by the
ステップS10において、演算部102は、入力I/F106を介して入力信号を取得する。
In step S10, the calculation unit 102 acquires an input signal via the input I/F 106.
ステップS12において、入力信号が加熱調理器1のマイク50からの音声信号であり、かつ音声認識の結果、その音声信号が操作ワードを含むと判定した場合には、演算部102は、出力I/F108を介して制御信号を出力する。具体的には、制御信号は、操作ワードに対応する音声コマンドの実行確認を要求する信号である。
In step S12, when it is determined that the input signal is the voice signal from the microphone 50 of the cooking device 1 and the voice signal includes the operation word as a result of voice recognition, the calculation unit 102 outputs I/ A control signal is output via F108. Specifically, the control signal is a signal requesting confirmation of execution of the voice command corresponding to the operation word.
ステップS14における制御信号の送信後、ステップS14において、演算部102は再び、入力I/F106を介して入力信号を取得する。
After transmitting the control signal in step S14, the calculation unit 102 again acquires the input signal via the input I/F 106 in step S14.
ステップS16において、入力信号が加熱調理器1のセンサ52の検出結果であって、音声コマンドの実行を確認する確認応答信号であると判定した場合には、演算部102は、音声コマンドの実行を指示する制御信号を出力する。
In step S16, when it is determined that the input signal is the detection result of the sensor 52 of the heating cooker 1 and is an acknowledgment signal confirming the execution of the voice command, the calculation unit 102 executes the voice command. Outputs a commanding control signal.
第2制御出力信号が出力I/F108を介して加熱調理器1に送信されると、加熱調理器1は指示された音声コマンドを実行する。これにより、ユーザ200が音声で入力した操作ワードに対応する動作が実現される。
When the second control output signal is sent to the heating cooker 1 via the output I/F 108, the heating cooker 1 executes the indicated voice command. As a result, an operation corresponding to the operation word input by voice by the user 200 is realized.
図10は、制御装置100の演算部102によって実行される応用的な処理の手順を示すフローチャートである。本例は、ウェイクアップワードの認識処理も含んでいる。
FIG. 10 is a flow chart showing the procedure of applied processing executed by the calculation unit 102 of the control device 100. FIG. This example also includes wakeup word recognition processing.
ステップS20において、演算部102は、入力I/F106に音声信号が入力されるまでは、スリープ状態または待ち受け状態で待機する。音声信号が入力されるとステップS22に遷移する。
In step S20, the calculation unit 102 waits in a sleep state or standby state until an audio signal is input to the input I/F 106. When an audio signal is input, the process transitions to step S22.
ステップS22において、演算部102は、音声認識処理を実行して音声信号にウェイクアップワードが含まれているか否かを判定する。含まれていない場合には処理はステップS20に戻る。含まれている場合には処理はステップS24に進む。
In step S22, the calculation unit 102 executes voice recognition processing to determine whether or not the wakeup word is included in the voice signal. If not included, the process returns to step S20. If it is included, the process proceeds to step S24.
ステップS24において、演算部102は、自身及び制御装置100が動作できるよう、他の構成要素も含めたシステムを起動させ、次の音声信号が入力されるのを待つ。
In step S24, the calculation unit 102 activates the system including other components so that it and the control device 100 can operate, and waits for the input of the next audio signal.
ステップS26において、音声信号が入力されるまでに待ち時間が一定時間経過した場合には処理はステップS20に戻り、再び新たな音声信号が入力されるまでスリープ状態で待機する。一定時間が経過するまでに、入力I/F106に音声信号が入力された場合には、処理はステップS28に進む。
In step S26, if the waiting time elapses until the audio signal is input, the process returns to step S20 and waits in a sleep state until a new audio signal is input again. If an audio signal is input to the input I/F 106 before the lapse of the fixed time, the process proceeds to step S28.
ステップS28において、演算部102は、音声認識処理を実行してワードを抽出し、操作ワード群データ122を参照して、音声信号に操作ワードが含まれているか否かを判定する。操作ワードが含まれている場合には処理はステップS30に進み、含まれていない場合にはステップS26に戻る。
In step S28, the computing unit 102 executes voice recognition processing to extract words, refers to the operation word group data 122, and determines whether or not the voice signal contains an operation word. If the operation word is included, the process proceeds to step S30, and if not included, the process returns to step S26.
ステップS30において、演算部102は、出力I/F108から実行確認を要求する制御信号を送信する。実行確認を要求する制御信号を受信した加熱調理器1の制御部31は、後述する種々の方法の少なくとも1つによってユーザ200に実行確認を求める。ユーザ200が実行確認の操作または動作を行うと、加熱調理器1の制御部31は入力I/F106にその確認結果を示す信号を入力する。
In step S<b>30 , the calculation unit 102 transmits a control signal requesting execution confirmation from the output I/F 108 . Upon receiving the control signal requesting execution confirmation, control unit 31 of heating cooker 1 requests execution confirmation from user 200 by at least one of various methods described later. When the user 200 performs an operation or action for confirming execution, the control unit 31 of the heating cooker 1 inputs a signal indicating the confirmation result to the input I/F 106 .
ステップS32において、演算部102は、入力I/F106において受け取った入力信号の種類を判定して、その結果に応じて複数の処理のうちの一つを実行する。
At step S32, the calculation unit 102 determines the type of input signal received at the input I/F 106, and executes one of a plurality of processes according to the result.
まず、入力信号が、音声コマンドの実行を確認したことを示す確認応答信号であった場合、演算部102は、ユーザ200が実行を希望する操作ワードに対応する音声コマンドを発行し、入力I/F106から加熱調理器1の制御部31に送信する。これにより、加熱調理器1が音声によって操作される。または、入力I/F106において受け取った入力信号が操作ワードの再入力を希望することを示すリトライ要求信号であった場合、処理はステップS26に戻る。演算部102は、一定時間待機しながら、操作ワードを含む音声信号の再入力を待つ。一方、入力I/F106において受け取った入力信号が、確認応答信号及びリトライ要求信号のいずれとも異なると演算部102が判定した場合、あるいは、その音声操作の解除を求めることを示す解除信号であった場合、演算部102はそれまでの処理をキャンセルしてステップS20の処理に戻る。
First, if the input signal is an acknowledgment signal indicating that the execution of the voice command has been confirmed, the computing unit 102 issues a voice command corresponding to the operation word that the user 200 desires to execute, and It is transmitted to the control unit 31 of the heating cooker 1 from F106. Thereby, the heating cooker 1 is operated by voice. Alternatively, if the input signal received at the input I/F 106 is a retry request signal indicating a desire to re-input the operation word, the process returns to step S26. The calculation unit 102 waits for a re-input of the voice signal including the operation word while standing by for a certain period of time. On the other hand, if the calculation unit 102 determines that the input signal received by the input I/F 106 is different from either the acknowledgment signal or the retry request signal, or it is a release signal indicating that the voice operation is to be released. In this case, the calculation unit 102 cancels the processing up to that point and returns to the processing of step S20.
上述した処理のうち、本実施形態では、操作ワードに対応する音声コマンドの実行確認をユーザ200に求める処理を新たに設け、ユーザ200が音声コマンドの実行を指示する場合に加熱調理器1に音声コマンドを実行させることにした。そこで、以下では、どのような方法で実行確認を行うかについて、複数の具体例を挙げながら説明する。なお、表示部24(図5~図8)を利用する例を挙げているが、表示部23および/または表示部25であってもよい。その場合には、実行確認には、操作部20に代えて操作部19および/または21が利用されればよい。
Among the above-described processes, in the present embodiment, a process for requesting the user 200 to confirm the execution of the voice command corresponding to the operation word is newly provided, and when the user 200 instructs the execution of the voice command, a voice is sent to the heating cooker 1. I decided to run the command. Therefore, in the following, a method for confirming execution will be described with a plurality of specific examples. An example using the display unit 24 (FIGS. 5 to 8) is given, but the display unit 23 and/or the display unit 25 may be used. In that case, the operation unit 19 and/or 21 may be used instead of the operation unit 20 for execution confirmation.
図11は、中火の火力5で加熱コイル8を使用している場合の表示部24に表示される画像の例を示している。表示部24の下方には、「タイマー」、「火力調整」、「切」の文字が表示されている。ユーザ200は操作部20を利用してユーザ200に実行確認を要求する。例えばユーザ200は、「タイマー」機能を使用したければ第1操作部51を押下する。またユーザ200は、「火力調整」機能を使用して火力を増加または減少させたければ第2操作部53または第3操作部55を押下し、加熱を終了したい場合には第4操作部57を押下すればよい。
FIG. 11 shows an example of an image displayed on the display unit 24 when the heating coil 8 is used with the medium heat power 5. Below the display section 24, the characters "timer", "thermal power adjustment", and "off" are displayed. The user 200 uses the operation unit 20 to request execution confirmation from the user 200 . For example, the user 200 presses the first operation unit 51 if he wants to use the "timer" function. Further, the user 200 presses the second operating section 53 or the third operating section 55 to increase or decrease the heating power using the "thermal power adjustment" function, and presses the fourth operating section 57 to end heating. Just press it.
このような状況下で、加熱調理器1の加熱コイル8の火力を4に調節することを求める操作ワードをユーザ200が発したとする。そのような操作ワードの一例は、「右IH」及び「火力を4に変更して」である。図9のステップS12、及び図10のステップS30において求められる実行確認を求めるための制御信号が、演算部102から出力I/F108を介して制御部31に送信される。
Assume that the user 200 issues an operation word requesting that the heating power of the heating coil 8 of the heating cooker 1 be adjusted to 4 under such circumstances. Examples of such operation words are "Right IH" and "Change fire power to 4". 9 and step S30 of FIG. 10 is transmitted from the calculation unit 102 to the control unit 31 via the output I/F 108. FIG.
図12は、ユーザ200に音声コマンドの実行確認を要求するための表示部24の表示例である。制御部31は、表示部24に「火力を5から4に変更しますか?」というメッセージを表示することで、ユーザ200に実行確認を求める。このとき、制御部31は表示部24の下部の表示も切り替えて、音声操作の解除を求める「キャンセル」の文字24a、操作ワードの再入力を求める「音声再入力」の文字24b、操作ワードに対応する音声コマンドの実行を指示する「実行」の文字24cを表示する。ユーザ200は、「キャンセル」、「音声再入力」及び「実行」のいずれかを選択するために、第1操作部51、第2操作部53または第3操作部55、及び第4操作部57のいずれかを押下すればよい。各操作部の押下を検出するいずれかのセンサ52の出力信号(検出信号)が、制御装置100に送信される。実行確認の要否、という観点からすると、この例では、第4操作部57のみが音声コマンドの実行を指示する「実行」の文字24cに対応付けられている。第1操作部51、第2操作部53及び第3操作部55は、「実行」の文字24c以外の文字24a及び24bに対応付けられており、音声コマンドの実行確認には利用できない。
FIG. 12 is a display example of the display unit 24 for requesting the user 200 to confirm the execution of the voice command. The control unit 31 asks the user 200 to confirm the execution by displaying a message “Are you sure you want to change the thermal power from 5 to 4?” on the display unit 24 . At this time, the control unit 31 also switches the display in the lower part of the display unit 24 to display characters 24a of "cancel" requesting cancellation of the voice operation, characters 24b of "re-input voice" requesting re-input of the operation word, and Characters 24c of "execute" are displayed to instruct execution of the corresponding voice command. The user 200 selects one of "cancel", "re-input voice" and "execute" using the first operation unit 51, the second operation unit 53 or the third operation unit 55, and the fourth operation unit 57. You can press either An output signal (detection signal) of one of the sensors 52 that detects pressing of each operation unit is transmitted to the control device 100 . From the viewpoint of whether or not execution confirmation is necessary, in this example, only the fourth operation unit 57 is associated with the characters 24c of "execute" that instruct execution of the voice command. The first operation part 51, the second operation part 53 and the third operation part 55 are associated with the characters 24a and 24b other than the character 24c of "execute", and cannot be used to confirm the execution of the voice command.
図13は、音声コマンドの実行が指示された結果、音声コマンドにしたがって火力が4に調整されたことを文字画像で表示する表示部24を示している。
FIG. 13 shows the display unit 24 displaying a character image indicating that the thermal power has been adjusted to 4 according to the voice command as a result of the instruction to execute the voice command.
図14は、他の例による実行確認の要求方法を示している。演算部102は、加熱調理器1の制御部31に、「結果を実行するには、「確定」と発音してください」という文字を含む画像を表示させる制御信号を送信し、ユーザ200に実行確認を要求する。このとき、ユーザ200は操作部20を使用するのではなく、自ら「確定」と発声してマイク50に検出させることで、音声コマンドの実行を指示する。このとき、マイク50はセンサ52としても機能すると言える。仮に、一定時間「確定」という発声が検出されなかった場合には、ユーザ200は、火力を4に変更する、という音声コマンドの実行を指示していないとして、それまでの処理はキャンセルされる。つまり、図10において、ステップS32の処理からステップS20の処理に戻る。上述の「確定」という単語は一例である。発声させる語は、文字、数字、記号、図形の形状などの、予め定められた、またはランダムな組み合わせであってもよい。また、発声の検出のための時間は一定でなくてもよく、予め用意された複数の時間値の中からランダムに選択されてもよい。
FIG. 14 shows a method of requesting execution confirmation according to another example. Arithmetic unit 102 transmits to control unit 31 of heating cooker 1 a control signal for displaying an image including characters “To execute the result, pronounce 'confirm'”, and instructs user 200 to execute the command. Request confirmation. At this time, the user 200 does not use the operation unit 20, but utters "OK" himself and causes the microphone 50 to detect it, thereby instructing the execution of the voice command. At this time, it can be said that the microphone 50 also functions as the sensor 52 . If the utterance "confirm" is not detected for a certain period of time, it is assumed that the user 200 has not instructed the execution of the voice command to change the thermal power to 4, and the processing up to that point is cancelled. That is, in FIG. 10, the process returns from step S32 to step S20. The word "confirmed" above is an example. The words to be spoken may be predetermined or random combinations of letters, numbers, symbols, graphic shapes, and the like. Also, the time for detecting the utterance may not be constant, and may be randomly selected from a plurality of time values prepared in advance.
発声すべき単語がその時々で変更されるため、ユーザは発声すべき単語を都度確認しなければ、発声することができない。換言すると、ユーザが近くにいない場合、演算部102はユーザによる実行確認を受け付けられず、そのためコマンドを実行することはない。よって、ユーザが音声操作を意識しない状態で音声インタフェースによって加熱状態が変更されることを防止できる。加えて、発声の検出のための時間をランダムに選択することにより、加熱調理器1の近傍にいなければ音声による操作ができない、という認識をより強くユーザに与えることができる。なお、提示する候補となる単語は予め用意され、記憶部33に記憶されていてもよい。
Since the words to be spoken change from time to time, the user cannot speak unless he or she confirms the words to be spoken each time. In other words, if the user is not nearby, the computing unit 102 cannot accept execution confirmation from the user, and therefore does not execute the command. Therefore, it is possible to prevent the heating state from being changed by the voice interface without the user being conscious of the voice operation. In addition, by randomly selecting the time for detection of vocalization, it is possible to give the user a stronger recognition that voice operation cannot be performed unless the user is in the vicinity of the heating cooker 1 . The candidate words to be presented may be prepared in advance and stored in the storage unit 33 .
次は、ランプを用いて、ユーザ200の実行要求を確認する方法を説明する。
図15は、任意の色で点灯させることが可能なランプ61を用いてユーザ200の実行要求を確認する例を説明するための図である。演算部102は、加熱調理器1の制御部31に、ランプ61を所定の色で点灯させる制御信号、及び、表示部24に表示させるメッセージ(「結果を実行するには、確認ランプの色を発音してください」)を伝達するための制御信号を送信する。点灯させるべき所定の色は、演算部102がランダムに決定すればよい。例えば演算部102は、赤色、青色、黄色の3色のうちから一つの色をランダムに選択し、その色を特定する色データ、例えばRGB値、を加熱調理器1に送信する。 Next, a method of confirming the user's 200 execution request using a lamp will be described.
FIG. 15 is a diagram for explaining an example of confirming an execution request from theuser 200 using a lamp 61 that can be lit in any color. The calculation unit 102 sends a control signal to the control unit 31 of the heating cooker 1 to turn on the lamp 61 in a predetermined color, and a message to be displayed on the display unit 24 (“To execute the result, change the color of the confirmation lamp. Speak out.") to transmit a control signal. The predetermined color to be lit may be randomly determined by the calculation unit 102 . For example, the calculation unit 102 randomly selects one color from three colors of red, blue, and yellow, and transmits color data specifying the selected color, such as RGB values, to the heating cooker 1 .
図15は、任意の色で点灯させることが可能なランプ61を用いてユーザ200の実行要求を確認する例を説明するための図である。演算部102は、加熱調理器1の制御部31に、ランプ61を所定の色で点灯させる制御信号、及び、表示部24に表示させるメッセージ(「結果を実行するには、確認ランプの色を発音してください」)を伝達するための制御信号を送信する。点灯させるべき所定の色は、演算部102がランダムに決定すればよい。例えば演算部102は、赤色、青色、黄色の3色のうちから一つの色をランダムに選択し、その色を特定する色データ、例えばRGB値、を加熱調理器1に送信する。 Next, a method of confirming the user's 200 execution request using a lamp will be described.
FIG. 15 is a diagram for explaining an example of confirming an execution request from the
演算部102は、当該色データを保持しておく。点灯指示の後に出力I/F108で受信した音声信号に、色を示す単語が含まれる場合には、その色のRGB値を算出し、または予め用意された変換テーブルを参照してその色のRGB値を抽出し、保持していた色データと比較する。両者が一致した場合には、出力I/F108で受信した信号は確認応答信号であると判定する。これにより、演算部102は加熱調理器1の制御部31に火力を4に変更する音声コマンドを送信する。なお、音声による色名の入力に代えて、各々に色が対応付けられた複数のスイッチのいずれかを押下してもよい。
The calculation unit 102 holds the color data. When the audio signal received by the output I/F 108 after the lighting instruction includes a word indicating a color, the RGB value of the color is calculated, or the conversion table prepared in advance is referred to. Extract the value and compare it with the color data you had. If both match, the signal received by the output I/F 108 is determined to be an acknowledgment signal. Accordingly, the calculation unit 102 transmits a voice command to change the heating power to 4 to the control unit 31 of the heating cooker 1 . Instead of inputting the color name by voice, one of a plurality of switches each associated with a color may be pressed.
次は、近接センサを用いて、ユーザ200の実行要求を確認する方法を説明する。
図16は、近接センサ63を備えた加熱調理器1を示している。近接センサ63は、例えば超音波センサであり、超音波を放射し、その反射波を検出することで、非接触で検出対象の物体までの距離を検出する。近接センサ63は、センサ52(図1B~1D、図3A~図3C)の一例である。本実施形態では、検出対象の物体はユーザ200の手であるとする。なお、近接センサ63の設置位置は加熱調理器1上方の壁面等であってもよく、加熱調理器1に埋め込まれる必要はない。 Next, a method of confirming an execution request from theuser 200 using a proximity sensor will be described.
FIG. 16 shows theheating cooker 1 with the proximity sensor 63. As shown in FIG. The proximity sensor 63 is, for example, an ultrasonic sensor that emits ultrasonic waves and detects the reflected waves to detect the distance to an object to be detected in a non-contact manner. Proximity sensor 63 is an example of sensor 52 (FIGS. 1B-1D, FIGS. 3A-3C). In this embodiment, it is assumed that the object to be detected is the user's 200 hand. In addition, the installation position of the proximity sensor 63 may be the wall surface above the heating cooker 1 or the like, and does not need to be embedded in the heating cooker 1 .
図16は、近接センサ63を備えた加熱調理器1を示している。近接センサ63は、例えば超音波センサであり、超音波を放射し、その反射波を検出することで、非接触で検出対象の物体までの距離を検出する。近接センサ63は、センサ52(図1B~1D、図3A~図3C)の一例である。本実施形態では、検出対象の物体はユーザ200の手であるとする。なお、近接センサ63の設置位置は加熱調理器1上方の壁面等であってもよく、加熱調理器1に埋め込まれる必要はない。 Next, a method of confirming an execution request from the
FIG. 16 shows the
図17Aは、近接センサ63を利用した確認応答信号の波形例を示すグラフである。図17Aのグラフの横軸は時間、縦軸は検出対象の物体(手)までの距離である。本発明者らは、近接センサ63の波形において、手が基準距離(Td)未満まで接近し、かつ、接近した状態が基準期間(Tt)以上継続した場合に、ユーザ200が意図的に近接センサ63上に手をかざしたと判定する。一方、図17Bは、確認応答信号に該当しない信号の波形例を示すグラフである。手が基準距離(Td)未満まで接近しているが、接近した状態が基準期間(Tt)以上継続していないため、ユーザが意図的に近接センサ63上に手をかざしたとは言えない。例えば、鍋が近接センサ63上を瞬間的に横切った場合が考えられる。
17A is a graph showing a waveform example of an acknowledgment signal using the proximity sensor 63. FIG. The horizontal axis of the graph in FIG. 17A is time, and the vertical axis is the distance to the object (hand) to be detected. The present inventors found that the user 200 intentionally touches the proximity sensor 63 when the hand approaches to less than the reference distance (Td) and the approaching state continues for the reference period (Tt) or longer in the waveform of the proximity sensor 63 . It is determined that the hand is held over 63 . On the other hand, FIG. 17B is a graph showing a waveform example of a signal that does not correspond to the acknowledgment signal. Although the hand is close to less than the reference distance (Td), it cannot be said that the user intentionally held the hand over the proximity sensor 63 because the close state has not continued for the reference period (Tt) or longer. For example, a pot may momentarily cross the proximity sensor 63 .
近接センサ63を利用する場合、演算部102は加熱調理器1に、近接センサ63に手を近づけることを指示する画像(文字を含む)を表示部24に表示させるための制御信号を送信し、その後、近接センサ63による検出動作を開始させる制御信号を送信してもよい。画像の表示から所定時間以内に近接センサ63が上述のジェスチャを検出したか否かに基づいて、演算部102は確認応答信号の有無を判定すればよい。
なお、超音波型の近接センサ63は一例である。人体の接近を検出可能であれば、赤外線型、静電容量型、電磁波型などの近接センサを用いてもよい。 When theproximity sensor 63 is used, the calculation unit 102 transmits a control signal to the cooking device 1 to cause the display unit 24 to display an image (including text) instructing the user to bring the hand closer to the proximity sensor 63, After that, a control signal for starting the detection operation by the proximity sensor 63 may be transmitted. Based on whether or not the proximity sensor 63 has detected the gesture described above within a predetermined time after the image is displayed, the calculation unit 102 may determine whether or not there is an acknowledgment signal.
Note that theultrasonic proximity sensor 63 is an example. Proximity sensors such as infrared type, capacitance type, and electromagnetic wave type may be used as long as they can detect the approach of a human body.
なお、超音波型の近接センサ63は一例である。人体の接近を検出可能であれば、赤外線型、静電容量型、電磁波型などの近接センサを用いてもよい。 When the
Note that the
ユーザ200の実行要求を確認するさらに他の方法として、ジェスチャセンサを用いる例が考えられる。ジェスチャセンサとは、例えば、赤外線カメラを用いて手の形や動きを撮影し、その一連の動き、すなわちジェスチャ、を取得するセンサである。音声コマンドの実行に対応するジェスチャと、音声コマンドの実行の解除に対応するジェスチャとを予め決めておくことで、ユーザ200のジェスチャが実行要求を意味するか否かを判定できる。なおジェスチャセンサの設置例は、図16の近接センサ63の設置例と同様と考えてよいため、図示は省略し、便宜的に図16に示す参照符号「73」を用いて説明する。ジェスチャセンサ73の設置位置は加熱調理器1上方の壁面等であってもよく、加熱調理器1に埋め込まれる必要はない。
As yet another method for confirming the user's 200 execution request, an example using a gesture sensor is conceivable. A gesture sensor is, for example, a sensor that captures the shape and movement of a hand using an infrared camera and obtains a series of movements, that is, a gesture. By predetermining a gesture corresponding to voice command execution and a gesture corresponding to cancellation of voice command execution, it is possible to determine whether or not the gesture of user 200 means an execution request. An example of installation of the gesture sensor can be considered to be the same as the example of installation of the proximity sensor 63 in FIG. 16, so illustration is omitted, and reference numeral "73" shown in FIG. 16 is used for explanation for convenience. The installation position of the gesture sensor 73 may be a wall surface above the heating cooker 1 or the like, and does not need to be embedded in the heating cooker 1 .
図18は、音声コマンドの実行及び解除にそれぞれ対応する2種類のジェスチャの組を示している。図18の(a)は、手を左から右に移動させるジェスチャを「音声コマンドの実行」に対応付け、手を左から右に移動させるジェスチャを「音声コマンドの解除」に対応付けた例である。図18の(b)は、手を上から下に移動させるジェスチャを「音声コマンドの実行」に対応付け、手を下から上に移動させるジェスチャを「音声コマンドの解除」に対応付けた例である。図18の(c)は、時計回りの円を描くジェスチャを「音声コマンドの実行」に対応付け、反時計回りの円を描くジェスチャを「音声コマンドの解除」に対応付けた例である。このようにジェスチャとその意味を予め対応付けておくことで、ジェスチャセンサ73の検出結果に基づいて、音声コマンドの実行を確認する確認応答信号を受け取ったと言えるか否かを判定できる。
FIG. 18 shows two sets of gestures corresponding to execution and cancellation of voice commands, respectively. FIG. 18A shows an example in which a gesture of moving the hand from left to right is associated with "execute voice command", and a gesture of moving the hand from left to right is associated with "cancel voice command". be. FIG. 18B shows an example in which the gesture of moving the hand from top to bottom is associated with "execute voice command", and the gesture of moving the hand from bottom to top is associated with "cancel voice command". be. (c) of FIG. 18 is an example in which a gesture of drawing a clockwise circle is associated with "execute voice command" and a gesture of drawing a counterclockwise circle is associated with "cancel voice command". By associating gestures with their meanings in advance, it is possible to determine whether or not it can be said that an acknowledgment signal confirming execution of a voice command has been received, based on the detection result of the gesture sensor 73 .
なお、ジェスチャセンサ73を利用する場合、演算部102は加熱調理器1に、ジェスチャセンサ73の近傍で所定の運動をすることを指示する画像(文字を含む)を表示部24に表示させるための制御信号を送信し、その後、ジェスチャセンサ73による検出動作を開始させる制御信号を送信してもよい。画像の表示から所定時間以内にジェスチャセンサ73が上述のジェスチャを検出したか否かに基づいて、演算部102は確認応答信号の有無を判定すればよい。
When using the gesture sensor 73 , the calculation unit 102 causes the display unit 24 to display an image (including characters) instructing the cooking device 1 to perform a predetermined exercise in the vicinity of the gesture sensor 73 . A control signal may be transmitted, and then a control signal for starting the detection operation by the gesture sensor 73 may be transmitted. Based on whether the gesture sensor 73 has detected the gesture described above within a predetermined time after the image is displayed, the calculation unit 102 may determine whether or not there is an acknowledgment signal.
上述した実施形態では、表示部に画像を表示して実行確認を求める例、及びランプを点灯することで光の色を利用して実行確認を求める例を挙げた。これらはいずれも、人の視覚への刺激を利用して実行確認を求める態様であると言うことができ、その意味において、表示部及びランプは「視覚的刺激を提示する提示部」と総称することができる。「視覚的刺激」は文字、数字、記号、図形、色および/または光である。
In the above-described embodiment, an example of requesting execution confirmation by displaying an image on the display unit and an example of requesting execution confirmation using the color of light by turning on a lamp were given. All of these can be said to be aspects of requesting confirmation of execution using stimuli to human vision, and in that sense, the display unit and the lamp are collectively referred to as a "presentation unit that presents visual stimuli." be able to. "Visual stimuli" are letters, numbers, symbols, graphics, colors and/or lights.
以下、変形例を説明する。
A modified example will be described below.
上述の図11の例では、表示部とその表示部の表示に対応付けられた操作部とを用いて実行確認を行う例を説明したが、どの表示部を利用する場合であっても、共通の操作部を用いて実行確認の要否をユーザが入力できるようにしてもよい。そのような共通の操作部は、操作部19~21のうちの全部または一部であってもよいし、操作部19~21とは別の独立した1または複数のスイッチであってもよい。各操作部に設けられている1または複数のセンサの出力信号(検出信号)が制御装置100に送信されればよい。
In the example of FIG. 11 described above, an example of performing confirmation using the display unit and the operation unit associated with the display of the display unit has been described. The operation unit may be used to allow the user to input whether or not execution confirmation is necessary. Such a common operation unit may be all or part of the operation units 19 to 21, or may be one or more switches independent of the operation units 19 to 21. Output signals (detection signals) of one or more sensors provided in each operation unit may be transmitted to the control device 100 .
また、ランプ61(図15)を複数設けて同じ色で点灯させてもよい。これによりユーザがより視認しやすくなる。また、図16では、近接センサ63は加熱調理器1の天板の右下隅に設けられているが、天板の左下隅に設けてもよいし、右下隅及び左下隅の両方またはより多くの位置に設けてもよい。複数の近接センサ63を設けた場合であっても、各近接センサ63の出力信号(検出信号)が制御装置100に送信されればよい。少なくとも右下隅及び左下隅に近接センサ63を設けると、ユーザ200が右利きであっても左利きであっても実行確認の要否を入力しやすくなり、ユーザの利便性が向上する。
Also, a plurality of lamps 61 (FIG. 15) may be provided and lit in the same color. This makes it easier for the user to visually recognize. Also, in FIG. 16, the proximity sensor 63 is provided at the lower right corner of the top plate of the heating cooker 1, but it may be provided at the lower left corner of the top plate, or at both the lower right corner and the lower left corner or more. position. Even when a plurality of proximity sensors 63 are provided, the output signal (detection signal) of each proximity sensor 63 may be transmitted to control device 100 . If the proximity sensors 63 are provided at least at the lower right corner and the lower left corner, it becomes easier for the user 200 to input whether or not to confirm the execution, regardless of whether the user is right-handed or left-handed, thereby improving user convenience.
以上、本開示にかかる誘導加熱調理器1の実施の形態を説明した。上述したフローチャートによる処理は、コンピュータプログラムによって演算部102の動作として実現される。なお、加熱調理器1と制御装置100とが明確に区分できず、加熱調理器1と制御装置100とが一体化される実装態様も考えられる。そのような場合には、例えば制御部31が演算部102の全ての動作を実行すると捉えればよい。このとき、制御装置100と加熱調理器1との間の信号の送受信はもはや必要なくなり、その限りにおいて制御部31及び演算部102が行っていた動作は省略できる。
The embodiment of the induction heating cooker 1 according to the present disclosure has been described above. The processing according to the flowchart described above is realized as the operation of the arithmetic unit 102 by a computer program. In addition, a mounting mode in which the heating cooker 1 and the control device 100 cannot be clearly distinguished and the heating cooker 1 and the control device 100 are integrated is also conceivable. In such a case, for example, the control unit 31 may be regarded as executing all operations of the calculation unit 102 . At this time, it is no longer necessary to transmit and receive signals between the control device 100 and the heating cooker 1, and to that extent, the operations performed by the control section 31 and the calculation section 102 can be omitted.
(3)態様
上記実施の形態及び変形例から明らかなように、本開示は、下記の態様を含む。以下では、上記実施の形態との対応関係を明示するためだけに、符号を括弧付きで付している。 (3) Aspects As is clear from the above embodiments and modifications, the present disclosure includes the following aspects. In the following, reference numerals are given in parentheses only for the purpose of clarifying correspondence with the above embodiment.
上記実施の形態及び変形例から明らかなように、本開示は、下記の態様を含む。以下では、上記実施の形態との対応関係を明示するためだけに、符号を括弧付きで付している。 (3) Aspects As is clear from the above embodiments and modifications, the present disclosure includes the following aspects. In the following, reference numerals are given in parentheses only for the purpose of clarifying correspondence with the above embodiment.
第1の態様は、熱機器を音声で操作するための音声インタフェースを制御する制御装置(100)である。制御装置は、外部から入力信号を受け取る入力インタフェース(106)と、入力信号が音声信号である場合に、音声信号が予め用意された複数の操作ワードのうちのいずれか1つを表しているか否かを判定する演算部(102)と、外部に制御信号を出力する出力インタフェース(108)とを備えている。演算部は、入力インタフェースから第1入力信号として音声信号を受け取り(S10)、音声信号が複数の操作ワードのうちの所定の操作ワードを表していると判定すると、所定の操作ワードに対応する音声コマンドの実行確認を要求する第1制御信号を、出力インタフェースを介して出力し(S12)、第1制御信号の送信後に入力インタフェースを介して第2入力信号を受け取り(S14)、第2入力信号が音声コマンドの実行を確認する確認応答信号であると判定すると、音声コマンドの実行を指示する第2制御信号を、出力インタフェースを介して出力する(S16)。
第2の態様は、第1の態様に基づく制御装置(100)である。第2の態様では、演算部(102)は、第2入力信号が操作ワードの再入力を要求するリトライ要求信号であると判定すると、第2制御信号を出力せず、操作ワードの入力を待ち受ける待ち受け状態へ移行する。
第3の態様は、第2の態様に基づく制御装置(100)である。第3の態様では、演算部(102)は、第2入力信号が、確認応答信号及びリトライ要求信号のいずれとも異なると判定すると、第2制御信号を出力しない。
第4の態様は、第1~第3のいずれかの態様に基づく制御装置(100)である。第4の態様では、演算部(102)は、第1制御信号の送信後、所定時間内に、入力インタフェースを介して第2入力信号を受け取った場合は、第2入力信号が音声コマンドの実行を確認する確認応答信号であると判定し、第1制御信号の送信後、所定時間内に、入力インタフェースを介して第2入力信号を受け取らなかった場合は、新たな第1入力信号の入力を待ち受ける待ち受け状態へ移行する。
第5の態様は、第1の態様に基づく制御装置(100)である。第5の態様では、所定の操作ワードは、熱機器の火力を調節するための音声コマンドに対応付けられている。
第6の態様は、第1から第5のいずれかの態様に基づく制御装置(100)である。第6の態様では、制御装置(100)は、複数の操作ワードの各々と複数の音声コマンドの各々とを対応付けたデータファイルを記憶する記憶部をさらに備えている。
第7の態様は、熱機器(1)である。第7の態様では、熱機器(1)は、第6の態様に基づく制御装置(100)と、熱を発生させる1以上の加熱部(7、8、9)と、加熱部の火力を制御する制御部(31)と、マイク(50)と、ユーザの操作および/または動作を検出する1または複数のセンサ(52、51、53、55、57、63、73)とを有する。制御装置(100)の入力インタフェース(106)は、マイク及び1または複数のセンサの各出力信号を入力信号として受け取る。出力インタフェース(108)は制御信号を制御部(31)に出力する。制御部(31)は制御信号に応じて1以上の加熱部の動作を制御する。
第8の態様は、第7の態様に基づく熱機器(1)である。第8の態様では、音声インタフェースが有効化されていないスリープ状態においてマイクに所定の起動ワードが入力されると、制御装置は操作ワードの入力を待ち受ける待ち受けモードへ移行する。
第9の態様は、第7または第8の態様に基づく熱機器(1)である。第9の態様では、熱機器(1)は、視覚的刺激を提示する提示部(23、24、25、61)をさらに備えている。制御部(31)は、第1制御信号の受信に応答して、提示部に、文字、数字、記号、図形、色および/または光を含む視覚的刺激を提示させてユーザに音声コマンドの実行確認を要求する。制御装置の演算部は、1または複数のセンサの検出結果、及び、提示された視覚的刺激に基づいて、確認応答信号の有無を判定する。
第10の態様は、第9の態様に基づく熱機器(1)である。第10の態様では、提示部(23、24、25、61)は表示装置(23、24、25)である。制御部(31)は、視覚的刺激として、表示装置に、文字、数字、記号、図形および/または色の1以上を含む画像を表示させる。1または複数のセンサ(52、51、53、55、57、63、73)は、文字、数字、記号、図形および/または色の選択を受け付け、選択の結果を検出結果として出力する。
第11の態様は、第10の態様に基づく熱機器(1)である。第11の態様において、制御部(31)は、画像に含まれる文字、数字、記号、図形および/または色をランダムに決定する。
第12の態様は、第10または第11のいずれかの態様に基づく熱機器(1)である。第12の態様において、1または複数のセンサ(52、51、53、55、57、63、73)は複数のスイッチ(51、53、55、57)である。複数のスイッチは、表示された画像に対応付けられたスイッチと、対応付けられていない1以上のスイッチとを含み、複数のスイッチのうち、ユーザが操作したスイッチを特定する信号を、検出結果として出力する。制御部(31)は、表示された画像と、画像に対応付けられたスイッチであるか否かとに基づいて、確認応答信号の有無を判定する。
第13の態様は、第10の態様に基づく熱機器(1)である。第13の態様において、熱機器(1)は、複数の提示候補ワード(33)を予め記憶した記憶装置をさらに備えている。制御部(31)は、複数の提示候補ワードのうちの一つをランダムに選択し、視覚的刺激として、表示装置(23、24、25)に、選択された提示候補ワードを表示させる。
第14の態様は、第9の態様に基づく熱機器(1)である。第14の態様において、提示部(23、24、25、61)は、複数の色のうちから選択された色で発光させることが可能なランプ(61)である。制御部(31)は、視覚的刺激として、複数の色のうちからランダムに選択された1つの色でランプを発光させる。1または複数のセンサ(52、51、53、55、57、63、73)は、色の選択を受け付け、選択の結果を検出結果として出力する。
第15の態様は、第13の態様に基づく熱機器(1)である。第15の態様において、記1または複数のセンサ(52、51、53、55、57、63、73)は複数のスイッチ(51、53、55、57)である。複数のスイッチの各々は、変化する複数の色にそれぞれ対応付けられており、複数のスイッチのうち、ユーザが操作したスイッチを特定する信号を、検出結果として出力する。制御部(31)は、ユーザが操作したスイッチに対応する色と、ランプを点灯させた色とに基づいて、確認応答信号の有無を判定する。
第16の態様は、第9の態様に基づく熱機器(1)である。第16の態様において、1または複数のセンサ(52、51、53、55、57、63、73)の各々は近接センサ(63)である。提示部(23、24、25、61)は表示装置(23、24、25)である。制御装置(100)の演算部(102)は、表示装置に、視覚的刺激として、近接センサに手を近づけることを指示する画像を表示させ、画像の表示から所定時間以内に近接センサが物体の接近を検出したか否かに基づいて、確認応答信号の有無を判定する。
第17の態様は、第9の態様に基づく熱機器(1)である。第17の態様において、1または複数のセンサ(52、51、53、55、57、63、73)の各々はジェスチャセンサ(73)である。提示部(23、24、25、61)は表示装置(23、24、25)である。制御装置(100)の演算部(102)は、表示装置に、視覚的刺激として、ジェスチャセンサ上で所定の運動をすることを指示する画像を表示させ、画像の表示から所定時間以内にジェスチャセンサが所定の運動を検出したか否かに基づいて、確認応答信号の有無を判定する。
第18の態様は、第7から第17のいずれかの態様に基づく熱機器(1)である。第18の態様において、1以上の加熱部(7、8、9)は複数の加熱部である。制御装置(100)の演算部(102)が、複数の加熱部のいずれの加熱部の動作を制御する場合でも、入力インタフェース(106)は、マイク(50)及び1または複数のセンサ(52、51、53、55、57、63、73)の各出力信号を入力信号として受け取る。
第19の態様は、第8のいずれかの態様に基づく熱機器(1)である。第19の態様において、制御装置(100)の演算部(102)は、第1制御信号の送信後、所定時間内に、入力インタフェース(106)を介して第2入力信号を受け取らなかった場合は、操作ワード及び音声コマンドをクリアしてスリープ状態へ移行する。
第20の態様は、熱機器(1)を音声で操作するための音声インタフェースを制御する制御装置(100)のコンピュータによって実行されるコンピュータプログラム(112)である。第20の態様において、制御装置は、外部から入力信号を受け取る入力インタフェース(106)と、入力信号が音声信号である場合に、音声信号が予め用意された複数の操作ワードのうちのいずれか1つを表しているか否かを判定する、コンピュータである演算部(102)と、外部に制御信号を出力する出力インタフェース(108)とを備えている。コンピュータプログラム(112)は演算部(102)に、入力インタフェースから第1入力信号として音声信号を受け取らせる処理と、音声信号が複数の操作ワードのうちの所定の操作ワードを表していると判定すると、所定の操作ワードに対応する音声コマンドの実行確認を要求する第1制御信号を、出力インタフェースを介して出力させる処理と、第1制御信号の送信後に入力インタフェースを介して第2入力信号を受け取らせる処理と、第2入力信号が音声コマンドの実行を確認する確認応答信号であると判定すると、音声コマンドの実行を指示する第2制御信号を、出力インタフェースを介して出力させる処理とを実行させる。 A first aspect is a control device (100) for controlling a voice interface for operating a thermal appliance by voice. The control device includes an input interface (106) for receiving an input signal from the outside, and if the input signal is a voice signal, whether the voice signal represents one of a plurality of operation words prepared in advance. It has a calculation unit (102) for determining whether or not, and an output interface (108) for outputting a control signal to the outside. The computing unit receives a voice signal as a first input signal from the input interface (S10), and when determining that the voice signal represents a predetermined operation word among a plurality of operation words, outputs a voice corresponding to the predetermined operation word. outputting a first control signal requesting confirmation of command execution via the output interface (S12), receiving a second input signal via the input interface after transmitting the first control signal (S14), and receiving the second input signal is an acknowledgment signal confirming the execution of the voice command, a second control signal instructing the execution of the voice command is output through the output interface (S16).
The second aspect is a controller (100) based on the first aspect. In the second mode, when the second input signal is determined to be a retry request signal requesting re-input of the operation word, the calculation unit (102) waits for the input of the operation word without outputting the second control signal. Move to standby state.
A third aspect is a control device (100) based on the second aspect. In the third mode, the calculation section (102) does not output the second control signal when it determines that the second input signal is different from both the acknowledgment signal and the retry request signal.
A fourth aspect is a control device (100) based on any of the first to third aspects. In the fourth aspect, when the calculation unit (102) receives the second input signal via the input interface within a predetermined time after transmitting the first control signal, the second input signal is the execution of the voice command. and if the second input signal is not received through the input interface within a predetermined time after the first control signal is transmitted, input of a new first input signal It shifts to the waiting waiting state.
A fifth aspect is a control device (100) based on the first aspect. In a fifth aspect, the predetermined operation word is associated with a voice command for adjusting the thermal power of the thermal equipment.
A sixth aspect is a control device (100) according to any of the first through fifth aspects. In a sixth aspect, the control device (100) further includes a storage unit that stores a data file that associates each of the plurality of operation words with each of the plurality of voice commands.
A seventh aspect is a thermal equipment (1). In a seventh aspect, the thermal equipment (1) comprises a control device (100) according to the sixth aspect, one or more heating units (7, 8, 9) for generating heat, and controlling the heating power of the heating units. It has a control unit (31) for controlling, a microphone (50), and one or more sensors (52, 51, 53, 55, 57, 63, 73) for detecting user operations and/or actions. An input interface (106) of the control device (100) receives the respective output signals of the microphone and one or more sensors as input signals. The output interface (108) outputs the control signal to the control section (31). A control unit (31) controls the operation of one or more heating units according to the control signal.
An eighth aspect is a thermal appliance (1) according to the seventh aspect. In the eighth aspect, when a predetermined activation word is input to the microphone in a sleep state in which the voice interface is not activated, the control device shifts to a standby mode to wait for input of an operation word.
A ninth aspect is a thermal appliance (1) according to the seventh or eighth aspects. In a ninth aspect, the thermal equipment (1) further comprises a presentation part (23, 24, 25, 61) for presenting visual stimuli. A control unit (31), in response to receiving the first control signal, causes the presentation unit to present visual stimuli including letters, numbers, symbols, graphics, colors and/or lights to execute voice commands to the user. Request confirmation. The computing unit of the control device determines the presence or absence of the acknowledgment signal based on the detection results of the one or more sensors and the presented visual stimulus.
A tenth aspect is a thermal appliance (1) according to the ninth aspect. In a tenth aspect, the presentation units (23, 24, 25, 61) are display devices (23, 24, 25). A control unit (31) causes the display device to display an image including one or more of letters, numbers, symbols, graphics and/or colors as a visual stimulus. One or more sensors (52, 51, 53, 55, 57, 63, 73) accept selections of letters, numbers, symbols, graphics and/or colors, and output selection results as detection results.
An eleventh aspect is a thermal appliance (1) according to the tenth aspect. In the eleventh aspect, the control section (31) randomly determines letters, numbers, symbols, figures and/or colors included in the image.
A twelfth aspect is a thermal appliance (1) according to either the tenth or eleventh aspect. In a twelfth aspect, the one or more sensors (52, 51, 53, 55, 57, 63, 73) are a plurality of switches (51, 53, 55, 57). The plurality of switches includes a switch associated with the displayed image and one or more unassociated switches, and a signal specifying the switch operated by the user among the plurality of switches is used as a detection result. Output. A control unit (31) determines the presence or absence of an acknowledgment signal based on the displayed image and whether or not it is a switch associated with the image.
A thirteenth aspect is a thermal appliance (1) according to the tenth aspect. In the thirteenth aspect, the thermal equipment (1) further comprises a storage device pre-stored with a plurality of presentation candidate words (33). A control unit (31) randomly selects one of a plurality of presentation candidate words, and causes display devices (23, 24, 25) to display the selected presentation candidate word as a visual stimulus.
A fourteenth aspect is a thermal appliance (1) according to the ninth aspect. In the fourteenth aspect, the presentation unit (23, 24, 25, 61) is a lamp (61) capable of emitting light in a color selected from a plurality of colors. A control unit (31) causes the lamp to emit light in one color randomly selected from a plurality of colors as a visual stimulus. One or more sensors (52, 51, 53, 55, 57, 63, 73) accept color selection and output the selection result as a detection result.
A fifteenth aspect is a thermal appliance (1) according to the thirteenth aspect. In a fifteenth aspect, the one or more sensors (52, 51, 53, 55, 57, 63, 73) are a plurality of switches (51, 53, 55, 57). Each of the plurality of switches is associated with a plurality of changing colors, and outputs a signal identifying the switch operated by the user among the plurality of switches as a detection result. A control unit (31) determines whether or not there is an acknowledgment signal based on the color corresponding to the switch operated by the user and the color of the lamp.
A sixteenth aspect is a thermal appliance (1) according to the ninth aspect. In the sixteenth aspect, each of the one or more sensors (52, 51, 53, 55, 57, 63, 73) is a proximity sensor (63). The presentation units (23, 24, 25, 61) are display devices (23, 24, 25). The computing unit (102) of the control device (100) causes the display device to display an image instructing the user to approach the proximity sensor with the hand as a visual stimulus, and within a predetermined time after the display of the image, the proximity sensor is positioned close to the object. The presence or absence of an acknowledgment signal is determined based on whether or not proximity is detected.
A seventeenth aspect is a thermal appliance (1) according to the ninth aspect. In the seventeenth aspect, each of the one or more sensors (52, 51, 53, 55, 57, 63, 73) is a gesture sensor (73). The presentation units (23, 24, 25, 61) are display devices (23, 24, 25). The computing unit (102) of the control device (100) causes the display device to display an image instructing the gesture sensor to perform a predetermined movement as a visual stimulus, and the gesture sensor is activated within a predetermined time after the display of the image. determines the presence or absence of an acknowledgment signal based on whether the has detected a predetermined motion.
An eighteenth aspect is a thermal appliance (1) according to any of the seventh to seventeenth aspects. In an eighteenth aspect, the one or more heating units (7, 8, 9) is a plurality of heating units. When the arithmetic unit (102) of the control device (100) controls the operation of any one of the plurality of heating units, the input interface (106) includes a microphone (50) and one or more sensors (52, 51, 53, 55, 57, 63, 73) are received as input signals.
A nineteenth aspect is a thermal appliance (1) according to any eighth aspect. In the nineteenth aspect, if the arithmetic unit (102) of the control device (100) does not receive the second input signal via the input interface (106) within a predetermined time after transmitting the first control signal, , clears the operation word and voice command, and shifts to the sleep state.
A twentieth aspect is a computer program (112) executed by a computer of a control device (100) for controlling a voice interface for operating a thermal appliance (1) by voice. In a twentieth aspect, the control device comprises an input interface (106) for receiving an input signal from the outside, and one of a plurality of operation words prepared in advance as a voice signal when the input signal is a voice signal. It comprises an arithmetic unit (102), which is a computer, for determining whether or not one is represented, and an output interface (108) for outputting a control signal to the outside. A computer program (112) causes an arithmetic unit (102) to receive a voice signal as a first input signal from an input interface, and determines that the voice signal represents a predetermined operation word among a plurality of operation words. a process of outputting a first control signal requesting execution confirmation of a voice command corresponding to a predetermined operation word via an output interface; and receiving a second input signal via an input interface after transmitting the first control signal. and, if the second input signal is determined to be an acknowledgment signal confirming execution of the voice command, a process of outputting a second control signal instructing execution of the voice command via the output interface. .
第2の態様は、第1の態様に基づく制御装置(100)である。第2の態様では、演算部(102)は、第2入力信号が操作ワードの再入力を要求するリトライ要求信号であると判定すると、第2制御信号を出力せず、操作ワードの入力を待ち受ける待ち受け状態へ移行する。
第3の態様は、第2の態様に基づく制御装置(100)である。第3の態様では、演算部(102)は、第2入力信号が、確認応答信号及びリトライ要求信号のいずれとも異なると判定すると、第2制御信号を出力しない。
第4の態様は、第1~第3のいずれかの態様に基づく制御装置(100)である。第4の態様では、演算部(102)は、第1制御信号の送信後、所定時間内に、入力インタフェースを介して第2入力信号を受け取った場合は、第2入力信号が音声コマンドの実行を確認する確認応答信号であると判定し、第1制御信号の送信後、所定時間内に、入力インタフェースを介して第2入力信号を受け取らなかった場合は、新たな第1入力信号の入力を待ち受ける待ち受け状態へ移行する。
第5の態様は、第1の態様に基づく制御装置(100)である。第5の態様では、所定の操作ワードは、熱機器の火力を調節するための音声コマンドに対応付けられている。
第6の態様は、第1から第5のいずれかの態様に基づく制御装置(100)である。第6の態様では、制御装置(100)は、複数の操作ワードの各々と複数の音声コマンドの各々とを対応付けたデータファイルを記憶する記憶部をさらに備えている。
第7の態様は、熱機器(1)である。第7の態様では、熱機器(1)は、第6の態様に基づく制御装置(100)と、熱を発生させる1以上の加熱部(7、8、9)と、加熱部の火力を制御する制御部(31)と、マイク(50)と、ユーザの操作および/または動作を検出する1または複数のセンサ(52、51、53、55、57、63、73)とを有する。制御装置(100)の入力インタフェース(106)は、マイク及び1または複数のセンサの各出力信号を入力信号として受け取る。出力インタフェース(108)は制御信号を制御部(31)に出力する。制御部(31)は制御信号に応じて1以上の加熱部の動作を制御する。
第8の態様は、第7の態様に基づく熱機器(1)である。第8の態様では、音声インタフェースが有効化されていないスリープ状態においてマイクに所定の起動ワードが入力されると、制御装置は操作ワードの入力を待ち受ける待ち受けモードへ移行する。
第9の態様は、第7または第8の態様に基づく熱機器(1)である。第9の態様では、熱機器(1)は、視覚的刺激を提示する提示部(23、24、25、61)をさらに備えている。制御部(31)は、第1制御信号の受信に応答して、提示部に、文字、数字、記号、図形、色および/または光を含む視覚的刺激を提示させてユーザに音声コマンドの実行確認を要求する。制御装置の演算部は、1または複数のセンサの検出結果、及び、提示された視覚的刺激に基づいて、確認応答信号の有無を判定する。
第10の態様は、第9の態様に基づく熱機器(1)である。第10の態様では、提示部(23、24、25、61)は表示装置(23、24、25)である。制御部(31)は、視覚的刺激として、表示装置に、文字、数字、記号、図形および/または色の1以上を含む画像を表示させる。1または複数のセンサ(52、51、53、55、57、63、73)は、文字、数字、記号、図形および/または色の選択を受け付け、選択の結果を検出結果として出力する。
第11の態様は、第10の態様に基づく熱機器(1)である。第11の態様において、制御部(31)は、画像に含まれる文字、数字、記号、図形および/または色をランダムに決定する。
第12の態様は、第10または第11のいずれかの態様に基づく熱機器(1)である。第12の態様において、1または複数のセンサ(52、51、53、55、57、63、73)は複数のスイッチ(51、53、55、57)である。複数のスイッチは、表示された画像に対応付けられたスイッチと、対応付けられていない1以上のスイッチとを含み、複数のスイッチのうち、ユーザが操作したスイッチを特定する信号を、検出結果として出力する。制御部(31)は、表示された画像と、画像に対応付けられたスイッチであるか否かとに基づいて、確認応答信号の有無を判定する。
第13の態様は、第10の態様に基づく熱機器(1)である。第13の態様において、熱機器(1)は、複数の提示候補ワード(33)を予め記憶した記憶装置をさらに備えている。制御部(31)は、複数の提示候補ワードのうちの一つをランダムに選択し、視覚的刺激として、表示装置(23、24、25)に、選択された提示候補ワードを表示させる。
第14の態様は、第9の態様に基づく熱機器(1)である。第14の態様において、提示部(23、24、25、61)は、複数の色のうちから選択された色で発光させることが可能なランプ(61)である。制御部(31)は、視覚的刺激として、複数の色のうちからランダムに選択された1つの色でランプを発光させる。1または複数のセンサ(52、51、53、55、57、63、73)は、色の選択を受け付け、選択の結果を検出結果として出力する。
第15の態様は、第13の態様に基づく熱機器(1)である。第15の態様において、記1または複数のセンサ(52、51、53、55、57、63、73)は複数のスイッチ(51、53、55、57)である。複数のスイッチの各々は、変化する複数の色にそれぞれ対応付けられており、複数のスイッチのうち、ユーザが操作したスイッチを特定する信号を、検出結果として出力する。制御部(31)は、ユーザが操作したスイッチに対応する色と、ランプを点灯させた色とに基づいて、確認応答信号の有無を判定する。
第16の態様は、第9の態様に基づく熱機器(1)である。第16の態様において、1または複数のセンサ(52、51、53、55、57、63、73)の各々は近接センサ(63)である。提示部(23、24、25、61)は表示装置(23、24、25)である。制御装置(100)の演算部(102)は、表示装置に、視覚的刺激として、近接センサに手を近づけることを指示する画像を表示させ、画像の表示から所定時間以内に近接センサが物体の接近を検出したか否かに基づいて、確認応答信号の有無を判定する。
第17の態様は、第9の態様に基づく熱機器(1)である。第17の態様において、1または複数のセンサ(52、51、53、55、57、63、73)の各々はジェスチャセンサ(73)である。提示部(23、24、25、61)は表示装置(23、24、25)である。制御装置(100)の演算部(102)は、表示装置に、視覚的刺激として、ジェスチャセンサ上で所定の運動をすることを指示する画像を表示させ、画像の表示から所定時間以内にジェスチャセンサが所定の運動を検出したか否かに基づいて、確認応答信号の有無を判定する。
第18の態様は、第7から第17のいずれかの態様に基づく熱機器(1)である。第18の態様において、1以上の加熱部(7、8、9)は複数の加熱部である。制御装置(100)の演算部(102)が、複数の加熱部のいずれの加熱部の動作を制御する場合でも、入力インタフェース(106)は、マイク(50)及び1または複数のセンサ(52、51、53、55、57、63、73)の各出力信号を入力信号として受け取る。
第19の態様は、第8のいずれかの態様に基づく熱機器(1)である。第19の態様において、制御装置(100)の演算部(102)は、第1制御信号の送信後、所定時間内に、入力インタフェース(106)を介して第2入力信号を受け取らなかった場合は、操作ワード及び音声コマンドをクリアしてスリープ状態へ移行する。
第20の態様は、熱機器(1)を音声で操作するための音声インタフェースを制御する制御装置(100)のコンピュータによって実行されるコンピュータプログラム(112)である。第20の態様において、制御装置は、外部から入力信号を受け取る入力インタフェース(106)と、入力信号が音声信号である場合に、音声信号が予め用意された複数の操作ワードのうちのいずれか1つを表しているか否かを判定する、コンピュータである演算部(102)と、外部に制御信号を出力する出力インタフェース(108)とを備えている。コンピュータプログラム(112)は演算部(102)に、入力インタフェースから第1入力信号として音声信号を受け取らせる処理と、音声信号が複数の操作ワードのうちの所定の操作ワードを表していると判定すると、所定の操作ワードに対応する音声コマンドの実行確認を要求する第1制御信号を、出力インタフェースを介して出力させる処理と、第1制御信号の送信後に入力インタフェースを介して第2入力信号を受け取らせる処理と、第2入力信号が音声コマンドの実行を確認する確認応答信号であると判定すると、音声コマンドの実行を指示する第2制御信号を、出力インタフェースを介して出力させる処理とを実行させる。 A first aspect is a control device (100) for controlling a voice interface for operating a thermal appliance by voice. The control device includes an input interface (106) for receiving an input signal from the outside, and if the input signal is a voice signal, whether the voice signal represents one of a plurality of operation words prepared in advance. It has a calculation unit (102) for determining whether or not, and an output interface (108) for outputting a control signal to the outside. The computing unit receives a voice signal as a first input signal from the input interface (S10), and when determining that the voice signal represents a predetermined operation word among a plurality of operation words, outputs a voice corresponding to the predetermined operation word. outputting a first control signal requesting confirmation of command execution via the output interface (S12), receiving a second input signal via the input interface after transmitting the first control signal (S14), and receiving the second input signal is an acknowledgment signal confirming the execution of the voice command, a second control signal instructing the execution of the voice command is output through the output interface (S16).
The second aspect is a controller (100) based on the first aspect. In the second mode, when the second input signal is determined to be a retry request signal requesting re-input of the operation word, the calculation unit (102) waits for the input of the operation word without outputting the second control signal. Move to standby state.
A third aspect is a control device (100) based on the second aspect. In the third mode, the calculation section (102) does not output the second control signal when it determines that the second input signal is different from both the acknowledgment signal and the retry request signal.
A fourth aspect is a control device (100) based on any of the first to third aspects. In the fourth aspect, when the calculation unit (102) receives the second input signal via the input interface within a predetermined time after transmitting the first control signal, the second input signal is the execution of the voice command. and if the second input signal is not received through the input interface within a predetermined time after the first control signal is transmitted, input of a new first input signal It shifts to the waiting waiting state.
A fifth aspect is a control device (100) based on the first aspect. In a fifth aspect, the predetermined operation word is associated with a voice command for adjusting the thermal power of the thermal equipment.
A sixth aspect is a control device (100) according to any of the first through fifth aspects. In a sixth aspect, the control device (100) further includes a storage unit that stores a data file that associates each of the plurality of operation words with each of the plurality of voice commands.
A seventh aspect is a thermal equipment (1). In a seventh aspect, the thermal equipment (1) comprises a control device (100) according to the sixth aspect, one or more heating units (7, 8, 9) for generating heat, and controlling the heating power of the heating units. It has a control unit (31) for controlling, a microphone (50), and one or more sensors (52, 51, 53, 55, 57, 63, 73) for detecting user operations and/or actions. An input interface (106) of the control device (100) receives the respective output signals of the microphone and one or more sensors as input signals. The output interface (108) outputs the control signal to the control section (31). A control unit (31) controls the operation of one or more heating units according to the control signal.
An eighth aspect is a thermal appliance (1) according to the seventh aspect. In the eighth aspect, when a predetermined activation word is input to the microphone in a sleep state in which the voice interface is not activated, the control device shifts to a standby mode to wait for input of an operation word.
A ninth aspect is a thermal appliance (1) according to the seventh or eighth aspects. In a ninth aspect, the thermal equipment (1) further comprises a presentation part (23, 24, 25, 61) for presenting visual stimuli. A control unit (31), in response to receiving the first control signal, causes the presentation unit to present visual stimuli including letters, numbers, symbols, graphics, colors and/or lights to execute voice commands to the user. Request confirmation. The computing unit of the control device determines the presence or absence of the acknowledgment signal based on the detection results of the one or more sensors and the presented visual stimulus.
A tenth aspect is a thermal appliance (1) according to the ninth aspect. In a tenth aspect, the presentation units (23, 24, 25, 61) are display devices (23, 24, 25). A control unit (31) causes the display device to display an image including one or more of letters, numbers, symbols, graphics and/or colors as a visual stimulus. One or more sensors (52, 51, 53, 55, 57, 63, 73) accept selections of letters, numbers, symbols, graphics and/or colors, and output selection results as detection results.
An eleventh aspect is a thermal appliance (1) according to the tenth aspect. In the eleventh aspect, the control section (31) randomly determines letters, numbers, symbols, figures and/or colors included in the image.
A twelfth aspect is a thermal appliance (1) according to either the tenth or eleventh aspect. In a twelfth aspect, the one or more sensors (52, 51, 53, 55, 57, 63, 73) are a plurality of switches (51, 53, 55, 57). The plurality of switches includes a switch associated with the displayed image and one or more unassociated switches, and a signal specifying the switch operated by the user among the plurality of switches is used as a detection result. Output. A control unit (31) determines the presence or absence of an acknowledgment signal based on the displayed image and whether or not it is a switch associated with the image.
A thirteenth aspect is a thermal appliance (1) according to the tenth aspect. In the thirteenth aspect, the thermal equipment (1) further comprises a storage device pre-stored with a plurality of presentation candidate words (33). A control unit (31) randomly selects one of a plurality of presentation candidate words, and causes display devices (23, 24, 25) to display the selected presentation candidate word as a visual stimulus.
A fourteenth aspect is a thermal appliance (1) according to the ninth aspect. In the fourteenth aspect, the presentation unit (23, 24, 25, 61) is a lamp (61) capable of emitting light in a color selected from a plurality of colors. A control unit (31) causes the lamp to emit light in one color randomly selected from a plurality of colors as a visual stimulus. One or more sensors (52, 51, 53, 55, 57, 63, 73) accept color selection and output the selection result as a detection result.
A fifteenth aspect is a thermal appliance (1) according to the thirteenth aspect. In a fifteenth aspect, the one or more sensors (52, 51, 53, 55, 57, 63, 73) are a plurality of switches (51, 53, 55, 57). Each of the plurality of switches is associated with a plurality of changing colors, and outputs a signal identifying the switch operated by the user among the plurality of switches as a detection result. A control unit (31) determines whether or not there is an acknowledgment signal based on the color corresponding to the switch operated by the user and the color of the lamp.
A sixteenth aspect is a thermal appliance (1) according to the ninth aspect. In the sixteenth aspect, each of the one or more sensors (52, 51, 53, 55, 57, 63, 73) is a proximity sensor (63). The presentation units (23, 24, 25, 61) are display devices (23, 24, 25). The computing unit (102) of the control device (100) causes the display device to display an image instructing the user to approach the proximity sensor with the hand as a visual stimulus, and within a predetermined time after the display of the image, the proximity sensor is positioned close to the object. The presence or absence of an acknowledgment signal is determined based on whether or not proximity is detected.
A seventeenth aspect is a thermal appliance (1) according to the ninth aspect. In the seventeenth aspect, each of the one or more sensors (52, 51, 53, 55, 57, 63, 73) is a gesture sensor (73). The presentation units (23, 24, 25, 61) are display devices (23, 24, 25). The computing unit (102) of the control device (100) causes the display device to display an image instructing the gesture sensor to perform a predetermined movement as a visual stimulus, and the gesture sensor is activated within a predetermined time after the display of the image. determines the presence or absence of an acknowledgment signal based on whether the has detected a predetermined motion.
An eighteenth aspect is a thermal appliance (1) according to any of the seventh to seventeenth aspects. In an eighteenth aspect, the one or more heating units (7, 8, 9) is a plurality of heating units. When the arithmetic unit (102) of the control device (100) controls the operation of any one of the plurality of heating units, the input interface (106) includes a microphone (50) and one or more sensors (52, 51, 53, 55, 57, 63, 73) are received as input signals.
A nineteenth aspect is a thermal appliance (1) according to any eighth aspect. In the nineteenth aspect, if the arithmetic unit (102) of the control device (100) does not receive the second input signal via the input interface (106) within a predetermined time after transmitting the first control signal, , clears the operation word and voice command, and shifts to the sleep state.
A twentieth aspect is a computer program (112) executed by a computer of a control device (100) for controlling a voice interface for operating a thermal appliance (1) by voice. In a twentieth aspect, the control device comprises an input interface (106) for receiving an input signal from the outside, and one of a plurality of operation words prepared in advance as a voice signal when the input signal is a voice signal. It comprises an arithmetic unit (102), which is a computer, for determining whether or not one is represented, and an output interface (108) for outputting a control signal to the outside. A computer program (112) causes an arithmetic unit (102) to receive a voice signal as a first input signal from an input interface, and determines that the voice signal represents a predetermined operation word among a plurality of operation words. a process of outputting a first control signal requesting execution confirmation of a voice command corresponding to a predetermined operation word via an output interface; and receiving a second input signal via an input interface after transmitting the first control signal. and, if the second input signal is determined to be an acknowledgment signal confirming execution of the voice command, a process of outputting a second control signal instructing execution of the voice command via the output interface. .
本開示の例示的な制御装置は、加熱調理器を音声コマンドで操作する用途に適用可能である。
The exemplary control device of the present disclosure is applicable to applications in which a heating cooker is operated using voice commands.
1 加熱調理器
3 本体
5 トッププレート
7、8、9 加熱コイル
11、12、13 マーカ
15、16、17 発光部
18 温度センサ
19、20、21 操作入力部
22 電源スイッチ
23、24、25 表示部
27 スピーカ
31 制御部
33 記憶部
50 マイク
52 センサ
100 制御装置
102 演算部
104 記憶部
106 入力インタフェース(入力I/F)
108 出力インタフェース(出力I/F)
150 サーバ装置
160 通信ネットワーク 1 heating cooker 3main body 5 top plate 7, 8, 9 heating coil 11, 12, 13 marker 15, 16, 17 light emitting unit 18 temperature sensor 19, 20, 21 operation input unit 22 power switch 23, 24, 25 display unit 27 speaker 31 control unit 33 storage unit 50 microphone 52 sensor 100 control device 102 calculation unit 104 storage unit 106 input interface (input I/F)
108 output interface (output I/F)
150server device 160 communication network
3 本体
5 トッププレート
7、8、9 加熱コイル
11、12、13 マーカ
15、16、17 発光部
18 温度センサ
19、20、21 操作入力部
22 電源スイッチ
23、24、25 表示部
27 スピーカ
31 制御部
33 記憶部
50 マイク
52 センサ
100 制御装置
102 演算部
104 記憶部
106 入力インタフェース(入力I/F)
108 出力インタフェース(出力I/F)
150 サーバ装置
160 通信ネットワーク 1 heating cooker 3
108 output interface (output I/F)
150
Claims (20)
- 熱機器を音声で操作するための音声インタフェースを制御する制御装置であって、
外部から入力信号を受け取る入力インタフェースと、
前記入力信号が音声信号である場合に、前記音声信号が予め用意された複数の操作ワードのうちのいずれか1つを表しているか否かを判定する演算部と、
外部に制御信号を出力する出力インタフェースと、
を備え、
前記演算部は、
前記入力インタフェースから第1入力信号として音声信号を受け取り、
前記音声信号が前記複数の操作ワードのうちの所定の操作ワードを表していると判定すると、前記所定の操作ワードに対応する音声コマンドの実行確認を要求する第1制御信号を、前記出力インタフェースを介して出力し、
前記第1制御信号の送信後に前記入力インタフェースを介して第2入力信号を受け取り、
前記第2入力信号が前記音声コマンドの実行を確認する確認応答信号であると判定すると、前記音声コマンドの実行を指示する第2制御信号を、前記出力インタフェースを介して出力する、
制御装置。 A control device for controlling a voice interface for operating a thermal appliance by voice,
an input interface that receives an input signal from the outside;
a computing unit for determining, when the input signal is a voice signal, whether the voice signal represents one of a plurality of operation words prepared in advance;
an output interface that outputs a control signal to the outside;
with
The calculation unit is
receiving an audio signal as a first input signal from the input interface;
When it is determined that the voice signal represents a predetermined operation word among the plurality of operation words, a first control signal requesting confirmation of execution of the voice command corresponding to the predetermined operation word is transmitted through the output interface. and output via
receiving a second input signal via the input interface after transmitting the first control signal;
outputting a second control signal instructing execution of the voice command through the output interface when determining that the second input signal is an acknowledgment signal confirming execution of the voice command;
Control device. - 前記演算部は、前記第2入力信号が操作ワードの再入力を要求するリトライ要求信号であると判定すると、前記第2制御信号を出力せず、前記操作ワードの入力を待ち受ける待ち受け状態へ移行する、請求項1に記載の制御装置。 When the operation unit determines that the second input signal is a retry request signal requesting re-input of the operation word, the operation unit does not output the second control signal and shifts to a standby state in which input of the operation word is awaited. A control device according to claim 1.
- 前記演算部は、前記第2入力信号が、前記確認応答信号及び前記リトライ要求信号のいずれとも異なると判定すると、前記第2制御信号を出力しない、請求項2に記載の制御装置。 3. The control device according to claim 2, wherein the calculation unit does not output the second control signal when it determines that the second input signal is different from both the acknowledgment signal and the retry request signal.
- 前記演算部は、
前記第1制御信号の送信後、所定時間内に、前記入力インタフェースを介して前記第2入力信号を受け取った場合は、前記第2入力信号が前記音声コマンドの実行を確認する確認応答信号であると判定し、
前記第1制御信号の送信後、前記所定時間内に、前記入力インタフェースを介して前記第2入力信号を受け取らなかった場合は、新たな第1入力信号の入力を待ち受ける待ち受け状態へ移行する、請求項1から3のいずれかに記載の制御装置。 The calculation unit is
If the second input signal is received through the input interface within a predetermined time after transmitting the first control signal, the second input signal is an acknowledgment signal confirming execution of the voice command. determined to be
If the second input signal is not received via the input interface within the predetermined time after the transmission of the first control signal, the device shifts to a standby state for waiting for input of a new first input signal. Item 4. The control device according to any one of Items 1 to 3. - 前記所定の操作ワードは、前記熱機器の火力を調節するための音声コマンドに対応付けられている、請求項1に記載の制御装置。 The control device according to claim 1, wherein said predetermined operation word is associated with a voice command for adjusting the thermal power of said thermal equipment.
- 前記複数の操作ワードの各々と複数の音声コマンドの各々とを対応付けたデータファイルを記憶する記憶部をさらに備えた、請求項1から5のいずれかに記載の制御装置。 The control device according to any one of claims 1 to 5, further comprising a storage unit that stores a data file that associates each of the plurality of operation words with each of the plurality of voice commands.
- 請求項6に記載の制御装置と、
熱を発生させる1以上の加熱部と、
前記加熱部の火力を制御する制御部と、
マイクと、
ユーザの操作および/または動作を検出する1または複数のセンサと
を有する熱機器であって、
前記制御装置の前記入力インタフェースは、前記マイク及び前記1または複数のセンサの各出力信号を前記入力信号として受け取り、
前記制御装置の前記出力インタフェースは前記制御信号を前記制御部に出力し、
前記制御部は前記制御信号に応じて前記1以上の加熱部の動作を制御する、
熱機器。 a control device according to claim 6;
one or more heating elements that generate heat;
a control unit that controls the heating power of the heating unit;
with a microphone
1. A thermal appliance, comprising: one or more sensors for detecting user manipulation and/or motion;
the input interface of the control device receives output signals of the microphone and the one or more sensors as the input signals;
the output interface of the control device outputs the control signal to the control unit;
the control unit controls the operation of the one or more heating units according to the control signal;
heat equipment. - 前記音声インタフェースが有効化されていないスリープ状態において前記マイクに所定の起動ワードが入力されると、前記制御装置は前記操作ワードの入力を待ち受ける待ち受けモードへ移行する、請求項7に記載の熱機器。 8. The thermal equipment according to claim 7, wherein when a predetermined activation word is input to said microphone in a sleep state in which said voice interface is not activated, said control device shifts to a standby mode for waiting for input of said operation word. .
- 視覚的刺激を提示する提示部をさらに備え、
前記制御部は、前記第1制御信号の受信に応答して、前記提示部に、文字、数字、記号、図形、色および/または光を含む前記視覚的刺激を提示させて前記ユーザに前記音声コマンドの実行確認を要求し、
前記制御装置の前記演算部は、前記1または複数のセンサの検出結果、及び、提示された前記視覚的刺激に基づいて、前記確認応答信号の有無を判定する、請求項7または8に記載の熱機器。 further comprising a presentation unit that presents a visual stimulus;
The control unit, in response to receiving the first control signal, causes the presentation unit to present the visual stimulus including letters, numbers, symbols, graphics, colors and/or lights to the user, and the voice. request confirmation of command execution,
9. The calculating unit of the control device according to claim 7 or 8, based on the detection result of the one or more sensors and the presented visual stimulus, determines the presence or absence of the acknowledgment signal. heat equipment. - 前記提示部は表示装置であり、
前記制御部は、前記視覚的刺激として、前記表示装置に、文字、数字、記号、図形および/または色の1以上を含む画像を表示させ、
前記1または複数のセンサは、文字、数字、記号、図形および/または色の選択を受け付け、前記選択の結果を前記検出結果として出力する、請求項9に記載の熱機器。 The presentation unit is a display device,
The control unit causes the display device to display an image including one or more of letters, numbers, symbols, graphics and/or colors as the visual stimulus;
10. The thermal equipment according to claim 9, wherein said one or more sensors accept selection of letters, numbers, symbols, figures and/or colors, and output a result of said selection as said detection result. - 前記制御部は、前記画像に含まれる文字、数字、記号、図形および/または色をランダムに決定する、請求項10に記載の熱機器。 11. The thermal equipment according to claim 10, wherein said control unit randomly determines characters, numbers, symbols, graphics and/or colors included in said image.
- 前記1または複数のセンサは複数のスイッチであり、
前記複数のスイッチは、表示された前記画像に対応付けられたスイッチと、対応付けられていない1以上のスイッチとを含み、
前記複数のスイッチのうち、前記ユーザが操作したスイッチを特定する信号を、前記検出結果として出力し、
前記制御部は、表示された前記画像と、前記画像に対応付けられたスイッチであるか否かとに基づいて、前記確認応答信号の有無を判定する、請求項10または11に記載の熱機器。 the one or more sensors are a plurality of switches;
the plurality of switches includes a switch associated with the displayed image and one or more unassociated switches;
outputting, as the detection result, a signal specifying the switch operated by the user among the plurality of switches;
12. The thermal equipment according to claim 10, wherein the controller determines whether or not the acknowledgment signal is present based on the displayed image and whether or not the switch is associated with the image. - 複数の提示候補ワードを予め記憶した記憶装置をさらに備え、
前記制御部は、前記複数の提示候補ワードのうちの一つをランダムに選択し、前記視覚的刺激として、前記表示装置に、選択された前記提示候補ワードを表示させる、請求項10に記載の熱機器。 further comprising a storage device in which a plurality of presentation candidate words are stored in advance;
11. The method according to claim 10, wherein the control unit randomly selects one of the plurality of presentation candidate words and causes the display device to display the selected presentation candidate word as the visual stimulus. heat equipment. - 前記提示部は、複数の色のうちから選択された色で発光させることが可能なランプであり、
前記制御部は、前記視覚的刺激として、複数の色のうちからランダムに選択された1つの色で前記ランプを発光させ、
前記1または複数のセンサは、色の選択を受け付け、前記選択の結果を前記検出結果として出力する、請求項9に記載の熱機器。 The presentation unit is a lamp capable of emitting light in a color selected from among a plurality of colors,
The control unit causes the lamp to emit light in one color randomly selected from among a plurality of colors as the visual stimulus,
10. The thermal equipment according to claim 9, wherein said one or more sensors accept color selection and output a result of said selection as said detection result. - 前記1または複数のセンサは複数のスイッチであり、
前記複数のスイッチの各々は、変化する複数の色にそれぞれ対応付けられており、
前記複数のスイッチのうち、前記ユーザが操作したスイッチを特定する信号を、前記検出結果として出力し、
前記制御部は、前記ユーザが操作したスイッチに対応する色と、前記ランプを点灯させた色とに基づいて、前記確認応答信号の有無を判定する、請求項13に記載の熱機器。 the one or more sensors are a plurality of switches;
each of the plurality of switches is associated with a plurality of changing colors;
outputting, as the detection result, a signal specifying the switch operated by the user among the plurality of switches;
14. The thermal equipment according to claim 13, wherein said control unit determines presence/absence of said acknowledgment signal based on a color corresponding to a switch operated by said user and a color of lighting said lamp. - 前記1または複数のセンサの各々は近接センサであり、
前記提示部は表示装置であり、
前記制御装置の演算部は、
前記表示装置に、前記視覚的刺激として、前記近接センサに手を近づけることを指示する画像を表示させ、
前記画像の表示から所定時間以内に前記近接センサが物体の接近を検出したか否かに基づいて、前記確認応答信号の有無を判定する、請求項9に記載の熱機器。 each of the one or more sensors is a proximity sensor;
The presentation unit is a display device,
The calculation unit of the control device,
causing the display device to display, as the visual stimulus, an image instructing a hand to approach the proximity sensor;
10. The thermal equipment according to claim 9, wherein presence/absence of said acknowledgment signal is determined based on whether or not said proximity sensor detects an approach of an object within a predetermined time from display of said image. - 前記1または複数のセンサの各々はジェスチャセンサであり、
前記提示部は表示装置であり、
前記制御装置の演算部は、
前記表示装置に、前記視覚的刺激として、前記ジェスチャセンサ上で所定の運動をすることを指示する画像を表示させ、
前記画像の表示から所定時間以内に前記ジェスチャセンサが前記所定の運動を検出したか否かに基づいて、前記確認応答信号の有無を判定する、請求項9に記載の熱機器。 each of the one or more sensors is a gesture sensor;
The presentation unit is a display device,
The calculation unit of the control device,
causing the display device to display, as the visual stimulus, an image instructing the user to perform a predetermined exercise on the gesture sensor;
10. The thermal equipment according to claim 9, wherein presence or absence of said acknowledgment signal is determined based on whether or not said gesture sensor has detected said predetermined motion within a predetermined time from display of said image. - 前記1以上の加熱部は複数の加熱部であり、
前記制御装置の演算部が、前記複数の加熱部のいずれの加熱部の動作を制御する場合でも、前記入力インタフェースは、前記マイク及び前記1または複数のセンサの各出力信号を前記入力信号として受け取る、請求項7から17のいずれかに記載の熱機器。 The one or more heating units are a plurality of heating units,
The input interface receives the output signals of the microphone and the one or more sensors as the input signals even when the operation unit of the control device controls the operation of any one of the plurality of heating units. A thermal appliance according to any one of claims 7 to 17. - 前記制御装置の前記演算部は、前記第1制御信号の送信後、前記所定時間内に、前記入力インタフェースを介して前記第2入力信号を受け取らなかった場合は、前記操作ワード及び前記音声コマンドをクリアして前記スリープ状態へ移行する、請求項8に記載の制御装置。 If the calculation unit of the control device does not receive the second input signal via the input interface within the predetermined time after transmission of the first control signal, the operation word and the voice command are not received. 9. The control device according to claim 8, which clears and transitions to said sleep state.
- 熱機器を音声で操作するための音声インタフェースを制御する制御装置のコンピュータによって実行されるコンピュータプログラムであって、
前記制御装置は、
外部から入力信号を受け取る入力インタフェースと、
前記入力信号が音声信号である場合に、前記音声信号が予め用意された複数の操作ワードのうちのいずれか1つを表しているか否かを判定する、コンピュータである演算部と、
外部に制御信号を出力する出力インタフェースと、
を備え、
前記コンピュータプログラムは前記演算部に、
前記入力インタフェースから第1入力信号として音声信号を受け取らせる処理と、
前記音声信号が前記複数の操作ワードのうちの所定の操作ワードを表していると判定すると、前記所定の操作ワードに対応する音声コマンドの実行確認を要求する第1制御信号を、前記出力インタフェースを介して出力させる処理と、
前記第1制御信号の送信後に前記入力インタフェースを介して第2入力信号を受け取らせる処理と、
前記第2入力信号が前記音声コマンドの実行を確認する確認応答信号であると判定すると、前記音声コマンドの実行を指示する第2制御信号を、前記出力インタフェースを介して出力させる処理と
を実行させる、コンピュータプログラム。 A computer program executed by a computer of a controller for controlling a voice interface for voice operating a thermal appliance, comprising:
The control device is
an input interface that receives an input signal from the outside;
a computing unit, which is a computer, for determining whether or not the input signal is a voice signal, and whether or not the voice signal represents one of a plurality of operation words prepared in advance;
an output interface that outputs a control signal to the outside;
with
The computer program causes the computing unit to
causing an audio signal to be received as a first input signal from the input interface;
When it is determined that the voice signal represents a predetermined operation word among the plurality of operation words, a first control signal requesting confirmation of execution of the voice command corresponding to the predetermined operation word is transmitted through the output interface. and the process of outputting via
receiving a second input signal via the input interface after transmitting the first control signal;
When the second input signal is determined to be an acknowledgment signal confirming execution of the voice command, a process of outputting a second control signal instructing execution of the voice command via the output interface is executed. , a computer program.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202280045225.1A CN117561794A (en) | 2021-06-28 | 2022-03-23 | Control device for controlling sound interface and thermal device provided with such control device |
DE112022003293.6T DE112022003293T5 (en) | 2021-06-28 | 2022-03-23 | CONTROL DEVICE FOR CONTROLLING THE VOICE INTERFACE AND HEATING APPLIANCE EQUIPPED WITH THIS CONTROL DEVICE |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021-106919 | 2021-06-28 | ||
JP2021106919A JP2023005170A (en) | 2021-06-28 | 2021-06-28 | Control device for controlling voice interface, and thermal appliance with control device |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023276335A1 true WO2023276335A1 (en) | 2023-01-05 |
Family
ID=84692670
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2022/013619 WO2023276335A1 (en) | 2021-06-28 | 2022-03-23 | Control device for controlling voice interface and thermal appliance equipped with such control device |
Country Status (4)
Country | Link |
---|---|
JP (1) | JP2023005170A (en) |
CN (1) | CN117561794A (en) |
DE (1) | DE112022003293T5 (en) |
WO (1) | WO2023276335A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117174089A (en) * | 2023-11-01 | 2023-12-05 | 中电科新型智慧城市研究院有限公司 | Control method, control device, electronic equipment and storage medium |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2019078463A (en) * | 2017-10-25 | 2019-05-23 | 株式会社パロマ | Heating cooker |
JP2020003081A (en) * | 2018-06-25 | 2020-01-09 | 株式会社パロマ | Control device for gas cooking stove, gas cooking stove, and instruction data generation program in control device for gas cooking stove |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003108183A (en) | 2001-09-28 | 2003-04-11 | Toshiba Corp | Voice controller and heating cooker |
-
2021
- 2021-06-28 JP JP2021106919A patent/JP2023005170A/en active Pending
-
2022
- 2022-03-23 CN CN202280045225.1A patent/CN117561794A/en active Pending
- 2022-03-23 DE DE112022003293.6T patent/DE112022003293T5/en active Pending
- 2022-03-23 WO PCT/JP2022/013619 patent/WO2023276335A1/en active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2019078463A (en) * | 2017-10-25 | 2019-05-23 | 株式会社パロマ | Heating cooker |
JP2020003081A (en) * | 2018-06-25 | 2020-01-09 | 株式会社パロマ | Control device for gas cooking stove, gas cooking stove, and instruction data generation program in control device for gas cooking stove |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117174089A (en) * | 2023-11-01 | 2023-12-05 | 中电科新型智慧城市研究院有限公司 | Control method, control device, electronic equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
DE112022003293T5 (en) | 2024-05-02 |
JP2023005170A (en) | 2023-01-18 |
CN117561794A (en) | 2024-02-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10504384B1 (en) | Augmented reality user engagement system | |
US11212882B2 (en) | Information processing apparatus and information processing method for presentation of a cooking situation based on emotion of a user | |
WO2023276335A1 (en) | Control device for controlling voice interface and thermal appliance equipped with such control device | |
WO2015045706A1 (en) | Cooking assistance device, cooking assistance method, and cooking assistance system | |
US10718526B2 (en) | Cooktop burner illumination | |
CN109154656B (en) | Gesture-supported audio device with visual feedback | |
CN106817822B (en) | Illumination control device, illumination system, and illumination control method | |
JP2017073256A (en) | Illumination control device and illumination system | |
CN102135286A (en) | Microwave oven and control method thereof | |
JP4542725B2 (en) | Operation panel for cooking equipment | |
WO2022181039A1 (en) | Method for starting speech interface, computer program, and control device | |
WO2022180885A1 (en) | Controller and heating cooker having said controller | |
KR102110944B1 (en) | Touch Input Method and Appratus of Touch panel using Jog and Shuttle GUI | |
CN207034731U (en) | Lighting device | |
JP2020071905A (en) | Cooking system and lighting fixture | |
JP2006078079A (en) | Cooking device and program | |
JP7270168B2 (en) | Induction cooker and computer program | |
KR102110947B1 (en) | Method for Cooking Condition Setting using Touch Panel | |
JP7515356B2 (en) | Heating system and program for the heating system | |
KR102250653B1 (en) | Heating device including hood | |
JP2024042133A (en) | Heating cooker and heating cooking system | |
JP2024004642A (en) | Heating cooker and heating cooking system | |
JP2024004643A (en) | Heating cooker and heating cooking system | |
JP2024004644A (en) | Heating cooker and heating cooking system | |
JP2024004641A (en) | Heating cooker and heating cooking system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22832498 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202280045225.1 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 112022003293 Country of ref document: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22832498 Country of ref document: EP Kind code of ref document: A1 |