WO2021065558A1 - Dispositif de traitement d'informations, procédé de traitement d'informations, appareil électrique, et procédé de traitement d'appareil électrique - Google Patents

Dispositif de traitement d'informations, procédé de traitement d'informations, appareil électrique, et procédé de traitement d'appareil électrique Download PDF

Info

Publication number
WO2021065558A1
WO2021065558A1 PCT/JP2020/035398 JP2020035398W WO2021065558A1 WO 2021065558 A1 WO2021065558 A1 WO 2021065558A1 JP 2020035398 W JP2020035398 W JP 2020035398W WO 2021065558 A1 WO2021065558 A1 WO 2021065558A1
Authority
WO
WIPO (PCT)
Prior art keywords
response
signal
trigger signal
electric device
output
Prior art date
Application number
PCT/JP2020/035398
Other languages
English (en)
Japanese (ja)
Inventor
健太郎 井田
保乃花 尾崎
将吾 川田
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Publication of WO2021065558A1 publication Critical patent/WO2021065558A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers

Definitions

  • the present technology relates to an information processing device and an information processing method, and an electric device and a processing method of the electric device. In addition, it relates to an electric device and a processing method of the electric device.
  • Patent Document 1 a feature amount is calculated from a measured value of a sensor arranged in the vicinity of a home appliance (household electric appliance), and the feature amount when the home appliance is in a predetermined state and the state of the home appliance are described.
  • a technique for estimating the state of home appliances from the features by learning the correspondence is described.
  • This technology was made in view of such a situation, and makes it easy to register electrical equipment.
  • the information processing device of the present technology includes a setting unit that sets a place where an electric device is installed, an output unit that outputs a trigger signal that is a trigger for the electric device to make a response, the place, and the trigger. It is an information processing device including a registration unit that registers in association with the electric device that has responded to a signal.
  • the information processing method of the present technology is to set a place where an electric device is installed, output a trigger signal which is a trigger for the electric device to make a response, and to the place and the trigger signal. It is an information processing method including registering in association with the electric device that has made a response.
  • the place where the electric device is installed is set, and a trigger signal which is a trigger for the electric device to make a response is output. Then, the location and the electric device that has responded to the trigger signal are associated and registered.
  • the first electric device of the present technology includes a detection unit that detects a trigger signal that is a trigger for performing a response from an information processing device, and a change trigger that is different from the trigger signal in response to the detection of the trigger signal. It is an electric device that includes an output unit that outputs a signal and outputs a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal in response to detection of the trigger signal.
  • the first processing method of the electric device of the present technology is different from the trigger signal depending on the detection of the trigger signal which is the trigger for performing the response from the information processing apparatus and the detection of the trigger signal.
  • An electric device including outputting a change trigger signal and outputting a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal in response to detection of the trigger signal. It is a processing method of.
  • a trigger signal which is a trigger for performing a response
  • a change trigger different from the trigger signal is detected in response to the detection of the trigger signal.
  • a signal is output.
  • a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal is output.
  • the second electric device of the present technology detects a change trigger signal different from the trigger signal output by another electric device that has detected a trigger signal that is a trigger for performing a response from the information processing device.
  • a unit and an output unit that outputs another change trigger signal in response to the detection of the change trigger signal, and a response signal that is a response to the trigger signal in response to the detection of the change trigger signal, or the said It is an electric device that outputs a response request signal that requests a response by a response signal.
  • the second processing method of the electric device of the present technology is to output a change trigger signal different from the trigger signal output by another electric device that has detected a trigger signal that is a trigger for performing a response from the information processing device.
  • the response signal which is a response to the trigger signal, or the response, depending on the detection, the output of another change trigger signal in response to the detection of the change trigger signal, and the detection of the change trigger signal. It is a processing method of an electric device including outputting a response request signal for requesting a response by a signal.
  • a change trigger signal different from the trigger signal output by another electric device that has detected a trigger signal that is a trigger for performing a response from the information processing device Is detected, and another change trigger signal is output in response to the detection of the change trigger signal. Then, in response to the detection of the change trigger signal, a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal is output.
  • the information processing device, the first electric device, and the second electric device can be realized by causing a computer to execute a program.
  • the program can be provided by transmitting via a transmission medium or by recording on a recording medium.
  • the first registration method of detecting an electric device (non-compatible device) to which this technology is applied by the electric device (compatible device) 12 to which this technology is applied and registering it in the profile list of the control device 11 will be described. It is a figure. It is a figure explaining the 2nd registration method which detects a non-corresponding device by a corresponding device 12, and registers it in the profile list of a control device 11. It is a block diagram which shows the structural example of one Embodiment of the computer to which this technique is applied.
  • FIG. 1 is a diagram showing a configuration example of an embodiment of an electric device control system to which the present technology is applied.
  • DLNA registered trademark
  • AV AudioVisual
  • the existence of the electric device to be controlled and the place where the existing electric device is installed are recognized, and the electric device is installed. It is necessary to register it in association with the location.
  • the user intends to turn on the power of the TV in the living room in the living room.
  • the user intends to turn on the power of the TV in the living room in the living room.
  • it is necessary to register the TV in the living room in association with the living room where the TV is installed. ..
  • the electrical device control system 10 of FIG. 1 automatically recognizes electrical devices installed in each indoor room by cooperating with a mobile terminal such as a smartphone, for example.
  • the electric device control system 10 automatically detects white goods, black goods, and other electric devices installed in each place (room), for example, using a smartphone as a host.
  • the smartphone generates and outputs, for example, a sound as a trigger signal that becomes a trigger for the electric device to respond.
  • the smartphone asks the user who owns the smartphone to move to the place where the electric device to be registered is installed, and outputs a sound as a trigger signal at that place.
  • An electric device detects a sound as a trigger signal by an input device (sensor) of the electric device, and changes another trigger signal different from the trigger signal according to the detection. Output from the output device that has. As a result, the electric device outputs a change trigger signal like a billiard in response to the detection of the trigger signal.
  • the change trigger signal is a signal in which the data format, data content, communication method, modal, etc. are changed from the original trigger signal so that a device that cannot receive the original trigger signal can receive and detect it.
  • the change trigger signal may be a signal having the same modal as the sound as the trigger signal, that is, a sound, or another modal signal having a different modal, for example, light or the like.
  • the change trigger signal reaches the electric device at a position relatively far from the smartphone where the trigger signal output by the smartphone does not reach, and it is possible to detect such an electric device. Become.
  • the change of another modal signal whose modal is different from that of the sound as a trigger signal According to the trigger signal, there is no input device that accepts (senses) the input of the sound as a trigger signal, but the input accepts the input of another modal signal. It becomes possible to detect a change trigger signal in an electric device having a device.
  • the electric device that has detected the trigger signal or the change trigger signal returns a response to the trigger signal to the smartphone.
  • the place where the trigger signal is output and the electric device that responded to the trigger signal are registered in association with each other.
  • the electric device that outputs the trigger signal from the smartphone at the predetermined place and responds to the trigger signal is designated as the electric device installed at the predetermined place. It is registered in association with the location of.
  • the electric device control system 10 includes a control device 11 and electric devices 12-1 to 12-5 as a plurality of electric devices.
  • the control device 11 is, for example, a smartphone, and registers the electric device and the place where the electric device is installed in association with each other, and remotely controls the electric device or the like by using the registered contents.
  • Electrical devices 12-1 to 12-5 are, for example, electrical devices installed in the kitchen.
  • the electric device 12-1 is a refrigerator
  • the electric device 12-2 is a microwave oven
  • the electric device 12-3 is a gas stove
  • the electric device 12-4 is a ventilation fan
  • the electric device 12 -5 is an electric kettle.
  • the electric devices 12-1 to 12-5 are also described as the electric devices A to E, respectively. Further, the electric devices 12-1 to 12-5 are collectively referred to as the electric device 12.
  • the electric device 12 has an input device and an output device as needed, in addition to its original function.
  • An input device is a device that accepts an input of a physical quantity, for example, a sensor that senses a physical quantity.
  • Input devices include, for example, various sensors such as a microphone (microphone) that senses sound, a camera that senses light, a motion sensor that senses a person, an odor sensor that senses odor, and a temperature sensor that senses temperature. is there.
  • An output device is a device that outputs a physical quantity that an input device can accept input.
  • Output devices include speakers that output sound, light emitting devices such as LEDs (light emission diodes) that output light, and actuators that move objects.
  • the electric device 12 has a necessary input device and an output device, and also has a function of performing control device communication as needed.
  • the control device communication is wireless communication (may include wired communication in part) by a predetermined communication method that can be performed by the control device 11.
  • the electric device 12 having a function of performing control device communication can perform communication (control device communication) with the control device 11.
  • the communication interface that performs communication by the predetermined communication method that can be performed by the control device 11 and the communication interface that performs communication other than the communication by the predetermined communication method are radio waves that serve as a medium in the communication. It is a device that accepts the input of the above, and is a device that outputs the radio wave, and is included in the input device and the output device from such a viewpoint.
  • the electric device 12-1 which is a refrigerator has a function of performing control device communication (control device communication function). Further, the electric device 12-1 has a camera, a microphone, and a motion sensor as input devices, and has a speaker and a light emitting device as output devices.
  • the electric device 12-2 which is a microwave oven, has a control device communication function. Further, the electrical device 12-2 has a microphone as an input device and a speaker as an output device.
  • the electric device 12-4 which is a ventilation fan, has a control device communication function. Further, the electrical device 12-4 has a camera and a temperature sensor as an input device, and a speaker as an output device.
  • the electric device 12-5 which is an electric kettle, has neither a control device communication function, an input device, nor an output device.
  • the present technology can be applied to at least an electric device 12 having an input device and an output device among the input device, the output device, and the control device communication function.
  • this technology is applied to at least an electric device 12 having an input device and an output device, and the electric device 12 to which this technology is applied is also referred to as a compatible device. Further, the electric device 12 to which the present technology is not applied is also referred to as a non-compliant device.
  • the electric devices 12-1 to 12-4 are compatible devices because they have an input device and an output device
  • the electric devices 12-5 are non-compatible devices because they do not have an input device and an output device. is there.
  • the control device 11 displays a predetermined display screen.
  • FIG. 2 is a diagram showing an example of a display screen of the control device 11.
  • control device 11 the control device 11 is brought to a place where the electric device to be registered is located, and the message "Take the smartphone to the place to be registered and touch the screen” prompting the user to touch the screen at that place. Please do “is displayed.
  • control device 11 displays a selection menu for selecting a location.
  • the control device 11 sets the location selected from the selection menu (here, the kitchen) to the registration location where the electrical equipment to be registered is installed.
  • the user moves to the kitchen with the control device 11 according to the message displayed on the display screen.
  • the order of selecting the kitchen from the selection menu and moving to the kitchen with the control device 11 is not particularly limited.
  • the user touches the screen of the control device 11 after selecting the kitchen from the selection menu and moving to the kitchen with the control device 11.
  • FIG. 3 is a diagram illustrating an example of registration processing performed by the electric device control system 10.
  • the control device 11 outputs, for example, a specific sound (for example, a sound such as "pawn") as a trigger signal that becomes a trigger for the electric device to respond in response to the user touching the screen.
  • a specific sound for example, a sound such as "pawn”
  • the control device 11 receives a response signal as a response to the trigger signal by the control device communication, and registers the kitchen as the registration place and the electric device in association with each other according to the response signal.
  • the sound as a trigger signal is detected by the electric device 12-1 (A) having a microphone as an input device capable of sensing the sound and the electric device 12-2 (B).
  • the electrical device 12-1 that has detected the sound as a trigger signal performs necessary internal processing in response to the detection of the sound as a trigger signal, and outputs a change trigger signal as another trigger signal.
  • the electric device 12-1 Since the electric device 12-1 has a speaker and a light emitting device as output devices, it outputs a modal change trigger signal that can be output from each of the speaker and the light emitting device, that is, sound and light as the change trigger signal.
  • the response signal to the trigger signal is transmitted by the control device communication in response to the detection of the sound as the trigger signal.
  • the control device 11 receives the response signal transmitted from the electric device 12-1 by the control device communication, and associates the electric device 12-1 (A) with the kitchen, which is the registration place, according to the response signal. And register.
  • the response signal includes device information (for example, "refrigerator”) indicating an electric device to be registered in association with the registration location, and the control device 11 associates the device information with the registration location. Recognize the electrical equipment to register.
  • device information for example, "refrigerator”
  • the electric device 12-2 that detects the sound as a trigger signal also performs the same processing as that of the electric device 12-1.
  • the electric device 12-2 (B) performs necessary internal processing in response to the detection of the sound as the trigger signal, and outputs the change trigger signal as another trigger signal.
  • the electric device 12-2 Since the electric device 12-2 has a speaker as an output device, it outputs a modal change trigger signal that can be output from the speaker, that is, a sound as a change trigger signal.
  • the response signal to the trigger signal is transmitted by the control device communication in response to the detection of the sound as the trigger signal.
  • the control device 11 receives the response signal transmitted from the electric device 12-2 by the control device communication, and associates the electric device 12-2 (B) with the kitchen, which is the registration place, according to the response signal. And register.
  • the electric devices 12-3 to 12-5 that do not have a microphone capable of sensing sound include sound as a trigger signal output by the control device 11, and the electric devices 12-1 and 12-2. Cannot detect the sound as the change trigger signal output by.
  • the electrical devices 12-3 and 12-4 have a camera capable of sensing light as an input device.
  • the light as the change trigger signal output by the electric device 12-1 can be detected.
  • the electric device 12-4 (D) having the control device communication function responds to the detection of the change trigger signal and has a trigger signal (change trigger) corresponding to the change trigger signal.
  • the response signal to the trigger signal that is the source of the signal) is transmitted by the control device communication.
  • the electric device 12-4 (second electric device) having the control device communication function receives light as a change trigger signal output by the electric device 12-1 (first electric device) in response to the detection of the trigger signal. In response to the detection of, the response signal is transmitted by the control device communication.
  • the control device 11 receives the response signal transmitted from the electric device 12-4 by the control device communication, and associates the electric device 12-4 (D) with the kitchen, which is the registration place, according to the response signal. And register.
  • the electric device 12-3 (C) that has detected the change trigger signal does not have the control device communication function, even if the change trigger signal is detected, the response signal cannot be transmitted by the control device communication.
  • the electric device 12-3 outputs a response request signal for requesting the response of the response signal from the output device of itself (electrical device 12-3) to the electric device having the control device communication function.
  • the electric device 12-3 Since the electric device 12-3 has a speaker and a light emitting device as an output device, a response request signal is output from one or more of the speaker and the light emitting device. For example, the electric device 12-3 outputs light as a response request signal from the light emitting device.
  • the response request signal can include device information of an electric device (electric device 12-3 in FIG. 3) that requests a response of the response signal by the response request signal.
  • the light as the response request signal output from the electric device 12-3 (C) is detected by the electric devices 12-1 and 12-4 having a camera capable of sensing the light.
  • the electric device 12-1 having the control device communication function is the light as the response request signal.
  • the response signal including the device information of the electric device 12-3 (C) included in the response request signal is transmitted by the control device communication.
  • the electric device 12-3 detects light as a change trigger signal from the electric device 12-1. In response to the detection of light as the response request signal output in response to the above, the response signal of the electric device 12-3 is transmitted by the control device communication.
  • the control device 11 receives the response signal of the electric device 12-3 (C) transmitted from the electric device 12-1 by the control device communication, and the response signal includes the device information according to the response signal.
  • the electric device 12-3 (C) is registered in association with the kitchen, which is the registration place.
  • the electric device can be easily registered. That is, the user simply takes the control device 11 to a place where the electric device to be registered is installed, selects the place from the selection menu, and touches the screen of the control device 11 to select the control device 11. The location selected from the menu and the electrical equipment installed at that location can be registered in association with each other.
  • the electrical devices that can be registered in the registration process shown in FIG. 3 are only compatible devices, and non-compatible devices cannot be registered. That is, for example, in the registration process, the corresponding devices 12-1 to 12-4 can be registered, but the non-compatible electric devices 12-5 cannot be registered. Registration of non-compatible devices is performed manually by the user or by a method described later.
  • FIG. 4 is a block diagram showing a configuration example of the control device 11 of FIG.
  • control device 11 includes an input unit 21, an output unit 22, a storage unit 23, a trigger generation unit 24, a control unit 25, a network unit 26, and an I / F (interface) unit 27.
  • the input unit 21 is operated by the user and supplies an operation signal corresponding to the operation to the control unit 25 via the I / F unit 27.
  • the input unit 21 has a touch panel 31 and a button 32, and supplies an operation signal corresponding to the operation of the touch panel 31 and the button 32 (for the user) to the control unit 25 via the I / F unit 27. ..
  • the output unit 22 outputs a predetermined physical quantity according to the trigger signal supplied from the trigger generation unit 24 via the I / F unit 27 and the control of the control unit 25.
  • the output unit 22 has a display 41 and a speaker 42.
  • the display 41 displays an image by outputting light according to the control of the control unit 25.
  • the speaker 42 outputs a sound as a trigger signal supplied from the trigger generation unit 24 and a sound according to the control of the control unit 25.
  • the storage unit 23 stores various data.
  • the storage unit 23 stores a profile list or the like registered in association with the electric device 12 supplied from the control unit 25 (profile control unit 51 of the control unit 25) and the place where the electric device 12 is installed. To do.
  • the trigger generation unit 24 functions as a generation unit that generates a trigger signal that serves as a trigger for the electric device 12 to respond.
  • the trigger generation unit 24 generates a trigger signal according to the control of the control unit 25, and supplies the trigger signal to the output unit 22 via the I / F unit 27.
  • the control unit 25 controls the blocks constituting the control device 11 and performs various other processes.
  • control unit 25 refers to the profile list stored in the storage unit 23, and networks the control signals for controlling the electric devices 12 set at each location according to the operation signals supplied from the input unit 21. Send to unit 26. Further, for example, the control unit 25 controls the output unit 22 to display an image or output a sound.
  • control unit 25 controls the trigger generation unit 24 according to the operation signal supplied from the input unit 21 to generate the trigger signal. Further, for example, the control unit 25 functions as a setting unit for setting a place (registration place) to be registered in the profile list according to an operation signal supplied from the input unit 21. Further, for example, the control unit 25 has a profile control unit 51.
  • the profile control unit 51 associates the electrical device 12 that has responded to the trigger signal in response to the response signal supplied from the network unit 26 with the location (registration location) set by the control unit 25, and stores the storage unit 51. It functions as a registration unit to be registered in the profile list stored in 23.
  • the network unit 26 performs control device communication by a predetermined communication method. For example, the network unit 26 transmits a control signal by control device communication in response to the control of the control unit 25. Further, for example, the network unit 26 receives the response signal transmitted from the electric device 12 capable of communicating with the control device and supplies the response signal to the control unit 25 (profile control unit 51).
  • wireless LAN via an access point for example, wireless LAN via an access point, mobile communication such as 4G, and TCP / IP communication via the Internet are adopted as control device communication.
  • mobile communication such as 4G
  • TCP / IP communication via the Internet
  • the I / F unit 27 is an interface for inputting / outputting signals (data) to the input unit 21, the output unit 22, the trigger generation unit 24, and the control unit 25.
  • FIG. 5 is a block diagram showing a configuration example of the electrical device 12 of FIG.
  • FIG. 5 shows a configuration example of the electric device 12 as a corresponding device.
  • the electrical device 12 includes an input unit 61, an output unit 62, a storage unit 63, a trigger detection unit 64, a trigger generation unit 65, a control unit 66, a network unit 67, and an I / F unit 68.
  • the input unit 61 has one (type) or more input devices that accept input of physical quantities.
  • the input unit 61 has a microphone 71, a camera 72, and a temperature sensor 73 as input devices.
  • the microphone 71 receives (senses) sound as vibration of air and outputs sound as an electric signal.
  • the camera 72 receives (sensing) light, performs photoelectric conversion, and outputs an image as an electric signal.
  • the temperature sensor 73 receives (senses) a temperature and outputs an electric signal corresponding to the temperature.
  • the electric signal output by the input device included in the input unit 61 is also referred to as sensor data.
  • the sensor data output by the microphone 71, the camera 72, and the temperature sensor 73 as input devices included in the input unit 61 is supplied to the trigger detection unit 64 via the I / F unit 68.
  • the output unit 62 has one or more output devices that output physical quantities.
  • the output unit 62 has a speaker 81, an LED 82, and a display 83 as output devices.
  • the speaker 81 outputs sound.
  • the speaker 81 outputs a sound as the change trigger signal or the response request signal in response to the change trigger signal or the response request signal supplied from the trigger generation unit 65 via the I / F unit 68.
  • LED82 outputs (emits) light.
  • the LED 82 outputs light as the change trigger signal or the response request signal in response to the change trigger signal or the response request signal supplied from the trigger generation unit 65 via the I / F unit 68.
  • the display 83 outputs light as an image (displays an image). For example, the display 83 outputs light as the change trigger signal or the response request signal in response to the change trigger signal or the response request signal supplied from the trigger generation unit 65 via the I / F unit 68.
  • the storage unit 63 stores various data.
  • the storage unit 63 stores the device information of the electric device 12, the input device and the output device of the electric device 12, and the profile of the electric device 12 which is other information related to the electric device 12.
  • the trigger detection unit 64 detects a trigger signal, a change trigger signal, and a response request signal from the sensor data supplied from the input unit 61 via the I / F unit 68, and the trigger signal, the change trigger signal, and the response request.
  • the sensor data detected as a signal is supplied to the control unit 66.
  • the trigger generation unit 65 generates a change trigger signal and a response request signal according to the control of the control unit 66, and supplies the change trigger signal and the response request signal to the output unit 62 via the I / F unit 68.
  • the control unit 66 controls the blocks constituting the electric device 12 and performs various other processes.
  • the control unit 66 includes a trigger analysis unit 91, a profile control unit 92, and a sensor data analysis unit 93.
  • the trigger analysis unit 91 analyzes the sensor data from the trigger detection unit 64 and recognizes whether the sensor data is a trigger signal, a change trigger signal, or a response request signal.
  • the control unit 66 controls the trigger generation unit 65 to generate a change trigger signal or a response request signal, if necessary. Therefore, in the electric device 12, the change trigger signal and the response request signal are generated and output in response to the detection of the trigger signal or the change trigger signal.
  • the control unit 66 when the sensor data from the trigger detection unit 64 is a trigger signal or a change trigger signal, the control unit 66 generates a response signal as necessary and causes the network unit 67 to transmit it. Therefore, the electrical device 12 generates and transmits a response signal in response to the detection of the trigger signal or the change trigger signal.
  • the control unit 66 When the sensor data from the trigger detection unit 64 is a response request signal, the control unit 66 generates a response signal of another electric device 12 that has requested a response of the response signal by the response request signal, if necessary. Then, it is transmitted to the network unit 67. Therefore, in the electric device 12, the response signal of the other electric device 12 is generated and transmitted in response to the detection of the response request signal from the other electric device 12.
  • the profile control unit 92 controls reading and writing of the profile to the storage unit 63.
  • the control unit 66 uses the device information and the like of the electric device 12 included in the profile read from the storage unit 63 by the profile control unit 92 to generate a response signal including the device information and the like.
  • the sensor data analysis unit 93 analyzes the sensor data output by the input unit 61, if necessary.
  • the network unit 67 communicates with the control device. For example, the network unit 67 transmits a response signal by control device communication in response to the control of the control unit 66. Further, for example, the network unit 67 receives the control signal transmitted from the control device 11 and supplies the control signal to the control unit 66. The control unit 66 controls the electric device 12 in response to a control signal from the network unit 67.
  • the network unit 67 can perform communication other than control device communication.
  • the electric device 12 cannot communicate with the control device 11 (by radio waves) unless it communicates with the control device.
  • the I / F unit 68 is an interface for inputting / outputting signals (data) to the input unit 61, the output unit 62, the trigger detection unit 64, the trigger generation unit 65, and the control unit 66.
  • the electrical device 12 as a corresponding device has an input unit 61 having one or more input devices and an output unit 62 having one or more output devices. However, it is not essential that the electric device 12 as a corresponding device has a control device communication function. Therefore, in the electric device 12 as a corresponding device, the network unit 67 is not provided, or even if the network unit 67 is provided, the network unit 67 can only perform communication other than the control device communication. is there.
  • FIG. 6 is a diagram illustrating communication between the control device 11 and the electric device 12.
  • control device 11 controls communication via an access point (mobile communication such as wireless LAN and 4G) as control device communication and TCP / IP communication via the Internet. It is used for device communication.
  • an access point mobile communication such as wireless LAN and 4G
  • control device communication TCP / IP communication via the Internet. It is used for device communication.
  • the electric device 12 on which the control device communication function is mounted can perform control device communication with the control device 11.
  • the electric device 12 on which the communication function of the control device communication is not implemented cannot perform the control device communication with the control device 11.
  • FIG. 7 is a flowchart illustrating an example of processing of the control device 11.
  • the process according to the flowchart of FIG. 7 is started by, for example, the user setting the control device 11 in the device registration mode for registering the electric device 12.
  • step S111 the control device 11 displays, for example, a message prompting the user to touch the screen and a selection menu for selecting a location on the display 41 as shown in FIG. 2, and the process is performed in step S112. Proceed to.
  • step S112 the control device 11 determines whether or not the location has been selected from the selection menu by the user, and if it is determined that the location has not been selected, the process returns to step 112.
  • step S112 If it is determined in step S112 that the location has been selected, the process proceeds to step S113.
  • step S113 the control device 11 determines whether or not the screen (of the display 41) has been touched, and if it is determined that the screen has not been touched, the process returns to step S113.
  • step S113 when it is determined that the screen has been touched, that is, for example, the user selects the location "kitchen” from the selection menu, and then brings the control device 11 to the kitchen to display the screen. If touched, the process proceeds to step S114.
  • the touch of the screen is adopted as a signal to notify the control device 11 that the user has moved to the place selected from the selection menu.
  • the utterance of a predetermined phrase or the like can be adopted as a signal to notify the control device 11 that the user has moved to a place selected from the selection menu.
  • step S114 the control device 11 sets the location selected from the selection menu in the control unit 25 as the registration location for registering the electric device, and the process proceeds to step S115.
  • step S115 the control device 11 generates a trigger signal in the trigger generation unit 24, outputs a specific sound as the trigger signal from the speaker 42, and the process proceeds to step S116.
  • step S116 the control device 11 determines whether or not the network unit 26 has received the response signal to the trigger signal transmitted from the electric device 12 by the control device communication.
  • step S116 If it is determined in step S116 that the response signal has not been received, the process proceeds to step S120.
  • step S116 If it is determined in step S116 that the response signal has been received, the process proceeds to step S117, and the control device 11 displays a registration screen for registering the electric device 12 represented by the device information included in the response signal. It is displayed on 41.
  • step S117 the control device 11 determines whether or not the user has performed a registration operation for registering the electric device 12 represented by the device information included in the response signal on the registration screen. judge.
  • step S118 If it is determined in step S118 that the registration operation has been performed, the process proceeds to step S119.
  • step S119 the control device 11 associates the registration location with the electrical device 12 represented by the device information included in the response signal in the profile control unit 51, registers the registration location in the profile list stored in the storage unit 23, and processes the registration. Goes to step S120.
  • step S118 If it is determined in step S118 that the registration operation has not been performed, the process skips step S119 and proceeds to step S120.
  • the electrical device 12 represented by the device information included in the response signal is placed in the registration location.
  • the user does not perform the registration operation so that the electric device 12 that is inappropriate to be registered in association with the registration location is registered in association with the registration location. Can be prevented.
  • step S120 the control device 11 determines whether or not a predetermined time has elapsed since the trigger signal was output in step S115.
  • step S120 If it is determined in step S120 that the predetermined time has not elapsed, the process returns to step S116, and the processes after step S116 are repeated thereafter.
  • step S120 when it is determined that the predetermined time has elapsed, the control device 11 ends the process.
  • the registration location is set and the trigger signal is generated according to the touch of the screen by the user. Further, in the control device 11, the registration location is associated with the electric device 12 that has responded to the trigger signal, that is, the electric device 12 represented by the device information included in the response signal to the trigger signal, and is registered in the profile list. To.
  • the user can easily register the electric device 12 associated with the registration location by simply bringing the control device 11 to the registration location and touching the screen at the registration location.
  • the same (type) electric device 12 can be placed in a plurality of places by referring to the profile list.
  • the electrical equipment 12 at each location can be controlled individually (independently). For example, when the same TV is installed in each of the living room and the bedroom, it is possible to turn on the power of only the TV in the bedroom.
  • the sound as the trigger signal for example, a single sound (“pip”), a periodic sound (“pip pip pip”), a voice of a specific phrase (“Hi Sony”), or the like can be adopted. ..
  • the voice of the keyword for example, "OK Google", "Alexa"
  • the voice of the keyword for example, "OK Google", "Alexa”
  • the control device 11 that the user has moved to the designated place.
  • the voice agent provided by each company can detect the response voice that responds (feedback) to the keyword that triggers the start of voice recognition.
  • an electric device such as a voice agent that uses a keyword for which the response voice is responded as a trigger for starting voice recognition is located at the place where the response voice is detected. It is possible to recognize that it is installed and register the electric device in association with the place where the response voice is detected.
  • the trigger signal a physical quantity other than sound that can be output by any output device of the control device 11, that is, the display 41 in FIG. 4 It is possible to adopt the light that can be output by the device and the radio wave of the control device communication that can be output by the network unit 26.
  • FIG. 8 is a flowchart illustrating an example of processing of the electric device 12.
  • step S131 the electrical device 12 determines whether or not it has an output device capable of accepting a modal sound input of the trigger signal, that is, a microphone 71.
  • step S131 If it is determined in step S131 that the microphone 71 is possessed, the process proceeds to step S132, and the electric device 12 determines whether or not the trigger signal is detected by the trigger detection unit 64.
  • step S132 If it is determined in step S132 that the trigger signal has been detected, that is, if the sound as the trigger signal is collected (sensed) by the microphone 71 and detected by the trigger detection unit 64, the process proceeds to step S133. move on.
  • step S133 the electric device 12 generates a change trigger signal in the trigger generation unit 65, outputs (broadcasts) the change trigger signal from the output unit 62, and the process proceeds to step S134.
  • the change trigger signal is output as if billiards were performed by the trigger signal.
  • the output unit 62 can output the change trigger signal from a part or all of the output devices included in the output unit 62.
  • the output unit 62 has the speaker 81, the LED 82, and the display 83
  • the change trigger signal is output from all of the speaker 81, the LED 82, and the display 83
  • Sound as a change trigger signal is output from the speaker 81
  • light as a change trigger signal is output from the LED 82 and the display 83.
  • the electric device 12 recognizes the output device of the electric device 12 from the profile of the electric device 12 stored in the storage unit 63, and outputs a change trigger signal from the output device recognized in this way. be able to.
  • the sound change trigger signal is a modal signal that is the same as the sound trigger signal, and can reach the range where the sound trigger signal does not reach, instead of the sound trigger signal. Therefore, according to the sound change trigger signal, it is possible to prompt the response of the electric device 12 installed in the range where the sound trigger signal does not reach.
  • the light change trigger signal is another modal signal whose modal is different from that of the sound trigger signal, and does not have a microphone 71 which is an input device that accepts sound input, but a camera 72 which is an input device that accepts light input. It can be detected by the electric device 12 having the device. Therefore, according to the light change trigger signal, it is possible to prompt the response of the electric device 12 which does not have the microphone 71 but has the camera 72.
  • step S134 the electric device 12 sets the reissue prevention flag to TRUE, and the process proceeds to step S135.
  • the reissue prevention flag is set to FALSE of TRUE and FALSE before the process of FIG. 8 is started.
  • the reissue prevention flag is set to TRUE in step S134 when the change trigger signal is output in step S133 after the process of FIG. 8 is started.
  • the reissue prevention flag is set to TRUE, the output of the change trigger signal in step S133 and the generation of the change trigger signal are restricted thereafter. This makes it possible to prevent the change trigger signal from being recursively (repeatedly) output in the electrical device 12.
  • step S1335 the electric device 12 determines whether or not the control device communication is possible.
  • step S135 If it is determined in step S135 that control device communication is possible, the process proceeds to step S136.
  • step S136 the electric device 12 generates a response signal including the device information of the electric device 12 and other necessary information of the electric device 12. Further, the electric device 12 transmits the response signal of the electric device 12 to the control device 11 by causing the network unit 67 to perform the control device communication, and the process ends. In the electric device 12, the information included in the response signal is read from the profile of the electric device 12 stored in the storage unit 63.
  • step S135 If it is determined in step S135 that control device communication is not possible, the process proceeds to step S137.
  • step S137 the electric device 12 requests the other electric device 12 to respond to the trigger signal of the electric device 12 (the electric device 12 that has detected the trigger signal) in the trigger generation unit 65. To generate. Further, the electric device 12 outputs (broadcasts) a response request signal from the output unit 62, and the process ends.
  • the output unit 62 can output the response request signal from a part or all of the output devices included in the output unit 62.
  • the output unit 62 has the speaker 81, the LED 82, and the display 83, and outputs a response request signal from all of the speaker 81, the LED 82, and the display 83
  • Sound as a response request signal is output from the speaker 81
  • light as a response request signal is output from the LED 82 and the display 83.
  • the electric device 12 recognizes the output device of the electric device 12 from the profile of the electric device 12 stored in the storage unit 63, and outputs a response request signal from the output device recognized in this way. be able to.
  • the response request signal can include information similar to the response signal, that is, device information of the electric device 12 that outputs the response request signal.
  • the device 12 outputs a change trigger signal in response to the detection of the sound trigger signal from the control device 11.
  • the response signal including the device information of the electric device 12 is transmitted to the control device 11 by the control device communication.
  • a response request signal for requesting a response signal to another electric device 12 is output from the output device of the electric device 12.
  • the electric device 12 that outputs the response request signal is referred to as the request electric device 12.
  • the request electric device 12 having the control device communication function detects the response request signal output by the request electric device 12
  • the response signal of the request electric device 12 is generated by the control device communication by the electric device 12 having the control device communication function. It is transmitted to the control device 11.
  • step S132 determines whether or not the trigger signal has been detected. If it is determined in step S132 that the trigger signal has not been detected, the process proceeds to step S138, and the electrical device 12 determines whether or not the change trigger signal has been detected in the trigger detection unit 64.
  • step S138 If it is determined in step S138 that the change trigger signal has been detected, the process proceeds to step S139, and the electrical device 12 determines whether the reissue prevention flag is FALSE.
  • step S139 If it is determined in step S139 that the reissue prevention flag is FALSE, the process proceeds to step S133, and the same process as described above is performed thereafter.
  • step SS139 If it is determined in step SS139 that the reissue prevention flag is not FALSE, the process skips steps S133 and S134 and proceeds to step S135, and the same process as described above is performed below.
  • an electric device having a microphone 71 capable of receiving an input of a sound trigger signal and detecting a change trigger signal output by another electric device 12 in response to detection of the sound trigger signal output by the control device 11.
  • a change trigger signal another change trigger signal
  • the change trigger signal has already been output when the reissue prevention flag is not set to FALSE, that is, according to the detection of the past trigger signal or the change trigger signal. If so, no further change trigger signal is output.
  • the response signal including the device information of the electric device 12 is transmitted to the control device 11 by the control device communication.
  • the response request signal requesting the response of the response signal is output from the output device of the electric device 12.
  • the response signal of the request electric device 12, which is the electric device 12 that outputs the response request signal, that is, the response signal of the electric device 12 that has detected the change trigger signal is the request electric device 12 that has the control device communication function.
  • the response request signal output by is detected, it is transmitted to the control device 11 by the control device communication by the electric device 12 having the control device communication function.
  • step S138 determines whether or not the change trigger signal has been detected. If it is determined in step S138 that the change trigger signal has not been detected, the process proceeds to step S140, and the electrical device 12 determines whether or not the trigger detection unit 64 has detected the response request signal.
  • step S138 If it is determined in step S138 that the response request signal has not been detected, the process returns to step S132.
  • step S138 If it is determined in step S138 that the response request signal has been detected, the process proceeds to step S141, and the electric device 12 determines whether or not the control device communication is possible.
  • step S141 If it is determined in step S141 that control device communication is possible, the process proceeds to step S142.
  • step S142 the electric device 12 generates a response signal of the request electric device 12 that outputs the response request signal in response to the detection of the response request signal. Further, the electric device 12 transmits the response signal of the requesting electric device 12 to the control device 11 by causing the network unit 67 to perform the control device communication, and the process ends.
  • step S141 if it is determined in step S141 that the control device communication is not possible, the process ends.
  • the electric device 12 (other electric device) having the control device communication function detects the response request signal of the request electric device 12, the request electric device 12 responds to the detection of the response request signal. Instead, the response signal of the requested electric device 12 is transmitted to the control device 11 by the control device communication.
  • the requesting electric device 12 since the requesting electric device 12 does not have the control device communication function, it outputs a response request signal, but if the electric device 12 that has detected the response request signal has the control device communication function, it responds. In response to the detection of the request signal, the response signal of the request electric device 12 is transmitted to the control device 11 by the control device communication.
  • control device 11 not only the electric device 12 having the control device communication function but also the electric device 12 having no control device communication function can be registered according to the response signal.
  • the response request signal from the request electric device 12 includes the device information of the request electric device 12
  • the electric device 12 that has detected the response request signal has the request electric device 12 included in the response request signal.
  • a response signal including the device information of the above can be transmitted to the control device 11.
  • the electric device 12 that has detected the response request signal includes the device information or the like of the request electric device 12.
  • the response signal that is not received is transmitted to the control device 11.
  • the control device 11 can recognize the existence of the requested electric device 12 that does not have the control device communication function, but cannot recognize the device information or the like of the requested electric device 12.
  • the device information and the like of the requested electric device 12 can be manually input by the user by operating the control device 11.
  • step S131 determines whether or not the microphone 71 is not provided. If it is determined in step S131 that the microphone 71 is not provided, the process proceeds to step S142, and the electric device 12 determines whether or not the trigger detection unit 64 has detected the change trigger signal.
  • step S142 If it is determined in step S142 that the change trigger signal has been detected, the process proceeds to step S139, and the above-described process is performed below.
  • step S142 is performed when it is determined in step S142 that the electric device 12 does not have the microphone 71. Therefore, the change trigger signal detected (determined) in step S142 is a modal signal other than sound (for example, light), which is a modal signal that can be received by the input device of the electric device 12. is there.
  • the change trigger signal detected (determined) in step S142 is a modal signal other than sound (for example, light), which is a modal signal that can be received by the input device of the electric device 12. is there.
  • the electric device 12 having no microphone 71 capable of receiving the input of the sound trigger signal the sound other than the sound output by the other electric device 12 in response to the detection of the sound trigger signal output by the control device 11
  • a change trigger signal another change trigger signal
  • the electric device 12 that has detected the change trigger signal when the reissue prevention flag is TRUE, that is, when the change trigger signal has already been output in response to the detection of the past change trigger signal. Does not output any further change trigger signals.
  • the response signal including the device information of the electric device 12 is transmitted by the control device communication in the electric device 12. It is transmitted to the control device 11.
  • the response request signal is output from the output device of the electric device 12.
  • the response signal of the request electric device 12, which is the electric device 12 that outputs the response request signal, that is, the response signal of the electric device 12 that has detected the change trigger signal other than the sound is requested by the electric device 12 having the control device communication function.
  • the response request signal output by the electric device 12 is detected, it is transmitted to the control device 11 by the control device communication by the electric device 12 having the control device communication function.
  • step S142 determines whether or not the change trigger signal has been detected.
  • step S143 If it is determined in step S143 that the response request signal has not been detected, the process returns to step S142.
  • step S143 If it is determined in step S143 that the response request signal has been detected, the process proceeds to step S141, and the above-described processing is performed below.
  • the electric device 12 (another electric device) that does not have the microphone 71 detects the response request signal of the request electric device 12, when it has the control device communication function, the request electricity corresponds to the detection of the response request signal. Instead of the device 12, the response signal of the requested electric device 12 is transmitted to the control device 11 by the control device communication.
  • control device 11 not only the electric device 12 having the control device communication function but also the electric device 12 having no control device communication function can be registered according to the response signal.
  • control device 11 sets the registration location and outputs a trigger signal that serves as a trigger for the electric device 12 to respond. Then, the registration location and the electric device 12 for which the response signal to the trigger signal is received are registered in association with each other.
  • the trigger signal from the control device 11 is detected.
  • a change trigger signal is output according to the detection of the trigger signal.
  • a response signal or a response request signal is output according to the detection of the trigger signal.
  • the electric device 12 which is modal of the trigger signal and does not have the microphone 71 capable of accepting sound
  • the electric device 12 which has the microphone 71 but is not within the reach of the trigger signal from the control device 11.
  • a change trigger signal output by another electric device that has detected a trigger signal from the control device 11 is detected, and another change trigger signal is output in response to the detection of the change trigger signal. Further, a response signal or a response request signal is output according to the detection of the change trigger signal.
  • the control device 11 with respect to the electric device 12 installed at the registration place, not only the electric device 12 having an input device capable of accepting the modal of the trigger signal but also the electric device 12 having no such input device. Even if there is, it can be easily registered in association with the registration location.
  • the electric device 12 is currently being converted to IoT, for the time being, the electric device 12 that has been converted to IoT, that is, the electric device 12 that is equipped with the control device communication function, has been converted to IoT. It is expected that the environment in which electrical equipment 12 such as white goods that are not used will continue to coexist.
  • the necessary profile of the electric device 12 can be registered by performing the control device communication with the control device 11, but the control device communication function is mounted. For the electric device 12 that has not been performed, it is necessary to manually register the necessary profile of the electric device 12.
  • a smartphone as a control device 11 is taken to a registration place, and an electric device as a corresponding device installed at the registration place is performed as a simple operation, for example, by touching a screen. 12 can be registered.
  • DLNA registered trademark
  • TVs and recording devices it is possible to detect electric devices on the network such as TVs and recording devices, but it is not possible to detect the location where each electric device on the network is installed. Therefore, for example, when TVs of the same model exist as electrical devices on the network in each of a plurality of places (rooms), the user tries to remotely control the TV in the room in which he / she is located, and in another room, for example. It was inconvenient because the TV was sometimes controlled remotely.
  • the electric device 12 is registered in association with the place (registration place) where the electric device 12 is installed. Therefore, for example, the electric device 12 of the same model is installed in each of the plurality of places. If so, the electrical device 12 at a specific location can be easily remotely controlled.
  • FIG. 9 is a diagram showing an example of a combination of the modal of the change trigger signal and the input device that accepts the input of the change trigger signal.
  • the same modal sound as the trigger signal can be adopted.
  • the sound as the change trigger signal can be received (sensed) by the microphone that senses the sound.
  • the output of the sound change trigger signal can be regarded as a retransmission or relay of the sound trigger signal.
  • Other modal changes trigger signals include light as the blinking LED of the power supply, physical movement, light as the blinking IR of the LED that outputs IR (infrared light) used in remote commanders, etc., Bluetooth.
  • Signals transmitted / received via (registered trademark) communication, signals transmitted / received via LAN, signals transmitted / received via ZigBee (registered trademark) communication, and the like can be adopted.
  • the physical movement is the movement of an object caused by driving the object by a mechanical mechanism, for example, the movement of opening and closing the lid and the door, the movement of rotating a rotary table such as a microwave oven, and the return type.
  • a push button-like shape is a dented / popped out movement.
  • the light as the blinking LED of the power supply etc. and the physical movement can be input by the RGB camera that receives visible light.
  • the light as the blinking of the IR of the LED can be received by the IR camera that receives the IR or the light receiving part of the remote commander.
  • Signals sent and received via Bluetooth® communication can be input via the Bluetooth® communication interface.
  • Signals sent and received on a LAN can be input by the LAN interface.
  • Signals sent and received in ZigBee® communication can be input by the ZigBee® communication interface.
  • FIG. 10 is a diagram showing an example of a response request signal.
  • the modal of the response request signal is the same modal sound as the trigger signal
  • a sound that can be distinguished from the trigger signal that is, an arbitrary sound different from the trigger signal can be adopted as the response request signal. ..
  • the sound response request signal can be a "pip” that is a repetition of the single "pip”. ..
  • an arbitrary sound different from the trigger signal such as a sound having a pitch or length different from that of the sound trigger signal, or a chord containing the sound trigger signal as one sound, should be adopted. Can be done.
  • the device information of the requested electric device 12 and other information related to the requested electric device 12 is a refrigerator. It is possible to output a sound as a response request signal including information such as having a human sensor as an input device.
  • the response request signal including the information about the request electric device 12 when the response request signal including the information about the request electric device 12 is detected, the response signal including the information about the request electric device 12 is transmitted to the control device 11 by the control device communication. can do.
  • a response request signal that does not include information about the requested electric device 12 is detected in the electric device 12 that has the control device communication function
  • a response signal that notifies the existence of the requested electric device 12 that does not have the control device communication function is sent. , It is transmitted to the control device 11 by the control device communication.
  • FIG. 11 is a diagram showing an example of the format of the response signal.
  • FIG. 11 shows an example of a packet format as a response signal.
  • the packet as a response signal is configured by arranging 8-bit location information, 8-bit device information, and 16-bit device information from the beginning.
  • the location information is the location where the trigger signal or the electrical device 12 (hereinafter, also referred to as the response electrical device 12) that outputs the response signal in response to the detection of the change trigger signal output in response to the detection of the trigger signal is installed. Represents.
  • the location information is included in the response signal when it is included in the profile of the response electrical device 12 stored in the storage unit 63 of the response electrical device 12.
  • the control device 11 selects one of the registered location and the location represented by the location information included in the response signal according to, for example, a user's operation, and responds to electricity. It is registered in association with the device 12.
  • the device information represents the type of response electrical device 12 (for example, a category such as "refrigerator” or "fan”).
  • the device information represents an input device and an output device included in the response electric device 12.
  • the response signal can include the profile of the response electrical device 12 other than the location information, the device information, and the device information.
  • FIG. 12 is a diagram showing an example of location allocation for 8 bits as location information.
  • 00000000 as location information indicates that the location is unknown.
  • 00000001, 00000010 and 00000011 as location information represent kitchen 1, kitchen 2, and kitchen 3, respectively.
  • the kitchen 1, the kitchen 2, and the kitchen 3 are, for example, a kitchen existing in a separate room or a specific place in the kitchen of one room (for example, when the kitchen is divided into two sections by a workbench of an Irish kitchen). Each section, etc.) is represented.
  • FIG. 13 is a diagram showing an example of assignment of the type of the electric device 12 to 8 bits as device information.
  • 00000000 as device information indicates that the type is unknown (Unknown). Further, for example, 00000001 as device information indicates that the type is a refrigerator.
  • FIG. 14 is a diagram showing an example of device allocation for 16 bits as device information.
  • the control device communication interface is assigned to the first bit Bit1 (from the least significant bit or the most significant bit) of the 16-bit device information.
  • a camera, a microphone, a speaker, a motion sensor, a temperature sensor, and an odor sensor are assigned to the 2nd to 7th bits of the 16-bit device information, Bit2 to Bit7, respectively.
  • Bits Bit8 to Bit16 of the 8th to 16th bits of the 16-bit device information are reserved.
  • each bit of the device information is, for example, 1 of 0 and 1, it means that the electric device 12 has an input device or an output device assigned to the bit.
  • FIG. 15 is a diagram showing an example of a profile list in which the control device 11 registers the registration location and the electrical device 12 in association with each other.
  • the type of the response electric device 12 and the registration location are associated with each other and registered in the profile list according to the response signal of the response electric device 12. Further, in the profile list, if necessary, the presence / absence of each input device and each output device in the response electric device 12 can be registered in association with (the type of) the response electric device 12.
  • 0s and 1s in the fields of input device and output device indicate that they do not have the input device or output device represented by the corresponding fields, and that they have, respectively.
  • FIG. 16 is a diagram showing an example of a registration screen displayed by the control device 11.
  • the registration screen is displayed on the control device 11 in step S117 of FIG. 7, and is also displayed according to a user operation or the like.
  • the registration screen has a "location” column, a "device name” column, a “type” column, a “function setting” button, a "no future discovery” check box, a “registration” button, and a “cancel” button.
  • the location where the (registered) electrical device 12 to be registered in the profile list is installed is displayed.
  • a location is entered according to the user's operation.
  • the control device 11 displays the registration screen in step S117, the registration location set in step S114 is input by default in the "location" field.
  • the device name of the electrical device 12 registered in the profile list is displayed.
  • the device name is input according to the operation of the user.
  • the device name of the electric device 12 is the name of the electric device 12, and the electric devices 12 of the same type can be distinguished by giving different device names to the electric devices 12 of the same type.
  • the device name "in front of the stove” is attached to the fan in front of the stove.
  • “Type” the type of the electrical device 12 to be registered in the profile list is displayed.
  • “Type” the type is input according to the operation of the user. Further, when the control device 11 displays the registration screen in step S117, and the response signal of the response electric device 12 includes device information indicating the type of the response electric device 12, the "type" column is filled with the device information. Response The type represented by the device information included in the response signal of the electrical device 12 is input by default.
  • the "function setting" button is operated when the setting screen is displayed on the control device 11.
  • the "Do not discover in the future" check box is, for example, when the control device 11 displays the registration screen in response to the response signal of the response electrical device 12 in step S117, the user does not need to register the response electrical device 12. Then, the response electric device 12 is checked when it is desired to limit the display of the registration screen.
  • the control device 11 When the "Do not discover in the future" check box is checked and the "Register” button is operated on the registration screen displayed for the response electrical device 12, the control device 11 then outputs a response signal for the response electrical device 12. Even if it is received, the display of the registration screen is restricted. In this case, it is possible to prevent the registration screen from being repeatedly displayed for the electric device 12 that the user has determined that registration is unnecessary.
  • the "Register” button is operated when registering the contents of the registration screen in the profile list.
  • the "Cancel” button is operated when canceling the registration of the contents of the registration screen to the profile list.
  • the user controls the functions (for example, power ON / OFF, microwave oven reheating, air conditioner temperature, etc.) of the electric device 12 that is remotely controlled by the control device 11 by operating the setting screen.
  • the state (for example, power state and usage state) of the electric device 12 monitored by the device 11 can be set.
  • the electric device 12 can notify the control device 11 of information regarding the change in the state.
  • the setting screen also has a "save” button and a “cancel” button.
  • the “Save” button is operated when saving the setting contents of the setting screen
  • the “Cancel” button is operated when canceling the setting contents of the setting screen.
  • the UI (user interface) of the so-called learning remote controller is linked to the setting screen, and the IR pattern of the functions (power ON / OFF, etc.) of the electrical device 12 set on the setting screen in that UI. Can be learned. Further, the UI of the learning remote controller displays a profile list, and the electric device 12 to be remotely controlled by the UI of the learning remote controller can be selected from the electric devices 12 registered in the profile list.
  • FIG. 17 shows the first registration in which an electric device (non-compatible device) to which the present technology is applied is detected by the electric device (compatible device) 12 to which the present technology is applied and registered in the profile list of the control device 11. It is a figure explaining the method.
  • the non-compatible equipment includes electrical equipment to which the present technology can be applied, but has not yet been applied, and electrical equipment to which the present technology cannot be applied.
  • An electric device to which this technology cannot be applied is, for example, an electric device 12-5 which is an electric kettle in FIG. 1, which cannot communicate with a control device and is an input device such as a camera or a microphone. , And an electrical device that does not have at least one of an output device such as a speaker.
  • the position of a person is detected from an image taken by the thermo camera, for example.
  • the position of the person detected from the image taken by the thermo camera and the position of the person detected by the motion sensor are time-integrated, and the person stays according to the result of the time integration.
  • the location of the residence is specified.
  • the corresponding device 12 estimates that some non-compatible device exists at the staying point (equipment estimation), and notifies the control device 11 of the device estimation result indicating that the device exists by the control device communication or the like.
  • control device 11 When the control device 11 receives the notification of the device estimation result from the compatible device 12, it opens (displays) the registration screen (FIG. 16) and prompts the user to register the non-compatible device (in the profile list). In this case, in the profile list, the registration location associated with the compatible device 12 that estimates the existence of the non-compatible device is registered as the default registration location of the non-compatible device and is displayed on the registration screen. For non-compatible devices, the user inputs the device name and type on the registration screen.
  • the user checks the "Do not discover in the future" check box on the registration screen (displayed) opened (displayed) for the non-compliant device presumed to exist in a certain retention point P.
  • the registration screen is subsequently opened for non-compliant devices presumed to exist at the retention point P.
  • the first registration method it is presumed from the behavior of the person that some non-compatible device exists in the staying place where the person stays, and the user is prompted to register the non-compatible device. Non-compliant devices are registered.
  • a person is detected in order to identify the place where the person stays.
  • a sensor input device
  • the motion sensor include a far-infrared sensor, an ultrasonic sensor, a barometric pressure sensor, and a carbon dioxide sensor.
  • the camera include an RGB camera, a thermo camera, and a depth sensor.
  • Other sensors include pressure sensors located on the floor.
  • FIG. 18 is a diagram illustrating a second registration method in which a non-compatible device is detected by the compatible device 12 and registered in the profile list of the control device 11.
  • the time change of the temperature is detected from the image taken by the thermo camera. Further, the corresponding device 12 estimates that some non-compatible device exists (equipment estimation) at the place where the temperature changes according to the time change of the temperature, and the control device determines the device estimation result indicating that the device exists. Notify the control device 11 by communication or the like.
  • the control device 11 Upon receiving the notification of the device estimation result from the corresponding device 12, the control device 11 opens the registration screen (FIG. 16) and performs the same processing as in the case of the first registration method.
  • the second registration method it is estimated that some non-compatible device exists at the place where the temperature changes from the time change of the temperature, and the user is prompted to register the non-compatible device. Non-compliant devices are registered.
  • a physical quantity other than temperature can be sensed, and the existence of a non-compatible device can be estimated according to the change in the physical quantity.
  • thermo camera As a sensor (input device) that senses a physical quantity used for estimating the existence of a non-compatible device in the second registration method, for example, a thermo camera, an RGB camera, or a depth camera can be adopted.
  • the existence of the non-compatible device can be estimated from the heat generated by the power source of the non-compatible device and the heat of the heat source of the non-compatible device for cooking.
  • the RGB camera for example, using a database that stores the standard pattern used for image recognition, the captured image taken by the RGB camera is matched with the standard pattern, and the non-compatible device as the subject reflected in the captured image is recognized. By doing so, the existence of non-compatible devices can be estimated.
  • distance measurement is performed by the method adopted by Microsoft Kinect, and the three-dimensional shape of the non-compatible device as the object of distance measurement is recognized from the distance obtained by the distance measurement. , The existence of non-compliant devices can be estimated.
  • the first and second registration methods it is possible to estimate the existence of non-compatible devices using a plurality of types of input devices.
  • an RGB camera that receives visible light is used, and image recognition for an image taken by the RGB camera is performed. Then, the existence of the non-compatible device can be estimated, and the model of the non-compatible device can be estimated by using the recognition result of the image recognition.
  • the user can manually input all the items and register any electric device in the profile list.
  • control device 11 in addition to adopting a smartphone, a TV, a PC (Personal Computer), an AR (augmented reality) / VR (virtual reality) glass, a wearable device such as a smart watch, etc. are adopted. be able to.
  • FIG. 19 is a block diagram showing a configuration example of an embodiment of a computer on which a program for executing the above-mentioned series of processes is installed.
  • the program can be recorded in advance on the hard disk 905 or ROM 903 as a recording medium built in the computer.
  • the program can be stored (recorded) in the removable recording medium 911 driven by the drive 909.
  • a removable recording medium 911 can be provided as so-called package software.
  • examples of the removable recording medium 911 include a flexible disc, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disc, a DVD (Digital Versatile Disc), a magnetic disc, and a semiconductor memory.
  • the program can be installed on the computer from the removable recording medium 911 as described above, or can be downloaded to the computer via a communication network or a broadcasting network and installed on the built-in hard disk 905. That is, for example, the program transfers wirelessly from a download site to a computer via an artificial satellite for digital satellite broadcasting, or transfers to a computer by wire via a network such as LAN (Local Area Network) or the Internet. be able to.
  • LAN Local Area Network
  • the computer has a built-in CPU (Central Processing Unit) 902, and the input / output interface 910 is connected to the CPU 902 via the bus 901.
  • CPU Central Processing Unit
  • the CPU 902 executes a program stored in the ROM (Read Only Memory) 903 accordingly. .. Alternatively, the CPU 902 loads the program stored in the hard disk 905 into the RAM (Random Access Memory) 904 and executes it.
  • ROM Read Only Memory
  • the CPU 902 performs processing according to the above-mentioned flowchart or processing performed according to the above-mentioned block diagram configuration. Then, the CPU 902 outputs the processing result from the output unit 906 or transmits it from the communication unit 908, and further records it on the hard disk 905, if necessary, via the input / output interface 910.
  • the input unit 907 is composed of a keyboard, a mouse, a microphone, and the like. Further, the output unit 906 is composed of an LCD (Liquid Crystal Display), a speaker, or the like.
  • LCD Liquid Crystal Display
  • the processing performed by the computer according to the program does not necessarily have to be performed in chronological order in the order described as the flowchart. That is, the processing performed by the computer according to the program also includes processing executed in parallel or individually (for example, parallel processing or processing by an object).
  • the program may be processed by one computer (processor) or may be distributed processed by a plurality of computers. Further, the program may be transferred to a distant computer and executed.
  • the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a device in which a plurality of modules are housed in one housing are both systems. ..
  • this technology can have a cloud computing configuration in which one function is shared by a plurality of devices via a network and jointly processed.
  • each step described in the above flowchart can be executed by one device or shared by a plurality of devices.
  • one step includes a plurality of processes
  • the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices.
  • a setting unit that sets the location where electrical equipment is installed, An output unit that outputs a trigger signal, which is a trigger for the electric device to respond, and an output unit.
  • An information processing device including a registration unit that registers the location and the electrical device that has responded to the trigger signal in association with each other.
  • ⁇ 2> Equipped with a communication unit for communication The communication unit receives a response signal, which is a response to the trigger signal, transmitted by the electric device capable of performing the communication, and receives the response signal.
  • the information processing device according to ⁇ 1>, wherein the registration unit registers the location and the electric device in association with each other in response to the response signal.
  • the communication unit receives the response signal of the electric device transmitted by another electric device that has detected the response request signal of the electric device requesting the response by the response signal.
  • the information processing device according to ⁇ 2>, wherein the registration unit registers the location and the electric device in association with each other in response to the response signal.
  • the communication unit The response signal of the second electric device transmitted by the second electric device that has detected the change trigger signal output by the first electric device in response to the detection of the trigger signal.
  • the response of the third electric device transmitted by the second electric device that has detected the response request signal requesting the response of the response signal output by the third electric device in response to the detection of the change trigger signal.
  • the information processing apparatus according to ⁇ 2> or ⁇ 3>, wherein the registration unit registers the location and the second electric device or the third electric device in association with each other in accordance with the response signal.
  • the change trigger signal is another modal signal whose modal is different from that of the trigger signal.
  • the trigger signal is sound.
  • a detector that detects a trigger signal, which is a trigger for making a response, from an information processing device. It is provided with an output unit that outputs a change trigger signal different from the trigger signal in response to the detection of the trigger signal.
  • An electrical device that outputs a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal in response to the detection of the trigger signal.
  • the electrical device according to ⁇ 8> which limits the output of the change trigger signal according to the detection of the change trigger signal after the output of the change trigger signal.
  • ⁇ 10> Further equipped with a communication unit capable of communicating with the information processing device, The electrical device according to ⁇ 8> or ⁇ 9>, wherein the communication unit transmits the response signal.
  • the electrical device which outputs the response request signal when it does not have a communication unit capable of communicating with the information processing device.
  • the detection unit detects a response request signal requesting a response of the response signal from another electric device, and detects the response request signal.
  • the electric device according to ⁇ 10>, wherein the communication unit transmits a response signal of the other electric device in response to detection of a response request signal from the other electric device.
  • the change trigger signal is another modal signal whose modal is different from that of the trigger signal.
  • Detecting a trigger signal from an information processing device that triggers a response In response to the detection of the trigger signal, a change trigger signal different from the trigger signal is output, and A processing method of an electric device including outputting a response signal which is a response to the trigger signal or a response request signal requesting a response by the response signal in response to the detection of the trigger signal.
  • An electrical device that outputs a response signal that is a response to the trigger signal or a response request signal that requests a response by the response signal in response to the detection of the change trigger signal.
  • a communication unit capable of communicating with the information processing device
  • the electrical device according to ⁇ 15> wherein the communication unit transmits the response signal.
  • the electrical device according to ⁇ 15> which outputs the response request signal when it does not have a communication unit capable of communicating with the information processing device.
  • the detection unit detects a response request signal requesting a response of the response signal from another electric device, and detects the response request signal.
  • the electric device wherein the communication unit transmits a response signal of the other electric device in response to detection of a response request signal from the other electric device.
  • the change trigger signal is another modal signal whose modal is different from that of the trigger signal.
  • a processing method of an electric device including outputting a response signal which is a response to the trigger signal or a response request signal requesting a response by the response signal in response to the detection of the change trigger signal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Selective Calling Equipment (AREA)

Abstract

La présente invention concerne un dispositif de traitement d'informations et un procédé de traitement d'informations au moyen desquels des appareils électriques peuvent être facilement repérés ; et un appareil électrique et un procédé de traitement d'appareil électrique. Le dispositif de traitement d'informations définit l'emplacement au niveau duquel l'appareil électrique est disposé, délivre en sortie un signal de déclenchement, qui est un déclencheur de la réponse de l'appareil électrique, et associe et repère l'emplacement et l'appareil électrique qui a répondu au signal de déclenchement. L'appareil électrique détecte le signal de déclenchement provenant du dispositif de traitement d'informations, délivre en sortie un signal de déclenchement modifié, qui est différent du signal de déclenchement, en réponse à la détection du signal de déclenchement, et délivre en sortie un signal de réponse qui est une réponse au signal de déclenchement ou délivre en sortie un signal de demande de réponse qui demande une réponse à l'aide du signal de réponse. En variante, l'appareil électrique détecte un signal de déclenchement modifié délivré par un autre appareil électrique qui a détecté un signal de déclenchement provenant du dispositif de traitement d'informations et, en réponse à la détection du signal de déclenchement modifié, délivre en sortie un autre signal de déclenchement modifié, ainsi qu'un signal de réponse ou un signal de demande de réponse. Cette technologie peut, par exemple, s'appliquer au repérage d'appareils électriques.
PCT/JP2020/035398 2019-10-04 2020-09-18 Dispositif de traitement d'informations, procédé de traitement d'informations, appareil électrique, et procédé de traitement d'appareil électrique WO2021065558A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019183472 2019-10-04
JP2019-183472 2019-10-04

Publications (1)

Publication Number Publication Date
WO2021065558A1 true WO2021065558A1 (fr) 2021-04-08

Family

ID=75338013

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/035398 WO2021065558A1 (fr) 2019-10-04 2020-09-18 Dispositif de traitement d'informations, procédé de traitement d'informations, appareil électrique, et procédé de traitement d'appareil électrique

Country Status (1)

Country Link
WO (1) WO2021065558A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014207792A1 (fr) * 2013-06-24 2014-12-31 日立マクセル株式会社 Dispositif terminal et procédé de commande à distance
JP2015211232A (ja) * 2014-04-23 2015-11-24 キヤノン株式会社 通信装置
JP2016063531A (ja) * 2014-09-12 2016-04-25 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 情報機器の制御方法及びプログラム
JP2018182578A (ja) * 2017-04-14 2018-11-15 サクサ株式会社 無線通信システム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014207792A1 (fr) * 2013-06-24 2014-12-31 日立マクセル株式会社 Dispositif terminal et procédé de commande à distance
JP2015211232A (ja) * 2014-04-23 2015-11-24 キヤノン株式会社 通信装置
JP2016063531A (ja) * 2014-09-12 2016-04-25 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 情報機器の制御方法及びプログラム
JP2018182578A (ja) * 2017-04-14 2018-11-15 サクサ株式会社 無線通信システム

Similar Documents

Publication Publication Date Title
CN111937051B (zh) 使用增强现实可视化的智能家居设备放置和安装
US10985936B2 (en) Customized interface based on vocal input
US11929844B2 (en) Customized interface based on vocal input
KR20050005869A (ko) 사용자 예약에 따른 홈 네트워크 시스템 및 그 제어방법
JP5622869B2 (ja) 電気機器管理装置、電気機器管理システム及び電気機器管理方法
US10989426B2 (en) Information processing device, electronic apparatus, method, and program
JP6489793B2 (ja) 電子機器、制御システム、制御方法、および制御プログラム
WO2021065558A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations, appareil électrique, et procédé de traitement d'appareil électrique
JP2019061334A (ja) 機器制御装置、機器制御方法及び機器制御システム
US20100146064A1 (en) Source apparatus, sink apparatus and method for sharing information thereof
WO2018047458A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations et programme
KR102510499B1 (ko) 클라우드 플랫폼 기반의 공동주택의 스마트홈 시스템
WO2021085126A1 (fr) Appareil de traitement d'informations, procédé de traitement d'informations et programme
JP2012194752A (ja) ネットワークシステム、および電力センサの制御方法
JP2017151742A (ja) ネットワークシステム、サーバ、情報処理方法、および電気機器
KR101206349B1 (ko) 홈 네트워크 제어 서버 및 방법
KR20240063131A (ko) 계층적 모바일 애플리케이션 런칭
JP2022061119A (ja) ネットワークシステム、情報処理方法、サーバ、および電気機器
WO2023069621A1 (fr) Configuration de niveau système d'exploitation pour dispositifs domestiques intelligents multi-écosystèmes
JP2018152756A (ja) ネットワークシステム、情報処理方法、サーバ、および通信端末

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20871501

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20871501

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP