WO2023199904A1 - Abnormality diagnosis system and program - Google Patents

Abnormality diagnosis system and program Download PDF

Info

Publication number
WO2023199904A1
WO2023199904A1 PCT/JP2023/014657 JP2023014657W WO2023199904A1 WO 2023199904 A1 WO2023199904 A1 WO 2023199904A1 JP 2023014657 W JP2023014657 W JP 2023014657W WO 2023199904 A1 WO2023199904 A1 WO 2023199904A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
unit
abnormality diagnosis
predetermined position
electrical device
Prior art date
Application number
PCT/JP2023/014657
Other languages
French (fr)
Japanese (ja)
Inventor
優太 森
Original Assignee
シャープ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by シャープ株式会社 filed Critical シャープ株式会社
Publication of WO2023199904A1 publication Critical patent/WO2023199904A1/en

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00—Control or safety arrangements
    • F24F11/30—Control or safety arrangements for purposes related to the operation of the system, e.g. for safety or monitoring
    • F24F11/32—Responding to malfunctions or emergencies
    • F24F11/38—Failure diagnosis
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00—Control or safety arrangements
    • F24F11/30—Control or safety arrangements for purposes related to the operation of the system, e.g. for safety or monitoring
    • F24F11/49—Control or safety arrangements for purposes related to the operation of the system, e.g. for safety or monitoring ensuring correct operation, e.g. by trial operation or configuration checks
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00—Control or safety arrangements
    • F24F11/50—Control or safety arrangements characterised by user interfaces or communication
    • F24F11/56—Remote control
    • F24F11/58—Remote control using Internet communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F2110/00—Control inputs relating to air properties
    • F24F2110/50—Air quality properties
    • F24F2110/64—Airborne particle content
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24F—AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F2110/00—Control inputs relating to air properties
    • F24F2110/50—Air quality properties
    • F24F2110/65—Concentration of specific substances or contaminants
    • F24F2110/70—Carbon dioxide

Definitions

  • the present invention relates to an abnormality diagnosis system and program.
  • This application claims priority based on Japanese Patent Application No. 2022-067262 filed in Japan on April 15, 2022, the contents of which are incorporated herein.
  • Patent Document 1 discloses a failure diagnosis system that diagnoses the failure of an air conditioner.
  • the above-mentioned failure diagnosis system uses a sound detection device that detects sound information of an air conditioner, past sound information that is sound information detected in the past, and the equipment state of the air conditioner at the time when the past sound information was detected.
  • the present invention includes a data server that constructs a base database, and a fault diagnosis means that performs fault diagnosis based on data in the database and new sound information that is sound information of an air conditioner to be diagnosed.
  • the way the sound generated by the air conditioner is heard depends on the positional relationship between the air conditioner (air conditioner) and the sound collection unit that collects the sound generated from the air conditioner. different. This may be caused by, for example, vibrations varying depending on the part of the air conditioner, or wind noise occurring near openings through which air passes, such as inlets and outlets. Therefore, even if a failure occurs in the air conditioner, the collected sounds differ depending on the sound collection position, so it may not be possible to accurately diagnose the failure of the air conditioner.
  • an object of one aspect of the present invention is to provide an abnormality diagnosis system and program that can accurately perform failure diagnosis regarding electrical equipment such as an air conditioner.
  • An abnormality diagnosis system includes a terminal and an abnormality diagnosis device that can communicate with the terminal, and the terminal includes a sound collection unit that collects sound, and a sound collection unit that collects sounds collected by the sound collection unit.
  • a recording processing unit that performs recording processing to generate audio data from the electrical device;
  • a determination unit that determines whether the electrical device is in a predetermined position relative to the electrical device;
  • the abnormality diagnosis device includes a recording control unit that allows the start of the recording process, and a transmission control unit that transmits the audio data generated in the recording process to the abnormality diagnosis device, and the abnormality diagnosis device The electric device is diagnosed based on the voice data obtained.
  • a program includes a processor, a recording processing unit that performs a recording process of generating audio data from sounds collected by a sound collection unit provided in a terminal, and a recording processing unit that performs a recording process that generates audio data from sounds collected by a sound collection unit provided in a terminal, and a recording processing unit that performs a recording process that generates audio data from sounds collected by a sound collection unit provided in a terminal, and a recording processing unit that performs a recording processing that generates audio data from sounds collected by a sound collection unit provided in a terminal; a recording control unit that allows the recording processing unit to start the recording processing when it is determined that the recording processing unit is located at the predetermined position, and audio data generated by the recording processing. functions as a transmission control unit that transmits the information to the abnormality diagnosis device.
  • FIG. 1 is a schematic diagram showing an abnormality diagnosis system.
  • FIG. 2 is a block diagram showing the hardware configuration of a terminal and a server device.
  • FIG. 2 is a perspective view showing an electrical device.
  • FIG. 3 is a top view of an electrical device showing an example of the arrangement of identification markers. It is a figure showing an example of identification information.
  • FIG. 7 is a side view of an electrical device showing a modification of the arrangement of identification markers.
  • FIG. 3 is a diagram illustrating an example of a display unit in a state where a terminal is not placed at a predetermined position.
  • FIG. 3 is a diagram illustrating an example of a display unit in a state where a terminal is placed at a predetermined position. This is a thumbnail of identification information displayed superimposed on the display unit.
  • FIG. 1 is a schematic diagram showing an abnormality diagnosis system.
  • FIG. 2 is a block diagram showing the hardware configuration of a terminal and a server device.
  • FIG. 2 is a perspective view showing
  • FIG. 3 is a diagram showing a database in which identification information and equipment information of electrical equipment are associated. It is an example of the control flow regarding the recording process by a control part.
  • FIG. 3 is a top view of the electrical device showing markers for locating a terminal in a predetermined position.
  • FIG. 2 is a side view of the electrical device showing a holder for placing a terminal in a predetermined position.
  • FIG. 1 is a schematic diagram showing an abnormality diagnosis system 10.
  • FIG. 2 is a diagram showing the hardware configuration of the terminal 100 and the server device 200.
  • the abnormality diagnosis system 10 is a system that performs failure diagnosis of the electrical equipment 300 by collecting sounds generated from the electrical equipment 300 (in this embodiment, the outdoor unit).
  • the abnormality diagnosis system 10 is configured such that a terminal 100 can be connected to a server device 200 via a network NW.
  • Terminal 100 is a terminal for collecting sounds generated from electrical equipment 300.
  • Terminal 100 is, for example, a smart phone.
  • the terminal 100 includes a control section 110, a storage section 120, a communication section 130, a sound collection section 140, an imaging section 150, and a display section 160.
  • the control unit 110 controls the terminal 100.
  • the control unit 110 implements various functions by reading and executing various programs stored in the storage unit 120.
  • the control unit 110 includes, for example, one or more CPUs (Central Processing Units).
  • the storage unit 120 stores various programs and various data necessary for the operation of the terminal 100.
  • the storage unit 120 is, for example, a nonvolatile storage unit such as a flash memory.
  • the communication unit 130 is an interface for connecting to and communicating with the network NW.
  • the communication unit 130 controls communication with the server device 200 via the network NW.
  • the communication unit 130 is connected to the network NW by wireless communication, but the communication unit 130 is not limited to this, and may be connected by wired communication.
  • the sound collection unit 140 collects surrounding sounds.
  • the sound collection unit 140 is, for example, a condenser microphone, a dynamic microphone, or MEMS (Micro Electro Mechanical Systems).
  • the imaging unit 150 is a camera that images an object within its imaging range.
  • the imaging unit 150 may be a stereo camera, a multispectral camera, or the like.
  • the display unit 160 displays a captured image (captured video) captured by the imaging unit 150, a frame F, a thumbnail S, a button B, etc., which will be described later.
  • the display unit 160 is, for example, a touch panel with an operation function.
  • the display unit 160 is not limited to a touch panel, and may be a display panel having only the function of displaying, for example, a captured image (captured video) captured by the imaging unit 150, a frame F, a thumbnail S, etc. to be described later. In this case, a separate operation section for operating the terminal 100 may be provided.
  • the server device 200 is a device that performs failure diagnosis of the electrical device 300 based on audio data generated by the terminal 100.
  • Server device 200 includes a control section 210, a storage section 220, and a communication section 230.
  • the control unit 210 controls the server device 200.
  • the control unit 210 implements various functions by reading and executing various programs stored in the storage unit 220.
  • the control unit 210 includes, for example, one or more CPUs (Central Processing Units).
  • the storage unit 220 stores various programs and various data necessary for the operation of the server device 200.
  • the storage unit 220 is, for example, a nonvolatile storage unit such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive).
  • the communication unit 230 is an interface for connecting to and communicating with the network NW. Communication unit 230 controls communication with terminal 100 via network NW. In this embodiment, the communication unit 230 is connected to the network NW by wired communication, but the communication unit 230 is not limited to this, and may be connected by wireless communication.
  • Electrical equipment 300 is, for example, an outdoor unit of an air conditioner.
  • the electrical device 300 has a substantially rectangular parallelepiped-shaped housing 310 that houses a compressor, a blower, a heat exchanger, and the like (see FIG. 3).
  • the housing 310 has a front surface 311 , a rear surface 312 , a left side surface 313 , a right side surface 314 , an upper surface 315 , and a lower surface 316 .
  • a suction port 313a is formed on the left side surface 313 of the casing 310, and an air outlet 311a is formed on the front surface 311 of the casing 310.
  • the user uses the terminal 100 to collect sounds generated from the electrical equipment 300, thereby diagnosing the failure of the electrical equipment 300.
  • the abnormality diagnosis system 10 determines whether or not the terminal 100 is in a predetermined position with respect to the electrical device 300, and when it is determined that the terminal 100 is in the predetermined position, the terminal 100 detects the electrical device. Allow the start of the recording process of 300.
  • the recording process by the terminal 100 is completed, the audio data generated by the recording process is transmitted to the server device 200, and the server device 200 diagnoses the failure of the electrical device 300 based on the acquired audio data.
  • the failure diagnosis by the server device 200 is completed, the diagnosis result is transmitted to the terminal 100 and the process ends.
  • FIG. 3 is a perspective view showing the electrical device 300.
  • FIG. 4 is a top view of the electrical device 300 showing an example of the arrangement of the identification markers M.
  • FIG. 5 is a diagram showing the identification information D1.
  • FIG. 6 is a side view of the electrical device 300 showing a modification of the arrangement of the identification markers M.
  • FIG. 7 is an example of the display unit 160 in a state where the terminal 100 is not placed at a predetermined position.
  • FIG. 8 is a diagram showing an example of the display unit 160 in a state where the terminal 100 is placed at a predetermined position.
  • the terminal 100 determines whether the terminal 100 is at a predetermined position relative to the electrical device 300 by performing image recognition processing.
  • the predetermined position is a position facing a predetermined surface (in this embodiment, the top surface 315) of the electrical device 300 with a space therebetween.
  • the predetermined surface of the electrical device 300 is, for example, a surface different from the surface of the electrical device 300 where an opening through which air passes is provided.
  • the opening through which the air of the electrical device 300 passes refers to the inlet 313a and the outlet 311a of the electrical device 300.
  • the control unit 110 of the terminal 100 includes a determination unit 111, a display control unit 112, a recording control unit 113, a recording processing unit 114, a transmission control unit 115, and a registration processing unit 116 (see FIG. 2). .
  • the determining unit 111 determines whether the captured image captured by the imaging unit 150 includes the identification information D1.
  • the identification information D1 is image data obtained by capturing a part of the electrical device 300 from a specific position.
  • the part of electrical equipment 300 is, for example, an identification marker M provided on a predetermined surface (in this embodiment, upper surface 315) of electrical equipment 300.
  • the identification marker M is, for example, a marker that has a surface (also referred to as identification surface M1) on which a specific pattern (for example, a pattern imitating an animal) is formed.
  • the identification surface M1 of the identification marker M is arranged to face upward.
  • the specific position is a position that faces a predetermined surface (in this embodiment, the top surface 315) of the electrical device 300 with an interval therebetween. That is, the identification information D1 is image data obtained by capturing an image of the identification marker M (identification surface M1) provided on the top surface 315 of the electrical device 300 from above. As a result, the identification information D1 is included in the captured image only when the identification marker M of the electrical device 300 is captured from above.
  • the identification marker M has a pattern imitating an animal, but is not limited to this, and may have, for example, a blonde logo, a barcode, or a QR code (registered trademark). Moreover, although the identification marker M has a specific pattern, it is not limited to this, and may have a specific shape, for example. It is assumed that the identification information D1 is stored in the storage unit 120 in advance.
  • the determining unit 111 determines that the identification information D1 is included in the captured image captured by the imaging unit 150, it determines that the terminal 100 is at a predetermined position with respect to the electrical device 300.
  • a method for image recognition processing by the determination unit 111 a known image matching format, an object recognition method using feature amounts, a two-dimensional barcode image identification method, etc. can be used.
  • the predetermined position is a position facing the top surface 315 of the electrical device 300 with a space between them, but the predetermined position is not limited to this, and any position facing the top surface 315 of the electrical device 300 with a space between them is not limited to this.
  • the predetermined position may be a position facing the right side surface 314 of the electrical device 300.
  • the identification marker M may be provided on the right side surface 314, and the identification surface M1 of the identification marker M may be placed so as to face to the right.
  • the electrical device 300 has one identification marker M
  • the present invention is not limited to this, and may have a plurality of identification markers M.
  • they may be provided on the upper surface 315 and the lower surface 316 of the electrical device 300, respectively.
  • the identification information D1 is image data obtained by capturing an image of the identification marker M, but is not limited to this. It may also be image data that has been created.
  • the determination unit 111 determines that the identification information D1 is included in the captured image captured by the imaging unit 150, it is determined that the terminal 100 is at a predetermined position with respect to the electrical device 300.
  • the terminal 100 it is not limited to this. For example, if it is determined that the identification information D1 is included in the captured image captured by the imaging unit 150, and if it is determined that the distance of the terminal 100 to the electrical device 300 is within a predetermined range, the terminal 100 , it may be determined that it is at a predetermined position with respect to the electrical device 300.
  • the predetermined position is a position facing a predetermined surface of the electrical device 300 (in this embodiment, the top surface 315) with an interval, and where the distance of the terminal 100 to the electrical device 300 is within a predetermined range. Points to a position by distance.
  • the determining unit 111 further determines whether the distance of the terminal 100 to the identification marker M of the electrical device 300 is within a predetermined range. In this embodiment, by determining whether the size of the identification information D1 with respect to the imaging range R is within a predetermined range, it is determined whether the above distance is within a predetermined range. ing.
  • the distance of the terminal 100 to the identification marker M is calculated using the size of the identification information D1 with respect to the imaging range R, but the distance between the terminal 100 and the identification marker M is not limited to this.
  • the distance to the terminal 100 may also be measured.
  • the distance measurement sensor may be a TOF (Time of Flight) method that measures distance using the return time of pulsed light reflected from the target, or a distance measurement sensor that uses a grid-like pattern of light to measure the distance. , a structured light type sensor that measures distance by pattern distortion may also be used.
  • the distance to the object (identification marker M) within the imaging range R of the imaging unit 150 may be calculated using not only the distance measuring sensor but also the parallax of a stereo camera, for example. In this case, the imaging unit 150 is configured by a stereo camera.
  • the display control unit 112 displays the captured image on the display unit 160, and also superimposes an icon for guiding the terminal 100 to a predetermined position on the display unit 160 (captured image).
  • the icon is, for example, a frame F that serves as a reference for the size of the identification information D1 for the imaging range R.
  • the frame F is a rectangular frame set to a desired size with respect to the imaging range R. It is assumed that the size of the frame F is predetermined based on the angle of view of the imaging section 150. Thereby, by matching the identification information D1 to the frame F, the distance between the terminal 100 and the electrical device 300 can be set to an appropriate distance.
  • the display control unit 112 highlights the icon (frame F). Highlighting here refers to displaying the frame F with at least a portion of the color, line type, line thickness, etc. changed.
  • the frame F is displayed in green, and the terminal 100 is in a predetermined position with respect to the electrical device 300.
  • the frame F is displayed in red.
  • the recording control unit 113 allows the recording processing unit 114 to start recording processing.
  • the display control unit 112 displays a button B on the display unit 160 ( displayed superimposed on the captured image).
  • the recording control unit 113 causes the recording processing unit 114 to start recording processing.
  • the recording control unit 113 allows the recording processing unit 114 to start recording processing. Therefore, the display control unit 112 does not display button B on the display unit 160.
  • the recording control unit 113 allows the recording processing unit 114 to start recording processing.
  • the display control unit 112 displays button B in a superimposed manner on the display unit 160 (captured image).
  • the recording control unit 113 causes the recording processing unit 114 to start recording processing.
  • the recording control unit 113 causes the recording processing unit 114 to execute the recording process until a predetermined time period elapses after the user performs an operation to start the recording process, or until the user performs an operation to end the recording process.
  • the user's operation to start the recording process is the user's touch of button B shown in FIG. 8 .
  • the user's operation to end the recording process is when the user touches button B shown in FIG. 8 again.
  • the recording processing unit 114 performs recording processing to generate audio data from the sounds collected by the sound collection unit.
  • the recording process is, for example, a process in which an input audio signal (analog signal) obtained from the sound collection section 140 is amplified by an amplifier circuit and then converted into a digital signal.
  • FIG. 9 shows a thumbnail S of the identification information D1 superimposed and displayed on the display unit 160 (captured image).
  • the display control unit 112 displays an icon (thumbnail S) for guiding the terminal 100 to a predetermined position in a superimposed manner on the display unit 160 (captured image).
  • the thumbnail S is image data in which the identification information D1 is displayed in a reduced size. Thereby, the user can search for the identification marker M provided on the electrical device 300 while referring to the thumbnail S. Therefore, it is possible to easily align the terminal 100 with respect to the electrical device 300.
  • the display control unit 112 highlights the icon (thumbnail S) when the determination unit 111 determines that the terminal 100 is in a predetermined position.
  • Highlighting refers to displaying the thumbnail S with at least a portion of the color, line type, line thickness, etc. changed.
  • the thumbnail S is displayed as a thin line, and the thumbnail S is displayed as a thin line, If it is determined that there is, it is displayed with a thick line. Thereby, the user can easily understand that the terminal 100 is at a predetermined position with respect to the electrical device 300.
  • the transmission control unit 115 transmits the audio data generated by the recording process by the recording processing unit 114 to the server device 200 via the communication unit 130.
  • the generated audio data may be stored in the storage unit 120.
  • FIG. 10 is a diagram showing an example of a database 120a in which identification information and equipment information of electrical equipment are associated.
  • the device information of the electrical device includes, for example, the type and model number of the electrical device.
  • the storage unit 120 of the terminal 100 stores a database 120a in which different types of identification information are associated with each electrical device.
  • the identification information D1 is associated with equipment information of an outdoor unit, which is an example of electrical equipment
  • the identification information D2 is associated with equipment information of a refrigerator, which is another example of electrical equipment.
  • Information D3 is associated with device information of a washing machine, which is another example of electrical equipment.
  • the transmission control unit 115 transmits the device information of the electrical device to the server device 200 via the communication unit 130 along with the audio data generated by the recording process by the recording processing unit 114. Send.
  • the database 120a is stored in the storage unit 120 of the terminal 100, the database 120a is not limited to this, and may be stored in the storage unit 220 of the server device 200, for example, or may be stored in an external terminal. good.
  • the terminal 100 or the server device 200 may be able to communicate with the electrical device 300, in addition to the device information of the electrical device 300 described above, information related to the operation of the electrical device 300 may be acquired.
  • the information related to the operation of the electrical equipment 300 here includes, for example, the rotation speed of the compressor, the rotation speed of the blower, and the like.
  • the identification information D1 is stored in advance in the storage unit 120, but the invention is not limited to this.
  • Image data captured by the imaging unit 150 using the terminal 100 may be stored in the storage unit 120 as identification information. You may register.
  • the registration processing unit 116 registers the image data captured by the imaging unit 150 in the storage unit 120 as identification information.
  • the registration processing unit 116 registers image data captured by the user (for example, a portion of the top surface 315 of the electrical device 300) in the storage unit 120 as identification information.
  • the determining unit 111 determines whether the identification information registered in the registration processing unit 116 is included in the captured image captured by the imaging unit 150.
  • the user himself/herself can register the identification information using the terminal 100, there is no need to provide the identification marker M on the electrical device 300. Therefore, even if an existing electrical device is not equipped with the identification marker M, the sound generated from the electrical device can be collected at a predetermined position.
  • the control unit 210 of the server device 200 includes an audio data acquisition unit 211, a diagnosis unit 212, and a transmission control unit 213 (see FIG. 2).
  • the audio data acquisition unit 211 acquires audio data from the terminal 100 via the communication unit 230.
  • the diagnosis unit 212 performs diagnostic processing regarding a failure of the electrical device 300 based on the audio data acquired by the audio data acquisition unit 211.
  • the transmission control unit 213 transmits the results of the diagnostic processing performed by the diagnosis unit 212 to the terminal 100 via the communication unit 230.
  • the diagnostic unit 212 determines whether or not there is a failure in the electrical device 300, for example, based on a learned failure diagnosis model. When determining that a failure has occurred in the electrical device 300, the diagnostic unit 212 determines the type of failure.
  • the fault diagnosis model is a model for determining a fault in the electrical device 300 using audio data.
  • the fault diagnosis model is generated by performing machine learning using the fault diagnosis database 220a stored in the storage unit 220. For each type of electrical equipment 300, a plurality of audio data (teacher data) corresponding to the type of failure is stored in the failure diagnosis database 220a. For example, a known algorithm such as deep learning can be used to form the fault diagnosis model.
  • the transmission control unit 213 transmits the diagnostic result of the electrical device 300 to the terminal 100 via the communication unit 230.
  • the terminal 100 can display the diagnosis results sent from the server device 200 on the display unit 160.
  • FIG. 11 is an example of a control flow related to recording processing by the control unit 110.
  • the control flow related to the recording process is started, for example, when the user activates an application installed on the terminal 100.
  • the determination unit 111 determines whether the terminal 100 is at a predetermined position with respect to the electrical device 300. In S101, if the determination unit 111 determines that the terminal 100 is in the predetermined position, the process advances to S102. In S101, if the determination unit 111 determines that the terminal 100 is not at the predetermined position, the process returns to S101.
  • the recording control unit 113 allows the recording processing unit 114 to start recording processing.
  • the recording processing unit 114 starts recording processing, and the process advances to S103.
  • S103 it is determined whether a predetermined period of time has elapsed since the user performed an operation to start the recording process. If it is determined in S103 that the predetermined time has elapsed, the process advances to S104. In S103, if it is not determined that the predetermined time has elapsed, the process returns to S103.
  • the recording control unit 113 ends the recording process by the recording processing unit 114, and proceeds to S105.
  • the transmission control unit 115 transmits the audio data generated by the recording process by the recording processing unit 114 to the server device 200, and the process ends.
  • the recording processing unit 114 while the recording processing unit 114 is performing the recording process, it is preferable to maintain the operating state of the electrical equipment 300 (the rotational speed of the compressor and the blower). For example, by configuring the terminal 100 to be able to communicate with the electrical device 300, the operating state of the electrical device 300 may not be changed while the recording processing unit 114 is performing recording processing. Thereby, audio data can be generated while the operation of the electrical device 300 is kept constant, so that failure diagnosis of the electrical device 300 can be performed accurately.
  • the operating state of the electrical equipment 300 the rotational speed of the compressor and the blower
  • the timing for maintaining the operating state (rotational speed of the compressor and blower) of the electrical equipment 300 may be, for example, the timing when the user starts an application, or the timing when the terminal 100 is in a predetermined position relative to the electrical equipment 300.
  • the timing may be determined to be within the current range, or may be any timing.
  • FIG. 12 is a top view of the electrical device 300a showing the marker 330 for arranging the terminal 100 at a predetermined position.
  • This modification differs from the above embodiment in that the terminal 100 does not perform image recognition processing. Specifically, in this modification, the above-mentioned point is determined that the electrical device 300a is at a predetermined position based on the signal transmitted from the short-range wireless communication unit 320 provided in the electrical device 300a. Different from the embodiment.
  • the electrical device 300a has a short-range wireless communication section 320.
  • the short-range wireless communication unit 320 is a communication module for performing short-range wireless communication with the terminal 100.
  • the near field communication unit 320 is, for example, a Bluetooth module, a near field communication (NFC) module, or the like.
  • the electrical device 300a has a marker 330 for locating the terminal 100 at a predetermined position.
  • the marker 330 is, for example, a marker for aligning the terminal 100 with respect to the electrical device 300a.
  • Marker 330 has substantially the same external shape as terminal 100.
  • the marker 330 is provided on a predetermined surface (in this embodiment, the top surface 315) of the electrical device 300a.
  • a short-range wireless communication unit 320 is provided inside the electrical device 300a, specifically, at a position facing the marker 330 of the electrical device 300a.
  • the determination unit 111 determines that the electric device 300a is at a predetermined position based on a signal transmitted from the outside (short-range wireless communication unit 320).
  • the configuration for determining whether the terminal 100 is at a predetermined position with respect to the electrical device 300a does not necessarily require the imaging unit 150 and the display unit 160, and the short-range wireless It is only necessary to have a communication module for executing communication.
  • a marker 330 is provided as a configuration for arranging the terminal 100 at a predetermined position, but the structure is not limited to this, and for example, a holder 340 for arranging the terminal 100 at a predetermined position may be provided. (See FIG. 13).
  • FIG. 13 is a side view of the electrical device 300b showing the holder 340.
  • the holder 340 holds the terminal 100 in a predetermined position, for example.
  • the holder 340 is provided, for example, on a predetermined surface (in this embodiment, the right side surface 314) of the electrical device 300b.
  • the electrical device 300b includes a short-range wireless communication unit 320.
  • the determination unit 111 determines that the electric device 300b is located at a predetermined position based on a signal transmitted from the outside (short-range wireless communication unit 320).
  • the determination unit 111 determines that the terminal 100 is at a predetermined position with respect to the electrical device 300b based on the signal transmitted from the short-range wireless communication unit 320, but this is not limited to this.
  • the terminal 100 is connected to the electrical device based on a signal transmitted from a sensor such as a limit switch that is installed in the holder 340 formed on the electrical device 300b and can detect that the terminal 100 is installed. It may also be determined whether or not it is in a predetermined position.
  • the abnormality diagnosis system 10 includes a terminal 100 and an abnormality diagnosis device (server device 200) that can communicate with the terminal 100.
  • the terminal 100 includes a sound collection unit 140 that collects sounds, a recording processing unit 114 that performs recording processing that generates audio data from the sounds collected by the sound collection unit 140, and whether or not the terminal 100 is at a predetermined position relative to the electrical equipment 300.
  • a recording control unit 113 that allows the recording processing unit 114 to start recording processing when it is determined that the recording processing unit 114 is in a predetermined position
  • an abnormality diagnosis device and a transmission control unit 115 that transmits data to the server device 200.
  • the abnormality diagnosis device (server device 200) diagnoses the electrical device 300 based on the audio data transmitted from the terminal 100. As a result, sound can be collected from a predetermined position with respect to the electrical device 300, so that failure diagnosis of the electrical device 300 can be performed accurately.
  • the terminal 100 includes an imaging unit 150, and the determination unit 111 determines that the terminal is at a predetermined position when the captured image captured by the imaging unit 150 includes identification information D1.
  • the identification information D1 is image data obtained by capturing a part of the electrical device 300 from a specific position. Thereby, when the captured image includes the identification information D1, the relative position between the terminal 100 and the electrical device 300 is approximately determined, so that the terminal 100 can be easily aligned with respect to the electrical device 300.
  • the terminal 100 further includes a registration processing unit 116 that registers image data captured by the imaging unit 150 as identification information. Thereby, since the user himself/herself can register the identification information using the terminal 100, there is no need to provide the identification marker M on the electrical device 300. Therefore, even if an existing electrical device is not equipped with the identification marker M, the sound generated from the electrical device can be collected at a predetermined position.
  • the terminal 100 further includes a display unit 160 and a display control unit 112 that displays the captured image on the display unit 160 and displays an icon for guiding the terminal 100 to a predetermined position superimposed on the captured image. Thereby, the positioning of the terminal 100 with respect to the electric device 300 can be easily performed.
  • the display control unit 112 displays the icon in a highlighted manner when the determination unit 111 determines that the icon is in the predetermined position. Thereby, the user can easily understand that the terminal 100 is at a predetermined position with respect to the electrical device 300.
  • the icon is a thumbnail S of the identification information D1.
  • the user can search for the identification marker M provided on the electrical device 300 while referring to the thumbnail S. Therefore, it is possible to easily align the terminal 100 with respect to the electrical device 300.
  • the icon is a frame F that serves as a reference for the size of the identification marker M with respect to the imaging range R of the imaging unit 150. Thereby, by aligning the identification marker M with the frame F, the distance between the terminal 100 and the electrical device 300 can be set to an appropriate distance.
  • the display control unit 112 displays a button B that accepts an operation input to start the recording process, superimposed on the captured image. Thereby, the user can easily understand that the terminal 100 is in a predetermined position, and can smoothly start the recording process.
  • Device information of the electrical device 300 is associated with the identification information D1, and the transmission control unit 115 transmits the device information along with the audio data to the abnormality diagnosis device (server device 200). Thereby, it is possible to perform a failure diagnosis of the electrical device 300 taking into account the device information of the electrical device 300.
  • the identification information D1 is image data of an identification marker M provided on the outdoor unit, and the identification marker M is provided on a surface of the outdoor unit that is different from the surface on which the opening through which air passes is provided. Thereby, it is possible to avoid collecting sound from around the inlet 313a and the outlet 311a, which are susceptible to the influence of wind.
  • the outdoor unit (electrical equipment 300) has a plurality of identification markers M, each of which is an identification marker M. Thereby, it is possible to easily align the terminal 100 with respect to the identification marker M regardless of the arrangement position of the outdoor unit.
  • the determining unit 111 determines that the electrical device 300a (or the electrical device 300b) is at a predetermined position based on a signal transmitted from the outside when the electrical device is located at a predetermined position.
  • the electrical device 300a (or the electrical device 300b) has a marker 330 (or a holder 340) for placing the terminal 100 in a predetermined position. Thereby, it is possible to easily align the terminal 100 with respect to the electrical equipment.
  • the program connects the processor to a recording processing unit 114 that performs recording processing to generate audio data from sounds collected by a sound collection unit 140 provided in the terminal 100, and a recording processing unit 114 that performs a recording process to generate audio data from sounds collected by a sound collection unit 140 provided in the terminal 100.
  • a determination unit 111 that determines whether or not the device is located at a predetermined position
  • a recording control unit 113 that allows the recording processing unit 114 to start recording processing when it is determined that the recording processing unit 114 is located at a predetermined position
  • server device 200 server device 200
  • the above terminal 100 can be realized by hardware, software, or a combination thereof.
  • being realized by software means being realized by a computer reading and executing a program.
  • Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media are magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-ROMs, R/W, semiconductor memory (for example, mask ROM, PROM (programmable ROM), EPROM (erasable PROM), flash ROM, RAM (random access memory)).
  • the program may also be provided to the computer on various types of transitory computer readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves.
  • the temporary computer-readable medium can provide the program to the computer via wired communication channels, such as electrical wires and fiber optics, or wireless communication channels.
  • the present invention is not limited to this, and may be, for example, an indoor unit of an air conditioner, a washing machine, It may also be a refrigerator.
  • the present invention is not limited to the above embodiments, and various modifications are possible.
  • it can be replaced with a configuration that is substantially the same as the configuration shown in the above embodiment, a configuration that has the same effect, or a configuration that can achieve the same objective.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • Biomedical Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Selective Calling Equipment (AREA)
  • Air Conditioning Control Device (AREA)
  • Telephone Function (AREA)

Abstract

Provided is an abnormality diagnosis system capable of accurately performing failure diagnosis relating to an electrical device such as an air conditioner. An abnormality diagnosis system according to one aspect of the present invention comprises a terminal and an abnormality diagnosis device capable of communicating with the terminal. The terminal has a sound collection unit that collects sound, a recording processing unit that performs recording processing for generating sound data from the sound collected by the sound collection unit, a determination unit that determines whether or not the terminal is located in a predetermined position with respect to an electrical device, a recording control unit that, when the terminal is determined to be located in the predetermined position, permits the start of the recording processing by the recording processing unit, and a transmission control unit that transmits the sound data generated in the recording processing to the abnormality diagnosis device, and the abnormality diagnosis device diagnoses the electrical device on the basis of the sound data transmitted from the terminal.

Description

異常診断システム及びプログラムAbnormality diagnosis system and program
　本発明は、異常診断システム及びプログラムに関する。本願は、２０２２年４月１５日に、日本に出願された特願２０２２－０６７２６２号に基づき優先権を主張し、その内容をここに援用する。 The present invention relates to an abnormality diagnosis system and program. This application claims priority based on Japanese Patent Application No. 2022-067262 filed in Japan on April 15, 2022, the contents of which are incorporated herein.
　例えば、特許文献１には、空気調和装置の故障診断を行う故障診断システムが開示されている。上述の故障診断システムは、空気調和装置の音情報を検知する音検知装置と、過去に検知された音情報である過去音情報と過去音情報を検知した際の空気調和装置の機器状態とを元としたデータベースを構築するデータサーバと、データベースのデータと診断対象の空気調和装置の音情報である新規音情報とに基づいて故障診断を行う故障診断手段と、を備える。 For example, Patent Document 1 discloses a failure diagnosis system that diagnoses the failure of an air conditioner. The above-mentioned failure diagnosis system uses a sound detection device that detects sound information of an air conditioner, past sound information that is sound information detected in the past, and the equipment state of the air conditioner at the time when the past sound information was detected. The present invention includes a data server that constructs a base database, and a fault diagnosis means that performs fault diagnosis based on data in the database and new sound information that is sound information of an air conditioner to be diagnosed.
特開２００４－１３２６８３号公報Japanese Patent Application Publication No. 2004-132683
　上述の異常診断システム（故障診断システム）では、空気調和機（空気調和装置）と、空気調和機から生じる音を収集する集音部との位置関係によって、空気調和機から生じる音の聞こえ方が異なる。これは、例えば、空気調和機の部位によって振動が異なったり、吸込口、吹出口等の空気が通過する開口部近傍において風切り音が生じたりすることが要因として挙げられる。そのため、仮に、空気調和機に故障が生じていたとしても、集音位置によって収集される音が異なるため、空気調和機に関する故障診断を正確に行うことができない場合があった。 In the above-mentioned abnormality diagnosis system (failure diagnosis system), the way the sound generated by the air conditioner is heard depends on the positional relationship between the air conditioner (air conditioner) and the sound collection unit that collects the sound generated from the air conditioner. different. This may be caused by, for example, vibrations varying depending on the part of the air conditioner, or wind noise occurring near openings through which air passes, such as inlets and outlets. Therefore, even if a failure occurs in the air conditioner, the collected sounds differ depending on the sound collection position, so it may not be possible to accurately diagnose the failure of the air conditioner.
　そこで、本発明の一態様は、例えば、空気調和機等の電気機器に関する故障診断を正確に行うことができる異常診断システム及びプログラムを提供することを目的とする。 Therefore, an object of one aspect of the present invention is to provide an abnormality diagnosis system and program that can accurately perform failure diagnosis regarding electrical equipment such as an air conditioner.
　本発明の一態様に係る異常診断システムは、端末と、前記端末と通信可能な異常診断装置と、を備え、前記端末は、音を収集する集音部と、前記集音部が収集した音から音声データを生成する録音処理を行う録音処理部と、電気機器に対して所定位置にあるか否かを判定する判定部と、前記所定位置にあると判定した場合に、前記録音処理部による前記録音処理の開始を許可する録音制御部と、前記録音処理で生成された音声データを前記異常診断装置に送信する送信制御部と、を有し、前記異常診断装置は、前記端末から送信された前記音声データに基づいて前記電気機器の診断を行う。 An abnormality diagnosis system according to one aspect of the present invention includes a terminal and an abnormality diagnosis device that can communicate with the terminal, and the terminal includes a sound collection unit that collects sound, and a sound collection unit that collects sounds collected by the sound collection unit. a recording processing unit that performs recording processing to generate audio data from the electrical device; a determination unit that determines whether the electrical device is in a predetermined position relative to the electrical device; The abnormality diagnosis device includes a recording control unit that allows the start of the recording process, and a transmission control unit that transmits the audio data generated in the recording process to the abnormality diagnosis device, and the abnormality diagnosis device The electric device is diagnosed based on the voice data obtained.
　本発明の一態様に係るプログラムは、プロセッサを、端末に設けられた集音部が収集した音から音声データを生成する録音処理を行う録音処理部と、電気機器に対して前記端末が所定位置にあるか否かを判定する判定部と、前記所定位置にあると判定した場合に、前記録音処理部による前記録音処理の開始を許可する録音制御部と、前記録音処理で生成された音声データを異常診断装置に送信する送信制御部として機能させる。 A program according to one aspect of the present invention includes a processor, a recording processing unit that performs a recording process of generating audio data from sounds collected by a sound collection unit provided in a terminal, and a recording processing unit that performs a recording process that generates audio data from sounds collected by a sound collection unit provided in a terminal, and a recording processing unit that performs a recording process that generates audio data from sounds collected by a sound collection unit provided in a terminal, and a recording processing unit that performs a recording processing that generates audio data from sounds collected by a sound collection unit provided in a terminal; a recording control unit that allows the recording processing unit to start the recording processing when it is determined that the recording processing unit is located at the predetermined position, and audio data generated by the recording processing. functions as a transmission control unit that transmits the information to the abnormality diagnosis device.
異常診断システムを示す概要図である。FIG. 1 is a schematic diagram showing an abnormality diagnosis system. 端末及びサーバ装置のハードウェア構成を示すブロック図である。FIG. 2 is a block diagram showing the hardware configuration of a terminal and a server device. 電気機器を示す斜視図である。FIG. 2 is a perspective view showing an electrical device. 識別マーカの配置の一例を示す電気機器の上面図である。FIG. 3 is a top view of an electrical device showing an example of the arrangement of identification markers. 識別情報の一例を示す図である。It is a figure showing an example of identification information. 識別マーカの配置の変形例を示す電気機器の側面図である。FIG. 7 is a side view of an electrical device showing a modification of the arrangement of identification markers. 所定位置に端末が配置されていない状態における表示部の一例を示す図である。FIG. 3 is a diagram illustrating an example of a display unit in a state where a terminal is not placed at a predetermined position. 所定位置に端末が配置された状態における表示部の一例を示す図である。FIG. 3 is a diagram illustrating an example of a display unit in a state where a terminal is placed at a predetermined position. 表示部に重畳して表示される識別情報のサムネイルである。This is a thumbnail of identification information displayed superimposed on the display unit. 識別情報と電気機器の機器情報とが関連付けられたデータベースを示す図である。FIG. 3 is a diagram showing a database in which identification information and equipment information of electrical equipment are associated. 制御部による録音処理に係る制御フローの一例である。It is an example of the control flow regarding the recording process by a control part. 端末を所定位置に配置するためのマーカを示す電気機器の上面図である。FIG. 3 is a top view of the electrical device showing markers for locating a terminal in a predetermined position. 端末を所定位置に配置するためのホルダを示す電気機器の側面図である。FIG. 2 is a side view of the electrical device showing a holder for placing a terminal in a predetermined position.
　以下、図面を参照しつつ、本発明の各実施の形態について説明する。なお、本明細書及び図面において、同一又は同等の要素には同一の符号を付することにより重複する説明は省略し、また、本発明に直接関係のない要素は図示を省略する場合がある。さらに、かかる実施の形態に示す構成要素の形態はあくまでも例示であって、これらの形態に限定されるものではない。 Hereinafter, each embodiment of the present invention will be described with reference to the drawings. In this specification and the drawings, the same or equivalent elements are denoted by the same reference numerals, thereby omitting redundant explanations, and elements not directly related to the present invention may be omitted from illustration. Further, the configurations of the components shown in the embodiments are merely examples, and the present invention is not limited to these configurations.
　図１及び図２を参照して、本実施形態での異常診断システム１０の概要について説明する。図１は、異常診断システム１０を示す概略図である。図２は、端末１００及びサーバ装置２００のハードウェア構成を示す図である。異常診断システム１０は、電気機器３００（本実施形態では、室外機）から生じる音を収集することにより、電気機器３００の故障診断を行うシステムである。異常診断システム１０は、端末１００がネットワークＮＷを介してサーバ装置２００に接続可能に構成されている。 An overview of the abnormality diagnosis system 10 in this embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a schematic diagram showing an abnormality diagnosis system 10. FIG. 2 is a diagram showing the hardware configuration of the terminal 100 and the server device 200. The abnormality diagnosis system 10 is a system that performs failure diagnosis of the electrical equipment 300 by collecting sounds generated from the electrical equipment 300 (in this embodiment, the outdoor unit). The abnormality diagnosis system 10 is configured such that a terminal 100 can be connected to a server device 200 via a network NW.
　まず、端末１００について説明する。端末１００は、電気機器３００から生じる音を収集するための端末である。端末１００は、例えば、スマートホンである。端末１００は、制御部１１０と、記憶部１２０と、通信部１３０と、集音部１４０と、撮像部１５０と、表示部１６０と、を有する。 First, the terminal 100 will be explained. Terminal 100 is a terminal for collecting sounds generated from electrical equipment 300. Terminal 100 is, for example, a smart phone. The terminal 100 includes a control section 110, a storage section 120, a communication section 130, a sound collection section 140, an imaging section 150, and a display section 160.
　制御部１１０は、端末１００を制御する。制御部１１０は、記憶部１２０に記憶されている各種プログラムを読み出して実行することにより、各種機能を実現している。制御部１１０は、例えば、１つまたは複数のＣＰＵ（Ｃｅｎｔｒａｌ　Ｐｒｏｃｅｓｓｉｎｇ　Ｕｎｉｔ）等により構成されている。 The control unit 110 controls the terminal 100. The control unit 110 implements various functions by reading and executing various programs stored in the storage unit 120. The control unit 110 includes, for example, one or more CPUs (Central Processing Units).
　記憶部１２０は、端末１００の動作に必要な各種プログラムや、各種データを記憶する。記憶部１２０は、例えば、フラッシュメモリなどの不揮発性の記憶部である。 The storage unit 120 stores various programs and various data necessary for the operation of the terminal 100. The storage unit 120 is, for example, a nonvolatile storage unit such as a flash memory.
　通信部１３０は、ネットワークＮＷに接続して通信するためのインタフェースである。通信部１３０は、ネットワークＮＷを介してサーバ装置２００との通信を制御する。本実施形態では、通信部１３０は、ネットワークＮＷと無線通信で接続されているが、これに限らず、有線通信で接続されてもよい。 The communication unit 130 is an interface for connecting to and communicating with the network NW. The communication unit 130 controls communication with the server device 200 via the network NW. In this embodiment, the communication unit 130 is connected to the network NW by wireless communication, but the communication unit 130 is not limited to this, and may be connected by wired communication.
　集音部１４０は、周囲の音を収集する。集音部１４０は、例えば、コンデンサマイク、ダイナミックマイク、またはＭＥＭＳ（Ｍｉｃｒｏ　Ｅｌｅｃｔｒｏ　Ｍｅｃｈａｎｉｃａｌ　Ｓｙｓｔｅｍｓ）などである。 The sound collection unit 140 collects surrounding sounds. The sound collection unit 140 is, for example, a condenser microphone, a dynamic microphone, or MEMS (Micro Electro Mechanical Systems).
　撮像部１５０は、撮像範囲に入った対象を画像化するカメラである。撮像部１５０は、ステレオカメラであってもよいし、マルチスペクトルカメラ等であってもよい。 The imaging unit 150 is a camera that images an object within its imaging range. The imaging unit 150 may be a stereo camera, a multispectral camera, or the like.
　表示部１６０は、撮像部１５０によって撮像された撮像画像（撮像映像）、後述の枠Ｆ、サムネイルＳ、ボタンＢ等を表示する。表示部１６０は、例えば、操作機能を有するタッチパネルである。表示部１６０は、タッチパネルに限らず、例えば、撮像部１５０によって撮像された撮像画像（撮像映像）、後述の枠Ｆ、サムネイルＳ等を表示する機能のみを有する表示パネルであってもよい。この場合、端末１００を操作するための操作部を別途設ければよい。 The display unit 160 displays a captured image (captured video) captured by the imaging unit 150, a frame F, a thumbnail S, a button B, etc., which will be described later. The display unit 160 is, for example, a touch panel with an operation function. The display unit 160 is not limited to a touch panel, and may be a display panel having only the function of displaying, for example, a captured image (captured video) captured by the imaging unit 150, a frame F, a thumbnail S, etc. to be described later. In this case, a separate operation section for operating the terminal 100 may be provided.
　次に、サーバ装置２００について説明する。本実施形態では、サーバ装置２００は、端末１００によって生成された音声データに基づいて電気機器３００の故障診断を行う装置である。サーバ装置２００は、制御部２１０と、記憶部２２０と、通信部２３０と、を有する。 Next, the server device 200 will be explained. In this embodiment, the server device 200 is a device that performs failure diagnosis of the electrical device 300 based on audio data generated by the terminal 100. Server device 200 includes a control section 210, a storage section 220, and a communication section 230.
　制御部２１０は、サーバ装置２００を制御する。制御部２１０は、記憶部２２０に記憶されている各種プログラムを読み出して実行することにより、各種機能を実現している。制御部２１０は、例えば、１つまたは複数のＣＰＵ（Ｃｅｎｔｒａｌ　Ｐｒｏｃｅｓｓｉｎｇ　Ｕｎｉｔ）等により構成されている。 The control unit 210 controls the server device 200. The control unit 210 implements various functions by reading and executing various programs stored in the storage unit 220. The control unit 210 includes, for example, one or more CPUs (Central Processing Units).
　記憶部２２０は、サーバ装置２００の動作に必要な各種プログラムや各種データを記憶する。記憶部２２０は、例えば、ＳＳＤ（Ｓｏｌｉｄ　Ｓｔａｔｅ　Ｄｒｉｖｅ）またはＨＤＤ（Ｈａｒｄ　Ｄｉｓｋ　Ｄｒｉｖｅ）等の不揮発性の記憶部である。 The storage unit 220 stores various programs and various data necessary for the operation of the server device 200. The storage unit 220 is, for example, a nonvolatile storage unit such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive).
　通信部２３０は、ネットワークＮＷに接続して通信するためのインタフェースである。通信部２３０は、ネットワークＮＷを介して端末１００との通信を制御する。本実施形態では、通信部２３０は、ネットワークＮＷと有線通信で接続されているが、これに限らず、無線通信で接続されてもよい。 The communication unit 230 is an interface for connecting to and communicating with the network NW. Communication unit 230 controls communication with terminal 100 via network NW. In this embodiment, the communication unit 230 is connected to the network NW by wired communication, but the communication unit 230 is not limited to this, and may be connected by wireless communication.
　次に、電気機器３００について説明する。電気機器３００は、例えば、空気調和機の室外機である。電気機器３００は、圧縮機、送風機、熱交換器などが収容された略直方体状の筐体３１０を有する（図３参照）。筐体３１０は、前面３１１と、後面３１２と、左側面３１３と、右側面３１４と、上面３１５と、下面３１６と、を有する。筐体３１０の左側面３１３には、吸込口３１３ａが形成され、筐体３１０の前面３１１には、吹出口３１１ａが形成される。 Next, the electric device 300 will be explained. Electrical equipment 300 is, for example, an outdoor unit of an air conditioner. The electrical device 300 has a substantially rectangular parallelepiped-shaped housing 310 that houses a compressor, a blower, a heat exchanger, and the like (see FIG. 3). The housing 310 has a front surface 311 , a rear surface 312 , a left side surface 313 , a right side surface 314 , an upper surface 315 , and a lower surface 316 . A suction port 313a is formed on the left side surface 313 of the casing 310, and an air outlet 311a is formed on the front surface 311 of the casing 310.
　以上の構成において、異常診断システム１０では、ユーザが端末１００を用いて電気機器３００から生じる音を収集することにより、電気機器３００の故障診断を行う。具体的には、異常診断システム１０では、電気機器３００に対して端末１００が所定位置にあるか否かを判定し、端末１００が所定位置にあると判定された場合に、端末１００による電気機器３００の録音処理の開始を許可する。端末１００による録音処理が終了すると、録音処理で生成された音声データをサーバ装置２００に送信し、サーバ装置２００は、取得した音声データに基づいて電気機器３００の故障診断を行う。サーバ装置２００による故障診断が終了すると、診断結果を端末１００に送信して終了となる。 In the above configuration, in the abnormality diagnosis system 10, the user uses the terminal 100 to collect sounds generated from the electrical equipment 300, thereby diagnosing the failure of the electrical equipment 300. Specifically, the abnormality diagnosis system 10 determines whether or not the terminal 100 is in a predetermined position with respect to the electrical device 300, and when it is determined that the terminal 100 is in the predetermined position, the terminal 100 detects the electrical device. Allow the start of the recording process of 300. When the recording process by the terminal 100 is completed, the audio data generated by the recording process is transmitted to the server device 200, and the server device 200 diagnoses the failure of the electrical device 300 based on the acquired audio data. When the failure diagnosis by the server device 200 is completed, the diagnosis result is transmitted to the terminal 100 and the process ends.
　図３から図８までを用いて、端末１００が、電気機器３００に対して所定位置にあるか否かを判定する構成について説明する。図３は、電気機器３００を示す斜視図である。図４は、識別マーカＭの配置の一例を示す電気機器３００の上面図である。図５は、識別情報Ｄ１を示す図である。図６は、識別マーカＭの配置の変形例を示す電気機器３００の側面図である。図７は、所定位置に端末１００が配置されていない状態における表示部１６０の一例である。図８は、所定位置に端末１００が配置された状態における表示部１６０の一例を示す図である。 A configuration for determining whether the terminal 100 is at a predetermined position with respect to the electrical device 300 will be described using FIGS. 3 to 8. FIG. 3 is a perspective view showing the electrical device 300. FIG. 4 is a top view of the electrical device 300 showing an example of the arrangement of the identification markers M. FIG. 5 is a diagram showing the identification information D1. FIG. 6 is a side view of the electrical device 300 showing a modification of the arrangement of the identification markers M. FIG. 7 is an example of the display unit 160 in a state where the terminal 100 is not placed at a predetermined position. FIG. 8 is a diagram showing an example of the display unit 160 in a state where the terminal 100 is placed at a predetermined position.
　本実施形態では、端末１００は、画像認識処理を行うことによって、端末１００が電気機器３００に対して所定位置にあるか否かを判定している。所定位置とは、電気機器３００の所定の面（本実施形態では、上面３１５）と間隔をあけて対向する位置である。電気機器３００の所定の面とは、例えば、電気機器３００の空気が通過する開口部が設けられる面とは異なる面である。電気機器３００の空気が通過する開口部とは、電気機器３００の吸込口３１３ａおよび吹出口３１１ａを指す。 In this embodiment, the terminal 100 determines whether the terminal 100 is at a predetermined position relative to the electrical device 300 by performing image recognition processing. The predetermined position is a position facing a predetermined surface (in this embodiment, the top surface 315) of the electrical device 300 with a space therebetween. The predetermined surface of the electrical device 300 is, for example, a surface different from the surface of the electrical device 300 where an opening through which air passes is provided. The opening through which the air of the electrical device 300 passes refers to the inlet 313a and the outlet 311a of the electrical device 300.
　端末１００の制御部１１０は、判定部１１１と、表示制御部１１２と、録音制御部１１３と、録音処理部１１４と、送信制御部１１５と、登録処理部１１６と、を含む（図２参照）。 The control unit 110 of the terminal 100 includes a determination unit 111, a display control unit 112, a recording control unit 113, a recording processing unit 114, a transmission control unit 115, and a registration processing unit 116 (see FIG. 2). .
　判定部１１１は、撮像部１５０によって撮像された撮像画像に識別情報Ｄ１が含まれるか否かを判定する。識別情報Ｄ１は、電気機器３００の一部を特定の位置から撮像した画像データである。本実施形態では、電気機器３００の一部とは、例えば、電気機器３００の所定の面（本実施形態では、上面３１５）に設けられた識別マーカＭである。識別マーカＭは、例えば、特定の模様（例えば、動物を模した模様）が形成された面（識別面Ｍ１とも称する）を有するマーカである。本実施形態では、識別マーカＭの識別面Ｍ１は、上方を向くように配置される。特定の位置とは、電気機器３００の所定の面（本実施形態では、上面３１５）と間隔をあけて対向する位置である。すなわち、識別情報Ｄ１は、電気機器３００の上面３１５に設けられた識別マーカＭ（識別面Ｍ１）を上方から撮像した画像データである。これにより、電気機器３００の識別マーカＭを上方から撮像した場合にのみ、撮像画像に識別情報Ｄ１が含まれる構成としている。 The determining unit 111 determines whether the captured image captured by the imaging unit 150 includes the identification information D1. The identification information D1 is image data obtained by capturing a part of the electrical device 300 from a specific position. In this embodiment, the part of electrical equipment 300 is, for example, an identification marker M provided on a predetermined surface (in this embodiment, upper surface 315) of electrical equipment 300. The identification marker M is, for example, a marker that has a surface (also referred to as identification surface M1) on which a specific pattern (for example, a pattern imitating an animal) is formed. In this embodiment, the identification surface M1 of the identification marker M is arranged to face upward. The specific position is a position that faces a predetermined surface (in this embodiment, the top surface 315) of the electrical device 300 with an interval therebetween. That is, the identification information D1 is image data obtained by capturing an image of the identification marker M (identification surface M1) provided on the top surface 315 of the electrical device 300 from above. As a result, the identification information D1 is included in the captured image only when the identification marker M of the electrical device 300 is captured from above.
　なお、識別マーカＭは、動物を模した模様を有しているが、これに限らず、例えば、ブロンドロゴ、バーコード、ＱＲコード（登録商標）を有してもよい。また、識別マーカＭは、特定の模様を有しているが、これに限らず、例えば、特定の形状を有するものであってもよい。識別情報Ｄ１は、記憶部１２０に予め記憶されているものとする。 Note that the identification marker M has a pattern imitating an animal, but is not limited to this, and may have, for example, a blonde logo, a barcode, or a QR code (registered trademark). Moreover, although the identification marker M has a specific pattern, it is not limited to this, and may have a specific shape, for example. It is assumed that the identification information D1 is stored in the storage unit 120 in advance.
　判定部１１１が、撮像部１５０によって撮像された撮像画像に識別情報Ｄ１が含まれていると判定した場合に、端末１００が、電気機器３００に対して所定位置にあると判定する。判定部１１１による画像認識処理の方法は、公知の画像マッチング形式や、特徴量による物体認識方式、２次元バーコード画像識別方式等を用いることができる。 If the determining unit 111 determines that the identification information D1 is included in the captured image captured by the imaging unit 150, it determines that the terminal 100 is at a predetermined position with respect to the electrical device 300. As a method for image recognition processing by the determination unit 111, a known image matching format, an object recognition method using feature amounts, a two-dimensional barcode image identification method, etc. can be used.
　なお、本実施形態では、電気機器３００の上面３１５と間隔をあけて対向する位置を所定位置としているが、これに限らず、電気機器３００の所定の面と間隔をあけて対向する位置であればよく、例えば、電気機器３００の右側面３１４と対向する位置を所定位置としてもよい。この場合、図６に示すように、右側面３１４に識別マーカＭが設けられ、識別マーカＭの識別面Ｍ１が、右方を向くように配置されればよい。 Note that in this embodiment, the predetermined position is a position facing the top surface 315 of the electrical device 300 with a space between them, but the predetermined position is not limited to this, and any position facing the top surface 315 of the electrical device 300 with a space between them is not limited to this. For example, the predetermined position may be a position facing the right side surface 314 of the electrical device 300. In this case, as shown in FIG. 6, the identification marker M may be provided on the right side surface 314, and the identification surface M1 of the identification marker M may be placed so as to face to the right.
　また、電気機器３００は、１つの識別マーカＭを有しているが、これに限らず、複数の識別マーカＭを有してもよい。例えば、電気機器３００の上面３１５と下面３１６とにそれぞれ設けられてもよい。 Further, although the electrical device 300 has one identification marker M, the present invention is not limited to this, and may have a plurality of identification markers M. For example, they may be provided on the upper surface 315 and the lower surface 316 of the electrical device 300, respectively.
　また、識別情報Ｄ１は、識別マーカＭを撮像した画像データであるが、これに限らず、識別マーカＭを用いることなく、電気機器３００の所定の面（例えば、上面３１５）の一部を撮像した画像データであってもよい。 Further, the identification information D1 is image data obtained by capturing an image of the identification marker M, but is not limited to this. It may also be image data that has been created.
　また、判定部１１１が、撮像部１５０によって撮像された撮像画像に識別情報Ｄ１が含まれていると判定した場合に、端末１００が、電気機器３００に対して所定位置にあると判定しているが、これに限らない。例えば、撮像部１５０によって撮像された撮像画像に識別情報Ｄ１が含まれていると判定し、かつ電気機器３００に対する端末１００の距離が所定範囲内の距離であると判定した場合に、端末１００が、電気機器３００に対して所定位置にあると判定してもよい。この場合、所定位置とは、電気機器３００の所定の面（本実施形態では、上面３１５）に対して間隔をあけて対向する位置で、かつ電気機器３００に対する端末１００の距離が所定範囲内の距離である位置を指す。 Further, when the determination unit 111 determines that the identification information D1 is included in the captured image captured by the imaging unit 150, it is determined that the terminal 100 is at a predetermined position with respect to the electrical device 300. However, it is not limited to this. For example, if it is determined that the identification information D1 is included in the captured image captured by the imaging unit 150, and if it is determined that the distance of the terminal 100 to the electrical device 300 is within a predetermined range, the terminal 100 , it may be determined that it is at a predetermined position with respect to the electrical device 300. In this case, the predetermined position is a position facing a predetermined surface of the electrical device 300 (in this embodiment, the top surface 315) with an interval, and where the distance of the terminal 100 to the electrical device 300 is within a predetermined range. Points to a position by distance.
　この場合、判定部１１１は、電気機器３００の識別マーカＭに対する端末１００の距離が所定範囲内の距離であるか否かをさらに判定する。本実施形態では、撮像範囲Ｒに対する識別情報Ｄ１の大きさが所定範囲内の大きさであるか否かを判定することで、上記の距離が所定範囲内の距離であるか否かを判定している。 In this case, the determining unit 111 further determines whether the distance of the terminal 100 to the identification marker M of the electrical device 300 is within a predetermined range. In this embodiment, by determining whether the size of the identification information D1 with respect to the imaging range R is within a predetermined range, it is determined whether the above distance is within a predetermined range. ing.
　以上の構成において、撮像範囲Ｒに対する識別情報Ｄ１の大きさを用いて、識別マーカＭに対する端末１００の距離を算出しているが、これに限らず、測距センサを用いて、識別マーカＭに対する端末１００の距離を測定してもよい。この場合、測距センサは、例えば、対象からのパルス光の反射の戻り時間を用いて測距を行うＴＯＦ（Ｔｉｍｅ　ｏｆ　Ｆｌｉｇｈｔ）方式であってもよいし、格子状のパターン光を照射して、パターンの歪みにより測距を行うストラクチャードライト方式のセンサであってもよい。また、測距センサに限らず、例えば、ステレオカメラの視差を用いて、撮像部１５０の撮像範囲Ｒ内の対象（識別マーカＭ）までの距離を算出してもよい。この場合、撮像部１５０は、ステレオカメラによって構成される。 In the above configuration, the distance of the terminal 100 to the identification marker M is calculated using the size of the identification information D1 with respect to the imaging range R, but the distance between the terminal 100 and the identification marker M is not limited to this. The distance to the terminal 100 may also be measured. In this case, the distance measurement sensor may be a TOF (Time of Flight) method that measures distance using the return time of pulsed light reflected from the target, or a distance measurement sensor that uses a grid-like pattern of light to measure the distance. , a structured light type sensor that measures distance by pattern distortion may also be used. Further, the distance to the object (identification marker M) within the imaging range R of the imaging unit 150 may be calculated using not only the distance measuring sensor but also the parallax of a stereo camera, for example. In this case, the imaging unit 150 is configured by a stereo camera.
　図７及び図８に示すように、表示制御部１１２は、表示部１６０に撮像画像を表示するとともに、端末１００を所定位置にガイドするためのアイコンを表示部１６０（撮像画像）に重畳して表示する。アイコンは、例えば、撮像範囲Ｒに対する識別情報Ｄ１の大きさの基準となる枠Ｆである。枠Ｆは、撮像範囲Ｒに対して所望の大きさに設定された矩形状の枠である。枠Ｆの大きさは、撮像部１５０の画角に基づいて予め定められているものとする。これにより、枠Ｆに識別情報Ｄ１を合わせることによって、電気機器３００に対する端末１００の距離を適切な距離にすることができる。 As shown in FIGS. 7 and 8, the display control unit 112 displays the captured image on the display unit 160, and also superimposes an icon for guiding the terminal 100 to a predetermined position on the display unit 160 (captured image). indicate. The icon is, for example, a frame F that serves as a reference for the size of the identification information D1 for the imaging range R. The frame F is a rectangular frame set to a desired size with respect to the imaging range R. It is assumed that the size of the frame F is predetermined based on the angle of view of the imaging section 150. Thereby, by matching the identification information D1 to the frame F, the distance between the terminal 100 and the electrical device 300 can be set to an appropriate distance.
　表示制御部１１２は、判定部１１１によって端末１００が所定位置にあると判定された場合、アイコン（枠Ｆ）を強調表示する。ここでの強調表示とは、枠Ｆの色、線種及び線の太さ等の少なくとも一部を変更して表示することを指す。本実施形態では、例えば、端末１００が電気機器３００に対して所定位置にあると判定されていない状態では、枠Ｆは、緑色に表示され、端末１００が電気機器３００に対して所定位置にあると判定された状態では、枠Ｆは、赤色に表示される。これにより、ユーザは、端末１００が電気機器３００に対して所定位置にあることを容易に把握することができる。 When the determination unit 111 determines that the terminal 100 is in the predetermined position, the display control unit 112 highlights the icon (frame F). Highlighting here refers to displaying the frame F with at least a portion of the color, line type, line thickness, etc. changed. In this embodiment, for example, when it is not determined that the terminal 100 is in a predetermined position with respect to the electrical device 300, the frame F is displayed in green, and the terminal 100 is in a predetermined position with respect to the electrical device 300. In the state where it is determined that the frame F is red, the frame F is displayed in red. Thereby, the user can easily understand that the terminal 100 is at a predetermined position with respect to the electrical device 300.
　録音制御部１１３は、判定部１１１によって端末１００が電気機器３００に対して所定位置にあると判定された場合、録音処理部１１４による録音処理の開始を許可する。 If the determination unit 111 determines that the terminal 100 is at a predetermined position relative to the electrical device 300, the recording control unit 113 allows the recording processing unit 114 to start recording processing.
　表示制御部１１２は、判定部１１１によって端末１００が電気機器３００に対して所定位置にあると判定された場合、録音処理部１１４による録音処理を開始する操作入力を受け付けるボタンＢを表示部１６０（撮像画像）に重畳して表示する。ユーザがボタンＢをタッチすることにより、録音制御部１１３は、録音処理部１１４による録音処理を開始する。 When the determination unit 111 determines that the terminal 100 is at a predetermined position with respect to the electrical device 300, the display control unit 112 displays a button B on the display unit 160 ( displayed superimposed on the captured image). When the user touches button B, the recording control unit 113 causes the recording processing unit 114 to start recording processing.
　図７に示すように、判定部１１１によって、端末１００が電気機器３００に対して所定位置にあると判定されていない状態では、録音制御部１１３は、録音処理部１１４による録音処理の開始を許可せず、表示制御部１１２は、表示部１６０にボタンＢを表示しない。 As shown in FIG. 7, when the determination unit 111 does not determine that the terminal 100 is at a predetermined position with respect to the electrical device 300, the recording control unit 113 allows the recording processing unit 114 to start recording processing. Therefore, the display control unit 112 does not display button B on the display unit 160.
　図８に示すように、判定部１１１によって、端末１００が電気機器３００に対して所定位置にあると判定された状態では、録音制御部１１３は、録音処理部１１４による録音処理の開始を許可し、表示制御部１１２は、表示部１６０（撮像画像）にボタンＢを重畳して表示する。ユーザがボタンＢをタッチすることで、録音制御部１１３は、録音処理部１１４による録音処理を開始する。以上のように、端末１００が電気機器３００に対して所定位置にあると判定された場合に、表示部１６０（撮像画像）にボタンＢを重畳して表示することで、ユーザは端末１００が所定位置にあることを容易に把握することができるとともに、録音処理を円滑に開始することができる。 As shown in FIG. 8, in a state in which the determination unit 111 determines that the terminal 100 is at a predetermined position with respect to the electrical device 300, the recording control unit 113 allows the recording processing unit 114 to start recording processing. , the display control unit 112 displays button B in a superimposed manner on the display unit 160 (captured image). When the user touches button B, the recording control unit 113 causes the recording processing unit 114 to start recording processing. As described above, when it is determined that the terminal 100 is in a predetermined position with respect to the electrical device 300, by superimposing and displaying the button B on the display unit 160 (captured image), the user can see that the terminal 100 is in a predetermined position. It is possible to easily know the location, and also to smoothly start recording processing.
　録音制御部１１３は、ユーザによる録音処理の開始操作が行われてから、所定時間が経過する、またはユーザによる録音処理の終了操作が行われるまで、録音処理部１１４による録音処理を実行する。本実施形態でのユーザによる録音処理の開始操作とは、図８に示すボタンＢをユーザがタッチすることである。本実施形態でのユーザによる録音処理の終了操作とは、図８に示すボタンＢをユーザが再度タッチすることである。録音処理部１１４は、集音部が収集した音から音声データを生成する録音処理を行う。録音処理とは、例えば、集音部１４０から得られる入力音声信号（アナログ信号）をアンプ回路によって増幅した上で、デジタル信号に変換する処理である。 The recording control unit 113 causes the recording processing unit 114 to execute the recording process until a predetermined time period elapses after the user performs an operation to start the recording process, or until the user performs an operation to end the recording process. In this embodiment, the user's operation to start the recording process is the user's touch of button B shown in FIG. 8 . In this embodiment, the user's operation to end the recording process is when the user touches button B shown in FIG. 8 again. The recording processing unit 114 performs recording processing to generate audio data from the sounds collected by the sound collection unit. The recording process is, for example, a process in which an input audio signal (analog signal) obtained from the sound collection section 140 is amplified by an amplifier circuit and then converted into a digital signal.
　図９を用いて、端末１００を所定位置にガイドするためのアイコンの別例について説明する。図９は、表示部１６０（撮像画像）に重畳して表示される識別情報Ｄ１のサムネイルＳである。 Another example of an icon for guiding the terminal 100 to a predetermined position will be described using FIG. 9. FIG. 9 shows a thumbnail S of the identification information D1 superimposed and displayed on the display unit 160 (captured image).
　表示制御部１１２は、端末１００を所定位置にガイドするためのアイコン（サムネイルＳ）を表示部１６０（撮像画像）に重畳して表示する。サムネイルＳは、識別情報Ｄ１が縮小表示された画像データである。これにより、ユーザは、サムネイルＳを参照しながら、電気機器３００に設けられた識別マーカＭを探すことができる。ゆえに、電気機器３００に対する端末１００の位置合わせを容易に行うことができる。 The display control unit 112 displays an icon (thumbnail S) for guiding the terminal 100 to a predetermined position in a superimposed manner on the display unit 160 (captured image). The thumbnail S is image data in which the identification information D1 is displayed in a reduced size. Thereby, the user can search for the identification marker M provided on the electrical device 300 while referring to the thumbnail S. Therefore, it is possible to easily align the terminal 100 with respect to the electrical device 300.
　表示制御部１１２は、判定部１１１によって端末１００が所定位置にあると判定された場合、アイコン（サムネイルＳ）を強調表示する。ここでの強調表示とは、サムネイルＳの色、線種及び線の太さ等の少なくとも一部を変更して表示することを指す。本実施形態では、例えば、端末１００が電気機器３００に対して所定位置にあると判定されていない状態では、サムネイルＳは、細線にて表示し、端末１００が電気機器３００に対して所定位置にあると判定された状態では、太線にて表示する。これにより、ユーザは、端末１００が電気機器３００に対して所定位置にあることを容易に把握することができる。 The display control unit 112 highlights the icon (thumbnail S) when the determination unit 111 determines that the terminal 100 is in a predetermined position. Highlighting here refers to displaying the thumbnail S with at least a portion of the color, line type, line thickness, etc. changed. In this embodiment, for example, when the terminal 100 is not determined to be in a predetermined position with respect to the electrical device 300, the thumbnail S is displayed as a thin line, and the thumbnail S is displayed as a thin line, If it is determined that there is, it is displayed with a thick line. Thereby, the user can easily understand that the terminal 100 is at a predetermined position with respect to the electrical device 300.
　送信制御部１１５は、録音処理部１１４による録音処理で生成された音声データを、通信部１３０を介してサーバ装置２００に送信する。生成された音声データは、記憶部１２０に記憶してもよい。 The transmission control unit 115 transmits the audio data generated by the recording process by the recording processing unit 114 to the server device 200 via the communication unit 130. The generated audio data may be stored in the storage unit 120.
　図１０に示すように、識別情報には、電気機器３００の機器情報が関連付けられてもよい。図１０は、識別情報と電気機器の機器情報とが関連付けられたデータベース１２０ａの一例を示す図である。電気機器の機器情報とは、例えば、電気機器の種類、型番などである。端末１００の記憶部１２０には、電気機器ごとに、異なる種類の識別情報が対応付けられたデータベース１２０ａが記憶されている。図１０に示すように、例えば、識別情報Ｄ１は、電気機器の一例である室外機の機器情報と関連付けられ、識別情報Ｄ２は、電気機器の別例である冷蔵庫の機器情報と関連付けられ、識別情報Ｄ３は、電気機器の別例である洗濯機の機器情報と関連付けられている。 As shown in FIG. 10, device information of the electrical device 300 may be associated with the identification information. FIG. 10 is a diagram showing an example of a database 120a in which identification information and equipment information of electrical equipment are associated. The device information of the electrical device includes, for example, the type and model number of the electrical device. The storage unit 120 of the terminal 100 stores a database 120a in which different types of identification information are associated with each electrical device. As shown in FIG. 10, for example, the identification information D1 is associated with equipment information of an outdoor unit, which is an example of electrical equipment, and the identification information D2 is associated with equipment information of a refrigerator, which is another example of electrical equipment. Information D3 is associated with device information of a washing machine, which is another example of electrical equipment.
　以上の構成において、画像認識処理を用いて、識別情報を認識することで、当該認識された識別情報に関連付けられた電気機器の機器情報を取得する。電気機器の機器情報を取得する構成の場合、送信制御部１１５は、録音処理部１１４による録音処理で生成された音声データとともに、電気機器の機器情報を、通信部１３０を介してサーバ装置２００に送信する。 In the above configuration, by recognizing the identification information using image recognition processing, device information of the electrical device associated with the recognized identification information is acquired. In the case of a configuration in which device information of an electrical device is acquired, the transmission control unit 115 transmits the device information of the electrical device to the server device 200 via the communication unit 130 along with the audio data generated by the recording process by the recording processing unit 114. Send.
　なお、データベース１２０ａは、端末１００の記憶部１２０に記憶されているが、これに限らず、例えば、サーバ装置２００の記憶部２２０に記憶されてもよいし、外部の端末に記憶されていてもよい。 Note that although the database 120a is stored in the storage unit 120 of the terminal 100, the database 120a is not limited to this, and may be stored in the storage unit 220 of the server device 200, for example, or may be stored in an external terminal. good.
　また、端末１００又はサーバ装置２００を電気機器３００と通信可能に構成することで、上述の電気機器３００の機器情報に加えて、電気機器３００の運転に係る情報を取得してもよい。ここでの電気機器３００の運転に係る情報とは、例えば、圧縮機の回転数、送風機の回転数等である。 Furthermore, by configuring the terminal 100 or the server device 200 to be able to communicate with the electrical device 300, in addition to the device information of the electrical device 300 described above, information related to the operation of the electrical device 300 may be acquired. The information related to the operation of the electrical equipment 300 here includes, for example, the rotation speed of the compressor, the rotation speed of the blower, and the like.
　なお、本実施形態では、識別情報Ｄ１が記憶部１２０に予め記憶されているが、これに限らず、端末１００を用いて撮像部１５０によって撮像された画像データを、識別情報として記憶部１２０に登録してもよい。 In the present embodiment, the identification information D1 is stored in advance in the storage unit 120, but the invention is not limited to this. Image data captured by the imaging unit 150 using the terminal 100 may be stored in the storage unit 120 as identification information. You may register.
　登録処理部１１６は、撮像部１５０によって撮像された画像データを識別情報として記憶部１２０に登録する。登録処理部１１６は、例えば、ユーザが撮像した画像データ（例えば、電気機器３００の上面３１５の一部）を、識別情報として記憶部１２０に登録する。この場合、判定部１１１は、登録処理部１１６において登録された識別情報が、撮像部１５０によって撮像された撮像画像に含まれるか否かを判定する。 The registration processing unit 116 registers the image data captured by the imaging unit 150 in the storage unit 120 as identification information. For example, the registration processing unit 116 registers image data captured by the user (for example, a portion of the top surface 315 of the electrical device 300) in the storage unit 120 as identification information. In this case, the determining unit 111 determines whether the identification information registered in the registration processing unit 116 is included in the captured image captured by the imaging unit 150.
　以上の構成において、ユーザ自身が端末１００を用いて識別情報を登録することができるため、電気機器３００に識別マーカＭを設ける必要がない。ゆえに、識別マーカＭが備えられていない既存の電気機器であっても、電気機器から生じる音を所定位置において収集することができる。 In the above configuration, since the user himself/herself can register the identification information using the terminal 100, there is no need to provide the identification marker M on the electrical device 300. Therefore, even if an existing electrical device is not equipped with the identification marker M, the sound generated from the electrical device can be collected at a predetermined position.
　次に、サーバ装置２００による電気機器３００の故障診断について説明する。サーバ装置２００の制御部２１０は、音声データ取得部２１１と、診断部２１２と、送信制御部２１３と、を含む（図２参照）。 Next, failure diagnosis of the electrical equipment 300 by the server device 200 will be explained. The control unit 210 of the server device 200 includes an audio data acquisition unit 211, a diagnosis unit 212, and a transmission control unit 213 (see FIG. 2).
　音声データ取得部２１１は、端末１００から通信部２３０を介して音声データを取得する。診断部２１２は、音声データ取得部２１１が取得した音声データに基づいて、電気機器３００の故障に関する診断処理を行う。送信制御部２１３は、診断部２１２による診断処理の結果を、通信部２３０を介して端末１００に送信する。 The audio data acquisition unit 211 acquires audio data from the terminal 100 via the communication unit 230. The diagnosis unit 212 performs diagnostic processing regarding a failure of the electrical device 300 based on the audio data acquired by the audio data acquisition unit 211. The transmission control unit 213 transmits the results of the diagnostic processing performed by the diagnosis unit 212 to the terminal 100 via the communication unit 230.
　診断部２１２は、例えば、学習済みの故障診断モデルに基づいて、電気機器３００の故障の有無を判定している。診断部２１２は、電気機器３００に故障が生じていると判定した場合には、故障の種類を判定している。故障診断モデルは、音声データを用いて電気機器３００の故障を判定するためのモデルである。故障診断モデルは、記憶部２２０に記憶される故障診断データベース２２０ａを用いて機械学習を実行することで、生成される。故障診断データベース２２０ａには、電気機器３００の種類ごとに、故障の種類に応じた複数の音声データ（教師データ）が記憶される。故障診断モデルの形成には、例えば、ディープラーニングなどの公知のアルゴリズムを用いることができる。 The diagnostic unit 212 determines whether or not there is a failure in the electrical device 300, for example, based on a learned failure diagnosis model. When determining that a failure has occurred in the electrical device 300, the diagnostic unit 212 determines the type of failure. The fault diagnosis model is a model for determining a fault in the electrical device 300 using audio data. The fault diagnosis model is generated by performing machine learning using the fault diagnosis database 220a stored in the storage unit 220. For each type of electrical equipment 300, a plurality of audio data (teacher data) corresponding to the type of failure is stored in the failure diagnosis database 220a. For example, a known algorithm such as deep learning can be used to form the fault diagnosis model.
　診断部２１２によって、電気機器３００の診断結果が判定されると、送信制御部２１３は、電気機器３００の診断結果を、通信部２３０を介して端末１００に送信する。端末１００は、例えば、サーバ装置２００から送信された診断結果を表示部１６０に表示することができる。 When the diagnostic unit 212 determines the diagnosis result of the electrical device 300, the transmission control unit 213 transmits the diagnostic result of the electrical device 300 to the terminal 100 via the communication unit 230. For example, the terminal 100 can display the diagnosis results sent from the server device 200 on the display unit 160.
　図１１を用いて、端末１００の制御部１１０による録音処理に係る制御フローについて説明する。図１１は、制御部１１０による録音処理に係る制御フローの一例である。録音処理に係る制御フローは、例えば、端末１００にインストールされたアプリをユーザが起動することにより開始される。 A control flow related to recording processing by the control unit 110 of the terminal 100 will be explained using FIG. 11. FIG. 11 is an example of a control flow related to recording processing by the control unit 110. The control flow related to the recording process is started, for example, when the user activates an application installed on the terminal 100.
　Ｓ１０１では、判定部１１１は、電気機器３００に対して端末１００が所定位置にあるか否かを判定する。Ｓ１０１において、判定部１１１によって端末１００が所定位置にあると判定された場合、Ｓ１０２に進む。Ｓ１０１において、判定部１１１によって端末１００が所定位置にはないと判定された場合、Ｓ１０１に戻る。 In S101, the determination unit 111 determines whether the terminal 100 is at a predetermined position with respect to the electrical device 300. In S101, if the determination unit 111 determines that the terminal 100 is in the predetermined position, the process advances to S102. In S101, if the determination unit 111 determines that the terminal 100 is not at the predetermined position, the process returns to S101.
　Ｓ１０２では、録音制御部１１３は、録音処理部１１４による録音処理の開始を許可する。Ｓ１０２では、ユーザによる録音処理の開始操作が行われることによって、録音処理部１１４による録音処理が開始され、Ｓ１０３に進む。 In S102, the recording control unit 113 allows the recording processing unit 114 to start recording processing. In S102, when the user performs an operation to start recording processing, the recording processing unit 114 starts recording processing, and the process advances to S103.
　Ｓ１０３では、ユーザによる録音処理の開始操作が行われてから、所定時間経過したか否かを判定する。Ｓ１０３において、所定時間経過したと判定された場合、Ｓ１０４に進む。Ｓ１０３において、所定時間経過したと判定されない場合、Ｓ１０３に戻る。 In S103, it is determined whether a predetermined period of time has elapsed since the user performed an operation to start the recording process. If it is determined in S103 that the predetermined time has elapsed, the process advances to S104. In S103, if it is not determined that the predetermined time has elapsed, the process returns to S103.
　Ｓ１０４では、録音制御部１１３は、録音処理部１１４による録音処理を終了して、Ｓ１０５に進む。 In S104, the recording control unit 113 ends the recording process by the recording processing unit 114, and proceeds to S105.
　Ｓ１０５では、送信制御部１１５は、録音処理部１１４による録音処理で生成された音声データをサーバ装置２００に送信し、終了となる。 In S105, the transmission control unit 115 transmits the audio data generated by the recording process by the recording processing unit 114 to the server device 200, and the process ends.
　なお、録音処理部１１４による録音処理が行われている間、電気機器３００の運転状態（圧縮機及び送風機の回転数）を維持することが好ましい。例えば、端末１００を電気機器３００と通信可能に構成することで、録音処理部１１４による録音処理が行われる間は、電気機器３００の運転状態を変更しないように構成してもよい。これにより、電気機器３００の運転を一定に保った状態において音声データを生成することができるため、電気機器３００の故障診断を正確に行うことができる。 Note that while the recording processing unit 114 is performing the recording process, it is preferable to maintain the operating state of the electrical equipment 300 (the rotational speed of the compressor and the blower). For example, by configuring the terminal 100 to be able to communicate with the electrical device 300, the operating state of the electrical device 300 may not be changed while the recording processing unit 114 is performing recording processing. Thereby, audio data can be generated while the operation of the electrical device 300 is kept constant, so that failure diagnosis of the electrical device 300 can be performed accurately.
　なお、電気機器３００の運転状態（圧縮機及び送風機の回転数）を維持するタイミングとして、例えば、ユーザがアプリを起動するタイミングであってもよいし、電気機器３００に対して端末１００が所定位置にあると判定されたタイミングであってもよいし、任意のタイミングであってもよい。 Note that the timing for maintaining the operating state (rotational speed of the compressor and blower) of the electrical equipment 300 may be, for example, the timing when the user starts an application, or the timing when the terminal 100 is in a predetermined position relative to the electrical equipment 300. The timing may be determined to be within the current range, or may be any timing.
　次に、図１２を用いて、端末１００が、電気機器に対して所定位置にあるか否かを判定する構成の変形例について説明する。図１２は、端末１００を所定位置に配置するためのマーカ３３０を示す電気機器３００ａの上面図である。本変形例では、端末１００によって画像認識処理を行わない点が、上記の実施形態と異なる。具体的には、本変形例では、電気機器３００ａに設けられた近距離無線通信部３２０から送信される信号に基づいて、電気機器３００ａに対して所定位置にあると判定する点において、上記の実施形態と異なる。 Next, a modification of the configuration for determining whether or not the terminal 100 is at a predetermined position with respect to the electrical device will be described using FIG. 12. FIG. 12 is a top view of the electrical device 300a showing the marker 330 for arranging the terminal 100 at a predetermined position. This modification differs from the above embodiment in that the terminal 100 does not perform image recognition processing. Specifically, in this modification, the above-mentioned point is determined that the electrical device 300a is at a predetermined position based on the signal transmitted from the short-range wireless communication unit 320 provided in the electrical device 300a. Different from the embodiment.
　電気機器３００ａは、近距離無線通信部３２０を有する。近距離無線通信部３２０は、端末１００と近距離無線通信を実行するための通信モジュールである。近距離無線通信部３２０は、例えば、Ｂｌｕｅｔｏｏｔｈモジュール、ＮＦＣ（Ｎｅａｒ　Ｆｉｅｌｄ　Ｃｏｍｍｕｎｉｃａｔｉｏｎ）モジュール等である。 The electrical device 300a has a short-range wireless communication section 320. The short-range wireless communication unit 320 is a communication module for performing short-range wireless communication with the terminal 100. The near field communication unit 320 is, for example, a Bluetooth module, a near field communication (NFC) module, or the like.
　電気機器３００ａは、端末１００を所定位置に配置するためのマーカ３３０を有する。マーカ３３０は、例えば、端末１００の電気機器３００ａに対する位置合わせを行うためのマーカである。マーカ３３０は、端末１００の外形と略同様の形状を有する。マーカ３３０は、電気機器３００ａの所定の面（本実施形態では、上面３１５）に設けられる。電気機器３００ａの内部、具体的には、電気機器３００ａのマーカ３３０と対向する位置には、近距離無線通信部３２０が設けられる。 The electrical device 300a has a marker 330 for locating the terminal 100 at a predetermined position. The marker 330 is, for example, a marker for aligning the terminal 100 with respect to the electrical device 300a. Marker 330 has substantially the same external shape as terminal 100. The marker 330 is provided on a predetermined surface (in this embodiment, the top surface 315) of the electrical device 300a. A short-range wireless communication unit 320 is provided inside the electrical device 300a, specifically, at a position facing the marker 330 of the electrical device 300a.
　以上の構成において、電気機器３００ａのマーカ３３０に合わせて、電気機器３００ａ上にユーザが端末１００を配置することで、近距離無線通信部３２０から端末１００に信号が送信される。判定部１１１は、外部（近距離無線通信部３２０）から送信される信号に基づいて、電気機器３００ａに対して所定位置にあると判定する。以上のように、本変形例では、端末１００が、電気機器３００ａに対して所定位置にあるか否かを判定する構成として、撮像部１５０と表示部１６０とを必ずしも必要とせず、近距離無線通信を実行するための通信モジュールを有していればよい。 In the above configuration, when the user places the terminal 100 on the electrical device 300a in alignment with the marker 330 of the electrical device 300a, a signal is transmitted from the short-range wireless communication unit 320 to the terminal 100. The determination unit 111 determines that the electric device 300a is at a predetermined position based on a signal transmitted from the outside (short-range wireless communication unit 320). As described above, in this modification, the configuration for determining whether the terminal 100 is at a predetermined position with respect to the electrical device 300a does not necessarily require the imaging unit 150 and the display unit 160, and the short-range wireless It is only necessary to have a communication module for executing communication.
　なお、本変形例では、端末１００を所定位置に配置するための構成として、マーカ３３０が設けられているが、これに限らず、例えば、端末１００を所定位置に配置するためのホルダ３４０を有してもよい（図１３参照）。図１３は、ホルダ３４０を示す電気機器３００ｂの側面図である。 Note that in this modification, a marker 330 is provided as a configuration for arranging the terminal 100 at a predetermined position, but the structure is not limited to this, and for example, a holder 340 for arranging the terminal 100 at a predetermined position may be provided. (See FIG. 13). FIG. 13 is a side view of the electrical device 300b showing the holder 340.
　図１３に示すように、ホルダ３４０は、例えば、端末１００を所定位置において保持する。ホルダ３４０は、例えば、電気機器３００ｂの所定の面（本実施形態では、右側面３１４）に設けられる。図１２に示す例と同様に、電気機器３００ｂは、近距離無線通信部３２０を有する。 As shown in FIG. 13, the holder 340 holds the terminal 100 in a predetermined position, for example. The holder 340 is provided, for example, on a predetermined surface (in this embodiment, the right side surface 314) of the electrical device 300b. Similar to the example shown in FIG. 12, the electrical device 300b includes a short-range wireless communication unit 320.
　以上の構成において、電気機器３００ｂのホルダ３４０にユーザが端末１００を配置することで、近距離無線通信部３２０から端末１００に信号が送信される。判定部１１１は、外部（近距離無線通信部３２０）から送信される信号に基づいて、電気機器３００ｂに対して所定位置にあると判定する。 In the above configuration, when the user places the terminal 100 on the holder 340 of the electrical device 300b, a signal is transmitted from the short-range wireless communication unit 320 to the terminal 100. The determination unit 111 determines that the electric device 300b is located at a predetermined position based on a signal transmitted from the outside (short-range wireless communication unit 320).
　なお、本変形例では、判定部１１１は、近距離無線通信部３２０から送信される信号に基づいて、電気機器３００ｂに対して端末１００が所定位置にあると判定しているが、これに限らず、例えば、電気機器３００ｂに形成されたホルダ３４０に設けられ、端末１００が設置されたことを検知可能なリミットスイッチなどのセンサから送信される信号に基づいて、電気機器に対して端末１００が所定位置にあるか否かを判定してもよい。 Note that in this modification, the determination unit 111 determines that the terminal 100 is at a predetermined position with respect to the electrical device 300b based on the signal transmitted from the short-range wireless communication unit 320, but this is not limited to this. First, for example, the terminal 100 is connected to the electrical device based on a signal transmitted from a sensor such as a limit switch that is installed in the holder 340 formed on the electrical device 300b and can detect that the terminal 100 is installed. It may also be determined whether or not it is in a predetermined position.
　以上の構成において、異常診断システム１０は、端末１００と、端末１００と通信可能な異常診断装置（サーバ装置２００）と、を備える。端末１００は、音を収集する集音部１４０と、集音部１４０が収集した音から音声データを生成する録音処理を行う録音処理部１１４と、電気機器３００に対して所定位置にあるか否かを判定する判定部１１１と、所定位置にあると判定した場合に、録音処理部１１４による録音処理の開始を許可する録音制御部１１３と、録音処理で生成された音声データを異常診断装置（サーバ装置２００）に送信する送信制御部１１５と、を有する。異常診断装置（サーバ装置２００）は、端末１００から送信された音声データに基づいて電気機器３００の診断を行う。これにより、電気機器３００に対して所定の位置から音を収集できるため、電気機器３００の故障診断を正確に行うことができる。 In the above configuration, the abnormality diagnosis system 10 includes a terminal 100 and an abnormality diagnosis device (server device 200) that can communicate with the terminal 100. The terminal 100 includes a sound collection unit 140 that collects sounds, a recording processing unit 114 that performs recording processing that generates audio data from the sounds collected by the sound collection unit 140, and whether or not the terminal 100 is at a predetermined position relative to the electrical equipment 300. a recording control unit 113 that allows the recording processing unit 114 to start recording processing when it is determined that the recording processing unit 114 is in a predetermined position, and an abnormality diagnosis device ( and a transmission control unit 115 that transmits data to the server device 200). The abnormality diagnosis device (server device 200) diagnoses the electrical device 300 based on the audio data transmitted from the terminal 100. As a result, sound can be collected from a predetermined position with respect to the electrical device 300, so that failure diagnosis of the electrical device 300 can be performed accurately.
　端末１００は、撮像部１５０を含み、判定部１１１は、撮像部１５０によって撮像された撮像画像に識別情報Ｄ１が含まれる場合に、所定位置にあると判定する。識別情報Ｄ１は、電気機器３００の一部を特定の位置から撮像した画像データである。これにより、撮像画像に識別情報Ｄ１が含まれる場合に、端末１００と電気機器３００との相対位置がおおよそ定まるため、電気機器３００に対する端末１００の位置合わせを容易に行うことができる。 The terminal 100 includes an imaging unit 150, and the determination unit 111 determines that the terminal is at a predetermined position when the captured image captured by the imaging unit 150 includes identification information D1. The identification information D1 is image data obtained by capturing a part of the electrical device 300 from a specific position. Thereby, when the captured image includes the identification information D1, the relative position between the terminal 100 and the electrical device 300 is approximately determined, so that the terminal 100 can be easily aligned with respect to the electrical device 300.
　端末１００は、撮像部１５０によって撮像された画像データを識別情報として登録する登録処理部１１６をさらに備える。これにより、ユーザ自身が端末１００を用いて識別情報を登録することができるため、電気機器３００に識別マーカＭを設ける必要がない。ゆえに、識別マーカＭが備えられていない既存の電気機器であっても、電気機器から生じる音を所定位置において収集することができる。 The terminal 100 further includes a registration processing unit 116 that registers image data captured by the imaging unit 150 as identification information. Thereby, since the user himself/herself can register the identification information using the terminal 100, there is no need to provide the identification marker M on the electrical device 300. Therefore, even if an existing electrical device is not equipped with the identification marker M, the sound generated from the electrical device can be collected at a predetermined position.
　端末１００は、表示部１６０と、撮像画像を表示部１６０に表示するとともに、端末１００を所定位置にガイドするためのアイコンを撮像画像に重畳して表示する表示制御部１１２と、をさらに備える。これにより、電気機器３００に対する端末１００の位置合わせを容易に行うことができる。 The terminal 100 further includes a display unit 160 and a display control unit 112 that displays the captured image on the display unit 160 and displays an icon for guiding the terminal 100 to a predetermined position superimposed on the captured image. Thereby, the positioning of the terminal 100 with respect to the electric device 300 can be easily performed.
　表示制御部１１２は、判定部１１１によって所定位置にあると判定された場合、アイコンを強調表示する。これにより、ユーザは、端末１００が電気機器３００に対して所定位置にあることを容易に把握することができる。 The display control unit 112 displays the icon in a highlighted manner when the determination unit 111 determines that the icon is in the predetermined position. Thereby, the user can easily understand that the terminal 100 is at a predetermined position with respect to the electrical device 300.
　アイコンは、識別情報Ｄ１のサムネイルＳである。これにより、ユーザは、サムネイルＳを参照しながら、電気機器３００に設けられた識別マーカＭを探すことができる。ゆえに、電気機器３００に対する端末１００の位置合わせを容易に行うことができる。 The icon is a thumbnail S of the identification information D1. Thereby, the user can search for the identification marker M provided on the electrical device 300 while referring to the thumbnail S. Therefore, it is possible to easily align the terminal 100 with respect to the electrical device 300.
　アイコンは、撮像部１５０の撮像範囲Ｒに対する識別マーカＭの大きさの基準となる枠Ｆである。これにより、枠Ｆに識別マーカＭを合わせることによって、電気機器３００に対する端末１００の距離を適切な距離にすることができる。 The icon is a frame F that serves as a reference for the size of the identification marker M with respect to the imaging range R of the imaging unit 150. Thereby, by aligning the identification marker M with the frame F, the distance between the terminal 100 and the electrical device 300 can be set to an appropriate distance.
　表示制御部１１２は、判定部１１１によって所定位置にあると判定された場合、録音処理を開始する操作入力を受け付けるボタンＢを撮像画像に重畳して表示する。これにより、ユーザは端末１００が所定位置にあることを容易に把握することができるとともに、録音処理を円滑に開始することができる。 When the determination unit 111 determines that the button B is in the predetermined position, the display control unit 112 displays a button B that accepts an operation input to start the recording process, superimposed on the captured image. Thereby, the user can easily understand that the terminal 100 is in a predetermined position, and can smoothly start the recording process.
　識別情報Ｄ１には、電気機器３００の機器情報が関連付けられ、送信制御部１１５は、音声データとともに機器情報を異常診断装置（サーバ装置２００）に送信する。これにより、電気機器３００の機器情報を加味した電気機器３００の故障診断を行うことができる。 Device information of the electrical device 300 is associated with the identification information D1, and the transmission control unit 115 transmits the device information along with the audio data to the abnormality diagnosis device (server device 200). Thereby, it is possible to perform a failure diagnosis of the electrical device 300 taking into account the device information of the electrical device 300.
　識別情報Ｄ１は、室外機に設けられた識別マーカＭを撮像した画像データであって、識別マーカＭは、室外機において空気が通過する開口部が設けられる面とは異なる面に設けられる。これにより、風の影響を受けやすい吸込口３１３ａや吹出口３１１ａ周辺から音を収集することを回避できる。 The identification information D1 is image data of an identification marker M provided on the outdoor unit, and the identification marker M is provided on a surface of the outdoor unit that is different from the surface on which the opening through which air passes is provided. Thereby, it is possible to avoid collecting sound from around the inlet 313a and the outlet 311a, which are susceptible to the influence of wind.
　室外機（電気機器３００）は、それぞれが識別マーカＭである複数の識別マーカＭを有する。これにより、室外機の配置位置に関わらず、識別マーカＭに対する端末１００の位置合わせを容易に行うことができる。 The outdoor unit (electrical equipment 300) has a plurality of identification markers M, each of which is an identification marker M. Thereby, it is possible to easily align the terminal 100 with respect to the identification marker M regardless of the arrangement position of the outdoor unit.
　判定部１１１は、所定位置にある場合に外部から送信される信号に基づいて、電気機器３００ａ（または、電気機器３００ｂ）に対して所定位置にあると判定する。 The determining unit 111 determines that the electrical device 300a (or the electrical device 300b) is at a predetermined position based on a signal transmitted from the outside when the electrical device is located at a predetermined position.
　電気機器３００ａ（または、電気機器３００ｂ）は、端末１００を所定位置に配置するためのマーカ３３０（またはホルダ３４０）を有する。これにより、電気機器に対する端末１００の位置合わせを容易に行うことができる。 The electrical device 300a (or the electrical device 300b) has a marker 330 (or a holder 340) for placing the terminal 100 in a predetermined position. Thereby, it is possible to easily align the terminal 100 with respect to the electrical equipment.
　プログラムは、プロセッサを、端末１００に設けられた集音部１４０が収集した音から音声データを生成する録音処理を行う録音処理部１１４と、電気機器３００に対して端末１００が所定位置にあるか否かを判定する判定部１１１と、所定位置にあると判定した場合に、録音処理部１１４による録音処理の開始を許可する録音制御部１１３と、録音処理で生成された音声データを異常診断装置（サーバ装置２００）に送信する送信制御部１１５として機能させる。 The program connects the processor to a recording processing unit 114 that performs recording processing to generate audio data from sounds collected by a sound collection unit 140 provided in the terminal 100, and a recording processing unit 114 that performs a recording process to generate audio data from sounds collected by a sound collection unit 140 provided in the terminal 100. a determination unit 111 that determines whether or not the device is located at a predetermined position; a recording control unit 113 that allows the recording processing unit 114 to start recording processing when it is determined that the recording processing unit 114 is located at a predetermined position; (server device 200).
　また、上記の端末１００は、ハードウェア、ソフトウェア又はこれらの組み合わせにより実現することができる。ここで、ソフトウェアによって実現されるとは、コンピュータがプログラムを読み込んで実行されることにより実現されることを意味する。 Furthermore, the above terminal 100 can be realized by hardware, software, or a combination thereof. Here, being realized by software means being realized by a computer reading and executing a program.
　プログラムは、様々なタイプの非一時的なコンピュータ可読媒体（ｎｏｎ－ｔｒａｎｓｉｔｏｒｙ　ｃｏｍｐｕｔｅｒ　ｒｅａｄａｂｌｅ　ｍｅｄｉｕｍ）を用いて格納され、コンピュータに供給することができる。非一時的なコンピュータ可読媒体は、様々なタイプの実体のある記録媒体（ｔａｎｇｉｂｌｅ　ｓｔｏｒａｇｅ　ｍｅｄｉｕｍ）を含む。非一時的なコンピュータ可読媒体の例は、磁気記録媒体（例えば、フレキシブルディスク、磁気テープ、ハードディスクドライブ）、光磁気記録媒体（例えば、光磁気ディスク）、ＣＤ－ＲＯＭ（Ｒｅａｄ　Ｏｎｌｙ　Ｍｅｍｏｒｙ）、ＣＤ－Ｒ／Ｗ、半導体メモリ（例えば、マスクＲＯＭ、ＰＲＯＭ（Ｐｒｏｇｒａｍａｂｌｅ　ＲＯＭ）、ＥＰＲＯＭ（Ｅｒａｓａｂｌｅ　ＰＲＯＭ）、フラッシュＲＯＭ、ＲＡＭ（ｒａｎｄｏｍ　ａｃｃｅｓｓ　ｍｅｍｏｒｙ））を含む。また、プログラムは、様々なタイプの一時的なコンピュータ可読媒体（ｔｒａｎｓｉｔｏｒｙ　ｃｏｍｐｕｔｅｒ　ｒｅａｄａｂｌｅ　ｍｅｄｉｕｍ）によってコンピュータに供給されてもよい。一時的なコンピュータ可読媒体の例は、電気信号、光信号、及び電磁波を含む。一時的なコンピュータ可読媒体は、電線及び光ファイバ等の有線通信路、又は無線通信路を介して、プログラムをコンピュータに供給できる。 The program can be stored and provided to a computer using various types of non-transitory computer readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media are magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-ROMs, R/W, semiconductor memory (for example, mask ROM, PROM (programmable ROM), EPROM (erasable PROM), flash ROM, RAM (random access memory)). The program may also be provided to the computer on various types of transitory computer readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can provide the program to the computer via wired communication channels, such as electrical wires and fiber optics, or wireless communication channels.
　なお、電気機器の一例として、空気調和機の室外機を用いて説明したが、これに限らず、例えば、空気調和機の室内機であってもよいし、洗濯機であってもよいし、冷蔵庫であってもよい。 Although the description has been made using an outdoor unit of an air conditioner as an example of the electric device, the present invention is not limited to this, and may be, for example, an indoor unit of an air conditioner, a washing machine, It may also be a refrigerator.
　なお、本発明は、上記実施の形態に限定されるものではなく、種々の変形が可能である。例えば、上記実施の形態で示した構成と実質的に同一の構成、同一の作用効果を奏する構成又は同一の目的を達成することができる構成で置き換えることができる。 Note that the present invention is not limited to the above embodiments, and various modifications are possible. For example, it can be replaced with a configuration that is substantially the same as the configuration shown in the above embodiment, a configuration that has the same effect, or a configuration that can achieve the same objective.

Claims (15)

  1. 　端末と、
    　前記端末と通信可能な異常診断装置と、を備え、
    　前記端末は、
    　音を収集する集音部と、
    　前記集音部が収集した音から音声データを生成する録音処理を行う録音処理部と、
    　電気機器に対して所定位置にあるか否かを判定する判定部と、
    　前記所定位置にあると判定した場合に、前記録音処理部による前記録音処理の開始を許可する録音制御部と、
    　前記録音処理で生成された音声データを前記異常診断装置に送信する送信制御部と、を有し、
    　前記異常診断装置は、前記端末から送信された前記音声データに基づいて前記電気機器の診断を行う、異常診断システム。     A terminal and
    An abnormality diagnosis device capable of communicating with the terminal,
    The terminal is
    A sound collection unit that collects sound,
    a recording processing unit that performs recording processing to generate audio data from the sound collected by the sound collection unit;
    a determination unit that determines whether or not the electrical device is in a predetermined position;
    a recording control section that allows the recording processing section to start the recording processing when it is determined that the recording processing section is located at the predetermined position;
    a transmission control unit that transmits the audio data generated in the recording process to the abnormality diagnosis device,
    The abnormality diagnosis device is an abnormality diagnosis system that diagnoses the electrical equipment based on the audio data transmitted from the terminal.
  2. 　前記端末は、撮像部を含み、
    　前記判定部は、前記撮像部によって撮像された撮像画像に識別情報が含まれる場合に、前記所定位置にあると判定する、請求項１に記載の異常診断システム。     The terminal includes an imaging unit,
    The abnormality diagnosis system according to claim 1, wherein the determination unit determines that the predetermined position is present when identification information is included in the captured image captured by the imaging unit.
  3. 　前記識別情報は、前記電気機器の一部を特定の位置から撮像した画像データである、請求項２に記載の異常診断システム。 The abnormality diagnosis system according to claim 2, wherein the identification information is image data obtained by capturing a part of the electrical device from a specific position.
  4. 　前記端末は、前記撮像部によって撮像された画像データを前記識別情報として登録する登録処理部をさらに備える、請求項３に記載の異常診断システム。 The abnormality diagnosis system according to claim 3, wherein the terminal further includes a registration processing unit that registers image data captured by the imaging unit as the identification information.
  5. 　前記端末は、
    　表示部と、
    　前記撮像画像を前記表示部に表示するとともに、前記端末を前記所定位置にガイドするためのアイコンを前記撮像画像に重畳して表示する表示制御部と、をさらに備える、請求項２から請求項４の何れか１項に記載の異常診断システム。     The terminal is
    A display section;
    Claims 2 to 4 further include a display control unit that displays the captured image on the display unit and displays an icon for guiding the terminal to the predetermined position superimposed on the captured image. The abnormality diagnosis system according to any one of the above.
  6. 　前記表示制御部は、前記判定部によって前記所定位置にあると判定された場合、前記アイコンを強調表示する、請求項５に記載の異常診断システム。 The abnormality diagnosis system according to claim 5, wherein the display control unit highlights the icon when the determination unit determines that the icon is at the predetermined position.
  7. 　前記アイコンは、前記識別情報のサムネイルである、請求項５に記載の異常診断システム。 The abnormality diagnosis system according to claim 5, wherein the icon is a thumbnail of the identification information.
  8. 　前記アイコンは、前記撮像部の撮像範囲に対する前記識別情報の大きさの基準となる枠である、請求項５に記載の異常診断システム。 The abnormality diagnosis system according to claim 5, wherein the icon is a frame that serves as a reference for the size of the identification information with respect to the imaging range of the imaging unit.
  9. 　前記表示制御部は、前記判定部によって前記所定位置にあると判定された場合、前記録音処理を開始する操作入力を受け付けるボタンを前記撮像画像に重畳して表示する、請求項５に記載の異常診断システム。 The abnormality according to claim 5, wherein the display control unit displays a button that accepts an operation input for starting the recording process in a superimposed manner on the captured image when the determination unit determines that the display is at the predetermined position. Diagnostic system.
  10. 　前記識別情報には、前記電気機器の機器情報が関連付けられ、
    　前記送信制御部は、前記音声データとともに前記機器情報を前記異常診断装置に送信する、請求項２から請求項４の何れか１項に記載の異常診断システム。     The identification information is associated with device information of the electrical device,
    The abnormality diagnosis system according to any one of claims 2 to 4, wherein the transmission control unit transmits the device information together with the audio data to the abnormality diagnosis device.
  11. 　前記電気機器は、室外機であって、
    　前記識別情報は、前記室外機に設けられた識別マーカを撮像した画像データであって、
    　前記識別マーカは、前記室外機において空気が通過する開口部が設けられる面とは異なる面に設けられる、請求項２から請求項４の何れか１項に記載の異常診断システム。     The electrical equipment is an outdoor unit,
    The identification information is image data obtained by capturing an identification marker provided on the outdoor unit,
    The abnormality diagnosis system according to any one of claims 2 to 4, wherein the identification marker is provided on a surface of the outdoor unit that is different from a surface where an opening through which air passes is provided.
  12. 　前記室外機は、それぞれが前記識別マーカである複数の識別マーカを有する、請求項１１に記載の異常診断システム。 The abnormality diagnosis system according to claim 11, wherein the outdoor unit has a plurality of identification markers, each of which is the identification marker.
  13. 　前記判定部は、前記所定位置にある場合に外部から送信される信号に基づいて、前記電気機器に対して前記所定位置にあると判定する、請求項１に記載の異常診断システム。 The abnormality diagnosis system according to claim 1, wherein the determination unit determines that the electric device is at the predetermined position based on a signal transmitted from the outside when the determination unit is at the predetermined position.
  14. 　前記電気機器は、前記端末を前記所定位置に配置するためのホルダまたはマーカを有する、請求項１３に記載の異常診断システム。 The abnormality diagnosis system according to claim 13, wherein the electric device has a holder or a marker for arranging the terminal at the predetermined position.
  15. 　プロセッサを、
    　端末に設けられた集音部が収集した音から音声データを生成する録音処理を行う録音処理部と、
    　電気機器に対して前記端末が所定位置にあるか否かを判定する判定部と、
    　前記所定位置にあると判定した場合に、前記録音処理部による前記録音処理の開始を許可する録音制御部と、
    　前記録音処理で生成された音声データを異常診断装置に送信する送信制御部として機能させるプログラム。     processor,
    a recording processing unit that performs recording processing to generate audio data from sounds collected by a sound collection unit provided in the terminal;
    a determination unit that determines whether the terminal is in a predetermined position relative to the electrical device;
    a recording control section that allows the recording processing section to start the recording processing when it is determined that the recording processing section is located at the predetermined position;
    A program that functions as a transmission control unit that transmits audio data generated in the recording process to an abnormality diagnosis device.
PCT/JP2023/014657 2022-04-15 2023-04-11 Abnormality diagnosis system and program WO2023199904A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022067262A JP2023157373A (en) 2022-04-15 2022-04-15 Abnormality diagnostic system and program
JP2022-067262 2022-04-15

Publications (1)

Publication Number Publication Date
WO2023199904A1 true WO2023199904A1 (en) 2023-10-19

Family

ID=88329787

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/014657 WO2023199904A1 (en) 2022-04-15 2023-04-11 Abnormality diagnosis system and program

Country Status (2)

Country Link
JP (1) JP2023157373A (en)
WO (1) WO2023199904A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004132683A (en) * 2002-08-09 2004-04-30 Daikin Ind Ltd Fault diagnosis system, inspection device, and data server
JP2019096152A (en) * 2017-11-24 2019-06-20 東芝産業機器システム株式会社 Diagnostic program and diagnostic device
JP2020029715A (en) * 2018-08-23 2020-02-27 株式会社東海理化電機製作所 Authentication system and authentication method
JP2021071586A (en) * 2019-10-30 2021-05-06 株式会社日立製作所 Sound extraction system and sound extraction method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004132683A (en) * 2002-08-09 2004-04-30 Daikin Ind Ltd Fault diagnosis system, inspection device, and data server
JP2019096152A (en) * 2017-11-24 2019-06-20 東芝産業機器システム株式会社 Diagnostic program and diagnostic device
JP2020029715A (en) * 2018-08-23 2020-02-27 株式会社東海理化電機製作所 Authentication system and authentication method
JP2021071586A (en) * 2019-10-30 2021-05-06 株式会社日立製作所 Sound extraction system and sound extraction method

Also Published As

Publication number Publication date
JP2023157373A (en) 2023-10-26

Similar Documents

Publication Publication Date Title
JP6104143B2 (en) Device control system and device control method
CN104272717A (en) A method and system for performing alignment of a projection image to detected infrared (IR) radiation information
KR20070066192A (en) Method and apparatus for determining positions of robot
JP2019144187A (en) Diagnosing method, diagnosing device, and diagnosing program
JP2019032685A (en) Power distribution arrangement inspection system
KR101757884B1 (en) Apparatus for providing circumstance information based on battlefield situation awareness and method thereof
JP2008226109A (en) Video image analysis system and method
JP6456783B2 (en) Bar arrangement measuring device
KR20120033414A (en) Robot for operating recognition of self-position and operation method thereof
TWI428508B (en) Controlling system, method for fans, and fan including the same
WO2023199904A1 (en) Abnormality diagnosis system and program
JP2006277283A (en) Information processing system and information processing method
US11810257B2 (en) Method for automatically capturing data from non-networked production equipment
JP2005338551A (en) Industrial endoscope
KR20230077487A (en) Diagnostic system using self-driving drone and operation method thereof
KR20200065909A (en) Apparatus for detection wiring mismatch of mof and wattmeter and control method thereof
JP2009177480A (en) Imaging device
WO2018158815A1 (en) Inspection assistance device, inspection assistance method, and recording medium
JP6503990B2 (en) Photographing apparatus, photographing method and photographing program
TWI644293B (en) Patrol service system and verification method used therein
JP7313895B2 (en) Acoustic diagnostic equipment
JP6818795B2 (en) Information processing equipment, information processing methods and computer programs
JPH10132651A (en) Plant monitoring device
EP2874117A1 (en) Method and apparatus for determining position related properties of a motion video camera
WO2023286447A1 (en) Device abnormality diagnosis method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23788322

Country of ref document: EP

Kind code of ref document: A1