WO2023002563A1 - 監視装置、監視システム、監視方法、及びプログラムが格納された非一時的なコンピュータ可読媒体 - Google Patents
監視装置、監視システム、監視方法、及びプログラムが格納された非一時的なコンピュータ可読媒体 Download PDFInfo
- Publication number
- WO2023002563A1 WO2023002563A1 PCT/JP2021/027118 JP2021027118W WO2023002563A1 WO 2023002563 A1 WO2023002563 A1 WO 2023002563A1 JP 2021027118 W JP2021027118 W JP 2021027118W WO 2023002563 A1 WO2023002563 A1 WO 2023002563A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- abnormal situation
- crowd
- analysis
- severity
- monitoring
- Prior art date
Links
- 238000012806 monitoring device Methods 0.000 title claims abstract description 29
- 238000012544 monitoring process Methods 0.000 title claims description 76
- 238000000034 method Methods 0.000 title claims description 37
- 230000002159 abnormal effect Effects 0.000 claims abstract description 182
- 238000004458 analytical method Methods 0.000 claims abstract description 100
- 230000008921 facial expression Effects 0.000 claims description 69
- 238000001514 detection method Methods 0.000 claims description 35
- 230000005856 abnormality Effects 0.000 claims description 34
- 238000005516 engineering process Methods 0.000 abstract description 6
- 238000000605 extraction Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 230000014509 gene expression Effects 0.000 description 7
- 239000000284 extract Substances 0.000 description 6
- 230000001815 facial effect Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000004044 response Effects 0.000 description 5
- 230000006399 behavior Effects 0.000 description 4
- 230000008451 emotion Effects 0.000 description 4
- 230000002547 anomalous effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000004880 explosion Methods 0.000 description 3
- 210000001508 eye Anatomy 0.000 description 3
- 206010000117 Abnormal behaviour Diseases 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 2
- 230000002238 attenuated effect Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 241000282412 Homo Species 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/53—Recognition of crowd images, e.g. recognition of crowd congestion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/44—Event detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Definitions
- video data from surveillance cameras is collected via a network and analyzed by a computer.
- video features that can lead to danger such as facial images of specific people, abnormal behavior of a single or multiple people, and abandoned items in specific places, are registered in advance and the presence of these features is detected.
- Sound anomaly detection is also performed in addition to video.
- Sound includes speech recognition, which recognizes and analyzes the content of human speech, and acoustic analysis, which analyzes sounds other than speech, but neither of these require a large amount of computer resources. For this reason, real-time analysis is sufficiently possible even with an embedded CPU (Central Processing Unit) such as that installed in a smart phone, for example.
- CPU Central Processing Unit
- the sound source can be determined based on the arrival time difference of the sound from the sound source to each microphone, the sound pressure difference due to the diffusion and attenuation of the sound, and the like. can be estimated.
- a monitoring device includes: a position acquiring means for acquiring the position of occurrence of an abnormal situation in the monitored area; analysis means for analyzing the state of the crowd around the position where the abnormal situation occurred, based on the image data of the camera capturing the monitoring target area; and severity estimation means for estimating the severity of the abnormal situation based on the result of the analysis.
- a monitoring system includes: a camera that captures the monitored area; a sensor that detects sound or heat generated in the monitored area; with a monitoring device and The monitoring device a position obtaining means for obtaining a position of occurrence of an abnormal situation in the monitoring target area by estimating a source of sound or heat detected by the sensor; analysis means for analyzing the state of the crowd around the position where the abnormal situation occurred, based on the image data of the camera; and severity estimation means for estimating the severity of the abnormal situation based on the result of the analysis.
- the monitoring method Acquire the location of the abnormal situation in the monitored area, analyzing the state of the crowd around the position where the abnormal situation occurred based on the image data of the camera that captures the monitoring target area; A severity of the abnormal situation is estimated based on the results of the analysis.
- a program according to the fourth aspect of the present disclosure, a position acquisition step of acquiring the position of occurrence of the abnormal situation in the monitored area; an analysis step of analyzing the state of the crowd around the position where the abnormal situation occurred, based on the image data of the camera capturing the monitoring target area; and a severity estimation step of estimating the severity of the abnormal situation based on the analysis result.
- FIG. 1 is a block diagram showing an example of a configuration of a monitoring device according to an outline of an embodiment
- FIG. 4 is a flow chart showing an example of the operation flow of the monitoring device according to the outline of the embodiment; It is a mimetic diagram showing an example of composition of a surveillance system concerning an embodiment. It is a block diagram showing an example of functional composition of an acoustic sensor. 4 is a block diagram showing an example of the functional configuration of an analysis server;
- FIG. It is a schematic diagram which shows an example of the hardware constitutions of a computer.
- FIG. 1 is a block diagram showing an example of the configuration of a monitoring device 1 according to the outline of the embodiment.
- the monitoring device 1 has a position acquisition unit 2, an analysis unit 3, and a severity estimation unit 4, and is a device for monitoring a predetermined monitoring target area.
- the position acquisition unit 2 acquires the location of the occurrence of the abnormal situation in the monitored area.
- the position acquisition unit 2 may acquire information indicating the location where the abnormal situation occurred by any method.
- the position acquisition unit 2 may acquire the occurrence position by estimating the occurrence position of the abnormal situation based on arbitrary information, or by accepting input information of the occurrence position from the user or another device. , the position of occurrence may be obtained.
- the analysis unit 3 analyzes the state of the crowd around (surrounding) the location where the abnormal situation occurred, based on the video data of the camera that captures the area to be monitored.
- the crowd around the location where the abnormal situation occurred does not mean, for example, people who are at the location where the abnormal situation occurred, but people who are away from and near the location where the abnormal situation occurred.
- the state of a crowd specifically refers to a state that appears in the appearance of the people who make up the crowd.
- the analysis unit 3 does not analyze the situation of the location where the abnormal situation occurred from the image of the camera, the facial characteristics and behavior of the person at the location, but rather Analyze crowd behavior.
- FIG. 2 is a flowchart showing an example of the operation flow of the monitoring device 1 according to the outline of the embodiment. An example of the operation flow of the monitoring device 1 will be described below with reference to FIG.
- the monitoring device 1 according to the outline of the embodiment has been described above. According to the monitoring device 1, as described above, it is possible to know the severity of the abnormal situation that has occurred.
- FIG. 3 is a schematic diagram showing an example of the configuration of the monitoring system 10 according to the embodiment.
- the surveillance system 10 comprises an analysis server 100 , a surveillance camera 200 and an acoustic sensor 300 .
- the monitoring system 10 is a system for monitoring a predetermined monitoring target area 90 .
- a monitored area 90 is any area in which monitoring is performed, but is an area where the public may be present, such as, for example, stations, airports, stadiums, public facilities, and the like.
- the monitoring camera 200 is a camera installed to photograph the monitored area 90 .
- the monitoring camera 200 photographs the monitored area 90 and generates video data.
- a monitoring camera 200 is installed at an appropriate position where the entire monitored area 90 can be monitored.
- a plurality of monitoring cameras 200 may be installed to monitor the entire monitored area 90 .
- the acoustic sensors 300 are provided at various locations within the monitored area 90 . Specifically, for example, the acoustic sensors 300 are installed at intervals of about 10 to 20 meters. The acoustic sensor 300 collects and analyzes the sound of the monitored area 90 . Specifically, the acoustic sensor 300 is a device configured from a microphone, a sound device, a CPU, and the like, and sensing sound. The acoustic sensor 300 collects ambient sounds with a microphone, converts them into digital signals with a sound device, and then performs acoustic analysis with a CPU.
- acoustic sensor 300 may be equipped with a speech recognition function. In that case, it will be possible to perform more advanced analysis, such as recognizing the contents of speech such as shouts and estimating the severity of abnormal situations.
- the acoustic sensors 300 are installed at various locations within the monitoring target area 90 at intervals of about 10 to 20 meters so that a plurality of acoustic sensors 300 are installed regardless of where in the area an abnormal sound occurs. This is to allow detection of In general, noise in public facilities is about 60 decibels, while screams and shouts are about 80 to 100 decibels, and explosions and bursts are 120 decibels or more. However, for example, when the sound is 10 meters away from the position where the sound is generated, the abnormal sound, which was 100 decibels near the sound source, is attenuated to 80 decibels.
- the acoustic sensors 300 are arranged at intervals as described above. It should be noted that no matter how far apart the acoustic sensors 300 can detect the same abnormal sound, it depends on the background noise level and the performance of each acoustic sensor 300. Therefore, it is not necessarily the case that the arrangement is 10 to 20 meters long. There are no restrictions.
- the analysis server 100 is a server for analyzing data obtained by the monitoring camera 200 and the acoustic sensor 300, and has the functions of the monitoring device 1 shown in FIG.
- the analysis server 100 receives analysis results from the acoustic sensor 300, and acquires video data from the monitoring camera 200 as necessary to analyze the video.
- the analysis server 100 and the monitoring camera 200 are communicably connected via a network 500 .
- analysis server 100 and acoustic sensor 300 are communicably connected via network 500 .
- the network 500 is a network that transmits communications between the monitoring camera 200, the acoustic sensor 300, and the analysis server 100, and may be a wired network or a wireless network.
- FIG. 4 is a block diagram showing an example of the functional configuration of the acoustic sensor 300.
- FIG. 5 is a block diagram showing an example of the functional configuration of the analysis server 100. As shown in FIG. 4
- the acoustic sensor 300 has an abnormality detection section 301 and an abnormality determination section 302 .
- the abnormality detection unit 301 detects the occurrence of an abnormality within the monitored area 90 based on the sound detected by the acoustic sensor 300 .
- the abnormality detection unit 301 detects occurrence of an abnormality by, for example, determining whether or not the sound detected by the acoustic sensor 300 corresponds to a predetermined abnormal sound. That is, when the sound detected by the acoustic sensor 300 corresponds to a predetermined abnormal sound, the abnormality detection unit 301 determines that an abnormality has occurred within the monitored area 90 .
- abnormality detection unit 301 when abnormality detection unit 301 determines that an abnormality has occurred, it calculates a score indicating the degree of abnormality. For example, the abnormality detection unit 301 may calculate a higher score as the volume of the abnormal sound increases, may calculate a score according to the type of abnormal sound, or may calculate a score based on a combination of these. may
- the processing of the analysis server 100 is performed. As described above, in the present embodiment, whether or not the processing of the analysis server 100 is performed is determined according to the determination result of the abnormality determination unit 302 . processing may be performed. In other words, the processing of the analysis server 100 may be performed in all cases where the anomaly detection unit 301 detects the occurrence of an anomaly. That is, the determination processing by the abnormality determination unit 302 may be omitted.
- the analysis server 100 includes a sound source position estimation unit 101, an image acquisition unit 102, a human detection unit 103, a crowd extraction unit 104, a gaze estimation unit 105, an expression recognition unit 106, a seriousness estimation unit 107, a serious It has a degree determination unit 108 and a signal output unit 109 .
- the sound source location estimating unit 101 estimates the location of the abnormal situation by estimating the source of the sound detected by the acoustic sensor 300 provided in the monitoring target area 90 . Specifically, when the analysis server 100 is notified of the occurrence of an abnormal situation from the plurality of acoustic sensors 300, the sound source position estimation unit 101 collects acoustic data about the abnormal sound from the plurality of acoustic sensors 300, for example. . Then, the sound source position estimating unit 101 performs a known sound source position estimating process disclosed in Patent Document 2, for example, to estimate the sound source position of the abnormal sound, that is, the position of occurrence of the abnormal situation.
- a sound source position estimation unit 101 corresponds to the position acquisition unit 2 in FIG. That is, in the present embodiment, the position of occurrence of the abnormal situation is acquired by estimating the source of the sound.
- the image acquisition unit 102 acquires image data from the monitoring camera 200 capturing the estimated location.
- the analysis server 100 stores in advance information indicating which area each monitoring camera 200 is shooting, and the image acquisition unit 102 compares this information with the estimated position to obtain Identify the monitoring camera 200 capturing the estimated position.
- the crowd extraction unit 104 extracts the crowd around the location where the abnormal situation occurred from the video data acquired by the video acquisition unit 102 .
- the crowd extraction unit 104 extracts people who are away from and near the location where the abnormal situation occurred.
- the crowd extraction unit 104 extracts persons corresponding to the crowd among persons detected by the person detection unit 103 .
- the crowd extraction unit 104 detects the ground reflected in the video data by image recognition processing, and identifies the position where the feet of the person detected by the human detection unit 103 are in contact with the ground, thereby detecting the presence of the person. position within the monitored area 90 .
- the crowd extraction unit 104 identifies the intersection of a straight line extending downward in the vertical direction from the position of the face detected by the person detection unit 103 and the ground. Estimate the position in . Also, the crowd extraction unit 104 may estimate the position of the person based on the size of the face shown in the video data. Then, the crowd extracting unit 104 extracts a crowd based on the distance between the estimated position of the person detected by the human detecting unit 103 and the abnormal situation occurrence position estimated by the sound source position estimating unit 101. .
- the crowd extraction unit 104 extracts, for example, people who are 1 meter or more away from the location of the occurrence of the abnormal situation and within 5 meters from the location of the occurrence of the abnormal situation as the crowd around the location of the occurrence of the abnormal situation.
- the line-of-sight estimation unit 105 estimates the line-of-sight of each person who constitutes the crowd around the location where the abnormal situation occurred. That is, the line-of-sight estimation unit 105 estimates the line-of-sight of the person extracted as a crowd by the crowd extraction unit 104 .
- a line-of-sight estimation unit 105 performs a known line-of-sight estimation process on video data to estimate a line of sight. For example, the line-of-sight estimation unit 105 may estimate the line of sight by performing the process disclosed in Patent Document 3 on the face image.
- the line-of-sight estimation unit 105 may estimate the line of sight from the orientation of the head shown in the image. Further, the line-of-sight estimation unit 105 may calculate the reliability (estimation accuracy) of the estimated line of sight based on the number of pixels of the face and the eyeball portion.
- the facial expression recognition unit 106 recognizes the facial expressions of each person making up the crowd around the location where the abnormal situation occurred. That is, the facial expression recognition unit 106 recognizes facial expressions of people extracted as a crowd by the crowd extraction unit 104 .
- the facial expression recognition unit 106 performs known facial expression recognition processing on video data to recognize facial expressions. For example, the facial expression recognition unit 106 may recognize the facial expression by performing the processing disclosed in Patent Document 4 on the facial image.
- the facial expression recognition unit 106 determines whether or not the facial expression of the person is a predetermined facial expression.
- the predetermined facial expression is specifically an unpleasant emotional expression.
- the facial expression recognition unit 106 determines whether the score value of the degree of smile is equal to or less than a reference value or the score value of the degree of anger is It may be determined that the facial expression of the person is an unpleasant facial expression when it is equal to or greater than the reference value. Thus, the facial expression recognition unit 106 determines whether or not the facial expression of the crowd corresponds to the facial expression of a person who has recognized an abnormal situation. Moreover, the facial expression recognition unit 106 may calculate the reliability (recognition accuracy) of the recognized facial expression based on the number of people in the crowd whose faces were captured or the number of pixels of each face.
- the seriousness estimation unit 107 estimates that the greater the number of people whose line of sight is directed toward the location where the abnormal situation occurred, the higher the seriousness. Similarly, the seriousness estimating unit 107 estimates that the greater the percentage of the number of people whose line of sight is directed toward the location of the occurrence of the abnormal situation, the higher the degree of seriousness. Note that the seriousness estimation unit 107 may calculate the reliability of the estimated severity of the abnormal situation based on the reliability of the line-of-sight estimation result of each person.
- the severity estimation unit 107 estimates the severity of the abnormal situation as follows based on the processing result of the facial expression recognition unit 106.
- the severity estimation unit 107 estimates the severity of the abnormal situation based on the number of people whose recognized facial expressions correspond to the predetermined facial expressions, or the ratio of the number of people whose recognized facial expressions correspond to the predetermined facial expressions to the number of people in the crowd.
- the seriousness estimation unit 107 estimates that the greater the number of people whose recognized facial expressions correspond to a predetermined facial expression, the higher the seriousness.
- the seriousness estimation unit 107 estimates that the greater the ratio of the number of people whose recognized facial expressions correspond to the predetermined facial expressions, the higher the seriousness.
- the severity estimation unit 107 multiplies the emotion score value, such as the degree of smile or the degree of anger, by a correlation coefficient representing the correlation between the unpleasant facial expression when seeing an abnormal situation and the emotion score value. may be At this time, the severity estimating unit 107 calculates the average of the seriousnesses calculated as described above from the facial expressions of each person constituting the extracted crowd, and estimates the severity of the emergency indicated by the entire crowd. can be estimated. The severity estimation unit 107 may calculate the reliability of the estimated severity of the abnormal situation based on the reliability of the facial expression recognition result of each person.
- the seriousness estimation unit 107 may adopt either the seriousness estimated based on the processing result of the gaze estimation unit 105 or the seriousness estimated based on the processing result of the facial expression recognition unit 106. , in the present embodiment, both are integrated to calculate the final degree of seriousness. That is, the seriousness estimation unit 107 integrates the seriousness estimated from the extracted line of sight of the crowd and the seriousness estimated from the extracted facial expression of the crowd. For example, the seriousness estimating unit 107 calculates the final seriousness by combining the seriousness estimated based on the processing result of the line-of-sight estimating unit 105 and the average value of the seriousness estimated based on the processing result of the facial expression recognition unit 106 into the final seriousness.
- both seriousness and reliability may be used to calculate the final seriousness.
- the seriousness estimating unit 107 may use, as weights, the reliability of the seriousness based on line-of-sight estimation and the reliability of the seriousness based on facial expression recognition, and calculate a weighted average of these seriousnesses. It should be noted that this is merely an example of calculating the severity using the reliability, and the severity may be calculated by other methods. For example, known statistics may be used, and the overall seriousness may be obtained by Bayesian estimation based on the reliability of each person.
- the severity determination unit 108 determines whether or not it is necessary to respond to the abnormal situation that has occurred. Specifically, the severity determination unit 108 determines whether or not the severity finally estimated by the severity estimation unit 107 is greater than or equal to a predetermined threshold. If the severity is equal to or greater than a predetermined threshold, the severity determination unit 108 determines that a response is required for the abnormal situation that has occurred, and otherwise determines that no response is required.
- the signal output unit 109 outputs a predetermined signal for responding to the abnormal situation when the severity determination unit 108 determines that it is necessary to respond to the abnormal situation that has occurred. That is, the signal output unit 109 outputs a predetermined signal when the degree of seriousness is equal to or greater than a predetermined threshold.
- This predetermined signal may be a signal for giving predetermined instructions to other programs (other devices) or humans.
- the predetermined signal may be a signal for activating an alarm lamp and an alarm sound in a guard room or the like, or may be a message instructing a guard or the like to respond to an abnormal situation.
- the predetermined signal may be a signal for flashing a warning light near the location where the abnormal situation occurred, in order to suppress criminal acts, or a signal for warning people in the vicinity of the location where the abnormal situation occurred. It may be a signal for outputting an alarm prompting evacuation.
- FIG. 4 The functions shown in FIG. 4 and the functions shown in FIG. 5 may be implemented by a computer 50 as shown in FIG. 6, for example.
- FIG. 6 is a schematic diagram showing an example of the hardware configuration of the computer 50.
- computer 50 includes network interface 51 , memory 52 and processor 53 .
- a network interface 51 is used to communicate with any other device.
- Network interface 51 may include, for example, a network interface card (NIC).
- NIC network interface card
- the memory 52 is configured by, for example, a combination of volatile memory and nonvolatile memory.
- the memory 52 is used to store programs including one or more instructions executed by the processor 53, data used for various processes, and the like.
- the processor 53 reads and executes the program from the memory 52 to process each component shown in FIG. 4 or FIG.
- the processor 53 may be, for example, a microprocessor, MPU (Micro Processor Unit), or CPU (Central Processing Unit).
- Processor 53 may include multiple processors.
- a program includes a set of instructions (or software code) that, when read into a computer, cause the computer to perform one or more of the functions described in the embodiments.
- the program may be stored in a non-transitory computer-readable medium or tangible storage medium.
- computer readable media or tangible storage media may include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drives (SSD) or other memory technology, CDs - ROM, digital versatile disc (DVD), Blu-ray disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disc storage or other magnetic storage device.
- the program may be transmitted on a transitory computer-readable medium or communication medium.
- transitory computer readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.
- FIG. 7 is a flowchart showing an example of the operation flow of the monitoring system 10.
- FIG. 8 is a flow chart showing an example of the flow of processing in step S104 in the flow chart shown in FIG.
- An example of the operation flow of the monitoring system 10 will be described below with reference to FIGS. 7 and 8.
- steps S101 and S102 are executed as processing of the acoustic sensor 300, and processing after step S103 is executed as processing of the analysis server 100.
- step S ⁇ b>101 the abnormality detection unit 301 detects the occurrence of an abnormality within the monitored area 90 based on the sound detected by the acoustic sensor 300 .
- step S102 the abnormality determination unit 302 determines whether or not it is necessary to respond to the abnormal situation that has occurred. If it is determined that no response is required for the abnormal situation that has occurred (Yes in step S102), the process returns to step S101, otherwise (No in step S102), the process proceeds to step S103.
- step S103 the sound source position estimating unit 101 estimates the position of the abnormal situation by estimating the source of the sound.
- step S104 the severity of the abnormal situation is estimated by video analysis.
- the video analysis process is not performed during normal times, and is performed only when an abnormal situation occurs.
- the analysis processing using the image of the surveillance camera 200 is executed when the occurrence of an abnormal situation is detected, and is not executed before the occurrence of the abnormal situation is detected.
- Analyzing surveillance camera images in real time to detect the occurrence of an abnormal situation such as the technique disclosed in Patent Document 1, requires a large amount of computer resources.
- video analysis processing is not performed in normal times, but is performed only when an abnormal situation occurs. Therefore, according to this embodiment, the use of computer resources can be suppressed.
- step S201 in order to analyze images, the image acquisition unit 102 selects from among all the surveillance cameras 200 provided in the monitoring target area 90, the surveillance cameras 200 that are photographing the location of the occurrence of the abnormal situation, Get video data. Therefore, of the plurality of surveillance cameras 200, only the image data of the surveillance camera 200 that captures the area including the location of the abnormal situation (the surveillance camera 200 near the position of the sound source) is analyzed. Then, as described above, the detection of the occurrence of an abnormal situation is performed by sound detection rather than video analysis. For these reasons, in the present embodiment, video analysis processing can be reduced. Therefore, according to this embodiment, the use of computer resources can be further suppressed.
- step S202 the human detection unit 103 analyzes the acquired video data and detects a person (a person's full body image and a person's face).
- step S203 the crowd extracting unit 104 extracts, from among the detected persons, persons constituting the crowd around the location where the abnormal situation occurred.
- step S203 the line of sight processing (steps S204 and S205) and the facial expression processing (steps S206 and S207) are performed in parallel. It should be noted that the line-of-sight process and the facial expression process may not be performed in parallel, but may be performed in sequence.
- step S204 the line-of-sight estimation unit 105 performs line-of-sight estimation processing for the crowd around the position where the abnormal situation occurred. Then, in step S ⁇ b>205 , the severity estimation unit 107 performs estimation processing of the severity of the abnormal situation based on the processing result of the line-of-sight estimation unit 105 .
- step S208 the seriousness estimation unit 107 integrates the seriousness estimated based on the processing result of the line-of-sight estimation unit 105 and the seriousness estimated based on the processing result of the facial expression recognition unit 106 into a final seriousness. Calculate degrees.
- step S208 the process proceeds to step S105 shown in FIG.
- the occurrence of an abnormal situation is detected by a method other than video analysis. Analysis of the crowd captured in the video is then performed on the assumption that the occurrence of an abnormal situation has already been detected. For example, when a street musician or a street performer is performing on the roadside, there is a scene where the eyes of the crowd around a certain person are focused on the person, although no abnormal situation has occurred. Also, there are scenes in which, for example, when a politician who is not supported by the citizens is giving a speech on the street, the surrounding crowd has an unpleasant expression, even though there is no abnormal situation. Therefore, it is not possible to determine that an abnormal situation has occurred simply by analyzing the crowd's line of sight and facial expressions.
- an analysis is performed as to whether the expression of the crowd is an unpleasant expression.
- This is due to the natural law that when an abnormal situation such as a criminal act or an accident occurs, the crowd will find it unpleasant, and will often lose their smiles and make unpleasant facial expressions such as frowns.
- Patent Document 4 there is a technology for recognizing human facial expressions from images taken from a somewhat distant location, such as surveillance camera images, and estimating emotions such as the degree of smile or anger from the facial expressions. already established. Therefore, it is possible to analyze with high accuracy whether the expression of the crowd is unpleasant or not by the existing technology.
- video analysis processing is not performed during normal times, and is performed only when an abnormal situation occurs. Therefore, according to this embodiment, the use of computer resources can be suppressed. Then, as described above, the analysis processing is performed only on the image data of the monitoring camera 200 that captures the area including the location where the abnormal situation occurred, among the plurality of monitoring cameras 200 . Therefore, according to this embodiment, it is possible to further reduce the use of computer resources.
- the acoustic sensor 300 is arranged, and the acoustic sensor 300 includes the abnormality detection unit 301 and the abnormality determination unit 302.
- the monitoring system is configured as follows. may be That is, instead of the acoustic sensor 300, a microphone may be placed in the monitoring target area 90, a sound signal collected by the microphone may be transmitted to the analysis server 100, and the analysis server 100 may perform sound analysis and speech recognition. That is, among the components of the acoustic sensor 300 , at least the microphone only needs to be placed in the monitored area 90 , and the other components do not have to be placed in the monitored area 90 . In this manner, the processing of the abnormality detection unit 301 and the abnormality determination unit 302 described above may be implemented by the analysis server 100 .
- the acoustic sensor 300 in FIG. 3 can be replaced with another sensor.
- a sensor that senses high temperature such as an infrared sensor or infrared camera, may be used.
- an infrared camera it is possible to estimate the location of the high temperature from the image without arranging many sensors.
- these may be used together with the acoustic sensor, and it is possible to use them properly depending on the installation location. Therefore, the occurrence of an abnormal situation may be detected based on the sound or heat detected by the sensor provided in the monitored area, or the source of the sound or heat detected by the sensor provided in the monitored area may be estimated. By doing so, the position of occurrence of the abnormal situation may be obtained.
- the monitoring method shown in the above embodiment may be implemented as a monitoring program and sold. In this case, the user can install it on arbitrary hardware and use it, which improves convenience.
- the monitoring method shown in the above-described embodiments may be implemented as a monitoring device. In this case, the user can use the above-described monitoring method without the trouble of preparing hardware and installing the program by himself, thereby improving convenience.
- the monitoring method shown in the above-described embodiments may be implemented as a system configured by a plurality of devices. In this case, the user can use the above-described monitoring method without the trouble of combining and adjusting a plurality of devices by himself, thereby improving convenience.
- (Appendix 1) a position acquiring means for acquiring the position of occurrence of an abnormal situation in the monitored area; analysis means for analyzing the state of the crowd around the position where the abnormal situation occurred, based on the image data of the camera capturing the monitoring target area; and severity estimation means for estimating the severity of the abnormal situation based on the result of the analysis.
- the analysis means estimates the line of sight of each person constituting the crowd as an analysis of the state of the crowd, and the number of people whose line of sight is directed toward the position where the abnormal situation occurs, or the line of sight is 2.
- the monitoring device according to any one of appendices 1 to 4, wherein the analysis processing by the analysis means is performed when the occurrence of the abnormal situation is detected, and is not performed before the occurrence of the abnormal situation is detected. .
- Appendix 6 The monitoring device according to appendix 5, further comprising abnormality detection means for detecting the occurrence of the abnormality based on sound or heat detected by a sensor provided in the monitoring target area.
- Appendix 7) 7.
- (Appendix 8) severity determination means for determining whether or not the severity is equal to or greater than a predetermined threshold; 8.
- the monitoring apparatus according to any one of appendices 1 to 7, further comprising signal output means for outputting a predetermined signal when the severity is equal to or greater than a predetermined threshold.
- the analysis means estimates the line of sight of each person constituting the crowd as an analysis of the state of the crowd, and the number of people whose line of sight is directed toward the position where the abnormal situation occurs, or the line of sight is 10.
- the analysis means recognizes the facial expression of each person constituting the crowd as an analysis of the appearance of the crowd, and the number of people whose facial expression corresponds to a predetermined facial expression, or 11.
- (Appendix 12) Acquire the location of the abnormal situation in the monitored area, analyzing the state of the crowd around the position where the abnormal situation occurred based on the image data of the camera that captures the monitoring target area; A monitoring method for estimating the severity of the abnormal situation based on the result of the analysis.
- (Appendix 13) a position acquisition step of acquiring the position of occurrence of the abnormal situation in the monitored area; an analysis step of analyzing the state of the crowd around the location where the abnormal situation occurred, based on the image data of the camera capturing the monitoring target area;
- a non-transitory computer-readable medium storing a program for causing a computer to execute: a severity estimation step of estimating the severity of the abnormal situation based on the result of the analysis;
- monitoring device position acquisition unit 3 analysis unit 4 severity estimation unit 10 monitoring system 50 computer 51 network interface 52 memory 53 processor 90 monitored area 100 analysis server 101 sound source location estimation unit 102 image acquisition unit 103 human detection unit 104 crowd extraction Unit 105 Gaze estimation unit 106 Facial expression recognition unit 107 Seriousness estimation unit 108 Seriousness determination unit 109 Signal output unit 200 Surveillance camera 300 Acoustic sensor 301 Abnormality detection unit 302 Abnormality determination unit 500 Network
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Alarm Systems (AREA)
Abstract
Description
監視対象エリアにおける異常事態の発生位置を取得する位置取得手段と、
前記監視対象エリアを撮影するカメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析する分析手段と、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する深刻度推定手段と
を有する。
監視対象エリアを撮影するカメラと、
監視対象エリアにおいて発生する音又は熱を検知するセンサと、
監視装置と
を備え、
前記監視装置は、
前記センサが検知した音又は熱の発生源を推定することにより、前記監視対象エリアにおける異常事態の発生位置を取得する位置取得手段と、
前記カメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析する分析手段と、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する深刻度推定手段と
を有する。
監視対象エリアにおける異常事態の発生位置を取得し、
前記監視対象エリアを撮影するカメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析し、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する。
監視対象エリアにおける異常事態の発生位置を取得する位置取得ステップと、
前記監視対象エリアを撮影するカメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析する分析ステップ、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する深刻度推定ステップと
をコンピュータに実行させる。
実施の形態の詳細を説明する前に、実施の形態の概要について説明する。図1は、実施の形態の概要にかかる監視装置1の構成の一例を示すブロック図である。図1に示すように、監視装置1は、位置取得部2と、分析部3と、深刻度推定部4とを有し、所定の監視対象エリアを監視するための装置である。
次に、ステップS12において、分析部3が、監視対象エリアを撮影するカメラの映像データに基づいて、異常事態の発生位置の周辺の群衆の様子を分析する。
次に、ステップS13において、深刻度推定部4が、ステップS12の分析の結果に基づいて、異常事態の深刻度を推定する。
次に、実施の形態の詳細について説明する。
図3は、実施の形態にかかる監視システム10の構成の一例を示す模式図である。本実施の形態では、監視システム10は、分析サーバー100と、監視カメラ200と、音響センサ300とを備えている。監視システム10は、所定の監視対象エリア90を監視するためのシステムである。監視対象エリア90は、監視が行われる任意のエリアであるが、例えば、駅、空港、競技場、公共施設などのように、公衆が存在しうるエリアである。
異常検知部301は、音響センサ300が検知した音に基づいて、監視対象エリア90内での異常事態の発生を検知する。異常検知部301は、例えば、音響センサ300が検知した音が、所定の異常音に該当するか否かを判定することにより、異常事態の発生を検知する。すなわち、異常検知部301は、音響センサ300が検知した音が所定の異常音に該当する場合、監視対象エリア90内で異常事態が発生したと判断する。また、本実施の形態では、異常検知部301は、異常事態が発生したと判断した場合、異常度合いを示すスコアを算出する。例えば、異常検知部301は、異常音の大きさが大きいほど高いスコアを算出してもよいし、異常音の種類に応じたスコアを算出してもよいし、これらの組み合わせによりスコアを算出してもよい。
まず、ステップS201において、映像の分析のために、映像取得部102が、監視対象エリア90に設けられた全ての監視カメラ200のうち、異常事態の発生位置を撮影している監視カメラ200から、映像データを取得する。このため、複数の監視カメラ200のうち、異常事態の発生位置を含むエリアを撮影する監視カメラ200(音源の位置の近傍の監視カメラ200)の映像データに対してだけ、分析処理が行われる。そして、上述の通り、異常事態の発生の検知は、映像の分析によってではなく、音の検出によって行われる。これらのことから、本実施の形態では、映像の分析処理を少なくすることができる。よって、本実施の形態によれば、さらに、コンピュータ資源の利用を抑制することができる。
そして、ステップS205において、深刻度推定部107が、視線推定部105の処理結果に基づいて、異常事態の深刻度の推定処理を行う。
そして、ステップS207において、深刻度推定部107が、表情認識部106の処理結果に基づいて、異常事態の深刻度の推定処理を行う。
上述した実施の形態では、音響センサ300が配置され、音響センサ300が異常検知部301及び異常判定部302を備えたが、このような構成に代えて、次のような構成により監視システムが構成されてもよい。すなわち、音響センサ300の代わりにマイクを監視対象エリア90に配置し、マイクで集音した音声信号を分析サーバー100に伝送して、分析サーバー100が音響分析や音声認識を行ってもよい。つまり、音響センサ300の構成要素のうち、少なくともマイクだけが、監視対象エリア90に配置されていればよく、その他の構成要素については、監視対象エリア90に配置されていなくてもよい。このように、上述した異常検知部301及び異常判定部302の処理が分析サーバー100により実現されてもよい。
(付記1)
監視対象エリアにおける異常事態の発生位置を取得する位置取得手段と、
前記監視対象エリアを撮影するカメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析する分析手段と、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する深刻度推定手段と
を有する監視装置。
(付記2)
前記分析手段は、前記群衆の様子の分析として、前記群衆を構成するそれぞれの人物の視線を推定し、前記視線が前記異常事態の発生位置の方向を向いている人数、又は、前記視線が前記異常事態の発生位置の方向を向いている人数の、前記群衆の人数に対する割合を分析する
付記1に記載の監視装置。
(付記3)
前記分析手段は、前記群衆の様子の分析として、前記群衆を構成するそれぞれの人物の表情を認識し、認識された前記表情が所定の表情に該当する人数、又は、認識された前記表情が前記所定の表情に該当する人数の、前記群衆の人数に対する割合を分析する
付記1又は2に記載の監視装置。
(付記4)
前記位置取得手段は、前記監視対象エリアに設けられたセンサが検知した音又は熱の発生源を推定することにより、前記異常事態の発生位置を取得する
付記1乃至3のいずれか一項に記載の監視装置。
(付記5)
前記分析手段による分析処理が、前記異常事態の発生が検知された場合に実行され、前記異常事態の発生が検知される前には実行されない
付記1乃至4のいずれか一項に記載の監視装置。
(付記6)
前記監視対象エリアに設けられたセンサが検知した音又は熱に基づいて、前記異常事態の発生を検知する異常検知手段をさらに有する
付記5に記載の監視装置。
(付記7)
前記分析手段は、複数の前記カメラのうち、前記異常事態の発生位置を含むエリアを撮影するカメラの映像データに対してだけ、分析処理を行う
付記1乃至6のいずれか一項に記載の監視装置。
(付記8)
前記深刻度が所定の閾値以上であるか否かを判定する深刻度判定手段と、
前記深刻度が所定の閾値以上である場合に、所定の信号を出力する信号出力手段と
をさらに有する付記1乃至7のいずれか一項に記載の監視装置。
(付記9)
監視対象エリアを撮影するカメラと、
監視対象エリアにおいて発生する音又は熱を検知するセンサと、
監視装置と
を備え、
前記監視装置は、
前記センサが検知した音又は熱の発生源を推定することにより、前記監視対象エリアにおける異常事態の発生位置を取得する位置取得手段と、
前記カメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析する分析手段と、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する深刻度推定手段と
を有する、
監視システム。
(付記10)
前記分析手段は、前記群衆の様子の分析として、前記群衆を構成するそれぞれの人物の視線を推定し、前記視線が前記異常事態の発生位置の方向を向いている人数、又は、前記視線が前記異常事態の発生位置の方向を向いている人数の、前記群衆の人数に対する割合を分析する
付記9に記載の監視システム。
(付記11)
前記分析手段は、前記群衆の様子の分析として、前記群衆を構成するそれぞれの人物の表情を認識し、認識された前記表情が所定の表情に該当する人数、又は、認識された前記表情が前記所定の表情に該当する人数の、前記群衆の人数に対する割合を分析する
付記9又は10に記載の監視システム。
(付記12)
監視対象エリアにおける異常事態の発生位置を取得し、
前記監視対象エリアを撮影するカメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析し、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する
監視方法。
(付記13)
監視対象エリアにおける異常事態の発生位置を取得する位置取得ステップと、
前記監視対象エリアを撮影するカメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析する分析ステップ、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する深刻度推定ステップと
をコンピュータに実行させるプログラムが格納された非一時的なコンピュータ可読媒体。
2 位置取得部
3 分析部
4 深刻度推定部
10 監視システム
50 コンピュータ
51 ネットワークインタフェース
52 メモリ
53 プロセッサ
90 監視対象エリア
100 分析サーバー
101 音源位置推定部
102 映像取得部
103 人検知部
104 群衆抽出部
105 視線推定部
106 表情認識部
107 深刻度推定部
108 深刻度判定部
109 信号出力部
200 監視カメラ
300 音響センサ
301 異常検知部
302 異常判定部
500 ネットワーク
Claims (13)
- 監視対象エリアにおける異常事態の発生位置を取得する位置取得手段と、
前記監視対象エリアを撮影するカメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析する分析手段と、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する深刻度推定手段と
を有する監視装置。 - 前記分析手段は、前記群衆の様子の分析として、前記群衆を構成するそれぞれの人物の視線を推定し、前記視線が前記異常事態の発生位置の方向を向いている人数、又は、前記視線が前記異常事態の発生位置の方向を向いている人数の、前記群衆の人数に対する割合を分析する
請求項1に記載の監視装置。 - 前記分析手段は、前記群衆の様子の分析として、前記群衆を構成するそれぞれの人物の表情を認識し、認識された前記表情が所定の表情に該当する人数、又は、認識された前記表情が前記所定の表情に該当する人数の、前記群衆の人数に対する割合を分析する
請求項1又は2に記載の監視装置。 - 前記位置取得手段は、前記監視対象エリアに設けられたセンサが検知した音又は熱の発生源を推定することにより、前記異常事態の発生位置を取得する
請求項1乃至3のいずれか一項に記載の監視装置。 - 前記分析手段による分析処理が、前記異常事態の発生が検知された場合に実行され、前記異常事態の発生が検知される前には実行されない
請求項1乃至4のいずれか一項に記載の監視装置。 - 前記監視対象エリアに設けられたセンサが検知した音又は熱に基づいて、前記異常事態の発生を検知する異常検知手段をさらに有する
請求項5に記載の監視装置。 - 前記分析手段は、複数の前記カメラのうち、前記異常事態の発生位置を含むエリアを撮影するカメラの映像データに対してだけ、分析処理を行う
請求項1乃至6のいずれか一項に記載の監視装置。 - 前記深刻度が所定の閾値以上であるか否かを判定する深刻度判定手段と、
前記深刻度が所定の閾値以上である場合に、所定の信号を出力する信号出力手段と
をさらに有する請求項1乃至7のいずれか一項に記載の監視装置。 - 監視対象エリアを撮影するカメラと、
監視対象エリアにおいて発生する音又は熱を検知するセンサと、
監視装置と
を備え、
前記監視装置は、
前記センサが検知した音又は熱の発生源を推定することにより、前記監視対象エリアにおける異常事態の発生位置を取得する位置取得手段と、
前記カメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析する分析手段と、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する深刻度推定手段と
を有する、
監視システム。 - 前記分析手段は、前記群衆の様子の分析として、前記群衆を構成するそれぞれの人物の視線を推定し、前記視線が前記異常事態の発生位置の方向を向いている人数、又は、前記視線が前記異常事態の発生位置の方向を向いている人数の、前記群衆の人数に対する割合を分析する
請求項9に記載の監視システム。 - 前記分析手段は、前記群衆の様子の分析として、前記群衆を構成するそれぞれの人物の表情を認識し、認識された前記表情が所定の表情に該当する人数、又は、認識された前記表情が前記所定の表情に該当する人数の、前記群衆の人数に対する割合を分析する
請求項9又は10に記載の監視システム。 - 監視対象エリアにおける異常事態の発生位置を取得し、
前記監視対象エリアを撮影するカメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析し、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する
監視方法。 - 監視対象エリアにおける異常事態の発生位置を取得する位置取得ステップと、
前記監視対象エリアを撮影するカメラの映像データに基づいて、前記異常事態の発生位置の周辺の群衆の様子を分析する分析ステップ、
前記分析の結果に基づいて、前記異常事態の深刻度を推定する深刻度推定ステップと
をコンピュータに実行させるプログラムが格納された非一時的なコンピュータ可読媒体。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2021/027118 WO2023002563A1 (ja) | 2021-07-20 | 2021-07-20 | 監視装置、監視システム、監視方法、及びプログラムが格納された非一時的なコンピュータ可読媒体 |
JP2023536258A JPWO2023002563A5 (ja) | 2021-07-20 | 監視装置、監視方法、及びプログラム | |
US18/274,198 US20240087328A1 (en) | 2021-07-20 | 2021-07-20 | Monitoring apparatus, monitoring system, monitoring method, and non-transitory computer-readable medium storing program |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2021/027118 WO2023002563A1 (ja) | 2021-07-20 | 2021-07-20 | 監視装置、監視システム、監視方法、及びプログラムが格納された非一時的なコンピュータ可読媒体 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023002563A1 true WO2023002563A1 (ja) | 2023-01-26 |
Family
ID=84979176
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2021/027118 WO2023002563A1 (ja) | 2021-07-20 | 2021-07-20 | 監視装置、監視システム、監視方法、及びプログラムが格納された非一時的なコンピュータ可読媒体 |
Country Status (2)
Country | Link |
---|---|
US (1) | US20240087328A1 (ja) |
WO (1) | WO2023002563A1 (ja) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001333416A (ja) * | 2000-05-19 | 2001-11-30 | Fujitsu General Ltd | ネットワーク監視カメラシステム |
JP2002032879A (ja) * | 2000-07-13 | 2002-01-31 | Yuasa Trading Co Ltd | 監視システム |
WO2014174760A1 (ja) * | 2013-04-26 | 2014-10-30 | 日本電気株式会社 | 行動解析装置、行動解析方法および行動解析プログラム |
JP2018148402A (ja) * | 2017-03-06 | 2018-09-20 | 株式会社 日立産業制御ソリューションズ | 映像監視装置および映像監視方法 |
-
2021
- 2021-07-20 US US18/274,198 patent/US20240087328A1/en active Pending
- 2021-07-20 WO PCT/JP2021/027118 patent/WO2023002563A1/ja active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001333416A (ja) * | 2000-05-19 | 2001-11-30 | Fujitsu General Ltd | ネットワーク監視カメラシステム |
JP2002032879A (ja) * | 2000-07-13 | 2002-01-31 | Yuasa Trading Co Ltd | 監視システム |
WO2014174760A1 (ja) * | 2013-04-26 | 2014-10-30 | 日本電気株式会社 | 行動解析装置、行動解析方法および行動解析プログラム |
JP2018148402A (ja) * | 2017-03-06 | 2018-09-20 | 株式会社 日立産業制御ソリューションズ | 映像監視装置および映像監視方法 |
Also Published As
Publication number | Publication date |
---|---|
JPWO2023002563A1 (ja) | 2023-01-26 |
US20240087328A1 (en) | 2024-03-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5043940B2 (ja) | ビデオおよびオーディオ認識を組み合わせたビデオ監視システムおよび方法 | |
US9761248B2 (en) | Action analysis device, action analysis method, and action analysis program | |
JP6532106B2 (ja) | 監視装置、監視方法および監視用プログラム | |
US20090195382A1 (en) | Video sensor and alarm system and method with object and event classification | |
JP7162412B2 (ja) | 検知認識システム | |
KR101602753B1 (ko) | 음성인식 비상 호출 시스템 | |
KR101485022B1 (ko) | 행동 패턴 분석이 가능한 객체 추적 시스템 및 이를 이용한 방법 | |
KR101841882B1 (ko) | 무인방범 시스템 및 방법 | |
KR101899436B1 (ko) | 비명인식 기반 안전감지센서 | |
KR101467352B1 (ko) | 위치기반 통합관제시스템 | |
KR102069270B1 (ko) | 화재감지 기능을 갖는 cctv시스템 및 그 제어방법 | |
KR101384781B1 (ko) | 이상 음원 탐지 장치 및 방법 | |
JP5970232B2 (ja) | 避難情報提供装置 | |
KR101321447B1 (ko) | 네트워크를 통한 현장 모니터링 방법, 및 이에 사용되는 관리 서버 | |
JP2005323046A (ja) | 監視システム、および監視カメラ | |
JP2014067383A (ja) | 行動監視通報システム | |
CN111908288A (zh) | 一种基于TensorFlow的电梯安全***及方法 | |
KR102233679B1 (ko) | Ess 침입자 및 화재 감지 장치 및 방법 | |
KR101286200B1 (ko) | 무장강도 자동인식 대응 시스템 및 방법 | |
WO2023002563A1 (ja) | 監視装置、監視システム、監視方法、及びプログラムが格納された非一時的なコンピュータ可読媒体 | |
KR20140076184A (ko) | 차량 및 보행자 검지를 이용한 스쿨존 방범장치 | |
KR102579572B1 (ko) | 음향 기반의 비상벨 관제 시스템 및 그 방법 | |
KR102648004B1 (ko) | 폭력감지장치 및 방법, 이를 포함하는 스마트 폭력감시시스템 | |
JP2017111496A (ja) | 行動監視予測システム、行動監視予測方法 | |
JP4175180B2 (ja) | 監視通報システム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21950916 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18274198 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2023536258 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21950916 Country of ref document: EP Kind code of ref document: A1 |