WO2015111312A1 - 画像検索システム及び画像検索方法 - Google Patents
画像検索システム及び画像検索方法 Download PDFInfo
- Publication number
- WO2015111312A1 WO2015111312A1 PCT/JP2014/082425 JP2014082425W WO2015111312A1 WO 2015111312 A1 WO2015111312 A1 WO 2015111312A1 JP 2014082425 W JP2014082425 W JP 2014082425W WO 2015111312 A1 WO2015111312 A1 WO 2015111312A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- search
- suspected
- person
- alarm
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 80
- 238000001514 detection method Methods 0.000 claims abstract description 104
- 239000000126 substance Substances 0.000 claims abstract description 22
- 238000000605 extraction Methods 0.000 claims abstract description 13
- 238000003384 imaging method Methods 0.000 claims description 61
- 238000007689 inspection Methods 0.000 claims description 17
- 238000004891 communication Methods 0.000 claims description 9
- 239000000463 material Substances 0.000 claims description 9
- 238000009434 installation Methods 0.000 claims description 7
- 239000002360 explosive Substances 0.000 abstract description 31
- 238000012545 processing Methods 0.000 description 43
- 230000006870 function Effects 0.000 description 18
- 238000012544 monitoring process Methods 0.000 description 11
- 230000005540 biological transmission Effects 0.000 description 10
- 239000011521 glass Substances 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 239000000284 extract Substances 0.000 description 4
- 150000002500 ions Chemical class 0.000 description 3
- 239000000523 sample Substances 0.000 description 3
- 239000004065 semiconductor Substances 0.000 description 3
- 230000002265 prevention Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 238000001917 fluorescence detection Methods 0.000 description 1
- 230000005021 gait Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004949 mass spectrometry Methods 0.000 description 1
- 238000001819 mass spectrum Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 230000037230 mobility Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000002250 progressing effect Effects 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000005549 size reduction Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000037303 wrinkles Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01V—GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
- G01V5/00—Prospecting or detecting by the use of ionising radiation, e.g. of natural or induced radioactivity
- G01V5/20—Detecting prohibited goods, e.g. weapons, explosives, hazardous substances, contraband or smuggled objects
- G01V5/271—Detecting prohibited goods, e.g. weapons, explosives, hazardous substances, contraband or smuggled objects using a network, e.g. a remote expert, accessing remote data or the like
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/80—Recognising image objects characterised by unique random patterns
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
- H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/05—Recognition of patterns representing particular kinds of hidden objects, e.g. weapons, explosives, drugs
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
Definitions
- the present invention relates to an image search system and an image search method, and in particular, an explosive detection device by connecting a similar image search system for searching people in a video surveillance system and a security system including an explosive detection device via a network.
- the present invention relates to an image search system and an image search method capable of tracking a specific person using a detection result obtained by the above and a similar image search system.
- video surveillance systems have been installed in facilities and places visited by an unspecified number of people such as hotels, buildings, convenience stores, financial institutions, dams and roads for the purpose of crime prevention and accident prevention. This is because a person to be monitored is photographed by an imaging device such as a camera, and the video is transmitted to a monitoring center such as a management office or a security room, and the resident supervisor monitors it, and the purpose and necessity This is for warning or recording video.
- the person search function is a function that records in real time the appearance of a person in a video as an object of automatic detection, and can search for a person appearance image from recorded images after the fact.
- a person search system that causes a computer to search for a desired person from images (moving images) shot or recorded by a plurality of surveillance cameras or the like using an image recognition technique or the like (for example, Patent Documents). 1 to 3).
- Japanese Patent Application Laid-Open No. 2004-228688 extracts a portion in which a person (face) appears from an image, extracts a color histogram or the like as a feature quantity for individually identifying the person, and the feature quantity is similar to that of a desired person.
- Japanese Patent Application Laid-Open No. 2004-228688 extracts a portion in which a person (face) appears from an image, extracts a color histogram or the like as a feature quantity for individually identifying the person, and the feature quantity is similar to that of a desired person.
- Patent Document 3 discloses an image security system that searches a captured video to identify a movement path of a person and uses the movement path for security management.
- Patent Document 4 describes an explosive detection device using a mass spectrometer.
- gas leaking from a luggage or the like is collected by a sampling probe, ionized and detected using a mass spectrometer, thereby determining the presence or absence of a dangerous substance.
- a technique for improving the inspection speed and the reliability of inspection by using a mass spectrometer as a detection unit of a security system is described in Patent Document 5.
- a signal obtained by an analysis unit is sent to a support system through a communication line, and the support system determines the presence or absence of dangerous goods.
- the determination result of the support system is sent to the terminal system via the communication line.
- JP 2009-027393 A Japanese Patent No. 4700477 JP 2012-068717 A JP 2000-028579 A JP 2003-014695 A
- the person search function using the above-described image search system is a function for searching for a specific person based on a video obtained from an imaging device such as a surveillance camera.
- the search is performed using information other than that as a trigger.
- a security guard or the like receives a notification of finding an explosive owner and performs a person search using a person search function based on the information (including location and time).
- explosive detection devices that have been developed so far have been considered mainly for the operation of airports and important facilities, and devices were considered for the purpose of inspecting a relatively small number of people.
- the present invention has been made in view of such a situation, and connects an image search system based on an application of similar image search technology, which has been operating independently, and a security system using an explosive detection device via a network. Therefore, it is possible to operate the image search system more quickly based on information such as the discovery of the subject of suspected possession of explosives by the explosive detection device, and the explosives possessor can be quickly and accurately operated from a large number of passengers.
- the purpose is to find out.
- An image search system and an image search method are configured as follows.
- An image search system according to the present invention includes at least one imaging device that outputs captured image data, a recording device that records image data input from the imaging device on a recording medium, and a detection device that detects a dangerous object.
- a network for communicating with each other by connecting the devices to each other, receiving means for receiving alarm information by the dangerous object detection transmitted from the detection device via the network, and the reception Based on the alarm issue time information included in the alarm information received by the means, the imaging set up around the detection device using the alarm issue time and a predetermined time before the alarm issue time as a search condition
- a target person extraction means for performing a face image search on the image data from the apparatus and extracting a target person suspected of possessing a dangerous substance; and the target person extraction
- the greylist registration means for registering the target of suspected possession of dangerous goods extracted in the stage to the greylist, and the recording for each subject of suspected possession of dangerous goods registered in the greylist by the greylist registration means
- a target person search means for periodically performing a similar face image search on the image data recorded in the apparatus.
- the imaging that captures the subject of suspected possession of the dangerous goods A target person information display means for displaying the position information of the installation location of the apparatus and the alarm issue time on the screen, and the imaging apparatus for photographing the target person suspected of possessing the dangerous goods displayed by the target person information display means.
- Trajectory display means for displaying on a map a trajectory traced by the person suspected of possessing the dangerous goods based on the position information.
- the image search system of the present invention includes a plurality of trajectory display means for searching for a plurality of persons who are suspected of possessing the dangerous goods registered in the greylist and displaying a plurality of trajectories simultaneously. To do.
- the image search system of the present invention sets the information before and after the alarm notification time and the information near the alarm detection device, and performs similar face image search for all the videos corresponding to the set information,
- the search result is registered in the greylist as the person who is suspected of possessing the dangerous goods, and the camera image set in the place where the alarm information is issued for the subject of suspected possession of the dangerous goods registered in the greylist.
- Dangerous goods owner identification means for identifying a dangerous goods holder using a plurality of images taken at different locations and at different times is provided.
- the image search system of the present invention includes a search result map display means for displaying on the map the result of the similar face image search performed by setting the information before and after the alarm notification time and the information in the vicinity of the alarm detection device. It is characterized by providing.
- the image search system of the present invention is provided with a gate in the detection device, and a human sensor is installed at the gate entrance to detect how many people have passed within a predetermined time, and the information on the number of people who have passed is obtained. It is characterized by comprising passing number counting means that transmits to the recording device in the recording device via a network and is used for making a greylist of persons who are suspected of possessing the dangerous goods.
- the image search method of the present invention detects at least one imaging device that outputs captured image data, a recording device that records the image data input from the imaging device on a recording medium, and a dangerous object.
- An image search method of an image search system comprising a detection device and a network for connecting the devices to each other for communication, wherein alarm information transmitted from the detection device is detected via the network.
- the detection device based on the reception step of receiving and the alarm notification time information included in the alarm information received in the reception step, using the alarm notification time and a predetermined time before the alarm notification time as search conditions
- a target person search step of periodically performing a similar face image search on the image data recorded in the recording device.
- the imaging of the subject person suspected of possessing the dangerous goods A target person information display step for displaying the position information of the installation location of the apparatus and the alarm issue time on the screen; and the imaging apparatus for photographing the target person suspected of possessing the dangerous goods displayed in the target person information display step.
- a trajectory display step for displaying a trajectory traced by the person suspected of possessing the dangerous material on the map based on the position information.
- the image search method of the present invention includes a plurality of trajectory display steps for respectively searching for a plurality of persons who are suspected of possessing the dangerous goods registered in the greylist and displaying a plurality of trajectories simultaneously. To do.
- the image search method of the present invention sets the information before and after the alarm notification time and the information near the alarm detection device, and performs similar face image search for all the videos corresponding to the set information,
- the search result is registered in the greylist as the person who is suspected of possessing the dangerous goods, and the camera image set in the place where the alarm information is issued for the subject of suspected possession of the dangerous goods registered in the greylist. It is characterized by having a dangerous goods owner specifying step of specifying a dangerous goods holder using a plurality of images taken at different places and at different times.
- the image search method of the present invention includes a search result map display step for displaying on the map the result of the similar face image search performed by setting the information before and after the alarm notification time and the information in the vicinity of the alarm detection device. It is characterized by having.
- a gate is provided in the detection device, a human sensor is installed at an entrance of the gate to detect how many people have passed within a predetermined time, and the information on the number of people who have passed is obtained.
- the method includes the step of counting the number of passing people to be transmitted to the recording device in the recording device via a network and used for making a greylist of persons who are suspected of possessing the dangerous goods.
- the recording apparatus of the present invention is connected to at least one imaging apparatus that outputs image data captured via a network and a detection apparatus that detects a dangerous object, and receives image data input from the imaging apparatus.
- a face image search is performed on the image data from the imaging device installed around the detection device, using the alarm issue time and a predetermined time before the alarm issue time as a search condition.
- the target person extracting means for extracting the target person suspected of possessing the dangerous goods, and the target person suspected of possessing the dangerous goods extracted by the target person extracting means.
- a greylist registering means for registering the image data and a target for suspected possession of dangerous goods registered in the greylist by the greylist registration means for each of the image data recorded in the recording device periodically.
- a target person search means for performing a similar face image search.
- the explosives possessed by the explosive detection device can be obtained by connecting the image retrieval system by the application of the similar image retrieval technology that has been operated independently and the security system by the explosive detection device via the network.
- the image search system can be operated more quickly based on information such as the discovery of the suspected person, and the explosives holder can be searched from a large number of passengers more quickly and accurately.
- FIG. 1 is a diagram illustrating a system configuration in which a similar image search system and a security system including a detection device according to an embodiment of the present invention are connected by a network. It is a figure which illustrates the hardware constitutions of the imaging device used for the similar image search system which concerns on one Embodiment of this invention. It is a figure which illustrates the hardware constitutions of the video recording apparatus used for the similar image search system which concerns on one Embodiment of this invention. It is a figure which illustrates the hardware constitutions of the terminal device used for the similar image search system which concerns on one Embodiment of this invention. In the first example, it is a diagram illustrating a feature amount of the first search key image.
- the first example it is a diagram illustrating the feature amount of the image obtained by the process of selecting the same person from the search result.
- a 1st Example it is a figure which illustrates the feature-value of the image obtained by the process which selects the same person before and after a search result.
- FIG. 10 is a diagram illustrating a result of clustering search key image candidates and feature amounts representing each cluster in the first example. It is a figure which illustrates the procedure which implements a similar image search in the similar image search system which concerns on one Embodiment of this invention.
- the present invention relates to an image search system capable of tracking a specific person by connecting a similar image search system and a security system including an explosive detection device via a network, and using a detection result from the explosive detection device and the similar image search system.
- An embodiment of the present invention will be described below.
- FIG. 1 illustrates a system configuration of a similar image search system according to an embodiment of the present invention.
- the similar image search system is configured such that an imaging apparatus 201, a recording apparatus 102, and a terminal apparatus 103 are connected to a network 200 and can communicate with each other.
- the imaging device 201 is installed in each of a plurality of places.
- the network 200 is a communication means for performing communication by mutually connecting devices such as a dedicated network for data communication, an intranet, the Internet, and a wireless LAN (Local Area Network).
- devices such as a dedicated network for data communication, an intranet, the Internet, and a wireless LAN (Local Area Network).
- the imaging device 201 performs a digital conversion process on an image captured by a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor) element, or the like, and outputs the converted image data to the recording device via the network 200.
- CCD Charge Coupled Device
- CMOS Complementary Metal Oxide Semiconductor
- Devices such as cameras and surveillance cameras.
- the recording device 102 is a device such as a network digital recorder that records image data input from the imaging device 201 via the network 200 on a recording medium such as an HDD.
- the apparatus is also equipped with a person search function including the method of the present invention.
- the recording apparatus 102 has an image transmission / reception unit 210, an image recording unit 211, a reproduction control unit 212, a person area detection unit 213, a person feature amount extraction unit 214, a person feature amount recording unit 215, an attribute information recording unit 216, as a functional configuration.
- Each processing unit includes a request reception unit 217, a similar person search unit 218, an appearance event search unit 219, a search result transmission unit 220, a keyword recording unit 110, and a keyword search unit 111.
- the image transmission / reception unit 210 is a processing unit that inputs and outputs images from the outside of the apparatus, and receives input image data from the imaging apparatus 201 and transmits output image data to the terminal apparatus 103.
- the image recording unit 211 writes input image data to a recording medium and reads output image data from the recording medium. At the time of writing, in addition to the image data, an image ID (image identification information) serving as information for reading the image data is also recorded.
- the playback control unit 212 controls video playback on the terminal device 103.
- the person area detection unit 213 performs person detection using image recognition technology on the input image data, determines the presence of a person in the image, and, if a person exists, calculates the coordinates of that area.
- the person feature amount extraction unit 214 performs feature amount calculation on the region detected by the person region detection unit 213 using an image recognition technique.
- the human feature amount calculated here is, for example, the shape and direction of the contour of the person, the color of the skin, the gait (how to roll a leg such as which leg is moved at what timing), or the person is specified
- the shape and direction of the contour of the face which is a representative part, and the size, shape, arrangement relationship, etc.
- the person feature amount recording unit 215 writes and reads the feature amount calculated by the person feature amount extraction unit 214 to and from the recording medium.
- the image data recording medium in the image recording unit 211 and the person feature amount recording medium in the processing unit may be the same or different.
- the attribute information recording unit 216 writes and reads attribute information related to image data to and from a recording medium.
- the attribute information is, for example, an image shooting time, an imaging device number, an imaging location, and the like.
- the request receiving unit 217 receives search requests and keyword assignment requests from the terminal device 103.
- the search request includes a similar image search request and an appearance event search request.
- the similar person search unit 218 performs a similar image search when the request received by the request reception unit 217 is a similar person search request.
- the appearance event search unit 219 performs an appearance event search when the request received by the request reception unit 217 is an appearance event search request.
- the search result transmission unit 220 transmits the similar person search result and the appearance event search result obtained from the similar person search unit 218 and the appearance event search unit 219 to the terminal device 103.
- the keyword recording unit 110 writes and reads a keyword on the recording medium based on the keyword assignment request received by the request receiving unit 217.
- the keyword search unit 111 performs a keyword search when the search request data received by the request reception unit 217 includes a keyword.
- the terminal device 103 may be realized by a general PC (personal computer) having a network function, or may be a dedicated search terminal.
- the terminal device 103 includes a search request transmission unit 221, a search result reception unit 222, a search result display unit 223, a reproduction image display unit 224, a screen operation detection unit 225, a keyword assignment request transmission unit 112, and a plurality of search key selections as functional configurations.
- Each processing unit of the unit 113 is included.
- the apparatus is also equipped with a person search function for realizing the method of the present invention.
- the search request transmission unit 221 transmits a search request to the recording device 102.
- the search request data includes a search key image or a feature amount thereof as a search key for similar person search.
- the search request data can also include a refinement parameter.
- the search result receiving unit 222 receives the search result from the recording device 102.
- the data received as the search result includes a set of images obtained by performing similar person search or appearance event search in the recording apparatus 102. Individual images constituting the set are generated by performing image size reduction processing or the like from the video recorded in the recording device 102.
- each individual image is referred to as a “search result image”
- data transmitted and received as a search result is referred to as “search result data”.
- the search result display unit 223 displays a screen of the search result received by the search result receiving unit 222. An example of the displayed screen will be described later.
- the reproduction image display unit 224 performs continuous moving image display on the screen of the image data input from the recording device 102.
- the screen operation detection unit 225 detects and acquires operation content performed by the user.
- the keyword assignment request transmitter 112 transmits a keyword assignment request to the recording device 102.
- the multiple search key selection unit 113 performs a process of appropriately selecting a smaller number of search key images when a plurality of search key image candidates are selected.
- the multiple search key selection unit 113 may be provided in the recording device 102.
- FIG. 2 illustrates a hardware configuration of the imaging apparatus 201 used in the similar image search system according to the embodiment of the present invention.
- the hardware configuration of the imaging apparatus 201 is a form in which an imaging unit 241, a main storage unit 242, an encoding unit 243, and a network interface (I / F) 244 are coupled via a bus 240.
- the imaging unit 241 converts the optical signal captured by the lens into digital data.
- the encoding unit 243 encodes the digital data output from the imaging unit 241 and converts it into image data such as JPEG (Joint Photographic Experts Group).
- the main storage unit 242 stores captured digital data and encoded image data.
- the network I / F 244 is an interface for transmitting image data on the main storage unit 242 to the recording device 102 via the network 200.
- FIG. 3 illustrates a hardware configuration of the recording apparatus 102 used in the similar image search system according to the embodiment of the present invention.
- the hardware configuration of the recording apparatus 102 is a form in which a CPU (Central Processing Unit) 251, a main storage unit 252, an auxiliary storage unit 253, and a network I / F 254 are coupled via a bus 250.
- a CPU Central Processing Unit
- main storage unit 252 main storage unit
- auxiliary storage unit 253 main storage unit
- a network I / F 254 are coupled via a bus 250.
- the CPU 251 performs control of each unit of the recording device 102 and execution of a program for realizing the function.
- the main storage unit 252 is realized by a semiconductor device such as a DRAM (Dynamic Random Access Memory), and is an intermediate memory for loading and storing image data for search and a program executed by the CPU 251.
- the auxiliary storage unit 253 is realized by an HDD, a flash memory, or the like, and has a larger capacity than the main storage unit 252 and stores image data and programs.
- the network I / F 254 is an interface for receiving image data from the imaging apparatus 201, receiving a search keyword from the terminal apparatus 103, and transmitting image data to the terminal apparatus 103 via the network 200.
- FIG. 4 illustrates a hardware configuration of the terminal device 103 used in the similar image search system according to the embodiment of the present invention.
- the hardware configuration of the terminal device 103 includes a CPU 261, a main storage unit 262, an auxiliary storage unit 263, a display I / F 264, an input / output I / F 265, and a network I / F 266 that are coupled via a bus 260. It is a form.
- the display I / F 264 is connected to the display device 270, and the input / output I / F 265 is connected to input / output devices such as a keyboard 280 and a mouse 282.
- the CPU 261 performs control of each unit of the terminal device 103 and execution of a program for realizing the function.
- the main storage unit 262 is realized by a semiconductor device such as a DRAM, and is an intermediate memory for loading and storing image data for display and a program executed by the CPU 261.
- the auxiliary storage unit 263 is realized by an HDD, a flash memory, or the like, and has a larger capacity than the main storage unit 262, and stores search keywords, image data, and programs.
- the display I / F 264 is an interface for connecting to the display device 270.
- the input / output I / F 265 is an interface for connecting to input / output devices such as a keyboard 280 and a mouse 282.
- the network I / F 266 is an interface for receiving image data from the recording apparatus 102 and transmitting a search keyword to the recording apparatus 102 via the network 200.
- the display device 270 is a device such as an LCD (Liquid Crystal Display), for example, and is a device that displays an image or a moving image on the display unit.
- the user operates the input / output device such as the keyboard 280 and the mouse 282 on the image displayed on the display unit of the display device 270, for example, the GUI (Graphical User Interface), thereby performing the terminal device 103 and the like. Operate the image search system.
- FIG. 6 illustrates a procedure for performing a similar person search.
- 5A to 5E exemplify feature amounts of images that are candidates for search key images in accordance with a procedure for performing similar person search.
- the first search is performed using the first search key image selected by the user.
- an image having a feature amount close to the feature amount of the image selected as the first search key image (in this example, the feature amount of a person in the image) is transmitted through the similar person search unit 218 in the recording apparatus 102.
- ten images are searched.
- the feature amount of the first search key image is indicated by “ ⁇ ”.
- the feature amount of the image is expressed in two dimensions.
- the feature amount of the image often has a very large number of dimensions such as several hundred dimensions. .
- the process 6002 for selecting the same person from the search results three target images are selected from the ten search result images.
- the user operates the mouse 282 of the terminal device 103 to click and select a target image.
- a threshold is set for the feature amount of the image, and if the distance between the feature amount of the first search key image and the feature amount of the search result image is equal to or less than the threshold, it is determined that they are the same target (same person), and the corresponding search result A method of automatically selecting an image may be used.
- the feature quantity of the image selected by the process 6002 for selecting the same person from the search result is indicated by “ ⁇ ”.
- the image selected by such processing becomes a candidate for a new search key image.
- the search result image is one of continuous images forming a moving image
- the same person image is often included before and after the search result image in the moving image.
- the position, speed, etc. of the person from a plurality of images included in a predetermined length of time zone before or after the search result image in the moving image from which the search result image is extracted Based on this, an image determined to be the same person as the person of the search result image (that is, the same person as the person of the search key image) is automatically selected.
- the user may be allowed to specify.
- the feature quantity of the image selected by the process 6003 for selecting the same person before and after the search result is indicated by “ ⁇ ”.
- the image selected by such processing becomes a candidate for a new search key image.
- an image in which a mask for covering the nose and mouth is added to the image of the person who is a candidate for a new search key image in the previous processing, and a new search key is generated.
- the image of the person before image processing is a mask covering the nose and mouth
- a process of removing the mask by image processing may be performed.
- a plurality of types of images may be prepared for the mask image.
- an image in which sunglasses or glasses are added by image processing is generated for the image of a person who is a candidate for a new search key image in the previous processing, and a new search key image is created.
- Process to add to candidate On the contrary, when the image of the person before image processing is wearing sunglasses or glasses, a process of removing the sunglasses or glasses may be performed in the image processing. Also, a plurality of types of images of sunglasses and glasses may be prepared. Note that the image processing 6004 for adding a mask and the image processing 6005 for adding sunglasses or glasses can be arbitrarily performed, and other image processing for adding a hairstyle, a wrinkle, or the like may be appropriately combined.
- an image in which the orientation of the person is changed by the image processing is generated with respect to the image of the person who is a candidate for the new search key image in the processing so far, and a new search key image is obtained.
- Process to add to candidate The direction of the person is usually plural, but simple left-right inversion may be used.
- image processing 6004 for adding a mask in addition to the contents shown in FIG. 5C, image processing 6004 for adding a mask, image processing 6005 for adding sunglasses and glasses, and feature amounts of a plurality of images generated as a result of image processing 6006 for changing the orientation of a person Is indicated by “x”.
- the image generated by such processing is added as a new search key image candidate.
- the image processing 6004 for adding a mask, the image processing 6005 for adding sunglasses or glasses, and the image processing 6006 for changing the orientation of a person are the results of the processing 6002 for selecting the same person from the first search key image and search results. Either an image or an image resulting from the process 6003 for selecting the same person before and after the search result may be targeted. Further, any one image processing may be performed on the target image, any two image processings may be performed, or all three image processings may be performed. In addition, image processing other than the above, such as image processing for changing the brightness of a target image, may be performed.
- a clustering process 6007 may be performed in which a plurality of images that are candidates for the search key image by the processes 6001 to 6006 so far are clustered to obtain an image representative of each cluster (or its feature value).
- a known technique such as a k-means method can be used.
- an image representing each cluster for example, an image closest to the average of the feature amounts of the images included in the cluster is used, and the feature amount of the image is used as a new search key. Note that the average of the feature amounts of the images included in the cluster may be used as a new search key as it is.
- FIG. 5E exemplifies how new search key image candidates obtained by the processes 6001 to 6006 are divided into clusters by the clustering process 6007 and the feature amount of the image representing each cluster.
- three clusters are surrounded by a frame line, and image feature amounts P11, P12, and P13 closest to the center of gravity of each cluster are selected as the feature amounts of the image representing each cluster. .
- a similar image search is performed using a feature quantity of an image representing each cluster obtained by the clustering process 6007 as a new search key, and the result is output.
- a search using the feature amount of these images as a new search key is performed.
- a similar image search is performed using the feature amounts of three images representing each cluster obtained by the clustering process 6007, so that the search can be performed three times while balancing the feature amounts. .
- the number of clusters is 3 here, this can be changed according to the setting.
- the similar image search system according to the embodiment of the present invention has been described with respect to a series of systems using the clustering process 6007, the clustering process 6007 is not performed, and 29 images that are related to the first search key image are displayed. You may search using all as a new search key.
- FIG. 7 illustrates a search screen that can be used in the similar image search system of this example.
- the search screen includes a reproduction image display area 3001, an image reproduction operation area 3003, a search key image designation area 3004, a search refinement parameter designation area 3008, a search execution area 3017, and a search result display area 3020.
- a reproduction image display area 3001 is an area for displaying an image recorded in the recording apparatus 102 as a moving image.
- a moving image 3002 in the reproduction image display area 3001 displays an image recorded in the recording device 102 as a moving image.
- An image reproduction operation area 3003 is an area for performing an operation for reproducing an image recorded in the recording apparatus 102.
- Each button constituting this area 3003 is assigned a unique reproduction type. In this figure, an example is shown in which playback types of rewind, reverse playback, playback stop, forward playback, and fast forward are assigned in order from the left. When the user appropriately presses each button with the mouse 282, the moving image 3002 is switched to the reproduction type assigned to the button.
- a search key image designation area 3004 is an area for designating and displaying a search key image.
- the area 3004 includes a search key image 3005, a video designation button 3006, and a file designation button 3007.
- a search key image 3005 is an image used as a first search key image for a similar search. In the initial state, the search key image is not specified, so that no image is displayed. In the case of non-designation, an indication of non-designation may be provided, such as displaying an image indicating a non-designated state prepared separately.
- a video designation button 3006 is a button for designating an image displayed in the reproduction image display area 3001 as a search key image 3005 when pressed.
- the file designation button 3007 is a button for designating an image other than the image recorded in the recording apparatus 102, for example, an image taken with a digital still camera or an image taken with a scanner as the search key image 3005.
- a dialog box for designating those images is displayed, and the user can designate a desired image there.
- the search refinement parameter designation area 3008 is an area for designating the type and value (range) of the refinement parameter at the time of search.
- This area 3008 includes imaging device designation check boxes 3009, 3010, 3011 and 3012, time designation check boxes 3013 and 3014, and time designation columns 3015 and 3016.
- the imaging device designation check boxes 3009, 3010, 3011 and 3012 are checkboxes for designating the imaging device 201 to be searched when searching. Each of the check boxes 3009, 3010, 3011 and 3012 displays a check mark indicating that it has been selected when pressed. This mark disappears when pressed again, and is repeatedly displayed and hidden when pressed. In the initial state, since all the imaging devices 201 (cameras 1 to 4) are to be searched, the imaging device designation check boxes 3009, 3010, 3011 and 3012 are all selected.
- the time specification check boxes 3013 and 3014 are check boxes for specifying a time range to be searched at the time of search. As for the display mode, this check box is the same as the other check boxes.
- the start time is given to the time range. In the non-selected state, it means that the start time is not given to the time range, that is, the image with the oldest time recorded in the recording device 102 is set as the search target range.
- the end time is given to the time range. In the non-selected state, it means that the end time is not given to the time range, that is, the image of the latest time recorded in the recording device 102 is set as the search target range.
- the time designation columns 3015 and 3016 are input columns for designating the above-described start time and end time values.
- the time specification check boxes 3013 and 3014 are all in a non-selected state, and the time specification columns 3015 and 3016 are blank.
- the search execution area 3017 is an area for instructing search execution.
- This area 3017 includes a similar person search button 3018 and an appearance event search button 3019, a similar person search button 3300 from the search result, the same scene check box 3201, a mask check box 3202, a sunglasses check box 3203, and a different angle check box 3204.
- the similar person search button 3018 is a button for instructing execution of a similar person search using the search key image 3005 (search process 6001 using the first key image in FIG. 6).
- execution of similar person search is instructed according to the specified parameters.
- the appearance event search button 3019 is a button for instructing execution of an appearance event search.
- a parameter is designated in the search refinement parameter designation area 3008, execution of an appearance event search is instructed according to the designated parameter.
- the search result display area 3020 is an area for displaying search results. Search results are displayed by displaying a list of search result images. In the initial state, nothing is displayed in the search result display area 3020.
- the user depresses the video designation button 3006, depresses the imaging apparatus designation check boxes 3009, 3010, and 3012, depresses the time designation check boxes 3013 and 3014, and enters the time designation columns 3015 and 3016. It is assumed that “2009/6/26 15:30:20” and “2009/7/13 12:30:20” are input, respectively.
- the search key image 3005 the image of the person “Mr. A” displayed in the moving image 3002 is designated as the search key image. 1 ”,“ Camera 2 ”, and“ Camera 4 ”are designated, and“ 2009/6/26 15:30:20 to 2009/7/13 12:30:20 ”is the time range to be searched. It is specified.
- FIG. 7 shows an example of the search screen in this state.
- Search results are displayed by displaying a list of search result images (in this example, search result images 3031 to 3141).
- the search result images 3031 to 3141 are displayed in order of similarity to the search key image 3005, for example, from the top left to the right, and then from the second left to the right.
- the search result image 3031 has the highest similarity to the search key image 3005, and the search result image 3141 has the lowest similarity.
- the circles and alphabets shown on the search result images 3031 to 3141 in the search result display area 3020 are simple displays of a person's face and person name.
- the result image 3031 indicates that a person “Mr. A” appears.
- an actual image is displayed in this simplified display portion in the actual system display.
- a cue playback button 3032, a search key image designation button 3033, and a search target check box 3301 are provided in the vicinity of the search result image 3031. The same applies to the other search result images 3041 to 3141.
- the cue playback button 3032 is a button for instructing start of continuous video playback starting from the search result image 3031. For example, when the cue / play button 3032 is pressed, the moving image 3002 is switched to the search result image 3031 and the user can view a moving image starting from the search result image 3031.
- the search key image designation button 3033 is a button for designating the search result image 3031 as a new search key image. For example, when a search key image designation button 3033 is pressed, a search result image 3031 is displayed on the search key image 3005. As a result, the search can be performed again using the search result image 3031.
- the search target check box 3301 is a check box for designating the search result image 3031 as a new search key image (or candidate) when the similar person search button 3300 from the search result is pressed. For example, all the images of “Mr. A” appearing in the search results (in this example, search result images 3031 to 3061, 3081, 3091, 3121, 3141) are checked, and a similar person search button 3300 from the search results is clicked. By pressing, it is possible to search for “Mr. A” of various patterns.
- the similar person search button 3300 from the search result is a button for instructing execution of a similar person search again based on the result of the similar person search by the search key image 3005 (search process 6008 using a representative search key).
- the image selected by the user from the display of the search result display area 3020 (result of the search process 6001 by the first key image) (the search target check box is checked) is used as a new search key.
- Similar person search is re-executed as an image (or candidate).
- the same scene check box 3201 executes a process 6003 (see FIG. 6) for selecting the same person before and after the search result for the image selected by the user from the display of the search result display area 3020. This is a check box for designating that an image (images before and after the same person as the person in the target image) is added as a new search key image candidate.
- the mask check box 3202 executes image processing 6004 (see FIG. 6) for adding a mask to the image selected by the user from the display of the search result display area 3020, and the resulting image (target image).
- the sunglasses check box 3203 executes image processing 6005 (see FIG. 6) for adding sunglasses or glasses to the image selected by the user from the display of the search result display area 3020, and the image (target)
- a different angle check box 3204 executes image processing 6006 (see FIG.
- each of the items selected by the user from the display of the search result display area 3020 is displayed.
- the image processing corresponding to the checked check box is executed on the image, and the resulting image is added as a new search key image candidate, and then the new search key image candidate.
- a similar image search is executed using the image feature amount as a search key.
- the search key determination unit is realized by the function of the multiple search key selection unit 113 of the terminal device 103, and the search unit is realized by the function of the similar person search unit 218 of the recording device 102. You may implement
- FIG. 1 shows a security system including the explosive detection device of the present invention.
- the security system includes a detection device 300, a network 200, and a security center 400, and the individual detection devices 300 are connected by the network 200 to construct a security system.
- Information gathered in the security center 400 is collated with a database, and risk determination is performed. As a result of the risk determination, if it is determined that a certain level is exceeded, an alarm can be issued and an instruction can be sent to the guard to inspect the baggage of the subject person.
- the detection device 300 starts detection of dangerous goods and determines the presence or absence of dangerous goods (S301).
- the detection device 300 communicates with the security center 400 via the network 200 (S302).
- the security center 400 performs risk judgment using a database, risk judgment logic, or the like.
- the security center 400 determines that the risk is dangerous, the security center 400 issues a notification instruction to the detection device 300 via the network 200.
- the detection device 300 receives a notification instruction from the security center 400 ( In S303, an alarm is issued (S304).
- the detection device 300 is installed at each of a plurality of places, and the detection device 300 includes a detection unit and, if necessary, a personal identification unit.
- the detection device 300 is an explosive detection device
- a mass spectrometer 315 is used as a detection unit
- a monitoring camera 316 is used as a personal identification unit.
- the monitoring camera 316 may be replaced with the imaging device 201 described above.
- a portion surrounded by a line indicating the inspection range is set as an inspection region 311. It is inspected by the mass spectrometer 315 whether or not the person 312 to be inspected passing through the inspection region 311 has an explosive.
- the combination of the inspection area and the inspection object may be, for example, a load (inspection object) placed on a belt conveyor (inspection area).
- the air sucked from the suction unit 313 is sent to the mass spectrometer 315 via the sample suction pipe 314.
- the mass spectrometer 315 examines whether or not explosive components are contained in the atmosphere. Specifically, the presence or absence of a dangerous substance is determined by acquiring a mass spectrum and comparing it with a database provided in the mass spectrometer 315 based on the mass-to-charge ratio (m / z) and ion intensity of the detected ions. To do.
- the determination result and the video imaged by the monitoring camera 316 as necessary are sent to the security center 400 via the network 200 and subjected to risk determination processing.
- the detection device 300 issues an alarm.
- a device that emits sound or light may be incorporated into the mass spectrometer 315 and this device may be driven, or these devices may be provided in the security officer's waiting room for the security officer. You may be able to contact them directly. Further, the inspection area 311 may be closed with a shutter or the like, and various notification forms can be used. The captured video may be acquired not only from the monitoring camera 316 but also from the imaging device 201 connected separately via the network 200.
- the security center 400 determines the risk of the detected dangerous substance (S334), and if it is determined that the predetermined risk is exceeded (YES), an alarm is issued to the detection device 300. Is instructed to do so (S337).
- the past history is inquired (S335). Therefore, a risk determination is made again including the past history (S336), and if it is determined that the predetermined risk is exceeded, an alarm notification instruction is given to the detection device 300 (S337).
- Alarm information issued from the security center 400 to the detection device 300 is also transmitted directly to the recording device 102 via the network 200.
- a target person suspected of possessing a dangerous object is searched using the similar face image search technique described above for the camera video of the detection device 300 (video captured by the monitoring camera 316 or the imaging device 201). .
- a target person search method for suspected possession of dangerous goods performed in the image search system according to an embodiment of the present invention will be described with reference to FIG.
- FIG. 11 is a diagram illustrating a method for searching a subject for suspected possession of dangerous goods by a security system including a similar image search system and a detection device according to an embodiment of the present invention.
- the similar person search unit 218 in the recording device 102 extracts the alarm notification time information included in the alarm information ( S351). Based on this alarm notification time information, the similar person search unit 218 of the recording device 102 targets a camera image at a location where the detection device 300 is installed for a predetermined number of seconds before the alarm notification time (for example, 5 seconds). By performing a face image search on the images up to (previous), a target person suspected of possessing a dangerous material is extracted (S352).
- the point of the present invention is that the similar person search unit 218 of the recording device 102 suspects without identifying the owner of the dangerous goods after performing the face image search up to a predetermined number of seconds before the alarm issue time.
- a plurality of target persons are extracted and the search result is registered in the greylist as a target of suspected possession of dangerous goods (S353).
- a similar face image search is periodically performed on each of the persons who are suspected of possessing dangerous goods registered in the gray list (S354).
- the similar person retrieval unit 218 of the recording device 102 detects the subject person suspected of possessing the dangerous substance. 316 or the location information and time information of the installation location of the imaging device 201 are recorded in a recording unit (not shown), and the search result transmission unit 220 of the recording device 102 transmits the search result reception unit 222 of the terminal device 103.
- the search result display unit 223 of the terminal device 103 displays the position information, time information, and the like of the installation location of the monitoring camera 316 or the imaging device 201 that has detected the dangerous substance possession suspected person transmitted from the recording device 102 on the screen ( S355).
- the terminal device 103 displays on the map the trajectory traced by the target person suspected of possessing the dangerous material based on the position information, time information, etc. of the installation location of the monitoring camera 316 or the imaging device 201 described above (S356). In addition, you may enable it to be able to display simultaneously each locus
- the object of suspected possession of dangerous goods using a plurality of images taken at a different location and at a different time from the camera image that issued the alarm information
- the frequency is high.
- a person can be identified.
- the dangerous object possession target is displayed by displaying on the map the result of the similar face image search performed by setting the information before and after the time when the alarm information was issued and the information near the detection device 300 that issued the alarm information. It is also possible to visually grasp the trajectory followed by the candidate.
- the passed number information is transmitted to the similar person search unit 218 in the recording device 102 via the network 200, and the similar person search unit 218 that has received the number information receives the number information as a similar face image search and It can be used to create a greylist of people who are suspected of possessing dangerous goods based on search results.
- the person who is registered in the greylist checks for the presence of baggage, for example, without specifying one dangerous person in advance as the greylisted person who is suspected of possessing the dangerous goods in the greylisted search results.
- the recording device 102 receives the alarm information from the detection device 300 via the network 200, the extraction and tracking of the target person suspected of possessing the dangerous substance and the display of the moving direction of the subject person suspected of possessing the dangerous substance are automatically performed. It can be done in and helps the investigation.
- an image search system by application of similar image search technology that has been operating independently and a security system by an explosives detection device are connected via a network.
- the image retrieval system can be operated more quickly based on information such as the discovery of the subject of suspected possession of explosives by the explosive detection device, and the explosives possessor can be searched quickly and accurately from a large number of passengers. Is possible.
- the present invention can be applied to inspection of possession of dangerous goods in places where there are a large number of passengers such as stations in addition to inspection of possession of dangerous goods in places where there are relatively few people such as airports and important facilities.
- 102 Recording device, 103: Terminal device, 110: Keyword recording unit, 111: Keyword search unit, 112: Keyword assignment request transmission unit, 113: Multiple search key selection unit, 200: Network 201: Imaging device 210: Image transmission / reception unit 211: Image recording unit 212: Playback control unit 213: Person area detection unit 214: Person feature amount extraction unit 215: Person feature amount recording unit 216: Attribute information recording unit, 217: Request receiving unit, 218: Similar person searching unit, 219: Appearance event searching unit, 220: Search result transmitting unit, 221: Search request transmitting unit, 222: Search result receiving unit, 223: Search result display unit, 224: Reproduced image display unit, 225: Screen operation detection unit, 240: Bus, 241: Imaging unit, 242: Main storage unit, 243: Encoding unit, 244: Network I / F, 250: Bus 251: CPU, 252: Main storage unit, 253: Auxiliary storage unit, 254: Network I / F, 260:
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Life Sciences & Earth Sciences (AREA)
- High Energy & Nuclear Physics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Geophysics (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Television Signal Processing For Recording (AREA)
- Closed-Circuit Television Systems (AREA)
- Alarm Systems (AREA)
Abstract
Description
本発明の画像検索システムは、撮像した画像データを出力する少なくとも1台の撮像装置と、前記撮像装置より入力された画像データを記録媒体に記録する録画装置と、危険物の探知を行う探知装置と、各装置を相互に接続して通信を行うネットワークとを備えた画像検索システムにおいて、前記探知装置から送信された危険物探知によるアラーム情報を前記ネットワークを介して受信する受信手段と、前記受信手段で受信した前記アラーム情報に含まれるアラーム発報時刻情報に基づき、前記アラーム発報時刻並びに前記アラーム発報時刻前の所定の時間を検索条件として、前記探知装置の周辺に設置された前記撮像装置からの画像データを対象に顔画像検索を行い、危険物所持容疑の対象者を抽出する対象者抽出手段と、前記対象者抽出手段で抽出した危険物所持容疑の対象者をグレイリストに登録するグレイリスト登録手段と、前記グレイリスト登録手段で前記グレイリストに登録された危険物所持容疑の対象者それぞれに対して、前記録画装置に記録された画像データを対象に定期的に類似顔画像検索を実施する対象者検索手段と、を備えることを特徴とする。
類似画像検索システムは、図1に示すように、ネットワーク200に、撮像装置201、録画装置102、端末装置103が接続され、互いに通信可能な状態で構成される。また、撮像装置201は複数の場所にそれぞれ設置されているものとする。
録画装置102は、機能構成として、画像送受信部210、画像記録部211、再生制御部212、人物領域検出部213、人物特徴量抽出部214、人物特徴量記録部215、属性情報記録部216、要求受信部217、類似人物検索部218、登場イベント検索部219、検索結果送信部220、キーワード記録部110、キーワード検索部111の各処理部を有する。
画像記録部211は、入力画像データの記録媒体へ書込みや出力画像データの記録媒体からの読出しを行う。書込みの際には、画像データに加え、画像データを読出す際の情報となる画像ID(画像の識別情報)も併せて記録する。
再生制御部212は、端末装置103への映像再生を制御する。
人物特徴量抽出部214は、人物領域検出部213で検出した領域に対して画像認識技術を用いて特徴量算出を行う。ここで算出する人物特徴量とは、例えば、人物の輪郭の形状や方向、皮膚の色、歩容(どの脚をどのようにどんなタイミングで動かすかといった脚の捌き方)、或いは、人物を特定する代表的な部位である顔の輪郭の形状や方向、目や鼻、口といった主要構成要素の大きさ、形状、配置関係等が挙げられるが、本実施形態においては、使用する特徴量の種類や数はいずれであってもよい。
人物特徴量記録部215は、人物特徴量抽出部214で算出した特徴量の記録媒体への書込みと読出しを行う。尚、画像記録部211における画像データの記録媒体と本処理部における人物特徴量の記録媒体とは同一であっても別個であってもよい。
属性情報記録部216は、画像データに関連する属性情報の記録媒体への書込みと読出しを行う。属性情報とは、例えば、画像の撮影時刻や撮像装置番号、撮像場所等である。
類似人物検索部218は、要求受信部217にて受信した要求が類似人物検索要求であった場合に、類似画像検索を行う。
登場イベント検索部219は、要求受信部217にて受信した要求が登場イベント検索要求であった場合に、登場イベント検索を行う。
検索結果送信部220は、類似人物検索部218や登場イベント検索部219から得た類似人物検索結果や登場イベント検索結果の端末装置103への送信を行う。
キーワード記録部110は、要求受信部217にて受信したキーワード付与要求に基づくキーワードの記録媒体への書込みと読出しを行う。
キーワード検索部111は、要求受信部217にて受信した検索要求データ中にキーワードが含まれていた場合に、キーワード検索を行う。
端末装置103は、機能構成として、検索要求送信部221、検索結果受信部222、検索結果表示部223、再生画像表示部224、画面操作検知部225、キーワード付与要求送信部112、複数検索キー選択部113の各処理部を有する。また、本装置には、本発明の方式を実現するための人物検索機能も搭載してある。
検索結果受信部222は、検索結果の録画装置102からの受信を行う。検索結果として受信するデータには、録画装置102において、類似人物検索、或いは、登場イベント検索を実施して得られた画像の集合が含まれる。集合を構成する個々の画像は、録画装置102に記録された映像から画像サイズ縮小処理等を施して生成される。以下、この個々の画像を「検索結果画像」、検索結果として送受信するデータを「検索結果データ」という。
検索結果表示部223は、検索結果受信部222にて受信した検索結果の画面表示を行う。表示される画面例については後述する。
再生画像表示部224は、録画装置102から入力された画像データの画面への連続動画表示を行う。
画面操作検知部225は、ユーザによる操作内容の検知及び取得を行う。
キーワード付与要求送信部112は、キーワード付与要求の録画装置102への送信を行う。
複数検索キー選択部113は、検索キー画像の候補が複数選択されたときに、より少ない数の検索キー画像を適切に選択する処理を行う。複数検索キー選択部113は録画装置102内に設けても良い。
撮像装置201のハードウェア構成は、図2に示すように、撮像部241、主記憶部242、符号化部243、ネットワークインタフェース(I/F)244が、バス240で結合された形態である。
録画装置102のハードウェア構成は、図3に示すように、CPU(Central Processing Unit)251、主記憶部252、補助記憶部253、ネットワークI/F254が、バス250で結合された形態である。
端末装置103のハードウェア構成は、図4に示すように、CPU261、主記憶部262、補助記憶部263、表示I/F264、入出力I/F265、ネットワークI/F266が、バス260で結合された形態である。また、表示I/F264は、表示装置270と接続され、入出力I/F265は、キーボード280やマウス282などの入出力装置と接続される。
図6には、類似人物検索を実施する手順を例示してある。また、図5A~図5Eには、類似人物検索を実施する手順に沿って、検索キー画像の候補となった画像の特徴量を例示してある。
ここで、図5Eの例では、最初の検索キー画像に関連する画像(処理6001~6006により得られた画像)は29枚あるため、これらの画像の特徴量を新たな検索キーとした検索を29回繰り返す必要があるが、クラスタリング処理6007によって得られた各クラスタを代表する3つの画像の特徴量を用いて類似画像検索を行うことで、特徴量のバランスをとりつつ3回の検索で済む。ここでは、クラスタの数を3としたが、これは設定によって変えることができる。尚、本発明の一実施形態に係る類似画像検索システムは、クラスタリング処理6007を用いた一連のシステムについて説明したが、クラスタリング処理6007を行わず、最初の検索キー画像に関連する画像である29枚全てについて新たな検索キーとした検索を行ってもよい。
検索画面は、再生画像表示領域3001、画像再生操作領域3003、検索キー画像指定領域3004、検索絞込パラメータ指定領域3008、検索実行領域3017、検索結果表示領域3020を有する。
画像再生操作領域3003は、録画装置102に記録された画像を再生操作する領域である。本領域3003を構成する各ボタンには、それぞれ固有の再生種類が割当てられている。本図においては、巻戻し、逆再生、再生停止、順再生、早送りの再生種類が左から順に割当てられている例を示している。ユーザが各ボタンをマウス282で適宜押下することにより、動画3002がボタンに割当てられた再生種類に切り替わる。
検索キー画像3005は、類似検索のための最初の検索キー画像とする画像である。初期状態においては、検索キー画像は、未指定であるので、画像表示はされていない状態となる。なお、未指定の場合に、別途用意した未指定状態を示す画像を表示する等、未指定である旨の表記をするようにしてもよい。
ファイル指定ボタン3007は、録画装置102に記録されている画像以外の画像、例えば、デジタルスチルカメラで撮影した画像やスキャナで取込んだ画像等を、検索キー画像3005として指定するボタンである。このボタン3007を押下すると、それらの画像をファイル指定するダイアログボックスが表示され、ユーザはそこで所望の画像を指定することができる。
初期状態においては、全ての撮像装置201(カメラ1~4)を検索対象とするため、撮像装置指定チェックボックス3009,3010,3011,3012は全て選択状態となる。
同様に時刻指定チェックボックス3014を選択状態にした場合には時刻範囲に末尾時刻を与える。非選択状態にした場合には、時刻範囲に末尾時刻を与えない、すなわち、録画装置102に記録された最も新しい時刻の画像までを検索対象範囲とすることを意味する。
時刻指定欄3015,3016は、上述の先頭時刻と末尾時刻の値を指定する入力欄である。
初期状態においては、全時間帯を検索対象とするため、時刻指定チェックボックス3013,3014は全て非選択状態、時刻指定欄3015,3016は空欄とする。
登場イベント検索ボタン3019は、登場イベント検索の実行を指示するボタンである。検索絞込パラメータ指定領域3008にてパラメータが指定されている場合には、指定されたパラメータに従って登場イベント検索の実行を指示する。
これにより、図7に示すように、検索キー画像3005には、動画3002に表示された人物「Aさん」の画像が検索キー画像として指定され、また、検索対象としたい撮像装置201として「カメラ1」、「カメラ2」、「カメラ4」の3つが指定され、検索対象としたい時刻範囲として「2009/6/26 15:30:20から2009/7/13 12:30:20まで」が指定される。
検索結果画像3031~3141は、例えば、最上段左から右へ、次に2段目左から右へと検索キー画像3005に対する類似度順に表示する。この表示例においては、検索結果画像3031が検索キー画像3005に対し最も類似度が高く、検索結果画像3141が最も類似度が低いということを示している。
検索結果画像3031の周辺には、頭出し再生ボタン3032、検索キー画像指定ボタン3033、検索対象チェックボックス3301を備える。他の検索結果画像3041~3141も同様である。
検索キー画像指定ボタン3033は、検索結果画像3031を新たな検索キー画像に指定するボタンである。例えば、検索キー画像指定ボタン3033を押下すると、検索結果画像3031が検索キー画像3005に表示される。これにより、検索結果画像3031を使って再検索を実施することができる。
マスクチェックボックス3202は、検索結果表示領域3020の表示の中からユーザに選択された画像を対象にしてマスクを付加する画像処理6004(図6参照)を実行し、その結果の画像(対象の画像中の人物にマスクを付加した画像或いは当該人物からマスクを外した画像)を新たな検索キー画像の候補に追加することを指定するチェックボックスである。
サングラスチェックボックス3203は、検索結果表示領域3020の表示の中からユーザに選択された画像を対象にしてサングラスや眼鏡を付加する画像処理6005(図6参照)を実行し、その結果の画像(対象の画像中の人物にサングラス等を付加した画像或いは当該人物からサングラス等を外した画像)を新たな検索キー画像の候補に追加することを指定するチェックボックスである。
異なる角度チェックボックス3204は、検索結果表示領域3020の表示の中からユーザに選択された画像を対象にして人物の向きを変更する画像処理6006(図6参照)を実行し、その結果の画像(対象の画像中の人物の向きを変更した画像)を新たな検索キー画像の候補に追加することを指定するチェックボックスである。
まず、探知装置300とセキュリティセンタ400における危険物判定方法の全体像について図8を用いて説明する。探知装置300において危険物の探知を開始して危険物の有無を判定する(S301)。危険物を発見した場合には、探知装置300はネットワーク200を介してセキュリティセンタ400と交信を行う(S302)。セキュリティセンタ400ではデータベースやリスク判定ロジックなどを用いてリスク判定が行われる。セキュリティセンタ400は、リスク判定により危険と判定した場合には、ネットワーク200を介して探知装置300に発報の指示を出し、探知装置300は、セキュリティセンタ400から発報の指示があった場合(S303)には、アラームを発報させる(S304)。
検査範囲を示す線で囲まれた部分を検査領域311とする。この検査領域311を通過する検査対象である人312が爆発物を所持していないかどうかを質量分析計315で検査する。検査領域と検査対象の組み合わせは、例えばベルトコンベア(検査領域)に載せられた荷物(検査対象)であってもよい。吸気部313から吸引された大気は、試料吸入配管314を介して質量分析計315に送られる。質量分析計315では、大気中に爆薬成分が含まれていないかどうかを検査する。具体的には、質量スペクトルを取得し、検出されたイオンの質量電荷比(m/z)とイオン強度により、質量分析計315内に備えられたデータベースと照合することで危険物の有無を判定する。危険物有無判定処理は種々の方法(例えば、イオンモビリティ法、化学発光法、レーザー励起蛍光検出法など)が知られており、質量分析法に限らず、これらを利用してもよい。危険物有りと判定された場合には、その判定結果と必要に応じて監視カメラ316で撮影された映像とが、ネットワーク200を介してセキュリティセンタ400に送られ、リスク判定処理される。セキュリティセンタ400から、ネットワーク200を介して探知装置300に発報の指示が来た場合には、探知装置300はアラームを発報する。アラーム発報の方法としては、質量分析計315内に音や光を発するデバイスを組み込み、このデバイスを駆動しても良いし、警備担当者の控え室にこれらのデバイスを設けて警備担当者に対して直接連絡できるようにしても良い。また、検査領域311をシャッターなどで閉鎖しても良く、種々の発報形態を利用することができる。尚、撮影された映像は、監視カメラ316だけでなく、ネットワーク200を介して別に接続されている撮像装置201より取得してもよい。
ここで、本発明の一実施形態に係る画像検索システムで行われる危険物所持容疑の対象者検索方法について図11を用いて説明する。
図11は、本発明の一実施形態に係る類似画像検索システムと探知装置を含むセキュリティシステムによる危険物所持容疑の対象者検索方法を例示する図である。
まず、録画装置102は、探知装置300から発報されたアラーム情報をネットワーク200経由で受信すると、録画装置102内の類似人物検索部218がアラーム情報に含まれるアラーム発報時刻情報を抽出する(S351)。録画装置102の類似人物検索部218はこのアラーム発報時刻情報に基づいて、探知装置300が設置されている場所のカメラ映像を対象に、アラーム発報時刻より所定の秒数前(例えば5秒前)までの画像に対する顔画像検索を実施することにより、危険物所持容疑の対象者を抽出する(S352)。
ここで、本発明のポイントは、録画装置102の類似人物検索部218は、アラーム発報時刻より所定の秒数前までの顔画像検索を行った後、危険物所持者を特定せずに疑いのある対象者を複数抽出し、検索結果を危険物所持容疑の対象者としてグレイリストに登録しておくことである(S353)。また、グレイリストに登録された危険物所持容疑の対象者それぞれに対して、定期的に類似顔画像検索を実施する(S354)。
これにより、グレイリスト化された危険物所持容疑の対象者の中から、危険所持者である可能性の最も高い人物を特定することができる。尚、アラーム情報を発報した時刻前後情報と、アラーム情報を発報した探知装置300近辺情報とを設定して行った類似顔画像検索の結果を地図上に表示することにより、危険物所持対象者候補の辿った軌跡を視覚的に把握することもできる。
また、予め危険物所持者を1人に特定せず、グレイリスト化した検索結果の危険物所持容疑の対象者をグレイリストとし、グレイリストに登録された人物は、例えば手荷物有無のチェックを行う等してセキュリティチェックを厳しくするよう指示することもできる。
これにより、ネットワーク200経由で録画装置102が探知装置300からのアラーム情報を受信することにより、危険物所持容疑の対象者の抽出・追跡、危険物所持容疑の対象者の移動方向の表示を自動で行うことができ、捜査の手助けとなる。
200:ネットワーク、 201:撮像装置、 210:画像送受信部、 211:画像記録部、 212:再生制御部、 213:人物領域検出部、 214:人物特徴量抽出部、 215:人物特徴量記録部、 216:属性情報記録部、 217:要求受信部、 218:類似人物検索部、 219:登場イベント検索部、 220:検索結果送信部、 221:検索要求送信部、 222:検索結果受信部、 223:検索結果表示部、 224:再生画像表示部、 225:画面操作検知部、 240:バス、 241:撮像部、 242:主記憶部、 243:符号化部、 244:ネットワークI/F、 250:バス、 251:CPU、 252:主記憶部、 253:補助記憶部、 254:ネットワークI/F、 260:バス、 261:CPU、 262:主記憶部、 263:補助記憶部、 264:表示I/F、 266:ネットワークI/F、 270:表示装置、 280:キーボード、 282:マウス、 300:探知装置、 311:検査領域、 312:人、 313:吸気部、 314:試料吸入配管、 315:質量分析計、 316:監視カメラ、 400:セキュリティセンタ、 3001:再生画像表示領域、 3002:動画、 3003:画像再生操作領域、 3004:検索キー画像指定領域、 3005:検索キー画像、 3006:映像指定ボタン、 3007:ファイル指定ボタン、 3008:検索絞込パラメータ指定領域、 3009~3012:撮像装置指定チェックボックス、 3013,3014:時刻指定チェックボックス、 3015,3016:時刻指定欄、 3017:検索実行領域、 3018:類似人物検索ボタン、 3019:登場イベント検索ボタン、 3020:検索結果表示領域、 3031,3041,3051,3061,3071,3081,3091,3101,3111,3121,3131,3141:検索結果画像、 3032:頭出し再生ボタン、 3033:検索キー画像指定ボタン、 3201:同一シーンチェックボックス、 3202:マスクチェックボックス、 3203:サングラスチェックボックス、
3204:異なる角度チェックボックス、 3300:検索結果からの類似人物検索ボタン、 3301:検索対象チェックボックス。
Claims (13)
- 撮像した画像データを出力する少なくとも1台の撮像装置と、前記撮像装置より入力された画像データを記録媒体に記録する録画装置と、危険物の探知を行う探知装置と、各装置を相互に接続して通信を行うネットワークとを備えた画像検索システムにおいて、
前記探知装置から送信された危険物探知によるアラーム情報を前記ネットワークを介して受信する受信手段と、
前記受信手段で受信した前記アラーム情報に含まれるアラーム発報時刻情報に基づき、前記アラーム発報時刻並びに前記アラーム発報時刻前の所定の時間を検索条件として、前記探知装置の周辺に設置された前記撮像装置からの画像データを対象に顔画像検索を行い、危険物所持容疑の対象者を抽出する対象者抽出手段と、
前記対象者抽出手段で抽出した危険物所持容疑の対象者をグレイリストに登録するグレイリスト登録手段と、
前記グレイリスト登録手段で前記グレイリストに登録された危険物所持容疑の対象者それぞれに対して、前記録画装置に記録された画像データを対象に定期的に類似顔画像検索を実施する対象者検索手段と、
を備えることを特徴とする画像検索システム。 - 請求項1記載の画像検索システムにおいて、
前記対象者検索手段によって前記グレイリストに登録された前記危険物所持容疑の対象者が検索された場合、前記危険物所持容疑の対象者を撮影した前記撮像装置の設置場所の位置情報や前記アラーム発報時刻を画面に表示する対象者情報表示手段と、
前記対象者情報表示手段で表示された前記危険物所持容疑の対象者を撮影した前記撮像装置の前記位置情報に基づいて前記危険物所持容疑の対象者が辿った軌跡を地図上に表示する軌跡表示手段と、
を備えることを特徴とする画像検索システム。 - 請求項2記載の画像検索システムにおいて、
前記グレイリストに登録された複数の前記危険物所持容疑の対象者をそれぞれ検索し、複数それぞれの軌跡を同時に表示する複数軌跡表示手段を備えることを特徴とする画像検索システム。 - 請求項3記載の画像検索システムにおいて、
アラーム発報時刻前後情報と、アラーム発報探知装置近辺情報とを設定し、前記設定した情報に該当する映像全てについて類似顔画像検索を行うことにより、前記検索結果を前記危険物所持容疑の対象者として前記グレイリストに登録し、前記グレイリストに登録した前記危険物所持容疑の対象者について、アラーム情報を発報した場所に設定されたカメラ映像とは別の場所及び別の時刻に撮影された複数の映像を用いて危険物所持者を特定する危険物所持者特定手段を備えることを特徴とする画像検索システム。 - 請求項4記載の画像検索システムにおいて、
アラーム発報時刻前後情報と、アラーム発報探知装置近辺情報とを設定して行った類似顔画像検索の結果を地図上に表示する検索結果地図表示手段を備えることを特徴とする画像検索システム。 - 請求項5記載の画像検索システムにおいて、
前記探知装置にゲートを設け、前記ゲートの出入口に人感センサを設置して所定時間内に何人が通過したかを検知し、前記通過した人数情報を前記ネットワークを経由して前記録画装置内の前記録画装置に送信し、前記危険物所持容疑の対象者のグレイリスト化に利用する通過人数計数手段を備えることを特徴とする画像検索システム。 - 撮像した画像データを出力する少なくとも1台の撮像装置と、前記撮像装置より入力された画像データを記録媒体に記録する録画装置と、危険物の探知を行う探知装置と、各装置を相互に接続して通信を行うネットワークとを備えた画像検索システムの画像検索方法であって、
前記探知装置から送信された危険物探知によるアラーム情報を前記ネットワークを介して受信する受信ステップと、
前記受信ステップで受信した前記アラーム情報に含まれるアラーム発報時刻情報に基づき、前記アラーム発報時刻並びに前記アラーム発報時刻前の所定の時間を検索条件として、前記探知装置の周辺に設置された前記撮像装置からの画像データを対象に顔画像検索を行い、危険物所持容疑の対象者を抽出する対象者抽出ステップと、
前記対象者抽出ステップで抽出した危険物所持容疑の対象者をグレイリストに登録するグレイリスト登録ステップと、
前記グレイリスト登録ステップで前記グレイリストに登録された危険物所持容疑の対象者それぞれに対して、前記録画装置に記録された画像データを対象に定期的に類似顔画像検索を実施する対象者検索ステップと、
を有することを特徴とする画像検索方法。 - 請求項7記載の画像検索方法において、
前記対象者検索ステップによって前記グレイリストに登録された前記危険物所持容疑の対象者が検索された場合、前記危険物所持容疑の対象者を撮影した前記撮像装置の設置場所の位置情報や前記アラーム発報時刻を画面に表示する対象者情報表示ステップと、
前記対象者情報表示ステップで表示された前記危険物所持容疑の対象者を撮影した前記撮像装置の前記位置情報に基づいて前記危険物所持容疑の対象者が辿った軌跡を地図上に表示する軌跡表示ステップと、
を有することを特徴とする画像検索方法。 - 請求項8記載の画像検索方法において、
前記グレイリストに登録された複数の前記危険物所持容疑の対象者をそれぞれ検索し、複数それぞれの軌跡を同時に表示する複数軌跡表示ステップを有することを特徴とする画像検索方法。 - 請求項9記載の画像検索方法において、
アラーム発報時刻前後情報と、アラーム発報探知装置近辺情報とを設定し、前記設定した情報に該当する映像全てについて類似顔画像検索を行うことにより、前記検索結果を前記危険物所持容疑の対象者として前記グレイリストに登録し、前記グレイリストに登録した前記危険物所持容疑の対象者について、アラーム情報を発報した場所に設定されたカメラ映像とは別の場所及び別の時刻に撮影された複数の映像を用いて危険物所持者を特定する危険物所持者特定ステップを有することを特徴とする画像検方法。 - 請求項10記載の画像検索方法において、
アラーム発報時刻前後情報と、アラーム発報探知装置近辺情報とを設定して行った類似顔画像検索の結果を地図上に表示する検索結果地図表示ステップを有することを特徴とする画像検索方法。 - 請求項11記載の画像検索方法において、
前記探知装置にゲートを設け、前記ゲートの出入口に人感センサを設置して所定時間内に何人が通過したかを検知し、前記通過した人数情報を前記ネットワークを経由して前記録画装置内の前記録画装置に送信し、前記危険物所持容疑の対象者のグレイリスト化に利用する通過人数計数ステップを有することを特徴とする画像検索方法。 - ネットワークを介して撮像した画像データを出力する少なくとも1台の撮像装置と危険物の探知を行う探知装置とに接続され、前記撮像装置より入力された画像データを記録媒体に記録する録画装置であって、
前記探知装置から送信された危険物探知によるアラーム情報を前記ネットワークを介して受信する受信手段と、
前記受信手段で受信した前記アラーム情報に含まれるアラーム発報時刻情報に基づき、前記アラーム発報時刻並びに前記アラーム発報時刻前の所定の時間を検索条件として、前記探知装置の周辺に設置された前記撮像装置からの画像データを対象に顔画像検索を行い、危険物所持容疑の対象者を抽出する対象者抽出手段と、
前記対象者抽出手段で抽出した危険物所持容疑の対象者をグレイリストに登録するグレイリスト登録手段と、
前記グレイリスト登録手段で前記グレイリストに登録された危険物所持容疑の対象者それぞれに対して、前記録画装置に記録された画像データを対象に定期的に類似顔画像検索を実施する対象者検索手段と、
を備えることを特徴とする録画装置。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015558749A JP6210650B2 (ja) | 2014-01-23 | 2014-12-08 | 画像検索システム及び画像検索方法 |
US15/112,879 US20160350583A1 (en) | 2014-01-23 | 2014-12-08 | Image search system and image search method |
EP14880351.3A EP3099061A4 (en) | 2014-01-23 | 2014-12-08 | Image search system and image search method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014-010243 | 2014-01-23 | ||
JP2014010243 | 2014-01-23 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015111312A1 true WO2015111312A1 (ja) | 2015-07-30 |
Family
ID=53681132
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/082425 WO2015111312A1 (ja) | 2014-01-23 | 2014-12-08 | 画像検索システム及び画像検索方法 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20160350583A1 (ja) |
EP (1) | EP3099061A4 (ja) |
JP (1) | JP6210650B2 (ja) |
WO (1) | WO2015111312A1 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2018061215A (ja) * | 2016-10-07 | 2018-04-12 | パナソニックIpマネジメント株式会社 | 監視システム及び監視方法 |
JPWO2021079501A1 (ja) * | 2019-10-25 | 2021-04-29 | ||
JP2022518459A (ja) * | 2019-06-28 | 2022-03-15 | 深▲セン▼市商▲湯▼科技有限公司 | 情報処理方法および装置、記憶媒体 |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017006749A1 (ja) * | 2015-07-03 | 2017-01-12 | 株式会社日立国際電気 | 画像処理装置および画像処理システム |
JP6172551B1 (ja) * | 2016-06-09 | 2017-08-02 | パナソニックIpマネジメント株式会社 | 画像検索装置、画像検索システム及び画像検索方法 |
JP6573346B1 (ja) * | 2018-09-20 | 2019-09-11 | パナソニック株式会社 | 人物検索システムおよび人物検索方法 |
US11879897B2 (en) * | 2019-05-30 | 2024-01-23 | Thermo Finnigan Llc | Operating a mass spectrometer utilizing mass spectral database search |
CN110276315A (zh) * | 2019-06-26 | 2019-09-24 | 重庆紫光华山智安科技有限公司 | 机场监控方法、装置及*** |
CN110516097A (zh) * | 2019-08-21 | 2019-11-29 | 深圳云天励飞技术有限公司 | 一种图像数据关联分析方法、装置及存储介质 |
US11625429B2 (en) * | 2020-01-31 | 2023-04-11 | Walmart Apollo, Llc | Image searching using a full-text search engine |
CN112775983A (zh) * | 2020-12-25 | 2021-05-11 | 张月崧 | 智能防卫保护方法及智能保镖机器人 |
CN113671589A (zh) * | 2021-09-14 | 2021-11-19 | 清华大学 | 一种安全检测赛博物理*** |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000028579A (ja) | 1998-07-08 | 2000-01-28 | Hitachi Ltd | 試料ガス採取装置及び危険物探知装置 |
JP2003014695A (ja) | 2001-07-05 | 2003-01-15 | Hitachi Ltd | セキュリティシステム及びセキュリティサービス事業方法 |
JP2006221378A (ja) * | 2005-02-09 | 2006-08-24 | Smart Wireless Kk | 顔認証を利用した警報システムおよび方法 |
JP2009027393A (ja) | 2007-07-19 | 2009-02-05 | Hitachi Ltd | 映像検索システムおよび人物検索方法 |
JP4700477B2 (ja) | 2005-11-15 | 2011-06-15 | 株式会社日立製作所 | 移動体監視システムおよび移動体特徴量算出装置 |
JP2011233133A (ja) * | 2010-04-09 | 2011-11-17 | Miyake Inc | 万引き防止システム |
JP2012068717A (ja) | 2010-09-21 | 2012-04-05 | Hitachi Kokusai Electric Inc | 画像セキュリティシステム |
JP2012098830A (ja) * | 2010-10-29 | 2012-05-24 | Nec Software Kyushu Ltd | 監視装置、監視方法、及びプログラム |
JP2012108777A (ja) * | 2010-11-18 | 2012-06-07 | Nec Software Kyushu Ltd | 監視システム、監視装置、監視方法、及びプログラム |
JP2013171476A (ja) * | 2012-02-22 | 2013-09-02 | Nec Corp | 携帯型顔認識防犯用背後カメラシステム及びそれに用いる防犯判断方法 |
JP2013192154A (ja) * | 2012-03-15 | 2013-09-26 | Omron Corp | 監視装置、信頼度算出プログラム、および信頼度算出方法 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7634662B2 (en) * | 2002-11-21 | 2009-12-15 | Monroe David A | Method for incorporating facial recognition technology in a multimedia surveillance system |
US6975346B2 (en) * | 2002-06-27 | 2005-12-13 | International Business Machines Corporation | Method for suspect identification using scanning of surveillance media |
US7881505B2 (en) * | 2006-09-29 | 2011-02-01 | Pittsburgh Pattern Recognition, Inc. | Video retrieval system for human face content |
JP5198151B2 (ja) * | 2008-05-30 | 2013-05-15 | 株式会社日立製作所 | 映像検索装置及び映像検索方法 |
EP2204783A1 (en) * | 2008-12-31 | 2010-07-07 | Thales | Security system comprising sensors in a corridor for uncovering hazardous items |
JP5730518B2 (ja) * | 2010-08-27 | 2015-06-10 | 株式会社日立国際電気 | 特定人物検知システムおよび特定人物検知方法 |
US20120113254A1 (en) * | 2010-11-05 | 2012-05-10 | Arnaldo Zael Cruz | Miniature billboard advertisements having security features |
US9025024B2 (en) * | 2011-09-28 | 2015-05-05 | Xerox Corporation | System and method for object identification and tracking |
-
2014
- 2014-12-08 JP JP2015558749A patent/JP6210650B2/ja active Active
- 2014-12-08 US US15/112,879 patent/US20160350583A1/en not_active Abandoned
- 2014-12-08 EP EP14880351.3A patent/EP3099061A4/en not_active Withdrawn
- 2014-12-08 WO PCT/JP2014/082425 patent/WO2015111312A1/ja active Application Filing
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000028579A (ja) | 1998-07-08 | 2000-01-28 | Hitachi Ltd | 試料ガス採取装置及び危険物探知装置 |
JP2003014695A (ja) | 2001-07-05 | 2003-01-15 | Hitachi Ltd | セキュリティシステム及びセキュリティサービス事業方法 |
JP2006221378A (ja) * | 2005-02-09 | 2006-08-24 | Smart Wireless Kk | 顔認証を利用した警報システムおよび方法 |
JP4700477B2 (ja) | 2005-11-15 | 2011-06-15 | 株式会社日立製作所 | 移動体監視システムおよび移動体特徴量算出装置 |
JP2009027393A (ja) | 2007-07-19 | 2009-02-05 | Hitachi Ltd | 映像検索システムおよび人物検索方法 |
JP2011233133A (ja) * | 2010-04-09 | 2011-11-17 | Miyake Inc | 万引き防止システム |
JP2012068717A (ja) | 2010-09-21 | 2012-04-05 | Hitachi Kokusai Electric Inc | 画像セキュリティシステム |
JP2012098830A (ja) * | 2010-10-29 | 2012-05-24 | Nec Software Kyushu Ltd | 監視装置、監視方法、及びプログラム |
JP2012108777A (ja) * | 2010-11-18 | 2012-06-07 | Nec Software Kyushu Ltd | 監視システム、監視装置、監視方法、及びプログラム |
JP2013171476A (ja) * | 2012-02-22 | 2013-09-02 | Nec Corp | 携帯型顔認識防犯用背後カメラシステム及びそれに用いる防犯判断方法 |
JP2013192154A (ja) * | 2012-03-15 | 2013-09-26 | Omron Corp | 監視装置、信頼度算出プログラム、および信頼度算出方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP3099061A4 |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2018061215A (ja) * | 2016-10-07 | 2018-04-12 | パナソニックIpマネジメント株式会社 | 監視システム及び監視方法 |
JP2022518459A (ja) * | 2019-06-28 | 2022-03-15 | 深▲セン▼市商▲湯▼科技有限公司 | 情報処理方法および装置、記憶媒体 |
JPWO2021079501A1 (ja) * | 2019-10-25 | 2021-04-29 | ||
WO2021079501A1 (ja) * | 2019-10-25 | 2021-04-29 | 日本電気株式会社 | 処理装置、処理方法及びプログラム |
JP7380698B2 (ja) | 2019-10-25 | 2023-11-15 | 日本電気株式会社 | 処理装置、処理方法及びプログラム |
Also Published As
Publication number | Publication date |
---|---|
US20160350583A1 (en) | 2016-12-01 |
JP6210650B2 (ja) | 2017-10-11 |
EP3099061A4 (en) | 2017-08-23 |
JPWO2015111312A1 (ja) | 2017-03-23 |
EP3099061A1 (en) | 2016-11-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6210650B2 (ja) | 画像検索システム及び画像検索方法 | |
US11030463B2 (en) | Systems and methods for displaying captured videos of persons similar to a search target person | |
US9141184B2 (en) | Person detection system | |
JP5976237B2 (ja) | 映像検索システム及び映像検索方法 | |
US7683929B2 (en) | System and method for video content analysis-based detection, surveillance and alarm management | |
JP6148480B2 (ja) | 画像処理装置、画像処理方法 | |
US11062160B2 (en) | Person monitoring system and person monitoring method | |
EP3861719A1 (en) | Video surveillance and object recognition | |
US20040240542A1 (en) | Method and apparatus for video frame sequence-based object tracking | |
KR101734029B1 (ko) | 이동형 촬영영상의 유사도 분석을 이용한 지능형 이동 감시시스템 및 그 감시방법 | |
EP2923487A1 (en) | Method and system for metadata extraction from master-slave cameras tracking system | |
WO2013069605A1 (ja) | 類似画像検索システム | |
KR102149832B1 (ko) | 딥러닝 기반의 자동 폭력 감지 시스템 | |
JP2022168070A (ja) | 人物検出システム | |
JP2009027393A (ja) | 映像検索システムおよび人物検索方法 | |
WO2020103293A1 (zh) | 一种人员检索信息的呈现方法、装置和电子设备 | |
JP2018061213A (ja) | 監視映像解析システム及び監視映像解析方法 | |
JP7380698B2 (ja) | 処理装置、処理方法及びプログラム | |
US10783365B2 (en) | Image processing device and image processing system | |
JP6702402B2 (ja) | 画像処理システム、画像処理方法および画像処理プログラム | |
WO2015128939A1 (ja) | 安全性判定システム、安全性判定装置、及び安全性判定方法 | |
JP2005284652A (ja) | 動きベクトルを用いた映像監視方法及び装置 | |
JP2018195992A (ja) | 人物グループ追跡装置および人物グループ追跡方法 | |
Rizk et al. | Human Detection in Thermal Images Using YOLOv8 for Search and Rescue Missions | |
JP7480841B2 (ja) | イベントの管理方法、イベント管理装置、システム及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14880351 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2015558749 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15112879 Country of ref document: US |
|
REEP | Request for entry into the european phase |
Ref document number: 2014880351 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2014880351 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |