WO2021176945A1 - Authentication device - Google Patents
Authentication device Download PDFInfo
- Publication number
- WO2021176945A1 WO2021176945A1 PCT/JP2021/004123 JP2021004123W WO2021176945A1 WO 2021176945 A1 WO2021176945 A1 WO 2021176945A1 JP 2021004123 W JP2021004123 W JP 2021004123W WO 2021176945 A1 WO2021176945 A1 WO 2021176945A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- authentication
- feature amount
- person
- unit
- information
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Definitions
- the present invention relates to an authentication device, an authentication method, and a recording medium.
- a technique called clothing authentication which is an authentication process based on the feature amount of clothing in image data, is known.
- Patent Document 1 is a document that describes the authentication process based on the feature amount of clothes.
- the size of the clothing area is calculated based on the position information of the face area, and the direction in which the clothing area is arranged is determined based on the inclination information of the face.
- clothing feature information is generated in an area based on the clothing area, and collation processing is performed.
- Patent Document 1 describes that the collation is performed based on the characteristic information of the clothing region estimated based on the face region.
- an object of the present invention is to provide an authentication method, an authentication device, and a program that solve the problem that it is difficult to improve the accuracy of clothing authentication.
- An authentication device which is a form of the present disclosure, in order to achieve such an object From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and Based on the acquired feature amount, an authentication unit that performs clothing authentication to determine whether or not the person in the image data is the pre-registered clothing, and an authentication unit. It has a structure of having.
- the authentication method which is another form of the present disclosure, Information processing device From the image data, the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition is acquired. Based on the feature amount acquired by the acquisition unit, clothing authentication is performed to determine whether or not the person in the image data is the clothing registered in advance.
- the recording medium which is another form of the present disclosure is For information processing equipment From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and Based on the feature amount acquired by the acquisition unit, an authentication unit that performs clothing authentication for determining whether or not a person in the image data is a pre-registered clothing, and an authentication unit. It is a program to realize.
- FIG. 1st Embodiment of this disclosure It is a figure which shows the configuration example of the authentication system in 1st Embodiment of this disclosure. It is a block diagram which shows the configuration example of the authentication apparatus shown in FIG. It is a figure which shows an example of the color information for each part for authentication shown in FIG. It is a figure which shows an example of the skeleton coordinate information shown in FIG. It is a figure which shows an example of the color information for each part shown in FIG. It is a figure for demonstrating the processing example of the skeleton recognition part and the part-specific color information acquisition part. It is a figure for demonstrating the processing example of the clothes authentication part. It is a flowchart which shows the operation example of the authentication apparatus in 1st Embodiment of this disclosure.
- FIG. 1 It is a block diagram which shows the other configuration example of an authentication apparatus. It is a figure which shows an example of the hardware block diagram of the authentication apparatus in the 2nd Embodiment of this disclosure. It is a block diagram which shows the structural example of the authentication apparatus shown in FIG.
- FIG. 1 is a diagram showing a configuration example of the authentication system 100.
- FIG. 2 is a block diagram showing a configuration example of the authentication device 300.
- FIG. 3 is a diagram showing an example of color information 333 for each part for authentication.
- FIG. 4 is a diagram showing an example of skeleton coordinate information 335.
- FIG. 5 is a diagram showing an example of color information 336 for each part.
- FIG. 6 is a diagram for explaining a processing example of the skeleton recognition unit 343 and the color information acquisition unit 344 for each part.
- FIG. 7 is a diagram for explaining a processing example of the clothing authentication unit 345.
- FIG. 8 is a flowchart showing an operation example of the authentication device 300.
- FIG. 9 is a block diagram showing another configuration example of the authentication device 300.
- an authentication system 100 that performs clothing authentication for determining whether or not a person in image data is a pre-registered clothing will be described.
- the authentication system 100 acquires color information of a plurality of parts of a person specified based on the result of skeleton recognition for image data such as shoulders, elbows, and knees. Then, the authentication system 100 performs clothing authentication by comparing the acquired color information of a plurality of parts with the information stored in advance.
- FIG. 1 shows a configuration example of the authentication system 100.
- the authentication system 100 includes, for example, a camera 200 and an authentication device 300. As shown in FIG. 1, the camera 200 and the authentication device 300 are connected so as to be able to communicate with each other via, for example, a network.
- the camera 200 is a photographing device that acquires image data.
- the camera 200 is installed at a predetermined position, and acquires image data in which at least a person's face and upper body are reflected. Further, the camera 200 can transmit the acquired image data to the authentication device 300 in association with the acquisition date and time of the image data.
- the authentication device 300 is an information processing device that authenticates the clothes worn by a person (clothes authentication).
- the authentication device 300 can also perform face authentication in addition to clothing authentication.
- FIG. 2 shows a configuration example of the authentication device 300. Referring to FIG. 2, the authentication device 300 has a screen display unit 310, a communication I / F unit 320, a storage unit 330, and an arithmetic processing unit 340 as main components.
- the screen display unit 310 includes a screen display device such as an LCD (Liquid Crystal Display).
- the screen display unit 310 displays various information stored in the storage unit 330 such as image information 334, skeleton coordinate information 335, color information 336 for each part, and authentication result information 337 on the screen in response to an instruction from the arithmetic processing unit 340. Can be done.
- the communication I / F unit 320 includes a data communication circuit.
- the communication I / F unit 320 performs data communication with a camera 200, an external device, or the like connected via a communication line.
- the storage unit 330 is a storage device such as a hard disk or a memory.
- the storage unit 330 stores processing information and a program 338 required for various processes in the arithmetic processing unit 340.
- the program 338 realizes various processing units by being read and executed by the arithmetic processing unit 340.
- the program 338 is read in advance from an external device or a recording medium via a data input / output function such as the communication I / F unit 320, and is stored in the storage unit 330.
- the main information stored in the storage unit 330 includes, for example, facial feature amount information 331, learned model 332, authentication site-specific color information 333, image information 334, skeleton coordinate information 335, site-specific color information 336, and authentication. There is result information 337 and the like.
- the face feature amount information 331 includes information indicating the face feature amount used when the face recognition unit 342 performs face recognition.
- the face feature amount information 331 for example, identification information for identifying a person and information indicating the face feature amount are associated with each other.
- the face feature amount information 331 is acquired in advance from an external device or the like via, for example, the communication I / F unit 320 or the like, and is stored in the storage unit 330.
- the trained model 332 is a trained model used when the skeleton recognition unit 343 performs skeleton recognition.
- the trained model 332 is generated in advance by performing machine learning using teacher data such as image data containing skeleton coordinates in an external device or the like, and is externally generated via a communication I / F unit 320 or the like. It is acquired from a device or the like and stored in the storage unit 330.
- the trained model 332 may be updated by a re-learning process using additional teacher data.
- the authentication part-specific color information 333 includes information indicating an object to be compared with the color information acquired from the image data when performing clothing authentication.
- the color information 333 for each part for authentication is defined in advance.
- the color information 333 for each authentication part is acquired in advance from an external device or the like via, for example, the communication I / F unit 320 or the like, and is stored in the storage unit 330.
- FIG. 3 shows an example of color information 333 for each part for authentication.
- the identification information for identifying a person and the authentication color information which is a registered feature amount are associated with each other.
- the identification information included in the color information 333 for each part for authentication is the same as the identification information included in the face feature amount information 331.
- the color information for authentication includes color information for each part.
- the first line of FIG. 3 includes color information (RGB (red, green, blue) information) of the right shoulder, left elbow, ....
- the authentication color information in the authentication part-specific color information 333 may include color information of all parts that can be recognized by the skeleton recognition unit 343, which will be described later, or color information of some parts. Only may be included.
- the authentication color information preferably includes color information of a plurality of parts, but may include only color information of one part such as only the right elbow.
- the color information for authentication includes color information of a characteristic part of a person's clothing, and color information of a part that must be worn such as long sleeves and a tie and must be compared by the clothing authentication unit 345 (for example, long sleeves).
- the color information of the upper part of the spine etc.
- the color may be defined by other than RGB.
- the image information 334 includes image data acquired by the camera 200.
- the image data and the information indicating the date and time when the camera 200 acquired the image data are associated with each other.
- the skeleton coordinate information 335 includes information indicating the coordinates of each part of the person recognized by the skeleton recognition unit 343.
- FIG. 4 shows an example of the skeleton coordinate information 335.
- the identification information and the part coordinates are associated with each other.
- the identification information is the same as the identification information included in the face feature amount information 331 and the authentication site-specific color information 333.
- the part coordinates include information indicating the coordinates of each part in the image data.
- the part included in the part coordinates corresponds to the trained model 332.
- the upper part of the spine, the right shoulder, the left shoulder, ..., are illustrated.
- the site coordinates can include, for example, about 30 sites (other than those illustrated).
- the part included in the part coordinates may be other than those illustrated in FIG. 4 and the like.
- the color information 336 for each part is the color information of each part acquired from the image data by the color information acquisition unit 344 for each part based on the image data included in the image information 334 and the part coordinates included in the skeleton coordinate information 335. Contains information that indicates.
- FIG. 5 shows an example of the color information 336 for each part. Referring to FIG. 5, in the part-specific color information 336, the identification information and the part color information are associated with each other. The identification information is the same as the identification information included in the face feature amount information 331, the color information 333 for each authentication part, and the skeleton coordinate information 335. Further, the part color information includes the color information of each part in the image data. For example, the first line of FIG. 5 includes color information (RGB (red, green, blue) information) of the upper part of the spine, the right shoulder, ....
- RGB red, green, blue
- the part color information in the part-specific color information 336 may include the color information of all the parts included in the skeleton coordinate information 335, or includes only the color information of some parts. It doesn't matter.
- the part color information may include the color information of the part included in the authentication color information corresponding to the identification information.
- the color in the part color information in the part-specific color information 336, the color may be defined by other than RGB as in the case of the authentication color information. However, it is desirable that the color of the part color information and the color information for authentication are defined by using the same method.
- the authentication result information 337 includes information indicating the result of the authentication process by the clothing authentication unit 345.
- the identification information and the information indicating whether or not to allow admission are associated with each other. The details of the authentication process by the clothing authentication unit 345 will be described later.
- the arithmetic processing unit 340 has a microprocessor such as an MPU and its peripheral circuits.
- the arithmetic processing unit 340 reads the program 338 from the storage unit 330 and executes it, thereby realizing various processing units in cooperation with the hardware and the program 338.
- the main processing units realized by the arithmetic processing unit 340 include, for example, an image acquisition unit 341, a face authentication unit 342, a skeleton recognition unit 343, a part-specific color information acquisition unit 344, a clothing authentication unit 345, and an admission permission unit 346. There is.
- the image acquisition unit 341 acquires the image data acquired by the camera 200 from the camera 200 via the communication I / F unit 320. Then, the image acquisition unit 341 stores the acquired image data in the storage unit 330 as image information 334 in association with, for example, the acquisition date and time of the image data.
- the face authentication unit 342 performs face authentication based on the image data included in the image information 334. For example, the face authentication unit 342 extracts a person to be authenticated from the image data. In addition, the face recognition unit 342 extracts feature points such as eyes, nose, and mouth of the extracted person, and calculates a feature amount based on the extracted result. Then, the face recognition unit 342 calculates the feature amount by examining whether or not the similarity between the calculated feature amount and the face feature amount included in the face feature amount information 331 exceeds the face comparison threshold. Is collated with the feature amount stored in the storage unit 330, and authentication is performed based on the collation result. For example, the face recognition unit 342 identifies the identification information of the person to be authenticated by performing face recognition.
- the skeleton recognition unit 343 recognizes the skeleton of the person to be authenticated by the face recognition unit 342 in the image data using the trained model 332. For example, as shown in FIG. 6, the skeletal recognition unit 343 recognizes each part such as the upper part of the spine, the right shoulder, the left shoulder, the right elbow, the left elbow, the right wrist, the left wrist, the right hand, the left hand, and so on. In addition, the skeleton recognition unit 343 calculates the coordinates in the screen data of each recognized part. Then, the skeleton recognition unit 343 associates the recognition / calculation result with the identification information specified by the authentication by the face recognition unit 342 and stores it in the storage unit 330 as the skeleton coordinate information 335.
- the part recognized by the skeleton recognition unit 343 corresponds to the trained model 332 (teacher data used when learning the trained model 332). Therefore, the skeleton recognition unit 343 may recognize a part other than the above-exemplified parts according to the trained model 332.
- the part-specific color information acquisition unit 344 acquires color information from the image data authenticated by the face authentication unit 342 by using the skeleton coordinate information 335 which is the result of recognition by the skeleton recognition unit 343. For example, as shown in FIG. 6, the part-specific color information acquisition unit 344 acquires color information at the coordinates of each part included in the skeleton coordinate information 335 among the image data. Then, the part-specific color information acquisition unit 344 stores the acquired color information and the identification information specified by the authentication by the face recognition unit 342 in the storage unit 330 as the part-specific color information 336 in association with each other.
- the color information acquisition unit 344 for each part may acquire the color information of all the coordinates included in the skeleton coordinate information 335, or may acquire the color information of some coordinates.
- the part-specific color information acquisition unit 344 acquires only the color information at the coordinates of the part included in the authentication color information associated with the identification information specified by the face authentication unit 342 in the authentication part-specific color information 333. It may be configured to do so.
- the color information acquisition unit 344 for each part may acquire the color information of the coordinates in the image data pinpointly, or may be configured to acquire the color information in a predetermined range centered on the coordinates, for example. ..
- the part-specific color information acquisition unit 344 uses, for example, the color information specified according to the average of the acquired color information or the ratio of the acquired color information as the color information of the part. You can estimate it.
- the clothing authentication unit 345 compares the color information of each part acquired by the part-specific color information acquisition unit 344 with the color information of each part included in the authentication part-specific color information 333.
- the clothing authentication unit 345 includes the part color information in the part-specific color information 336 and the authentication color information in the authentication part-specific color information 333 in which the identification information is the same. Is compared for each part. For example, in the case shown in FIG. 7, the clothing authentication unit 345 compares each part of the right shoulder, the left elbow, the left hand, and so on. Then, the clothing certification unit 345 performs authentication to determine whether or not the clothing is registered in advance based on the result of the comparison. After that, the clothing authentication unit 345 stores the information indicating the authentication result in the storage unit 330 as the authentication result information 337.
- the clothing certification unit 345 compares the part color information with the authentication color information by calculating the color distance indicated by the color information for each part. That is, the clothing certification unit 345 compares the part color information with the authentication color information by observing the color difference for each part.
- the clothing authentication unit 345 determines that the color information of the part acquired by the part-specific color information acquisition unit 344 is registered in advance for the part.
- the clothing authentication unit 345 determines that the color information of the part acquired by the part-specific color information acquisition unit 344 is not registered in advance for the part.
- the clothing certification unit 345 performs authentication to determine whether or not the entire clothing is registered in advance based on the result of comparison of each part. For example, the clothing certification unit 345 has pre-registered the color information of the parts acquired by the part-specific color information acquisition unit 344 for all the parts included in the authentication color information in the authentication part-specific color information 333. If it is determined that there is, it is determined and authenticated that the clothing is registered in advance.
- the certification by the clothing certification unit 345 may be other than those illustrated above. For example, when the clothing certification unit 345 determines that among the parts included in the color information for authentication in the color information 333 for each part for authentication, more than a predetermined number of parts are registered in advance. It is possible to identify and authenticate that the clothes are registered in advance. Further, for example, the clothing certification unit 345 has determined that among the parts included in the color information for authentication in the color information 333 for each part for authentication, the parts defined in advance as essential are registered in advance. In this case, it can be determined and authenticated that the clothes are registered in advance. The authentication by the clothing authentication unit 345 may be discriminated and authenticated by, for example, a score calculated based on a value defined in advance for each part. For example, as described above, various conditions can be adopted when the clothing authentication unit 345 makes a determination / authentication.
- the admission permission unit 346 performs processing based on the result of authentication by the clothing certification unit 345. For example, the admission permission unit 346 determines that the clothing is pre-registered by the clothing authentication unit 345, opens the gate, door, etc., and determines that the clothing is pre-registered in the screen display unit 310. It is possible to perform admission processing such as displaying the fact that the clothes have been authenticated, and transmitting the fact that the clothes have been determined and authenticated in advance to an external device via the communication I / F unit 320. Further, the admission permission unit 346 is not authenticated by transmitting an alarm to an external device via the communication I / F unit 320 when the clothing authentication unit 345 determines and authenticates that the clothing is not registered in advance. It may be configured to perform the processing in the case of the above.
- the above is a configuration example of the authentication device 300.
- FIG. 8 is a flowchart showing an operation example of the authentication device 300.
- the face recognition unit 342 of the authentication device 300 performs face recognition based on the image data included in the image information 334 (step S101).
- the face recognition process performed by the face recognition unit 342 may be a general one.
- the face recognition unit 342 identifies the identification information of the person to be authenticated as a result of the face recognition.
- the skeleton recognition unit 343 recognizes the skeleton of the person to be authenticated by the face recognition unit 342 in the image data using the trained model 332. In addition, the skeleton recognition unit 343 calculates the coordinates in the screen data of each recognized part. For example, as described above, the skeleton recognition unit 343 specifies the coordinates of each part by performing skeleton recognition (step S102).
- the part-specific color information acquisition unit 344 uses the skeleton coordinate information 335, which is the result of recognition by the skeleton recognition unit 343, to obtain the color of each part indicated by the skeleton coordinate information 335 from the image data authenticated by the face recognition unit 342. Acquire information (step S103).
- the color information acquisition unit 344 for each part may acquire the color information of all the coordinates included in the skeleton coordinate information 335, or may acquire the color information of some coordinates.
- the part-specific color information acquisition unit 344 acquires only the color information at the coordinates of the part included in the authentication color information associated with the identification information specified by the face recognition unit 342 in the authentication part-specific color information 333. It doesn't matter.
- the clothing authentication unit 345 compares the color information of each part acquired by the part-specific color information acquisition unit 344 with the color information of each part included in the authentication part-specific color information 333 (step S104). For example, the clothing certification unit 345 compares the part color information with the authentication color information by calculating the distance of the color indicated by the color information for each part.
- the clothing authentication unit 345 determines and authenticates whether or not the clothing of the person is registered in advance based on whether or not the result of comparison for each part satisfies a predetermined condition (step S105). ). For example, when the result of comparison for each part satisfies a predetermined condition (step S105, Yes), the clothing authentication unit 345 determines that the clothing of the person to be authenticated is registered in advance. In this case, the admission permission unit 346 performs admission processing such as admitting admission (step S106). On the other hand, if the result of comparison for each part does not satisfy the predetermined conditions (step S105, No), the admission permission unit 346 does not allow admission.
- the above is an operation example of the authentication device 300.
- the authentication device 300 has a skeleton recognition unit 343, a site-specific color information acquisition unit 344, and a clothing authentication unit 345.
- the part-specific color information acquisition unit 344 can acquire the color information of the part by using the skeleton coordinate information 335 which is the result of the recognition by the skeleton recognition unit 343.
- the clothing authentication unit 345 can perform authentication based on the color information of the part acquired by the part-specific color information acquisition unit 344. As a result, it becomes possible to compare the color information of an accurate area for performing clothing authentication. This makes it possible to improve the accuracy of clothing authentication.
- an example is given in the case where an individual is identified based on the result of face authentication. That is, the case where the target specific information for specifying the color information 333 for each part for authentication, which is the registered feature amount, is acquired by face authentication is illustrated.
- an RFID (radio frequency identifier) tag such as an employee ID card may be used to identify an individual.
- the authentication device 300 has an ID information acquisition unit 347 instead of the face authentication unit 342, and the storage unit 330 stores ID information 339 instead of the face feature amount information 331. ..
- the ID information acquisition unit 347 receives ID information from an external RFID reader or the like via the communication I / F unit 320 or the like.
- the ID information acquisition unit 347 can specify the identification information based on the received ID information and the ID information 339 that associates the ID information with the identification information.
- the authentication device 300 may be configured to acquire ID information instead of face authentication.
- the authentication device 300 may specify the identification information by a known authentication process such as iris authentication or fingerprint authentication instead of the face authentication process.
- the authentication device 300 may be configured so as not to identify an individual.
- the authentication device 300 is configured to discriminate attributes such as age and gender based on image data, and perform clothing authentication using authentication color information associated with a group according to the discriminated attributes. It doesn't matter.
- the clothing authentication unit 345 may be configured to perform clothing authentication using predetermined authentication color information without performing face authentication or attribute determination. In this way, the authentication device 300 does not necessarily have to identify and discriminate a group according to an individual or an attribute.
- the color identification information 333 for each authentication part the color information for authentication is associated with each predetermined group in which a plurality of identification information are collected. It doesn't matter if it is done.
- the grouping can be set in advance according to the attributes of the person such as job title, occupation, gender, and the like.
- the admission permission unit 346 performs admission processing in the case of pre-registered clothes.
- the result of the certification by the clothing certification unit 345 may be used for purposes other than admission processing.
- the authentication device 300 may be configured to refuse admission when it is determined and authenticated that the clothing is pre-registered as a result of authentication by the clothing authentication unit 345.
- the processing performed as a result of the authentication by the clothing authentication unit 345 may be other than the admission permission by the admission permission unit 346.
- skeleton recognition may be performed using, for example, an infrared depth sensor.
- the feature amount may be other than the color information.
- the feature amount can include, for example, a value according to the pattern or pattern of the clothes.
- FIGS. 1 and 2 a case where the function as the authentication device 300 is realized by one information processing device has been described.
- the function as the authentication device 300 may be realized by, for example, a plurality of information processing devices connected via a network.
- FIG. 1 illustrates a case where the authentication system 100 is composed of a camera 200 and an authentication device 300.
- the camera 200 and the authentication device 300 may be integrally configured, such as the camera 200 having the authentication device 300 and the authentication device 300 having the function as the camera 200.
- the configuration of the authentication system 100 is not limited to the case illustrated in FIG. 1, and various modified examples can be adopted.
- FIGS. 10 and 11 show a configuration example of the authentication device 400.
- FIG. 10 shows a hardware configuration example of the authentication device 400.
- the authentication device 400 has the following hardware configuration as an example.
- -CPU Central Processing Unit
- 401 (arithmetic unit)
- ROM Read Only Memory
- RAM Random Access Memory
- 404 storage device
- -Program group 404 loaded into RAM 403
- a storage device 405 that stores a program group 404.
- -Drive device 406 that reads and writes the recording medium 410 outside the information processing device
- -Communication interface 407 that connects to the communication network 411 outside the information processing device -I / O interface 408 that inputs and outputs data -Bus 409 connecting each component
- the authentication device 400 can realize the functions as the acquisition unit 421 and the authentication unit 422 shown in FIG. 11 by the CPU 401 acquiring the program group 404 and executing the program group 404.
- the program group 404 is stored in, for example, a storage device 405 or a ROM 402 in advance, and the CPU 401 loads the program group 404 into a RAM 403 or the like and executes the program group 404 as needed.
- the program group 404 may be supplied to the CPU 401 via the communication network 411, or may be stored in the recording medium 410 in advance, and the drive device 406 may read the program and supply the program to the CPU 401.
- FIG. 10 shows an example of a hardware configuration of the authentication device 400.
- the hardware configuration of the authentication device 400 is not limited to the above case.
- the authentication device 400 may be configured from a part of the above-described configuration, such as not having the drive device 406.
- the acquisition unit 421 acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition from the image data.
- the authentication unit 422 Based on the feature amount acquired by the acquisition unit 421, the authentication unit 422 performs clothing authentication for determining whether or not the person in the image data is the clothing registered in advance.
- the authentication device 400 has an acquisition unit 421 and an authentication unit 422.
- the authentication unit 422 can perform clothing authentication for determining whether or not the person in the image data is the clothing registered in advance based on the feature amount acquired by the acquisition unit 421. As a result, it becomes possible to compare the color information of an accurate area for performing clothing authentication. This makes it possible to improve the accuracy of clothing authentication.
- the above-mentioned authentication device 400 can be realized by incorporating a predetermined program into the authentication device 400.
- the program which is another embodiment of the present invention, causes the authentication device 400 to obtain the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition from the image data.
- the acquisition unit 421 to be acquired and the authentication unit 422 that performs clothing authentication for determining whether or not the person in the image data is the clothing registered in advance based on the feature amount acquired by the acquisition unit 421 are realized. It is a program for.
- the authentication device 400 determines the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition from the image data. It is a method of acquiring and performing clothing authentication for determining whether or not a person in the image data is a pre-registered clothing based on the acquired feature amount.
- an invention of a program or an authentication method having the above-mentioned configuration can achieve the above-mentioned object of the present invention because it has the same action and effect as the above-mentioned authentication device 400.
- an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and Based on the acquired feature amount, an authentication unit that performs clothing authentication to determine whether or not the person in the image data is the pre-registered clothing, and an authentication unit.
- Authentication device with. (Appendix 2) The authentication device described in Appendix 1 The acquisition unit identifies a plurality of parts of the person by recognizing the skeleton of the person in the image data by skeleton recognition, and acquires the feature amounts of the specified plurality of parts.
- the authentication unit is an authentication device that authenticates clothes by comparing the acquired feature amount with the registered feature amount registered in advance for each part for each part.
- the authentication unit is an authentication device that makes a comparison for each part by calculating the distance between the feature amount and the registered feature amount.
- the authentication unit is an authentication device that makes a comparison for each part by calculating the distance between the feature amount and the registered feature amount.
- the authentication unit is an authentication device that makes a comparison for each part by calculating the distance between the feature amount and the registered feature amount.
- the authentication unit is an authentication device that makes a comparison for each part by calculating the distance between the feature amount and the registered feature amount.
- An authentication device in which the feature amount and the registered feature amount are color information.
- the authentication unit is an authentication device that authenticates clothes by comparing the acquired feature amount with the registered feature amount specified based on the target identification information.
- the authentication unit is an authentication device that authenticates clothes by comparing the acquired feature amount with the registered feature amount specified based on the target identification information.
- the authentication unit is an authentication device that authenticates clothes by comparing the acquired feature amount with the registered feature amount specified
- the registered feature amount is registered for each of the groups when the person is divided into a plurality of groups according to the attributes of the person.
- the target identification information is an authentication device that is information for identifying the group.
- the authentication device according to Appendix 5 The registered feature amount is registered for each person,
- Target identification information is an authentication device that is information for identifying a person.
- Information processing device From the image data, the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition is acquired.
- An authentication method for performing clothing authentication for determining whether or not a person in image data is dressed in advance based on the acquired feature amount.
- Appendix 10 For information treatment equipment, From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and Based on the feature amount acquired by the acquisition unit, an authentication unit that performs clothing authentication for determining whether or not a person in the image data is a pre-registered clothing, and an authentication unit.
- a computer-readable recording medium that records programs to achieve this.
- the programs described in each of the above embodiments and appendices may be stored in a storage device or recorded in a recording medium readable by a computer.
- the recording medium is a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, and a semiconductor memory.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Collating Specific Patterns (AREA)
- Image Analysis (AREA)
Abstract
An authentication device 400 includes: an acquiring unit 421 which acquires, from image data, a feature quantity of a part of a person in the image data, the person being identified by employing skeleton recognition to recognize the skeleton of the person; and an authenticating unit 422 which, on the basis of the feature quantity acquired by the acquiring unit 421, performs clothing authentication to determine whether the person in the image data is wearing clothing that has been registered in advance.
Description
本発明は、認証装置、認証方法、記録媒体に関する。
The present invention relates to an authentication device, an authentication method, and a recording medium.
画像データ中の服の特徴量に基づく認証処理である服装認証という技術が知られている。
A technique called clothing authentication, which is an authentication process based on the feature amount of clothing in image data, is known.
服の特徴量に基づく認証処理について記載された文献として、例えば、特許文献1がある。特許文献1によると、顔領域の位置情報に基づいて服領域の大きさを算出し、顔の傾き情報に基づいて服領域を配置する方向を決定する。そして、服領域に基づく領域で服特徴情報を生成し、照合処理を行う。このように、特許文献1には、顔領域に基づいて推定される服領域の特徴情報に基づく照合を行う旨が記載されている。
For example, Patent Document 1 is a document that describes the authentication process based on the feature amount of clothes. According to Patent Document 1, the size of the clothing area is calculated based on the position information of the face area, and the direction in which the clothing area is arranged is determined based on the inclination information of the face. Then, clothing feature information is generated in an area based on the clothing area, and collation processing is performed. As described above, Patent Document 1 describes that the collation is performed based on the characteristic information of the clothing region estimated based on the face region.
特許文献1に記載されているように顔領域に基づいて算出・推定される服領域の特徴情報に基づく照合を行う場合、人物の状態などによっては服領域を正確に算出・推定することが難しいことがあった。その結果、服装認証の精度を向上させることが難しい、という課題が生じていた。
When collation based on the characteristic information of the clothing area calculated / estimated based on the face area as described in Patent Document 1, it is difficult to accurately calculate / estimate the clothing area depending on the state of the person or the like. There was something. As a result, there has been a problem that it is difficult to improve the accuracy of clothing authentication.
そこで、本発明の目的は、服装認証の精度を向上させることが難しい、という課題を解決する認証方法、認証装置、プログラムを提供することにある。
Therefore, an object of the present invention is to provide an authentication method, an authentication device, and a program that solve the problem that it is difficult to improve the accuracy of clothing authentication.
かかる目的を達成するため本開示の一形態である認証装置は、
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する取得部と、
取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証部と、
を有する
という構成をとる。 An authentication device, which is a form of the present disclosure, in order to achieve such an object
From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and
Based on the acquired feature amount, an authentication unit that performs clothing authentication to determine whether or not the person in the image data is the pre-registered clothing, and an authentication unit.
It has a structure of having.
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する取得部と、
取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証部と、
を有する
という構成をとる。 An authentication device, which is a form of the present disclosure, in order to achieve such an object
From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and
Based on the acquired feature amount, an authentication unit that performs clothing authentication to determine whether or not the person in the image data is the pre-registered clothing, and an authentication unit.
It has a structure of having.
また、本開示の他の形態である認証方法は、
情報処理装置が、
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得し、
前記取得部が取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う
という構成をとる。 In addition, the authentication method, which is another form of the present disclosure,
Information processing device
From the image data, the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition is acquired.
Based on the feature amount acquired by the acquisition unit, clothing authentication is performed to determine whether or not the person in the image data is the clothing registered in advance.
情報処理装置が、
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得し、
前記取得部が取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う
という構成をとる。 In addition, the authentication method, which is another form of the present disclosure,
Information processing device
From the image data, the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition is acquired.
Based on the feature amount acquired by the acquisition unit, clothing authentication is performed to determine whether or not the person in the image data is the clothing registered in advance.
また、本開示の他の形態である記録媒体は、
情報処理装置に、
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する取得部と、
前記取得部が取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証部と、
を実現するためのプログラムである。 In addition, the recording medium which is another form of the present disclosure is
For information processing equipment
From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and
Based on the feature amount acquired by the acquisition unit, an authentication unit that performs clothing authentication for determining whether or not a person in the image data is a pre-registered clothing, and an authentication unit.
It is a program to realize.
情報処理装置に、
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する取得部と、
前記取得部が取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証部と、
を実現するためのプログラムである。 In addition, the recording medium which is another form of the present disclosure is
For information processing equipment
From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and
Based on the feature amount acquired by the acquisition unit, an authentication unit that performs clothing authentication for determining whether or not a person in the image data is a pre-registered clothing, and an authentication unit.
It is a program to realize.
上述したような各構成によると、服装認証の精度を向上させることが可能な認証装置、認証方法、記録媒体を提供することが可能となる。
According to each configuration as described above, it is possible to provide an authentication device, an authentication method, and a recording medium capable of improving the accuracy of clothing authentication.
[第1の実施形態]
本開示の第1の実施形態について、図1から図9までを参照して説明する。図1は、認証システム100の構成例を示す図である。図2は、認証装置300の構成例を示すブロック図である。図3は、認証用部位別色情報333の一例を示す図である。図4は、骨格座標情報335の一例を示す図である。図5は、部位別色情報336の一例を示す図である。図6は、骨格認識部343と部位別色情報取得部344の処理例を説明するための図である。図7は、服装認証部345の処理例を説明するための図である。図8は、認証装置300の動作例を示すフローチャートである。図9は、認証装置300の他の構成例を示すブロック図である。 [First Embodiment]
The first embodiment of the present disclosure will be described with reference to FIGS. 1 to 9. FIG. 1 is a diagram showing a configuration example of the authentication system 100. FIG. 2 is a block diagram showing a configuration example of theauthentication device 300. FIG. 3 is a diagram showing an example of color information 333 for each part for authentication. FIG. 4 is a diagram showing an example of skeleton coordinate information 335. FIG. 5 is a diagram showing an example of color information 336 for each part. FIG. 6 is a diagram for explaining a processing example of the skeleton recognition unit 343 and the color information acquisition unit 344 for each part. FIG. 7 is a diagram for explaining a processing example of the clothing authentication unit 345. FIG. 8 is a flowchart showing an operation example of the authentication device 300. FIG. 9 is a block diagram showing another configuration example of the authentication device 300.
本開示の第1の実施形態について、図1から図9までを参照して説明する。図1は、認証システム100の構成例を示す図である。図2は、認証装置300の構成例を示すブロック図である。図3は、認証用部位別色情報333の一例を示す図である。図4は、骨格座標情報335の一例を示す図である。図5は、部位別色情報336の一例を示す図である。図6は、骨格認識部343と部位別色情報取得部344の処理例を説明するための図である。図7は、服装認証部345の処理例を説明するための図である。図8は、認証装置300の動作例を示すフローチャートである。図9は、認証装置300の他の構成例を示すブロック図である。 [First Embodiment]
The first embodiment of the present disclosure will be described with reference to FIGS. 1 to 9. FIG. 1 is a diagram showing a configuration example of the authentication system 100. FIG. 2 is a block diagram showing a configuration example of the
本開示の第1の実施形態においては、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証システム100について説明する。後述するように、認証システム100では、肩、ひじ、ひざなど、画像データに対する骨格認識の結果に基づいて特定される人物の複数部位の色情報を取得する。そして、認証システム100は、取得した複数部位の色情報と、予め記憶する情報と、を比較することで、服装認証を行う。
In the first embodiment of the present disclosure, an authentication system 100 that performs clothing authentication for determining whether or not a person in image data is a pre-registered clothing will be described. As will be described later, the authentication system 100 acquires color information of a plurality of parts of a person specified based on the result of skeleton recognition for image data such as shoulders, elbows, and knees. Then, the authentication system 100 performs clothing authentication by comparing the acquired color information of a plurality of parts with the information stored in advance.
図1は、認証システム100の構成例を示している。図1を参照すると、認証システム100は、例えば、カメラ200と認証装置300とを有している。図1で示すように、カメラ200と認証装置300とは、例えば、ネットワークなどを介して互いに通信可能なよう接続されている。
FIG. 1 shows a configuration example of the authentication system 100. Referring to FIG. 1, the authentication system 100 includes, for example, a camera 200 and an authentication device 300. As shown in FIG. 1, the camera 200 and the authentication device 300 are connected so as to be able to communicate with each other via, for example, a network.
カメラ200は、画像データを取得する撮影装置である。例えば、カメラ200は、予め定められた位置に設置されており、人物の顔と上半身とが少なくとも映る画像データを取得する。また、カメラ200は、取得した画像データと、当該画像データの取得日時などと、を対応付けて、認証装置300に対して送信することが出来る。
The camera 200 is a photographing device that acquires image data. For example, the camera 200 is installed at a predetermined position, and acquires image data in which at least a person's face and upper body are reflected. Further, the camera 200 can transmit the acquired image data to the authentication device 300 in association with the acquisition date and time of the image data.
認証装置300は、人物が着ている服装の認証(服装認証)を行う情報処理装置である。認証装置300は、服装認証の他に、顔認証を行うことも出来る。図2は、認証装置300の構成例を示している。図2を参照すると、認証装置300は、主な構成要素として、画面表示部310と、通信I/F部320と、記憶部330と、演算処理部340と、を有している。
The authentication device 300 is an information processing device that authenticates the clothes worn by a person (clothes authentication). The authentication device 300 can also perform face authentication in addition to clothing authentication. FIG. 2 shows a configuration example of the authentication device 300. Referring to FIG. 2, the authentication device 300 has a screen display unit 310, a communication I / F unit 320, a storage unit 330, and an arithmetic processing unit 340 as main components.
画面表示部310は、LCD(Liquid Crystal Display、液晶ディスプレイ)などの画面表示装置からなる。画面表示部310は、演算処理部340からの指示に応じて、画像情報334、骨格座標情報335、部位別色情報336、認証結果情報337などの記憶部330に格納された各種情報を画面表示することが出来る。
The screen display unit 310 includes a screen display device such as an LCD (Liquid Crystal Display). The screen display unit 310 displays various information stored in the storage unit 330 such as image information 334, skeleton coordinate information 335, color information 336 for each part, and authentication result information 337 on the screen in response to an instruction from the arithmetic processing unit 340. Can be done.
通信I/F部320は、データ通信回路からなる。通信I/F部320は、通信回線を介して接続されたカメラ200や外部装置などとの間でデータ通信を行う。
The communication I / F unit 320 includes a data communication circuit. The communication I / F unit 320 performs data communication with a camera 200, an external device, or the like connected via a communication line.
記憶部330は、ハードディスクやメモリなどの記憶装置である。記憶部330は、演算処理部340における各種処理に必要な処理情報やプログラム338を記憶する。プログラム338は、演算処理部340に読み込まれて実行されることにより各種処理部を実現する。プログラム338は、通信I/F部320などのデータ入出力機能を介して外部装置や記録媒体から予め読み込まれ、記憶部330に保存されている。記憶部330で記憶される主な情報としては、例えば、顔特徴量情報331、学習済みモデル332、認証用部位別色情報333、画像情報334、骨格座標情報335、部位別色情報336、認証結果情報337などがある。
The storage unit 330 is a storage device such as a hard disk or a memory. The storage unit 330 stores processing information and a program 338 required for various processes in the arithmetic processing unit 340. The program 338 realizes various processing units by being read and executed by the arithmetic processing unit 340. The program 338 is read in advance from an external device or a recording medium via a data input / output function such as the communication I / F unit 320, and is stored in the storage unit 330. The main information stored in the storage unit 330 includes, for example, facial feature amount information 331, learned model 332, authentication site-specific color information 333, image information 334, skeleton coordinate information 335, site-specific color information 336, and authentication. There is result information 337 and the like.
顔特徴量情報331は、顔認証部342が顔認証を行う際に用いる顔特徴量を示す情報を含んでいる。顔特徴量情報331では、例えば、人物を識別するための識別情報と、顔特徴量を示す情報と、が対応づけられている。顔特徴量情報331は、例えば、通信I/F部320などを介して外部装置などから予め取得され、記憶部330に格納されている。
The face feature amount information 331 includes information indicating the face feature amount used when the face recognition unit 342 performs face recognition. In the face feature amount information 331, for example, identification information for identifying a person and information indicating the face feature amount are associated with each other. The face feature amount information 331 is acquired in advance from an external device or the like via, for example, the communication I / F unit 320 or the like, and is stored in the storage unit 330.
学習済みモデル332は、骨格認識部343が骨格認識を行う際に用いる、学習済みのモデルである。学習済みモデル332は、例えば、外部装置などにおいて、骨格座標が入った画像データなどの教師データを用いた機械学習を行うことにより予め生成されており、通信I/F部320などを介して外部装置などから取得され、記憶部330に格納されている。
The trained model 332 is a trained model used when the skeleton recognition unit 343 performs skeleton recognition. The trained model 332 is generated in advance by performing machine learning using teacher data such as image data containing skeleton coordinates in an external device or the like, and is externally generated via a communication I / F unit 320 or the like. It is acquired from a device or the like and stored in the storage unit 330.
なお、学習済みモデル332は、追加の教師データを用いた再学習処理などにより更新されても構わない。
The trained model 332 may be updated by a re-learning process using additional teacher data.
認証用部位別色情報333は、服装認証を行う際に、画像データから取得した色情報と比較する対象を示す情報を含んでいる。例えば、認証用部位別色情報333は、予め定義されている。認証用部位別色情報333は、例えば、通信I/F部320などを介して外部装置などから予め取得され、記憶部330に格納されている。
The authentication part-specific color information 333 includes information indicating an object to be compared with the color information acquired from the image data when performing clothing authentication. For example, the color information 333 for each part for authentication is defined in advance. The color information 333 for each authentication part is acquired in advance from an external device or the like via, for example, the communication I / F unit 320 or the like, and is stored in the storage unit 330.
図3は、認証用部位別色情報333の一例を示している。図3を参照すると、認証用部位別色情報333では、例えば、人物を識別するための識別情報と、登録特徴量である認証用色情報と、が対応づけられている。ここで、認証用部位別色情報333に含まれる識別情報は、顔特徴量情報331に含まれる識別情報と同様のものである。また、認証用色情報には、部位ごとの色情報が含まれている。例えば、図3の1行目では、右肩、左ひじ、……、の色情報(RGB(red, green, blue)情報)が含まれている。
FIG. 3 shows an example of color information 333 for each part for authentication. Referring to FIG. 3, in the authentication part-specific color information 333, for example, the identification information for identifying a person and the authentication color information which is a registered feature amount are associated with each other. Here, the identification information included in the color information 333 for each part for authentication is the same as the identification information included in the face feature amount information 331. In addition, the color information for authentication includes color information for each part. For example, the first line of FIG. 3 includes color information (RGB (red, green, blue) information) of the right shoulder, left elbow, ....
なお、認証用部位別色情報333中の認証用色情報には、後述する骨格認識部343により認識可能なすべての部位の色情報が含まれていても構わないし、一部の部位の色情報のみが含まれていても構わない。認証用色情報には、複数部位の色情報が含まれていることが好ましいが、右ひじのみなど、一つの部位の色情報のみが含まれていても構わない。例えば、認証用色情報には、人物の服装のうち特徴的な部位の色情報、長袖やネクタイなど着用が必須であり服装認証部345により比較を行う必要がある部位の色情報(例えば、長袖の場合、左右の手首の色情報。ネクタイの場合、背骨上部の色情報)、などを含むことが出来る。なお、認証用部位別色情報333中の認証用色情報においては、RGB以外により色を定義していても構わない。
The authentication color information in the authentication part-specific color information 333 may include color information of all parts that can be recognized by the skeleton recognition unit 343, which will be described later, or color information of some parts. Only may be included. The authentication color information preferably includes color information of a plurality of parts, but may include only color information of one part such as only the right elbow. For example, the color information for authentication includes color information of a characteristic part of a person's clothing, and color information of a part that must be worn such as long sleeves and a tie and must be compared by the clothing authentication unit 345 (for example, long sleeves). In the case of, the color information of the left and right wrists. In the case of a tie, the color information of the upper part of the spine), etc. can be included. In the authentication color information in the authentication site-specific color information 333, the color may be defined by other than RGB.
画像情報334は、カメラ200が取得した画像データを含んでいる。画像情報334においては、例えば、画像データと、画像データをカメラ200が取得した日時を示す情報と、が対応づけられている。
The image information 334 includes image data acquired by the camera 200. In the image information 334, for example, the image data and the information indicating the date and time when the camera 200 acquired the image data are associated with each other.
骨格座標情報335は、骨格認識部343により認識された人物の各部位の座標を示す情報を含んでいる。図4は、骨格座標情報335の一例を示している。図4を参照すると、骨格座標情報335では、識別情報と部位座標とが対応づけられている。識別情報は、顔特徴量情報331や認証用部位別色情報333に含まれる識別情報と同様のものである。また、部位座標には、画像データ中における各部位の座標を示す情報が含まれている。
The skeleton coordinate information 335 includes information indicating the coordinates of each part of the person recognized by the skeleton recognition unit 343. FIG. 4 shows an example of the skeleton coordinate information 335. With reference to FIG. 4, in the skeleton coordinate information 335, the identification information and the part coordinates are associated with each other. The identification information is the same as the identification information included in the face feature amount information 331 and the authentication site-specific color information 333. In addition, the part coordinates include information indicating the coordinates of each part in the image data.
なお、部位座標に含まれる部位は、学習済みモデル332に応じたものである。例えば、図4では、背骨上部、右肩、左肩、……、が例示されている。部位座標には、例えば、30か所程度の部位を含むことが出来る(例示した以外でも構わない)。部位座標に含まれる部位は、図4などで例示した以外であっても構わない。
The part included in the part coordinates corresponds to the trained model 332. For example, in FIG. 4, the upper part of the spine, the right shoulder, the left shoulder, ..., Are illustrated. The site coordinates can include, for example, about 30 sites (other than those illustrated). The part included in the part coordinates may be other than those illustrated in FIG. 4 and the like.
部位別色情報336は、画像情報334に含まれる画像データと、骨格座標情報335に含まれる部位座標と、に基づいて、部位別色情報取得部344が画像データから取得した各部位の色情報を示す情報を含んでいる。図5は、部位別色情報336の一例を示している。図5を参照すると、部位別色情報336では、識別情報と部位色情報とが対応付けられている。識別情報は、顔特徴量情報331、認証用部位別色情報333、骨格座標情報335に含まれる識別情報と同様のものである。また、部位色情報には、画像データ中における各部位の色情報が含まれている。例えば、図5の1行目では、背骨上部、右肩、……、の色情報(RGB(red, green, blue)情報)が含まれている。
The color information 336 for each part is the color information of each part acquired from the image data by the color information acquisition unit 344 for each part based on the image data included in the image information 334 and the part coordinates included in the skeleton coordinate information 335. Contains information that indicates. FIG. 5 shows an example of the color information 336 for each part. Referring to FIG. 5, in the part-specific color information 336, the identification information and the part color information are associated with each other. The identification information is the same as the identification information included in the face feature amount information 331, the color information 333 for each authentication part, and the skeleton coordinate information 335. Further, the part color information includes the color information of each part in the image data. For example, the first line of FIG. 5 includes color information (RGB (red, green, blue) information) of the upper part of the spine, the right shoulder, ....
なお、部位別色情報336中の部位色情報には、骨格座標情報335に含まれるすべての部位の色情報が含まれていても構わないし、一部の部位の色情報のみが含まれていても構わない。例えば、部位色情報には、識別情報が対応する認証用色情報に含まれている部位の色情報が含まれていても構わない。また、部位別色情報336中の部位色情報においては、認証用色情報の場合と同様に、RGB以外により色を定義していても構わない。ただし、部位色情報と認証用色情報とは、同じ手法を用いて色を定義していることが望ましい。
The part color information in the part-specific color information 336 may include the color information of all the parts included in the skeleton coordinate information 335, or includes only the color information of some parts. It doesn't matter. For example, the part color information may include the color information of the part included in the authentication color information corresponding to the identification information. Further, in the part color information in the part-specific color information 336, the color may be defined by other than RGB as in the case of the authentication color information. However, it is desirable that the color of the part color information and the color information for authentication are defined by using the same method.
認証結果情報337は、服装認証部345による認証処理の結果を示す情報を含んでいる。例えば、認証結果情報337では、識別情報と、入場を許可するか否かを示す情報と、が対応づけられている。服装認証部345による認証処理の詳細については、後述する。
The authentication result information 337 includes information indicating the result of the authentication process by the clothing authentication unit 345. For example, in the authentication result information 337, the identification information and the information indicating whether or not to allow admission are associated with each other. The details of the authentication process by the clothing authentication unit 345 will be described later.
演算処理部340は、MPUなどのマイクロプロセッサとその周辺回路を有する。演算処理部340は、記憶部330からプログラム338を読み込んで実行することにより、上記ハードウェアとプログラム338とを協働させて各種処理部を実現する。演算処理部340で実現される主な処理部としては、例えば、画像取得部341、顔認証部342、骨格認識部343、部位別色情報取得部344、服装認証部345、入場許可部346などがある。
The arithmetic processing unit 340 has a microprocessor such as an MPU and its peripheral circuits. The arithmetic processing unit 340 reads the program 338 from the storage unit 330 and executes it, thereby realizing various processing units in cooperation with the hardware and the program 338. The main processing units realized by the arithmetic processing unit 340 include, for example, an image acquisition unit 341, a face authentication unit 342, a skeleton recognition unit 343, a part-specific color information acquisition unit 344, a clothing authentication unit 345, and an admission permission unit 346. There is.
画像取得部341は、通信I/F部320を介して、カメラ200から当該カメラ200が取得した画像データを取得する。そして、画像取得部341は、取得した画像データを、例えば画像データの取得日時と対応付けて、画像情報334として記憶部330に格納する。
The image acquisition unit 341 acquires the image data acquired by the camera 200 from the camera 200 via the communication I / F unit 320. Then, the image acquisition unit 341 stores the acquired image data in the storage unit 330 as image information 334 in association with, for example, the acquisition date and time of the image data.
顔認証部342は、画像情報334に含まれる画像データに基づく顔認証を行う。例えば、顔認証部342は、画像データから認証対象となる人物を抽出する。また、顔認証部342は、抽出した人物の目、鼻、口などの特徴点を抽出するとともに、抽出した結果に基づいて特徴量を算出する。そして、顔認証部342は、算出した特徴量と、顔特徴量情報331に含まれる顔特徴量と、の類似度が顔比較閾値を超えているか否かを調べることなどにより、算出した特徴量と記憶部330に格納されている特徴量との照合を行い、照合の結果に基づく認証を行う。例えば、顔認証部342は、顔認証を行うことにより、認証対象となる人物の識別情報を特定する。
The face authentication unit 342 performs face authentication based on the image data included in the image information 334. For example, the face authentication unit 342 extracts a person to be authenticated from the image data. In addition, the face recognition unit 342 extracts feature points such as eyes, nose, and mouth of the extracted person, and calculates a feature amount based on the extracted result. Then, the face recognition unit 342 calculates the feature amount by examining whether or not the similarity between the calculated feature amount and the face feature amount included in the face feature amount information 331 exceeds the face comparison threshold. Is collated with the feature amount stored in the storage unit 330, and authentication is performed based on the collation result. For example, the face recognition unit 342 identifies the identification information of the person to be authenticated by performing face recognition.
骨格認識部343は、学習済みモデル332を用いて、画像データ中において顔認証部342による認証対象となった人物の骨格を認識する。例えば、骨格認識部343は、図6で示すように、背骨上部、右肩、左肩、右ひじ、左ひじ、右手首、左手首、右手、左手、……、などの各部位を認識する。また、骨格認識部343は、認識した各部位の画面データにおける座標を算出する。そして、骨格認識部343は、認識・算出した結果と、顔認証部342による認証により特定された識別情報と、を対応付けて、骨格座標情報335として記憶部330に格納する。
The skeleton recognition unit 343 recognizes the skeleton of the person to be authenticated by the face recognition unit 342 in the image data using the trained model 332. For example, as shown in FIG. 6, the skeletal recognition unit 343 recognizes each part such as the upper part of the spine, the right shoulder, the left shoulder, the right elbow, the left elbow, the right wrist, the left wrist, the right hand, the left hand, and so on. In addition, the skeleton recognition unit 343 calculates the coordinates in the screen data of each recognized part. Then, the skeleton recognition unit 343 associates the recognition / calculation result with the identification information specified by the authentication by the face recognition unit 342 and stores it in the storage unit 330 as the skeleton coordinate information 335.
なお、骨格認識部343が認識する部位は、学習済みモデル332(学習済みモデル332を学習する際に用いられた教師データ)に応じたものとなる。そのため、骨格認識部343は、学習済みモデル332に応じて、上記例示した以外の部位を認識しても構わない。
The part recognized by the skeleton recognition unit 343 corresponds to the trained model 332 (teacher data used when learning the trained model 332). Therefore, the skeleton recognition unit 343 may recognize a part other than the above-exemplified parts according to the trained model 332.
部位別色情報取得部344は、骨格認識部343による認識の結果である骨格座標情報335を用いて、顔認証部342が認証を行った画像データから色情報を取得する。例えば、部位別色情報取得部344は、図6で示すように、画像データのうち、骨格座標情報335に含まれる各部位の座標における色情報を取得する。そして、部位別色情報取得部344は、取得した色情報と、顔認証部342による認証により特定された識別情報と、を対応付けて、部位別色情報336として記憶部330に格納する。
The part-specific color information acquisition unit 344 acquires color information from the image data authenticated by the face authentication unit 342 by using the skeleton coordinate information 335 which is the result of recognition by the skeleton recognition unit 343. For example, as shown in FIG. 6, the part-specific color information acquisition unit 344 acquires color information at the coordinates of each part included in the skeleton coordinate information 335 among the image data. Then, the part-specific color information acquisition unit 344 stores the acquired color information and the identification information specified by the authentication by the face recognition unit 342 in the storage unit 330 as the part-specific color information 336 in association with each other.
なお、部位別色情報取得部344は、骨格座標情報335に含まれるすべての座標の色情報を取得しても構わないし、一部の座標の色情報を取得しても構わない。例えば、部位別色情報取得部344は、認証用部位別色情報333において顔認証部342が特定した識別情報と対応づけられている認証用色情報に含まれる部位の座標における色情報のみを取得するよう構成しても構わない。また、部位別色情報取得部344は、画像データにおける座標の色情報をピンポイントで取得しても構わないし、例えば、座標を中心として所定範囲の色情報を取得するよう構成しても構わない。所定範囲の色情報を取得する場合、部位別色情報取得部344は、例えば、取得した色情報の平均や取得した色情報の割合に応じて特定される色情報などを当該部位の色情報と推定しても構わない。
Note that the color information acquisition unit 344 for each part may acquire the color information of all the coordinates included in the skeleton coordinate information 335, or may acquire the color information of some coordinates. For example, the part-specific color information acquisition unit 344 acquires only the color information at the coordinates of the part included in the authentication color information associated with the identification information specified by the face authentication unit 342 in the authentication part-specific color information 333. It may be configured to do so. Further, the color information acquisition unit 344 for each part may acquire the color information of the coordinates in the image data pinpointly, or may be configured to acquire the color information in a predetermined range centered on the coordinates, for example. .. When acquiring the color information in a predetermined range, the part-specific color information acquisition unit 344 uses, for example, the color information specified according to the average of the acquired color information or the ratio of the acquired color information as the color information of the part. You can estimate it.
服装認証部345は、部位別色情報取得部344が取得した各部位の色情報と、認証用部位別色情報333に含まれる各部位の色情報と、を比較する。換言すると、服装認証部345は、図7で示すように、識別情報が同一となる、部位別色情報336中の部位色情報と、認証用部位別色情報333中の認証用色情報と、を部位ごとに比較する。例えば、図7で示す場合、服装認証部345は、右肩、左ひじ、左手、……、の各部位を比較する。そして、服装認証部345は、比較の結果に基づいて、服装が予め登録されているものであるか判別する認証を行う。その後、服装認証部345は、認証の結果を示す情報を認証結果情報337として記憶部330に格納する。
The clothing authentication unit 345 compares the color information of each part acquired by the part-specific color information acquisition unit 344 with the color information of each part included in the authentication part-specific color information 333. In other words, as shown in FIG. 7, the clothing authentication unit 345 includes the part color information in the part-specific color information 336 and the authentication color information in the authentication part-specific color information 333 in which the identification information is the same. Is compared for each part. For example, in the case shown in FIG. 7, the clothing authentication unit 345 compares each part of the right shoulder, the left elbow, the left hand, and so on. Then, the clothing certification unit 345 performs authentication to determine whether or not the clothing is registered in advance based on the result of the comparison. After that, the clothing authentication unit 345 stores the information indicating the authentication result in the storage unit 330 as the authentication result information 337.
例えば、服装認証部345は、部位ごとに色情報が示す色の距離を算出することで、部位色情報と認証用色情報との比較を行う。つまり、服装認証部345は、部位ごとに色差をみることで、部位色情報と認証用色情報との比較を行う。色の距離が予め定められた閾値以内である場合、服装認証部345は、当該部位について、部位別色情報取得部344が取得した部位の色情報が予め登録されたものであると判定する。一方、色の距離が予め定められた閾値を超える場合、服装認証部345は、当該部位について、部位別色情報取得部344が取得した部位の色情報が予め登録されたものでないと判定する。
For example, the clothing certification unit 345 compares the part color information with the authentication color information by calculating the color distance indicated by the color information for each part. That is, the clothing certification unit 345 compares the part color information with the authentication color information by observing the color difference for each part. When the color distance is within a predetermined threshold value, the clothing authentication unit 345 determines that the color information of the part acquired by the part-specific color information acquisition unit 344 is registered in advance for the part. On the other hand, when the color distance exceeds a predetermined threshold value, the clothing authentication unit 345 determines that the color information of the part acquired by the part-specific color information acquisition unit 344 is not registered in advance for the part.
また、服装認証部345は、各部位の比較の結果に基づいて、服装全体が予め登録されているものであるか否か判別する認証を行う。例えば、服装認証部345は、認証用部位別色情報333中の認証用色情報に含まれるすべての部位について、部位別色情報取得部344が取得した部位の色情報が予め登録されたものであると判定した場合に、予め登録された服装であると判別・認証する。
In addition, the clothing certification unit 345 performs authentication to determine whether or not the entire clothing is registered in advance based on the result of comparison of each part. For example, the clothing certification unit 345 has pre-registered the color information of the parts acquired by the part-specific color information acquisition unit 344 for all the parts included in the authentication color information in the authentication part-specific color information 333. If it is determined that there is, it is determined and authenticated that the clothing is registered in advance.
なお、服装認証部345による認証は、上記例示した以外であっても構わない。例えば、服装認証部345は、認証用部位別色情報333中の認証用色情報に含まれる部位のうち、予め定められた数を超える部位について予め登録されたものであると判定した場合に、予め登録された服装であると判別・認証することが出来る。また、例えば、服装認証部345は、認証用部位別色情報333中の認証用色情報に含まれる部位のうち、予め必須であると定義された部位について予め登録されたものであると判定した場合に、予め登録された服装であると判別・認証することが出来る。服装認証部345による認証は、例えば、部位ごとに予め定義された値に基づいて算出されるスコアなどにより判別・認証しても構わない。例えば、以上のように、服装認証部345が判定・認証を行う際の条件は、様々なものを採用することが出来る。
Note that the certification by the clothing certification unit 345 may be other than those illustrated above. For example, when the clothing certification unit 345 determines that among the parts included in the color information for authentication in the color information 333 for each part for authentication, more than a predetermined number of parts are registered in advance. It is possible to identify and authenticate that the clothes are registered in advance. Further, for example, the clothing certification unit 345 has determined that among the parts included in the color information for authentication in the color information 333 for each part for authentication, the parts defined in advance as essential are registered in advance. In this case, it can be determined and authenticated that the clothes are registered in advance. The authentication by the clothing authentication unit 345 may be discriminated and authenticated by, for example, a score calculated based on a value defined in advance for each part. For example, as described above, various conditions can be adopted when the clothing authentication unit 345 makes a determination / authentication.
入場許可部346は、服装認証部345による認証の結果に基づく処理を行う。例えば、入場許可部346は、服装認証部345により予め登録された服装であると判定・認証された場合、ゲートや扉などを開く、画面表示部310に予め登録された服装であると判定・認証された旨を表示する、予め登録された服装であると判定・認証された旨を通信I/F部320を介して外部装置へと送信する、などの入場処理を行うことが出来る。また、入場許可部346は、服装認証部345により予め登録された服装でないと判定・認証された場合に、通信I/F部320を介して外部装置へと警報を送信するなど、認証されなかった場合の処理を行うよう構成しても構わない。
The admission permission unit 346 performs processing based on the result of authentication by the clothing certification unit 345. For example, the admission permission unit 346 determines that the clothing is pre-registered by the clothing authentication unit 345, opens the gate, door, etc., and determines that the clothing is pre-registered in the screen display unit 310. It is possible to perform admission processing such as displaying the fact that the clothes have been authenticated, and transmitting the fact that the clothes have been determined and authenticated in advance to an external device via the communication I / F unit 320. Further, the admission permission unit 346 is not authenticated by transmitting an alarm to an external device via the communication I / F unit 320 when the clothing authentication unit 345 determines and authenticates that the clothing is not registered in advance. It may be configured to perform the processing in the case of the above.
以上が、認証装置300の構成例である。
The above is a configuration example of the authentication device 300.
続いて、図8を参照して、認証装置300の動作について説明する。図8は、認証装置300の動作例を示すフローチャートである。図8を参照すると、認証装置300の顔認証部342は、画像情報334に含まれる画像データに基づく顔認証を行う(ステップS101)。顔認証部342が行う顔認証処理は、一般的なもので構わない。そして、顔認証部342は、顔認証の結果として、認証対象となる人物の識別情報を特定する。
Subsequently, the operation of the authentication device 300 will be described with reference to FIG. FIG. 8 is a flowchart showing an operation example of the authentication device 300. Referring to FIG. 8, the face recognition unit 342 of the authentication device 300 performs face recognition based on the image data included in the image information 334 (step S101). The face recognition process performed by the face recognition unit 342 may be a general one. Then, the face recognition unit 342 identifies the identification information of the person to be authenticated as a result of the face recognition.
骨格認識部343は、学習済みモデル332を用いて、画像データ中において顔認証部342による認証対象となった人物の骨格を認識する。また、骨格認識部343は、認識した各部位の画面データにおける座標を算出する。例えば、以上のように、骨格認識部343は、骨格認識を行うことで、各部位の座標を特定する(ステップS102)。
The skeleton recognition unit 343 recognizes the skeleton of the person to be authenticated by the face recognition unit 342 in the image data using the trained model 332. In addition, the skeleton recognition unit 343 calculates the coordinates in the screen data of each recognized part. For example, as described above, the skeleton recognition unit 343 specifies the coordinates of each part by performing skeleton recognition (step S102).
部位別色情報取得部344は、骨格認識部343による認識の結果である骨格座標情報335を用いて、顔認証部342が認証を行った画像データから、骨格座標情報335が示す各部位の色情報を取得する(ステップS103)。
The part-specific color information acquisition unit 344 uses the skeleton coordinate information 335, which is the result of recognition by the skeleton recognition unit 343, to obtain the color of each part indicated by the skeleton coordinate information 335 from the image data authenticated by the face recognition unit 342. Acquire information (step S103).
なお、部位別色情報取得部344は、骨格座標情報335に含まれるすべての座標の色情報を取得しても構わないし、一部の座標の色情報を取得しても構わない。例えば、部位別色情報取得部344は、認証用部位別色情報333において顔認証部342が特定した識別情報と対応づけられている認証用色情報に含まれる部位の座標における色情報のみを取得しても構わない。
Note that the color information acquisition unit 344 for each part may acquire the color information of all the coordinates included in the skeleton coordinate information 335, or may acquire the color information of some coordinates. For example, the part-specific color information acquisition unit 344 acquires only the color information at the coordinates of the part included in the authentication color information associated with the identification information specified by the face recognition unit 342 in the authentication part-specific color information 333. It doesn't matter.
服装認証部345は、部位別色情報取得部344が取得した各部位の色情報と、認証用部位別色情報333に含まれる各部位の色情報と、を比較する(ステップS104)。例えば、服装認証部345は、部位ごとに色情報が示す色の距離を算出することで、部位色情報と認証用色情報との比較を行う。
The clothing authentication unit 345 compares the color information of each part acquired by the part-specific color information acquisition unit 344 with the color information of each part included in the authentication part-specific color information 333 (step S104). For example, the clothing certification unit 345 compares the part color information with the authentication color information by calculating the distance of the color indicated by the color information for each part.
また、服装認証部345は、各部位について比較した結果が予め定められた条件を満たすか否かに基づいて、人物の服装が予め登録されたものであるか否か判定・認証する(ステップS105)。例えば、各部位について比較した結果が予め定められた条件を満たす場合(ステップS105、Yes)、服装認証部345は、認証対象の人物の服装が予め登録されたものであると判定する。この場合、入場許可部346は、入場を許可するなど入場処理を行う(ステップS106)。一方、各部位について比較した結果が予め定められた条件を満たさない場合(ステップS105、No)、入場許可部346は入場を許可しない。
Further, the clothing authentication unit 345 determines and authenticates whether or not the clothing of the person is registered in advance based on whether or not the result of comparison for each part satisfies a predetermined condition (step S105). ). For example, when the result of comparison for each part satisfies a predetermined condition (step S105, Yes), the clothing authentication unit 345 determines that the clothing of the person to be authenticated is registered in advance. In this case, the admission permission unit 346 performs admission processing such as admitting admission (step S106). On the other hand, if the result of comparison for each part does not satisfy the predetermined conditions (step S105, No), the admission permission unit 346 does not allow admission.
以上が、認証装置300の動作例である。
The above is an operation example of the authentication device 300.
このように、認証装置300は、骨格認識部343と、部位別色情報取得部344と、服装認証部345と、を有している。このような構成により、部位別色情報取得部344は、骨格認識部343による認識の結果である骨格座標情報335を用いて、部位の色情報を取得することが出来る。また、服装認証部345は、部位別色情報取得部344が取得した部位の色情報に基づく認証を行うことが出来る。その結果、服装認証を行うための的確な領域の色情報を比較することが可能となる。これにより、服装認証の精度を上げることが可能となる。
As described above, the authentication device 300 has a skeleton recognition unit 343, a site-specific color information acquisition unit 344, and a clothing authentication unit 345. With such a configuration, the part-specific color information acquisition unit 344 can acquire the color information of the part by using the skeleton coordinate information 335 which is the result of the recognition by the skeleton recognition unit 343. In addition, the clothing authentication unit 345 can perform authentication based on the color information of the part acquired by the part-specific color information acquisition unit 344. As a result, it becomes possible to compare the color information of an accurate area for performing clothing authentication. This makes it possible to improve the accuracy of clothing authentication.
また、上記構成によると、部位別色情報取得部344が取得した複数部位の色情報に基づく認証を行うことが出来る。このように複数部位の色情報に基づく認証を行うことで、指定のネクタイをしているか、長袖であるか、など、よりきめの細かい服装認証を行うことが可能となる。その結果、服装認証の精度を上げることが可能となる。
Further, according to the above configuration, it is possible to perform authentication based on the color information of a plurality of parts acquired by the part-specific color information acquisition unit 344. By performing authentication based on the color information of a plurality of parts in this way, it is possible to perform more detailed clothing authentication such as whether the person is wearing a designated tie or has long sleeves. As a result, it is possible to improve the accuracy of clothing authentication.
なお、本実施形態においては、顔認証の結果に基づいて個人の特定を行う場合について例示した。つまり、登録特徴量である認証用部位別色情報333を特定するための対象特定情報を顔認証により取得する場合について例示した。しかしながら、例えば、図9で示すように、社員証などのRFID(radio frequency identifier)タグを用いて、個人の特定を行うよう構成しても構わない。図9で示す場合、認証装置300は、顔認証部342の代わりにID情報取得部347を有しており、記憶部330には顔特徴量情報331の代わりにID情報339が格納されている。ID情報取得部347は、通信I/F部320などを介して外部のRFIDリーダなどからID情報を受信する。また、ID情報取得部347は、受信したID情報と、ID情報と識別情報とを対応づけたID情報339と、に基づいて、識別情報を特定することが出来る。例えば、図9で示すように、認証装置300は、顔認証の代わりにID情報を取得するよう構成しても構わない。なお、認証装置300は、顔認証処理の代わりに、虹彩認証や指紋認証などの既知の認証処理により識別情報を特定しても構わない。
In the present embodiment, an example is given in the case where an individual is identified based on the result of face authentication. That is, the case where the target specific information for specifying the color information 333 for each part for authentication, which is the registered feature amount, is acquired by face authentication is illustrated. However, for example, as shown in FIG. 9, an RFID (radio frequency identifier) tag such as an employee ID card may be used to identify an individual. In the case shown in FIG. 9, the authentication device 300 has an ID information acquisition unit 347 instead of the face authentication unit 342, and the storage unit 330 stores ID information 339 instead of the face feature amount information 331. .. The ID information acquisition unit 347 receives ID information from an external RFID reader or the like via the communication I / F unit 320 or the like. Further, the ID information acquisition unit 347 can specify the identification information based on the received ID information and the ID information 339 that associates the ID information with the identification information. For example, as shown in FIG. 9, the authentication device 300 may be configured to acquire ID information instead of face authentication. The authentication device 300 may specify the identification information by a known authentication process such as iris authentication or fingerprint authentication instead of the face authentication process.
また、認証装置300は、個人の特定までは行わないように構成しても構わない。例えば、認証装置300は、画像データに基づいて年齢や性別などの属性を判別して、判別した属性に応じた集団に対応付けられた認証用色情報を用いて服装認証を行うよう構成しても構わない。また、服装認証部345は、顔認証や属性の判別などを行わずに、予め定められた認証用色情報を用いて服装認証を行うよう構成しても構わない。このように、認証装置300は必ずしも個人や属性に応じた集団の特定・判別まで行わなくても構わない。なお、上記のように属性に応じた集団ごとの服装認証を行う場合、認証用部位別色識別情報333においては、複数の識別情報をまとめた所定の集団ごとに、認証用色情報が対応付けられていても構わない。集団分けは、例えば、役職、職種、性別、などの人物の属性などに応じて予め設定しておくことが出来る。
Further, the authentication device 300 may be configured so as not to identify an individual. For example, the authentication device 300 is configured to discriminate attributes such as age and gender based on image data, and perform clothing authentication using authentication color information associated with a group according to the discriminated attributes. It doesn't matter. Further, the clothing authentication unit 345 may be configured to perform clothing authentication using predetermined authentication color information without performing face authentication or attribute determination. In this way, the authentication device 300 does not necessarily have to identify and discriminate a group according to an individual or an attribute. In addition, in the case of performing clothing authentication for each group according to the attribute as described above, in the color identification information 333 for each authentication part, the color information for authentication is associated with each predetermined group in which a plurality of identification information are collected. It doesn't matter if it is done. The grouping can be set in advance according to the attributes of the person such as job title, occupation, gender, and the like.
また、本実施形態においては、予め登録された服装である場合に入場許可部346が入場処理を行う場合について説明した。しかしながら、服装認証部345による認証の結果は、入場処理以外に用いられても構わない。例えば、認証装置300は、服装認証部345による認証の結果、予め登録された服装であると判定・認証した場合に入場を拒絶するよう構成しても構わない。このように、服装認証部345による認証の結果として行われる処理は、入場許可部346による入場許可以外であっても構わない。
Further, in the present embodiment, a case where the admission permission unit 346 performs admission processing in the case of pre-registered clothes has been described. However, the result of the certification by the clothing certification unit 345 may be used for purposes other than admission processing. For example, the authentication device 300 may be configured to refuse admission when it is determined and authenticated that the clothing is pre-registered as a result of authentication by the clothing authentication unit 345. As described above, the processing performed as a result of the authentication by the clothing authentication unit 345 may be other than the admission permission by the admission permission unit 346.
また、本実施形態においては、画像データに基づいて骨格認識を行う場合について例示した。しかしながら、骨格認識は、例えば、赤外線深度センサなどを用いて行われても構わない。
Further, in the present embodiment, a case where skeleton recognition is performed based on image data is illustrated. However, skeleton recognition may be performed using, for example, an infrared depth sensor.
また、本実施形態においては、服装認証を行う際に用いる特徴量として色情報を用いる場合について説明した。しかしながら、特徴量は、色情報以外であっても構わない。特徴量には、例えば、服装の柄や模様などに応じた値などを含むことが出来る。
Further, in the present embodiment, a case where color information is used as a feature amount used when performing clothing authentication has been described. However, the feature amount may be other than the color information. The feature amount can include, for example, a value according to the pattern or pattern of the clothes.
また、図1、図2では、1台の情報処理装置により認証装置300としての機能を実現する場合について説明した。しかしながら、認証装置300としての機能は、例えば、ネットワークを介して接続された複数台の情報処理装置により実現されても構わない。また、図1では、認証システム100がカメラ200と認証装置300とから構成される場合について例示した。しかしながら、認証装置300をカメラ200が有する、カメラ200としての機能を認証装置300が有する、など、カメラ200と認証装置300とは一体的に構成されていても構わない。例えば、以上のように、認証システム100の構成は、図1で例示した場合に限定されず、様々な変形例を採用することが出来る。
Further, in FIGS. 1 and 2, a case where the function as the authentication device 300 is realized by one information processing device has been described. However, the function as the authentication device 300 may be realized by, for example, a plurality of information processing devices connected via a network. Further, FIG. 1 illustrates a case where the authentication system 100 is composed of a camera 200 and an authentication device 300. However, the camera 200 and the authentication device 300 may be integrally configured, such as the camera 200 having the authentication device 300 and the authentication device 300 having the function as the camera 200. For example, as described above, the configuration of the authentication system 100 is not limited to the case illustrated in FIG. 1, and various modified examples can be adopted.
[第2の実施形態]
次に、本発明の第2の実施形態について、図10、図11を参照して説明する。図10、図11は、認証装置400の構成例を示している。 [Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to FIGS. 10 and 11. 10 and 11 show a configuration example of theauthentication device 400.
次に、本発明の第2の実施形態について、図10、図11を参照して説明する。図10、図11は、認証装置400の構成例を示している。 [Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to FIGS. 10 and 11. 10 and 11 show a configuration example of the
図10は、認証装置400のハードウェア構成例を示している。図10を参照すると、認証装置400は、一例として、以下のようなハードウェア構成を有している。
・CPU(Central Processing Unit)401(演算装置)
・ROM(Read Only Memory)402(記憶装置)
・RAM(Random Access Memory)403(記憶装置)
・RAM403にロードされるプログラム群404
・プログラム群404を格納する記憶装置405
・情報処理装置外部の記録媒体410の読み書きを行うドライブ装置406
・情報処理装置外部の通信ネットワーク411と接続する通信インタフェース407
・データの入出力を行う入出力インタフェース408
・各構成要素を接続するバス409 FIG. 10 shows a hardware configuration example of theauthentication device 400. Referring to FIG. 10, the authentication device 400 has the following hardware configuration as an example.
-CPU (Central Processing Unit) 401 (arithmetic unit)
-ROM (Read Only Memory) 402 (storage device)
-RAM (Random Access Memory) 403 (storage device)
-Program group 404 loaded into RAM 403
Astorage device 405 that stores a program group 404.
-Drive device 406 that reads and writes the recording medium 410 outside the information processing device
-Communication interface 407 that connects to the communication network 411 outside the information processing device
-I /O interface 408 that inputs and outputs data
-Bus 409 connecting each component
・CPU(Central Processing Unit)401(演算装置)
・ROM(Read Only Memory)402(記憶装置)
・RAM(Random Access Memory)403(記憶装置)
・RAM403にロードされるプログラム群404
・プログラム群404を格納する記憶装置405
・情報処理装置外部の記録媒体410の読み書きを行うドライブ装置406
・情報処理装置外部の通信ネットワーク411と接続する通信インタフェース407
・データの入出力を行う入出力インタフェース408
・各構成要素を接続するバス409 FIG. 10 shows a hardware configuration example of the
-CPU (Central Processing Unit) 401 (arithmetic unit)
-ROM (Read Only Memory) 402 (storage device)
-RAM (Random Access Memory) 403 (storage device)
-
A
-
-
-I /
-Bus 409 connecting each component
また、認証装置400は、プログラム群404をCPU401が取得して当該CPU401が実行することで、図11に示す取得部421、認証部422としての機能を実現することが出来る。なお、プログラム群404は、例えば、予め記憶装置405やROM402に格納されており、必要に応じてCPU401がRAM403などにロードして実行する。また、プログラム群404は、通信ネットワーク411を介してCPU401に供給されてもよいし、予め記録媒体410に格納されており、ドライブ装置406が該プログラムを読み出してCPU401に供給してもよい。
Further, the authentication device 400 can realize the functions as the acquisition unit 421 and the authentication unit 422 shown in FIG. 11 by the CPU 401 acquiring the program group 404 and executing the program group 404. The program group 404 is stored in, for example, a storage device 405 or a ROM 402 in advance, and the CPU 401 loads the program group 404 into a RAM 403 or the like and executes the program group 404 as needed. Further, the program group 404 may be supplied to the CPU 401 via the communication network 411, or may be stored in the recording medium 410 in advance, and the drive device 406 may read the program and supply the program to the CPU 401.
なお、図10は、認証装置400のハードウェア構成例を示している。認証装置400のハードウェア構成は上述した場合に限定されない。例えば、認証装置400は、ドライブ装置406を有さないなど、上述した構成の一部から構成されてもよい。
Note that FIG. 10 shows an example of a hardware configuration of the authentication device 400. The hardware configuration of the authentication device 400 is not limited to the above case. For example, the authentication device 400 may be configured from a part of the above-described configuration, such as not having the drive device 406.
取得部421は、画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する。
The acquisition unit 421 acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition from the image data.
認証部422は、取得部421が取得した特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う。
Based on the feature amount acquired by the acquisition unit 421, the authentication unit 422 performs clothing authentication for determining whether or not the person in the image data is the clothing registered in advance.
このように、認証装置400は、取得部421と、認証部422と、を有している。このような構成により、認証部422は、取得部421が取得した特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行うことが出来る。その結果、服装認証を行うための的確な領域の色情報を比較することが可能となる。これにより、服装認証の精度を上げることが可能となる。
As described above, the authentication device 400 has an acquisition unit 421 and an authentication unit 422. With such a configuration, the authentication unit 422 can perform clothing authentication for determining whether or not the person in the image data is the clothing registered in advance based on the feature amount acquired by the acquisition unit 421. As a result, it becomes possible to compare the color information of an accurate area for performing clothing authentication. This makes it possible to improve the accuracy of clothing authentication.
なお、上述した認証装置400は、当該認証装置400に所定のプログラムが組み込まれることで実現できる。具体的に、本発明の他の形態であるプログラムは、認証装置400に、画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する取得部421と、取得部421が取得した特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証部422と、を実現するためのプログラムである。
The above-mentioned authentication device 400 can be realized by incorporating a predetermined program into the authentication device 400. Specifically, the program, which is another embodiment of the present invention, causes the authentication device 400 to obtain the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition from the image data. The acquisition unit 421 to be acquired and the authentication unit 422 that performs clothing authentication for determining whether or not the person in the image data is the clothing registered in advance based on the feature amount acquired by the acquisition unit 421 are realized. It is a program for.
また、上述した認証装置400により実行される認証方法は、認証装置400が、画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得し、取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う、という方法である。
Further, in the authentication method executed by the above-mentioned authentication device 400, the authentication device 400 determines the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition from the image data. It is a method of acquiring and performing clothing authentication for determining whether or not a person in the image data is a pre-registered clothing based on the acquired feature amount.
上述した構成を有する、プログラム、又は、認証方法、の発明であっても、上記認証装置400と同様の作用・効果を有するために、上述した本発明の目的を達成することが出来る。
Even an invention of a program or an authentication method having the above-mentioned configuration can achieve the above-mentioned object of the present invention because it has the same action and effect as the above-mentioned authentication device 400.
<付記>
上記実施形態の一部又は全部は、以下の付記のようにも記載されうる。以下、本発明における認証方法などの概略を説明する。但し、本発明は、以下の構成に限定されない。 <Additional notes>
Part or all of the above embodiments may also be described as in the appendix below. Hereinafter, the outline of the authentication method and the like in the present invention will be described. However, the present invention is not limited to the following configurations.
上記実施形態の一部又は全部は、以下の付記のようにも記載されうる。以下、本発明における認証方法などの概略を説明する。但し、本発明は、以下の構成に限定されない。 <Additional notes>
Part or all of the above embodiments may also be described as in the appendix below. Hereinafter, the outline of the authentication method and the like in the present invention will be described. However, the present invention is not limited to the following configurations.
(付記1)
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する取得部と、
取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証部と、
を有する
認証装置。
(付記2)
付記1に記載の認証装置であって、
前記取得部は、画像データ中の人物の骨格を骨格認識により認識することで、人物の複数の部位を特定し、特定した複数の部位の前記特徴量を取得し、
前記認証部は、取得した前記特徴量と予め部位ごとに登録された登録特徴量とを部位ごとに比較することで、前記服装認証を行う
認証装置。
(付記3)
付記2に記載の認証装置であって、
前記認証部は、前記特徴量と前記登録特徴量との間の距離を算出することで部位ごとの比較を行う
認証装置。
(付記4)
付記2または付記3に記載の認証装置であって、
前記特徴量と前記登録特徴量とは色情報である
認証装置。
(付記5)
付記2から付記4までのいずれか1項に記載の認証装置であって、
前記登録特徴量を特定するための対象特定情報を取得し、
前記認証部は、取得した前記特徴量と、前記対象特定情報に基づいて特定される前記登録特徴量と、を比較することで、前記服装認証を行う
認証装置。
(付記6)
付記5に記載の認証装置であって、
人物の属性に応じて人物を複数の集団に分けた際の前記集団ごとに、前記登録特徴量が登録されており、
前記対象特定情報は、前記集団を特定するための情報である
認証装置。
(付記7)
付記5に記載の認証装置であって、
人物ごとに前記登録特徴量が登録されており、
対象特定情報は、人物を特定するための情報である
認証装置。
(付記8)
付記5から付記7までのいずれか1項に記載の認証装置であって、
画像データに基づいて顔認証を行うことで、前記対象特定情報を取得する
認証装置。
(付記9)
情報処理装置が、
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得し、
取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う
認証方法。
(付記10)
情報処置装置に、
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する取得部と、
前記取得部が取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証部と、
を実現するためのプログラムを記録した、コンピュータが読み取り可能な記録媒体。 (Appendix 1)
From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and
Based on the acquired feature amount, an authentication unit that performs clothing authentication to determine whether or not the person in the image data is the pre-registered clothing, and an authentication unit.
Authentication device with.
(Appendix 2)
The authentication device described inAppendix 1
The acquisition unit identifies a plurality of parts of the person by recognizing the skeleton of the person in the image data by skeleton recognition, and acquires the feature amounts of the specified plurality of parts.
The authentication unit is an authentication device that authenticates clothes by comparing the acquired feature amount with the registered feature amount registered in advance for each part for each part.
(Appendix 3)
The authentication device described in Appendix 2
The authentication unit is an authentication device that makes a comparison for each part by calculating the distance between the feature amount and the registered feature amount.
(Appendix 4)
The authentication device according to Appendix 2 or Appendix 3.
An authentication device in which the feature amount and the registered feature amount are color information.
(Appendix 5)
The authentication device according to any one of Supplementary note 2 to Supplementary note 4.
Acquire the target identification information for specifying the registered feature amount,
The authentication unit is an authentication device that authenticates clothes by comparing the acquired feature amount with the registered feature amount specified based on the target identification information.
(Appendix 6)
The authentication device according to Appendix 5.
The registered feature amount is registered for each of the groups when the person is divided into a plurality of groups according to the attributes of the person.
The target identification information is an authentication device that is information for identifying the group.
(Appendix 7)
The authentication device according to Appendix 5.
The registered feature amount is registered for each person,
Target identification information is an authentication device that is information for identifying a person.
(Appendix 8)
The authentication device according to any one of Supplementary note 5 to Supplementary note 7.
An authentication device that acquires the target identification information by performing face recognition based on image data.
(Appendix 9)
Information processing device
From the image data, the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition is acquired.
An authentication method for performing clothing authentication for determining whether or not a person in image data is dressed in advance based on the acquired feature amount.
(Appendix 10)
For information treatment equipment,
From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and
Based on the feature amount acquired by the acquisition unit, an authentication unit that performs clothing authentication for determining whether or not a person in the image data is a pre-registered clothing, and an authentication unit.
A computer-readable recording medium that records programs to achieve this.
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する取得部と、
取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証部と、
を有する
認証装置。
(付記2)
付記1に記載の認証装置であって、
前記取得部は、画像データ中の人物の骨格を骨格認識により認識することで、人物の複数の部位を特定し、特定した複数の部位の前記特徴量を取得し、
前記認証部は、取得した前記特徴量と予め部位ごとに登録された登録特徴量とを部位ごとに比較することで、前記服装認証を行う
認証装置。
(付記3)
付記2に記載の認証装置であって、
前記認証部は、前記特徴量と前記登録特徴量との間の距離を算出することで部位ごとの比較を行う
認証装置。
(付記4)
付記2または付記3に記載の認証装置であって、
前記特徴量と前記登録特徴量とは色情報である
認証装置。
(付記5)
付記2から付記4までのいずれか1項に記載の認証装置であって、
前記登録特徴量を特定するための対象特定情報を取得し、
前記認証部は、取得した前記特徴量と、前記対象特定情報に基づいて特定される前記登録特徴量と、を比較することで、前記服装認証を行う
認証装置。
(付記6)
付記5に記載の認証装置であって、
人物の属性に応じて人物を複数の集団に分けた際の前記集団ごとに、前記登録特徴量が登録されており、
前記対象特定情報は、前記集団を特定するための情報である
認証装置。
(付記7)
付記5に記載の認証装置であって、
人物ごとに前記登録特徴量が登録されており、
対象特定情報は、人物を特定するための情報である
認証装置。
(付記8)
付記5から付記7までのいずれか1項に記載の認証装置であって、
画像データに基づいて顔認証を行うことで、前記対象特定情報を取得する
認証装置。
(付記9)
情報処理装置が、
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得し、
取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う
認証方法。
(付記10)
情報処置装置に、
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する取得部と、
前記取得部が取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証部と、
を実現するためのプログラムを記録した、コンピュータが読み取り可能な記録媒体。 (Appendix 1)
From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and
Based on the acquired feature amount, an authentication unit that performs clothing authentication to determine whether or not the person in the image data is the pre-registered clothing, and an authentication unit.
Authentication device with.
(Appendix 2)
The authentication device described in
The acquisition unit identifies a plurality of parts of the person by recognizing the skeleton of the person in the image data by skeleton recognition, and acquires the feature amounts of the specified plurality of parts.
The authentication unit is an authentication device that authenticates clothes by comparing the acquired feature amount with the registered feature amount registered in advance for each part for each part.
(Appendix 3)
The authentication device described in Appendix 2
The authentication unit is an authentication device that makes a comparison for each part by calculating the distance between the feature amount and the registered feature amount.
(Appendix 4)
The authentication device according to Appendix 2 or Appendix 3.
An authentication device in which the feature amount and the registered feature amount are color information.
(Appendix 5)
The authentication device according to any one of Supplementary note 2 to Supplementary note 4.
Acquire the target identification information for specifying the registered feature amount,
The authentication unit is an authentication device that authenticates clothes by comparing the acquired feature amount with the registered feature amount specified based on the target identification information.
(Appendix 6)
The authentication device according to Appendix 5.
The registered feature amount is registered for each of the groups when the person is divided into a plurality of groups according to the attributes of the person.
The target identification information is an authentication device that is information for identifying the group.
(Appendix 7)
The authentication device according to Appendix 5.
The registered feature amount is registered for each person,
Target identification information is an authentication device that is information for identifying a person.
(Appendix 8)
The authentication device according to any one of Supplementary note 5 to Supplementary note 7.
An authentication device that acquires the target identification information by performing face recognition based on image data.
(Appendix 9)
Information processing device
From the image data, the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition is acquired.
An authentication method for performing clothing authentication for determining whether or not a person in image data is dressed in advance based on the acquired feature amount.
(Appendix 10)
For information treatment equipment,
From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and
Based on the feature amount acquired by the acquisition unit, an authentication unit that performs clothing authentication for determining whether or not a person in the image data is a pre-registered clothing, and an authentication unit.
A computer-readable recording medium that records programs to achieve this.
なお、上記各実施形態及び付記において記載したプログラムは、記憶装置に記憶されていたり、コンピュータが読み取り可能な記録媒体に記録されていたりする。例えば、記録媒体は、フレキシブルディスク、光ディスク、光磁気ディスク、及び、半導体メモリ等の可搬性を有する媒体である。
Note that the programs described in each of the above embodiments and appendices may be stored in a storage device or recorded in a recording medium readable by a computer. For example, the recording medium is a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, and a semiconductor memory.
以上、上記各実施形態を参照して本願発明を説明したが、本願発明は、上述した実施形態に限定されるものではない。本願発明の構成や詳細には、本願発明の範囲内で当業者が理解しうる様々な変更をすることが出来る。
Although the invention of the present application has been described above with reference to each of the above embodiments, the invention of the present application is not limited to the above-described embodiment. Various changes that can be understood by those skilled in the art can be made to the structure and details of the present invention within the scope of the present invention.
なお、本発明は、日本国にて2020年3月5日に特許出願された特願2020-037821の特許出願に基づく優先権主張の利益を享受するものであり、当該特許出願に記載された内容は、全て本明細書に含まれるものとする。
The present invention enjoys the benefit of priority claim based on the patent application of Japanese Patent Application No. 2020-037821 filed in Japan on March 5, 2020, and is described in the patent application. All contents are included in this specification.
100 認証システム
200 カメラ
300 認証装置
310 画面表示部
320 通信I/F部
330 記憶部
331 顔特徴量情報
332 学習済みモデル
333 認証用部位別色情報
334 画像情報
335 骨格座標情報
336 部位別色情報
337 認証結果情報
338 プログラム
339 ID情報
340 演算処理部
341 画像取得部
342 顔認証部
343 骨格認識部
344 部位別色情報取得部
345 服装認証部
346 入場許可部
347 ID情報取得部
401 CPU
402 ROM
403 RAM
404 プログラム群
405 記憶装置
406 ドライブ装置
407 通信インタフェース
408 入出力インタフェース
409 バス
410 記録媒体
411 通信ネットワーク
421 取得部
422 認証部
100Authentication system 200 Camera 300 Authentication device 310 Screen display unit 320 Communication I / F unit 330 Storage unit 331 Face feature amount information 332 Learned model 333 Authentication site-specific color information 334 Image information 335 Skeletal coordinate information 336 Site-specific color information 337 Authentication result information 338 Program 339 ID information 340 Calculation processing unit 341 Image acquisition unit 342 Face recognition unit 343 Skeleton recognition unit 344 Part-specific color information acquisition unit 345 Clothing authentication unit 346 Admission permission unit 347 ID information acquisition unit 401 CPU
402 ROM
403 RAM
404Program group 405 Storage device 406 Drive device 407 Communication interface 408 Input / output interface 409 Bus 410 Recording medium 411 Communication network 421 Acquisition unit 422 Authentication unit
200 カメラ
300 認証装置
310 画面表示部
320 通信I/F部
330 記憶部
331 顔特徴量情報
332 学習済みモデル
333 認証用部位別色情報
334 画像情報
335 骨格座標情報
336 部位別色情報
337 認証結果情報
338 プログラム
339 ID情報
340 演算処理部
341 画像取得部
342 顔認証部
343 骨格認識部
344 部位別色情報取得部
345 服装認証部
346 入場許可部
347 ID情報取得部
401 CPU
402 ROM
403 RAM
404 プログラム群
405 記憶装置
406 ドライブ装置
407 通信インタフェース
408 入出力インタフェース
409 バス
410 記録媒体
411 通信ネットワーク
421 取得部
422 認証部
100
402 ROM
403 RAM
404
Claims (10)
- 画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する取得部と、
取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証部と、
を有する
認証装置。 From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and
Based on the acquired feature amount, an authentication unit that performs clothing authentication to determine whether or not the person in the image data is the pre-registered clothing, and an authentication unit.
Authentication device with. - 請求項1に記載の認証装置であって、
前記取得部は、画像データ中の人物の骨格を骨格認識により認識することで、人物の複数の部位を特定し、特定した複数の部位の前記特徴量を取得し、
前記認証部は、取得した前記特徴量と予め部位ごとに登録された登録特徴量とを部位ごとに比較することで、前記服装認証を行う
認証装置。 The authentication device according to claim 1.
The acquisition unit identifies a plurality of parts of the person by recognizing the skeleton of the person in the image data by skeleton recognition, and acquires the feature amounts of the specified plurality of parts.
The authentication unit is an authentication device that authenticates clothes by comparing the acquired feature amount with the registered feature amount registered in advance for each part for each part. - 請求項2に記載の認証装置であって、
前記認証部は、前記特徴量と前記登録特徴量との間の距離を算出することで部位ごとの比較を行う
認証装置。 The authentication device according to claim 2.
The authentication unit is an authentication device that makes a comparison for each part by calculating the distance between the feature amount and the registered feature amount. - 請求項2または請求項3に記載の認証装置であって、
前記特徴量と前記登録特徴量とは色情報である
認証装置。 The authentication device according to claim 2 or 3.
An authentication device in which the feature amount and the registered feature amount are color information. - 請求項2から請求項4までのいずれか1項に記載の認証装置であって、
前記登録特徴量を特定するための対象特定情報を取得し、
前記認証部は、取得した前記特徴量と、前記対象特定情報に基づいて特定される前記登録特徴量と、を比較することで、前記服装認証を行う
認証装置。 The authentication device according to any one of claims 2 to 4.
Acquire the target identification information for specifying the registered feature amount,
The authentication unit is an authentication device that authenticates clothes by comparing the acquired feature amount with the registered feature amount specified based on the target identification information. - 請求項5に記載の認証装置であって、
人物の属性に応じて人物を複数の集団に分けた際の前記集団ごとに、前記登録特徴量が登録されており、
前記対象特定情報は、前記集団を特定するための情報である
認証装置。 The authentication device according to claim 5.
The registered feature amount is registered for each of the groups when the person is divided into a plurality of groups according to the attributes of the person.
The target identification information is an authentication device that is information for identifying the group. - 請求項5に記載の認証装置であって、
人物ごとに前記登録特徴量が登録されており、
対象特定情報は、人物を特定するための情報である
認証装置。 The authentication device according to claim 5.
The registered feature amount is registered for each person,
Target identification information is an authentication device that is information for identifying a person. - 請求項5から請求項7までのいずれか1項に記載の認証装置であって、
画像データに基づいて顔認証を行うことで、前記対象特定情報を取得する
認証装置。 The authentication device according to any one of claims 5 to 7.
An authentication device that acquires the target identification information by performing face recognition based on image data. - 情報処理装置が、
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得し、
取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う
認証方法。 Information processing device
From the image data, the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition is acquired.
An authentication method for performing clothing authentication for determining whether or not a person in image data is dressed in advance based on the acquired feature amount. - 情報処置装置に、
画像データから、当該画像データ中の人物の骨格を骨格認識により認識することで特定される人物の部位の特徴量を取得する取得部と、
前記取得部が取得した前記特徴量に基づいて、画像データ中の人物が予め登録されている服装であるか否か判別する服装認証を行う認証部と、
を実現するためのプログラムを記録した、コンピュータが読み取り可能な記録媒体。 For information treatment equipment,
From the image data, an acquisition unit that acquires the feature amount of the part of the person specified by recognizing the skeleton of the person in the image data by skeleton recognition, and
Based on the feature amount acquired by the acquisition unit, an authentication unit that performs clothing authentication for determining whether or not a person in the image data is a pre-registered clothing, and an authentication unit.
A computer-readable recording medium that records programs to achieve this.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2022505061A JP7456659B2 (en) | 2020-03-05 | 2021-02-04 | Authentication Device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020-037821 | 2020-03-05 | ||
JP2020037821 | 2020-03-05 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021176945A1 true WO2021176945A1 (en) | 2021-09-10 |
Family
ID=77614251
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2021/004123 WO2021176945A1 (en) | 2020-03-05 | 2021-02-04 | Authentication device |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP7456659B2 (en) |
WO (1) | WO2021176945A1 (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010199771A (en) * | 2009-02-24 | 2010-09-09 | Olympus Imaging Corp | Image display apparatus, image display method, and program |
WO2011046128A1 (en) * | 2009-10-16 | 2011-04-21 | 日本電気株式会社 | Clothing feature extraction device, person retrieval device, and processing method thereof |
JP2012173761A (en) * | 2011-02-17 | 2012-09-10 | Nifty Corp | Information processor, information processing method and program |
JP2018041273A (en) * | 2016-09-07 | 2018-03-15 | キヤノン株式会社 | Image recognition device, method for controlling image recognition device, and program |
CN110796079A (en) * | 2019-10-29 | 2020-02-14 | 深圳龙岗智能视听研究院 | Multi-camera visitor identification method and system based on face depth features and human body local depth features |
-
2021
- 2021-02-04 WO PCT/JP2021/004123 patent/WO2021176945A1/en active Application Filing
- 2021-02-04 JP JP2022505061A patent/JP7456659B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010199771A (en) * | 2009-02-24 | 2010-09-09 | Olympus Imaging Corp | Image display apparatus, image display method, and program |
WO2011046128A1 (en) * | 2009-10-16 | 2011-04-21 | 日本電気株式会社 | Clothing feature extraction device, person retrieval device, and processing method thereof |
JP2012173761A (en) * | 2011-02-17 | 2012-09-10 | Nifty Corp | Information processor, information processing method and program |
JP2018041273A (en) * | 2016-09-07 | 2018-03-15 | キヤノン株式会社 | Image recognition device, method for controlling image recognition device, and program |
CN110796079A (en) * | 2019-10-29 | 2020-02-14 | 深圳龙岗智能视听研究院 | Multi-camera visitor identification method and system based on face depth features and human body local depth features |
Also Published As
Publication number | Publication date |
---|---|
JPWO2021176945A1 (en) | 2021-09-10 |
JP7456659B2 (en) | 2024-03-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106022032B (en) | PID personal identification device, recognition threshold setting method and program | |
Ahmed et al. | Vision based hand gesture recognition using dynamic time warping for Indian sign language | |
WO2018028546A1 (en) | Key point positioning method, terminal, and computer storage medium | |
US7092555B2 (en) | System for registering and authenticating human face using support vector machines and method thereof | |
US7158657B2 (en) | Face image recording system | |
TW505892B (en) | System and method for promptly tracking multiple faces | |
EP0930580B1 (en) | Method and device for registering and collating palm imprints | |
CN101661557A (en) | Face recognition system and face recognition method based on intelligent card | |
CN106682473A (en) | Method and device for identifying identity information of users | |
CN108805005A (en) | Auth method and device, electronic equipment, computer program and storage medium | |
Olagunju et al. | Staff attendance monitoring system using fingerprint biometrics | |
TWI526953B (en) | Face recognition method and system | |
CN105184236A (en) | Robot-based face identification system | |
Xue | Face Database Security Information Verification Based on Recognition Technology. | |
WO2021176945A1 (en) | Authentication device | |
Rosy et al. | An enhanced intelligent attendance management system for smart campus | |
JP2017054323A (en) | Biometric authentication apparatus, biometric authentication method, and biometric authentication program | |
JP2006092491A (en) | Personal authentication apparatus, personal authentication system, personal authentication method and personal authentication program | |
CN110532845A (en) | Biological authentication apparatus and biological authentication method | |
CN108647600A (en) | Face identification method, equipment and computer readable storage medium | |
Susanto et al. | Lecturer Attendance System using Face Recognition Application an Android-Based | |
Charishma et al. | Smart Attendance System with and Without Mask using Face Recognition | |
WO2023145475A1 (en) | Image processing device | |
JP3841482B2 (en) | Face image recognition device | |
US20240071135A1 (en) | Image processing device, image processing method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21764138 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2022505061 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21764138 Country of ref document: EP Kind code of ref document: A1 |