WO2017060805A1

WO2017060805A1 - Method and device for automated identification of persons and measuring the alcohol content in exhaled air

Info

Publication number: WO2017060805A1
Application number: PCT/IB2016/055915
Authority: WO
Inventors: Jolanta DIDZGALVIENE
Original assignee: Uab Inovatyviu Procesu Sprendimai
Priority date: 2015-10-06
Filing date: 2016-10-04
Publication date: 2017-04-13

Abstract

The invention relates to administration and control field. The invention proposes a reliable and sufficiently simple method and device for the identification of persons and control of alcohol content in blood that can be used at checkpoints. The control method is distinguished by the fact that a person is identified using the RFID card, the face is photographed and recognised when the person takes the breathalyzer test, the RFID card, face identification and breathalyzer data is forwarded to the cloud server via the internet, and if the alcohol content in the air exhaled by the controlled person is increased, the person cannot pass the checkpoint and the information is forwarded to the administrator. Facial recognition function does not require any special primary photographs; it learns autonomically and responds after the second successful login by a person. When a photograph is taken, the mouthpiece and breathalyzer inlet nozzle must be visible in order to establish if they were inserted during the air blowing action. Proposed technical solutions allow the high probability of identification of a person and any fraud and of provision of timely report to the administrator in all exceptional cases, especially those related to alcohol consumption.

Description

DESCRIPTION

METHOD AND DEVICE FOR AUTOMATED IDENTIFICATION OF PERSONS AND MEASURING THE ALCOHOL CONTENT IN EXHALED AIR

FIELD OF TECHNOLOGY

The invention relates to administration and control field and, in particular, to remote control devices used for the identification of persons and determination of alcohol content in the gas exhaled by a person.

BACKGROUND ART

Lately devices used for the control of access to administrative or manufacturing premises enabling the administration to remotely monitor and register the actions of employees and their health condition and to determine their location and time, became very popular. These devices must perform the following main functions: identify a person, determine his/her health condition, i.e. measure the alcohol content in blood, and transfer the data to the administration.

Additional measures and/or personal characteristics are used to identify a person. Additional measures may involve passwords, smart cards or bracelets.

Personal characteristics are face, fingers, hands, iris, blood, breath, saliva, etc.

It is especially important to control the alcohol intoxication of employees before and during work. Alcohol measuring devices of various designs determining the alcohol content in blood are used for this purpose. The most commonly used measuring devices are breathalyzers determining the alcohol content in person's breath samples. Driving under the influence of alcohol is a very relevant problem. The development and installation in vehicles of devices preventing from alcohol-impaired driving gets a lot of focus (see patents US20120268259, US2015258892). These devices perform: measuring of alcohol content in blood, driver identification by taking a photograph of the face, remote data transfer, blocking of starter operation or fuel supply in the vehicle.

Technical solutions enabling the person's image recognition function are available (see patents US20050041840, WO2007010799, EP1914961). They propose to implement this using mobile phones with image recognition function. This function is used for mobile phone handling (to recognise the mobile phone owner) or to transfer visual information to other users using mobile networks.

The portable device (see patent US20140335905) for measuring blood alcohol level by connecting it to a mobile device, such as a phone, tablet or laptop, is available. It uses the capacity of mobile phone, laptop or tablet to calculate, store and transfer data using e-mail or text messages.

The flaw of this invention is that it can be used as a self-control device in order to check the intoxication level or transfer the obtained information to the administrator and other concerned persons as an e-mail or text message.

Also, a self-service input terminal with a breathalyzer and central server and its method of operation is available (see patent WO2008076310). It consists from a stationary input terminal where a breathalyzer, photo camera, biometric scanner (sensor), card reader, as well as a control module, reception module, image recognition module and touchscreen are installed. This device measures the alcohol content in user's blood by the exhaled gas, identifies the person by fingerprints, recognises the smart card owner, stores the input data and transfers it to the administrator.

This invention is used for bank operations. The flaw of this invention is that it does not transfer the data remotely. DISCLOSURE

The purpose of the invention is to propose a reliable and sufficiently simple method and device for the identification of persons and control of alcohol content in blood that can be used at checkpoints.

The proposed method to control persons involves the following actions:

identifies a person using a RFID card,

provides a possibility for the person to take a breathalyzer test,

takes a face photograph during the air blowing,

performs the facial recognition function,

RFID card, facial identification and breathalyzer data are transferred to the cloud server via the internet;

if alcohol content in the air exhaled by the controlled person is increased, the person cannot pass the checkpoint and the information is sent to the administrator,

data is stored (archived) on the cloud server and, if required, transferred to the administrator. Persons can also be identified by a personal identification number.

Also, additionally it is proposed to measure the temperature of person's breath and/or measure the humidity of person's breath.

In addition, it is proposed to perform the face recognition function after the second successful interaction of a person with the control devise.

It is proposed to take a photograph of person's face from two sides using two video cameras and applying the cross-type mode: when the right-side light is on, the left-side video camera takes a photograph, and vice versa - when the left-side light is on, the right-side video camera takes a photograph.

It is proposed to take photographs in such a way, so that the mouthpiece inserted into the breathalyzer inlet nozzle is visible in images. The proposed person control device consists of an input terminal, cloud server, administrator access module and the internet, and its input terminal consists of a touchscreen, speaker, video camera, the main controller, GSM/WiFi communication module, breathalyzer, RFID card reader, peripheral device controller, and controller interconnect module. In the input terminal, the touchscreen, speaker and video camera are interconnected with the controller, and the breathalyzer and RFID card reader are interconnected with the peripheral device controller, which is connected to the main controller via the communication module. The device also has two lights connected and controlled by the peripheral device controller.

A whole range of new material features is proposed:

instead of two controllers a common controller can be used;

breath temperature measuring device and/or breath humidity measuring device interconnected with the peripheral device controller (12) or the main controller and controlled by them can be installed in the input terminal;

two video cameras allocated symmetrically at a distance from one another and installed at a short distance above the breathalyzer inlet can be used in the input terminal;

the breathalyzer inlet of the input terminal can have a nozzle, and video cameras can be allocated in such a way that the breathalyzer inlet nozzle and disposable mouthpiece are in the photo area; a frame determining the size of photographed face image can be installed in the touchscreen (5).

DESCRIPTION OF THE DRAWINGS

The invention is illustrated with drawings:

fig. 1 - device flowchart (version one),

fig. 2 - device flowchart (version two),

fig. 3 - generic view of the input terminal (version one, two),

fig. 4 - generic view of the input terminal (version three, four),

fig. 5 - device operation algorithm.

The device for identification of persons and measuring alcohol content in exhaled air can have several modifications: Option one (fig. 1). The device consists of the following main components: input terminal 1, cloud server 2, administrator access module 3. Input terminal 1 interacts with the cloud server 2 via the internet 4. Input terminal 1 consists of the touchscreen 5, speaker 6, video camera 7, main controller 8, GSM/WiFi communication module 9, breathalyzer 10, RFID card reader 11, peripheral device controller 12, and communication module 13. The main controller 8 has the following modules: keyboard 8a, screen control 8b, photography and image processing 8c, communication with peripheral devices 8d, communication with server 8e, and error diagnostics 8f. Touch-sensitive screen 5, speaker 6 and video camera 7 interact with the main controller 8. Breathalyzer 10 and RFID card reader 11 interact with the peripheral device controller 12, which is connected to the main controller 8 via the communication module 13. The device also has two lights 14a and 14b, which are controlled by the peripheral device controller 12. A person is symbolically marked with number 15. The interaction of person 15 with separate blocks of input terminal 1 is shown with dotted lines.

Instead of two controllers 8 and 12, one common controller can be used with the possibility to connect all aforementioned components and perform their functions.

The generic view of input terminal 1 is shown in fig. 3. Lights 14a and 14b are allocated on both sides of the touch-sensitive screen 5. At the bottom, below the touchscreen 5 there is a video camera 7 and inlet 10a of breathalyzer 10, as well as the input 1 la of RFID card reader 11.

Version two (fig. 2). The device differs from the first version in that its input terminal 1 has a breath temperature measuring device 16 and/or breath humidity measuring device 17.

Version three (fig. 2, fig. 4). The device differs from the first and second versions in that its input terminal 1 has two video cameras 7 and 18, which are installed symmetrically at a specific distance from one another.

Version four (fig. 4). The device differs from the third version in that the inlet 10b of breathalyzer 10 of its input terminal 1 has a nozzle. Person 15 can interact with the following components:

touchscreen 5, by entering information with a finger and obtaining visual information, by obtaining the audio information through speaker 6,

by being photographed with video cameras 7 and 18,

by blowing exhaled air into the inlet 10a and 10b of breathalyzer 10,

by being identified by RFID card and/or personal identification number.

In some cases, a smartphone or the aforementioned separate components can be used in the proposed control device.

IMPLEMENTATION OF THE INVENTION Operation of Version One Device (Fig. 1)

When standing in front of the input terminal 1, as the first action, the person 15 touches the RFID card to the RFID card reader 11 input 11a and/or enters the personal identification number and follows the instructions on screen 5;

as the second action, the person 15 blows exhaled air through the disposable mouthpiece into the breathalyzer 10 and, as soon as the breathalyzer 10 records the change of pressure, the person's face is photographed using video camera 7 and the alcohol content in the breath of person 15 is measured;

as the third action, the person 15 sees the measuring results and the instruction if he/she can pass the checkpoint or not on the screen 5; this ends the interaction of person 15 with the input terminal 1.

Operation of Version Two Device (Fig. 2)

As the first action, the person 15 touches the RFID card to the RFID card reader 11 input 11a and/or enters the personal identification number and follows the instructions on screen 5 ;

as the second action, the person 15 blows exhaled air through the disposable mouthpiece into the inlet 10a of breathalyzer 10 and, as soon as the breathalyzer 10 records the change of pressure, video camera 7 takes a photograph of person's face, breathalyzer 10 measures the alcohol content in person's breath, and air temperature measuring device 16 measures the breath temperature and/or humidity measuring device 17 measures the breath humidity; then the temperature and/or humidity of person's breath is compared to the temperature and humidity of ambient air;

as the third action, the person 15 sees the measuring results and the instruction if he/she can pass the checkpoint or not on the screen 5; this ends the interaction of person 15 with the input terminal

1.

Operation of Version Three and Four Devices

as the second action, person 15 blows exhaled air through the disposable mouthpiece into inlet 10a or inlet 10b of breathalyser 10 and, as soon as the breathalyser 10 records the change of pressure, cameras 7 and 18 take a photograph of person's face and the alcohol content in the breath of person 15 is measured;

This version provides the possibility of taking a photograph of the face of person 15 with both cameras 7 and 18. Various control modes are available. In order to increase the volumetric effect, the cross-type mode is used: the light 14a is turned on and the camera 18 takes a photograph, and then the light 14b is turned on and the camera 7 takes a photograph. Two photographs are compared on cloud server 2, different angle shading is recorded; this helps ensuring that a photograph of natural person's face was taken but not of a flat object, e.g., a person's picture. Also, the photography using two video cameras provides more characteristics for comparison and increases the probability of identification of a person.

Facial Recognition Procedure The image is compared to previous photographs using biometric facial recognition technologies and automated identification is made using module 8b of whether it is the same person. In separate cases, facial recognition procedure can be performed on the cloud server 2.

Device Operation Characteristics

All actions of interaction of person 15 with the input terminal 1 are recorded, saved in the memory and stored on the cloud server 2. Person's 15 interaction session with the control device is successful when:

the control device recognises the person 15 and does not record the readings of breathalyzer 10 at all or records the acceptable alcohol content limit established by the administrator;

the control device recognises the person 15 and does not record the readings of breathalyzer 10 at all or records the acceptable alcohol content limit established by the administrator, and the breath temperature was within the range of 33°C to 36°C;

the control device recognises the person 15 and does not record the readings of breathalyzer 10 at all or records the acceptable alcohol content limit established by the administrator, and the difference between the exhaled air humidity and ambient air humidity was recorded;

the control device recognises the person 15 and does not record the readings of breathalyzer 10 at all or records the acceptable alcohol content limit established by the administrator, and the provided acceptable differences between the photographs taken with cameras 7 and 18 were recorded.

All other cases of interaction of person 15 with the control device are exceptional and reported to the administrator. Various information provision methods can be used: text message sent to the administrator, display of information on administrator's access module 3, forwarding of information to other services, etc.

Information processing characteristics. Face photograph taken during the first session of interaction of person 15 with the input terminal 1 is stored in the memory of cloud server 2. Face photograph taken for the second time is biometrically processed and compared to the first biometrically processed face image. Then the face image is compared to the last previously taken image of person's face stored in the memory of cloud server 2.

Detailed operation of the device is shown by the algorithm in fig. 5.

The proposed technical solution is distinguished by a range of features enhancing its characteristics.

In order to ensure that the blown air really belongs to the person 15 (a human being), the change of blown air temperature and/or air humidity is additionally measured: the blown air temperature must be within the range of 33°C to 36°C, and the difference between the humidity of blown air and ambient air must be identified.

In order to identify the person 15 better, his/her photograph is taken at the sufficiently specific distance from the cameras 7, 18 of input terminal 1 ; the size of the image of his/her face must correspond to the frame displayed on the terminal 1 touchscreen 5. When a photograph is taken using two cameras (7, 18) from two angles, there must be some differences between the images (shading, reflections, etc.). When a photograph is taken, the mouthpiece and the nozzle of inlet 10b of breathalyzer 10 must be visible (this is to determine if the mouthpiece was inserted into the nozzle of inlet 10b during the air blowing).

Proposed technical solutions allow the high probability of identification of a person and any fraud and of provision of timely report to the administrator in all exceptional cases, especially those related to alcohol consumption.

The method and device may be relevant for companies and institutions where alcohol consumption in unacceptable. This could be relevant for drivers, electricians, construction workers, etc. The device can be used in stationary and portable environment. The proposed method and device can record the alcohol content in person's breath at the beginning and end of work. Person's working hours are also recorded. Human control is not necessary, thus, the human factor (fraud, errors, etc.) is excluded.

Claims

CLAIMS METHOD AND DEVICE FOR AUTOMATED IDENTIFICATION OF PERSONS AND MEASURING THE ALCOHOL CONTENT IN EXHALED AIR

1. The control method of persons involving the automated identification of a person and control of alcohol content in exhaled air characterized in that it involves the following actions: identifies a person using the RFID card, the person is provided with a possibility to blow the exhaled air into the breathalyzer (10), during the air blowing takes a photograph of the person, performs the facial recognition function, and the RFID card, facial identification and breathalyzer data, as well as the photograph are forwarded to the cloud server (2) via the internet (4); if the alcohol content in the air exhaled by the controlled person is increased, the person cannot pass the checkpoint and the information is forwarded to the administrator; the data is stored (archived) on the cloud server (2) and, if required, transferred to the administrator.

2. Method according to clause 1 wherein the person is identified using the personal identification number.

3. Method according to clause 1 wherein the face photograph is taken when the pressure in the breathalyzer (10) changes (at the beginning of blowing air).

4. Method according to clause 1 wherein the facial recognition function does not require any specially prepared primary photographs; it learns autonomically and responds after the second successful login by a person.

5. Method according to clauses 1-4 wherein the person's breath temperature and/or the person's breath humidity is additionally measured.

6. Method according to clauses 1-6 wherein a photograph of person's face is taken from two sides using two video cameras (7, 18) and applying the cross-type mode: when the right-side light (14b) is on, the left-side video camera (7) takes a photograph, and vice versa - when the left-side light (14a) is on, the right-side video camera (18) takes a photograph.

7. Method according to clauses 1, 6 wherein photographs are taken in such a way that the disposable mouthpiece inserted into the nozzle of inlet (10b) of breathalyzer (10) is visible in images of the face.

8. Person control device consisting of an input terminal (1), cloud server (2), administrator access module (3) and the internet (4), wherein the input terminal (1) consists of a touchscreen (5), speaker (6), video camera (7), main controller (8), GSM/WiFi communication module (9), breathalyzer (10), RFID card reader (11), peripheral device controller (12), and communication module (13); touch-sensitive screen (5), speaker (6) and video camera (7) are interconnected with the main controller (8); breathalyzer (10) and RFID card reader (11) are interconnected with the peripheral device controller (12), which is connected to the main controller (8) via the communication module (13); the device also has two lights (14a, 14b), which are connected and controlled by the peripheral device controller (12).

9. Control device according to clause 8 wherein the input terminal (1) has a common controller, which is interconnected with the touchscreen (5), speaker (6), video camera (7), GSM/WiFi communication module (9), breathalyzer (10) and RFID card reader (11), and also two lights (14a, 14b) are connected and controlled by it.

10. Control device according to clauses 8, 9 wherein the input terminal (1) has a breath temperature measuring device (16) and/or breath humidity measuring device (17) which are interconnected with the peripheral device controller (12) or the main controller and controlled by them.

11. Control device according to clauses 8-10 wherein the input terminal (1) has two video cameras (7, 18) allocated symmetrically at a distance from one another and installed at a short distance above the inlet (10a, 10b) of breathalyzer (10).

12. Control device according to clauses 8-11 characterized in that in the input terminal (1) the breathalyzer (10) inlet (10b) has a nozzle; video camera (7) or two cameras (7, 18) are allocated in such a way that the nozzle of inlet (10b) of breathalyzer (10) and the disposable mouthpiece is in the photo area; the touchscreen (5) has a frame installed that determines the size of face image.