CN218471342U - Image acquisition module and device for verifying identity of vehicle user and vehicle - Google Patents

Abstract

The utility model relates to an image acquisition module for verifying vehicle user identity, image acquisition module is arranged in installing on the vehicle and/or vehicle towards the vehicle externally, and image acquisition module is used for gathering personnel's around the vehicle biological characteristics, a serial communication port, image acquisition module includes: at least one low power first image capture device; at least one high power second image capture device; and control means for controlling the first image capturing means and the second image capturing means such that the first image capturing means continues to operate when the vehicle is in a locked state, and the second image capturing means is only activated when the person is in proximity to the vehicle. The utility model discloses also include an equipment and a vehicle for verifying vehicle user's identity. Through the utility model discloses can provide safe and reliable's vehicle user authentication under the condition that keeps vehicle electric energy consumption low.

Description

Image acquisition module and device for verifying identity of vehicle user and vehicle

Technical Field

The utility model relates to an image acquisition module, an equipment and a vehicle for verifying vehicle user identity.

Background

Biometric identification technology has significant technical advantages in terms of security and convenience compared to conventional authentication means (keys, signal transmitters, certificates, magnetic cards, IC cards, passwords, and the like), and is thus widely used today in the retail industry, smart buildings, and personal digital products. In the field of vehicles, biometric identification technology has hitherto been used only to a very limited extent in vehicles, for example in distinguishing different vehicle users within a vehicle and in monitoring the degree of drowsiness of a driver during driving. However, since most parked vehicles are not supplied with power from the outside, and the usage intervals and frequency of the vehicles depend strongly on the usage habits and travel plans of the vehicle users, the biometric recognition device cannot be kept in operation for a long time in the parked vehicles. This has led to the fact that biometric identification is still very limited in its application to authenticating a vehicle user from outside the vehicle.

SUMMERY OF THE UTILITY MODEL

The utility model aims at providing an image acquisition module, an equipment and a vehicle that is used for verifying vehicle user identity, it can provide safe and reliable's vehicle user authentication under the condition that keeps vehicle electric energy consumption low.

A first aspect of the present invention relates to an image acquisition module for verifying a vehicle user identity, the image acquisition module being for externally mounting on and/or in a vehicle towards the vehicle, and the image acquisition module being for acquiring biometric characteristics of a person around the vehicle, characterized in that the image acquisition module comprises:

at least one low power first image capture device;

at least one high power second image capture device; and

and the control device is used for controlling the first image acquisition device and the second image acquisition device, so that the first image acquisition device continuously operates when the vehicle is in a locked state, and the second image acquisition device is only started when the person approaches to the vehicle.

According to the utility model discloses, in order to gather the biological characteristics of people around the vehicle, the image acquisition module is arranged in installing on the vehicle and/or vehicle towards the vehicle is outside to obtain the image that contains the biological characteristics of people around the vehicle. According to the utility model discloses, an image acquisition module for verifying vehicle user identity has two kinds of image acquisition devices that power is different, wherein, only first image acquisition device is in under the shutting state at the vehicle, i.e. continuously operates when the vehicle is parked. This makes it possible to keep the vehicle electrical energy consumption low, and therefore the image acquisition module can be operated for a long time without excessive consumption of the vehicle battery. Meanwhile, the image acquisition module enables the second image acquisition device with higher power than the first image acquisition device when the person approaches to the vehicle so as to realize accurate biological feature acquisition, thereby ensuring the safety and reliability of vehicle user identity authentication.

According to an embodiment of the invention, the second image acquisition device is only activated when a person suspected to be a vehicle user is close to the vehicle. By means of this embodiment, on the one hand the power consumption of the vehicle can be further reduced, since this further limits the activation of the second image acquisition means, avoiding frequent activation of the second image acquisition means due to parking of the vehicle in a crowded place. On the other hand, since the person suspected to be the vehicle user has been determined to be close to the vehicle on the basis of the image captured by the first image capture device or the biometric feature, this means that the verification of the identity of the vehicle user has already started since the person entered the detection range of the first image capture device, which enables the identification or matching of the biometric feature to take place with the progress of the vehicle user walking towards the door, without having to wait for the authentication to start until the vehicle user stands at the vehicle, in particular at the driver-side door. This can enable the authentication process to be shortened, saving waiting time for the vehicle user, so that the vehicle user can be quickly authenticated through, so that the vehicle user can quickly enter the vehicle and/or quickly start the vehicle.

According to an embodiment of the invention, the first image acquisition device has a lower frame rate and/or resolution than the second image acquisition device. In order to achieve a low power operation of the first image acquisition device, the first image acquisition device may be set to operate at a low frame rate and/or with only a lower resolution. For example, the first image acquisition device has a frame rate of 5fps, 4fps, 2fps, or even 1fps; and/or the first image capture device has a resolution of 1280 × 720, 704 × 576, 352 × 288, or 176 × 144 pixels.

According to an embodiment of the invention, the first image capturing device has a power on the order of milliwatts and the second image capturing device has a power on the order of watts. The first image capture device has, for example, a power of 5 milliwatts, 3 milliwatts, or 1 milliwatt; and the second image acquisition device has, for example, a power of 1 watt, 3 watts, 5 watts or 7 watts.

According to an embodiment of the invention, the first image capturing device has a detection range of 3 to 10 meters, preferably 3 to 5 meters, and the second image capturing device has a detection range of 0.01 to 3 meters, in particular 0.1 to 3 meters, preferably 0.3 to 3 meters, particularly preferably 1 meter. Here, the first image capturing device has, for example, a lens with a focal length of 4mm to 6mm, and the second image capturing device has, for example, a lens with a focal length of 2.8 mm. Without being limited thereto, the first image capturing device and the second image capturing device may have a variable detection distance and/or a variable focal length.

According to an embodiment of the present invention, the biometric feature is a facial feature, a human iris feature, a human retina feature, a fingerprint feature, a palm print feature, a hand shape feature, a hand vein feature, or a human ear feature. In this case, it is conceivable to use the first image detection device and the second image detection device for detecting different biological characteristics. Therefore, double authentication can be realized, and the safety of vehicle user identity authentication is improved.

According to an embodiment of the present invention, the image capturing module is disposed in an a-pillar, a B-pillar, a door outer panel, a roof side, a door handle, or an exterior mirror of a vehicle. In particular, the image acquisition module is arranged in an a-pillar, a B-pillar, a door outer panel, a roof side, a door handle or an exterior rear view mirror of the driver side of the vehicle. Preferably, the image acquisition module is arranged in the driver-side B-pillar, in particular integrated into the B-pillar trim panel.

According to an embodiment of the present invention, the first image pickup device has a field angle in a range of 100 ° to 120 °. In this case, images of persons approaching the vehicle, in particular the driver-side door, from different directions can be captured by such a first image capture device.

According to an embodiment of the invention, the first image acquisition device constitutes for black and white camera, RGB camera or infrared camera, and the second image acquisition device constitutes for RGB camera, infrared camera, structured light camera, binocular camera, time of flight camera, depth camera, fingerprint scanner or iris scanner.

According to the utility model discloses an embodiment, image acquisition module includes photometric element and/or infrared light source. In order to ensure that the images of the first image capturing element and the second image capturing element are not overexposed or underexposed, a photometric element for determining the illumination condition is preferably provided to optimally adjust the parameters of the respective image capturing elements. In order to collect images under insufficient light or dark conditions, an infrared light source for light supplement can be arranged.

According to an embodiment of the present invention, the first image capturing device and the second image capturing device are integrally provided. For example, the first image capturing device and the second image capturing device may be disposed in the same housing. It is also possible for the first image detection device and the second image detection device to be integrated as two cameras of the same binocular camera. For this purpose, one of the cameras can be operated at low power, in particular at a low frame rate and/or at low resolution, by controlling the parameter configuration. It is also conceivable that the first image detection element and the second image detection element are integrated into one image detection element, wherein the first image detection element is designed to enable only a partial implementation of a CMOS or CCD photosensitive element in the image detection element, and correspondingly the second image detection element is designed to operate as a full function of the image detection element.

A second aspect of the present invention relates to an apparatus for verifying the identity of a vehicle user, the apparatus comprising:

according to the utility model discloses an image acquisition module for verifying vehicle user identity of first aspect;

a storage module for storing the biometric features;

the matching module is used for matching the biological characteristics acquired by the image acquisition module with the biological characteristics stored in the storage module in advance; and

and the output module is used for outputting a vehicle user identity verification conclusion and/or a control instruction based on the matching result of the matching module.

Through the utility model discloses an equipment for verifying vehicle user identity can provide safe and reliable's vehicle user authentication under the condition that keeps vehicle electric energy consumption low.

It should be noted that each module in the device for verifying the identity of the vehicle user can be implemented according to a known algorithm or protocol using existing hardware conditions in combination with existing programming means. The matching module may be configured as a lightweight GPU, ASIC, DSP, or FPGA hardware chip, for example, into which a feature extraction, matching, or recognition algorithm (e.g., a face recognition algorithm) that is well known in the art is integrated.

Furthermore, the memory module can store the biometrics of a plurality of vehicle users authorized to use the vehicle, so that different vehicle users can be authenticated and identified by the device for authenticating the identity of vehicle users.

According to one embodiment, the second image acquisition means of the image acquisition module is arranged to be activated on the basis of a matching result of the biometric characteristic acquired by the first image acquisition means of the image acquisition module with a pre-stored biometric characteristic. Here, the image captured by the first image capturing device may be input into the matching module in real time, and the control device of the image capturing module controls the activation of the second image capturing device according to the matching result calculated by the matching module.

According to one embodiment, the second image acquisition means of the image acquisition module is arranged to be activated if the degree of matching of the biometric characteristic acquired by the first image acquisition means with a pre-stored biometric characteristic exceeds a predetermined matching threshold.

According to one embodiment, the matching threshold is 40%, 50% or 60%.

According to one embodiment, the output module is configured to output to a central controller or a door control device of the vehicle. The output module may, for example, directly output a control command to the door control device in order to control the unlocking of the door. Thus enabling biometric-based keyless entry for the vehicle user. The output module can also output the vehicle user authentication conclusion to a central controller of the vehicle, and then the central controller sends an unlocking instruction to the vehicle door control device. In this case, it is also advantageous if the central control unit outputs commands to other components of the vehicle. For example, a start command is output to the vehicle drive device, thereby enabling a biometric-based keyless start of the vehicle user. It is also advantageous that the central controller personalizes the vehicle user on a targeted basis based on the identity of the vehicle user who has passed the verification, such as turning on the air conditioning unit, turning on the vehicle audio, adjusting the seat, illuminating the ambience light, setting the infotainment system interface, etc.

A third aspect of the present invention relates to a vehicle, the vehicle comprises according to the present invention in its first aspect the image acquisition module for verifying the identity of a vehicle user and/or according to the present invention in its second aspect the device for verifying the identity of a vehicle user.

To each embodiment, function, advantage and effect according to an aspect of the invention also be applicable in a corresponding way according to other aspects of the invention.

Other features of the invention will be apparent from the accompanying drawings and from the detailed description of the invention. All the features and feature combinations mentioned above in the description and also features and feature combinations mentioned below in the detailed description and/or shown in the drawings individually can be used not only in the respectively indicated combination but also in other combinations or in the individual case.

Drawings

FIG. 1 shows a schematic block diagram of one embodiment of an image acquisition module for verifying the identity of a vehicle user in accordance with the present invention;

fig. 2 shows a schematic front view of an embodiment of an image acquisition module for verifying the identity of a vehicle user according to the present invention;

FIG. 3 shows a schematic block diagram of another embodiment of an image acquisition module for verifying the identity of a vehicle user in accordance with the present invention;

fig. 4 shows a schematic front view of another embodiment of an image acquisition module for verifying the identity of a vehicle user according to the present invention;

fig. 5 shows a schematic layout of an image acquisition module for verifying the identity of a user of a vehicle on a vehicle according to the invention;

FIG. 6 shows a schematic block diagram of one embodiment of an apparatus for verifying the identity of a vehicle user in accordance with the present invention;

fig. 7 shows a schematic block diagram of an embodiment of a vehicle according to the invention; and

fig. 8 shows a schematic block diagram of another embodiment of a vehicle according to the invention.

Detailed Description

Fig. 1 shows a schematic block diagram of an embodiment of an image acquisition module 1 for verifying the identity of a vehicle user according to the present invention. Here, an image capturing module 1 for verifying the identity of a vehicle user is intended to be mounted on and/or in a vehicle towards the outside of the vehicle, and the image capturing module 1 is intended to capture the biometric features of persons around the vehicle, characterized in that the image capturing module 1 comprises:

at least one low-powered first image acquisition device 2;

at least one second image acquisition device 3 of high power; and

control means 4 for controlling the first image capturing means 2 and the second image capturing means 3 such that the first image capturing means 2 is continuously operated in a locked state of the vehicle and the second image capturing means 3 is activated only when the person is close to the vehicle.

As shown in fig. 1, the control device 4 is in signal connection with the first image capturing device 2 and the second image capturing device 3 to control the operation, activation and deactivation of the first image capturing device 2 and the second image capturing device 3, respectively. The second image acquisition means 3 are only activated when the person is close to the vehicle. In order to detect whether a person approaches the vehicle, the image acquired by the first image acquisition device 2 may be subjected to image analysis according to a known human body detection algorithm, human face detection algorithm, human body distance detection algorithm, and human face distance detection algorithm, using existing hardware conditions and combining with existing programming means. Preferably, a lightweight GPU, ASIC, DSP or FPGA hardware chip integrated with the above-mentioned functions in the prior art may be considered. Without being limited thereto, it is also conceivable to use simple electrical components such as an infrared sensor, a distance measuring sensor, a proximity switch, and the like to determine whether or not there is a condition for activating the second image pickup device 3.

In particular, the second image acquisition means 3 are only activated when a person suspected to be a user of the vehicle is close to the vehicle. The activation of the second image detection device 3 can be determined, for example, by evaluating the image captured by the first image capture device 2: whether a person in proximity to the vehicle is suspected of being a vehicle user or whether the person has a certain degree of match with one of the vehicle users. To achieve this, the images acquired by the first image acquisition device 2 can likewise be subjected to image analysis according to known algorithms using existing hardware conditions in combination with existing programming means. The method can be realized by applying algorithms such as human body detection, human face recognition, human body distance detection, human face distance detection and the like mature in the prior art.

By means of according to the utility model discloses an image acquisition module 1 for verifying vehicle user identity can provide reliable image data for authentication under the condition that keeps vehicle electric energy consumption low to realize safe and reliable's vehicle user authentication.

Preferably, the first image acquisition device 2 may have a lower frame rate and/or resolution than the second image acquisition device 3. Further preferably, the first image capturing device 2 may have a power on the order of milliwatts, while the second image capturing device 3 may have a power on the order of watts. In particular, the first image detection means 2 may have a detection range of 3 to 10 meters, in particular 3 to 5 meters, while the second image detection means 3 may have a detection range of 0.3 to 3 meters, in particular 1 meter. It is also preferred that the first image pickup device 2 has a field angle in the range of 100 ° to 120 °. Here, the biometric characteristic detected by the first image capture device 2 and the second image capture device 3 may be a facial characteristic, a human iris characteristic, a human retina characteristic, a fingerprint characteristic, a palm print characteristic, a hand shape characteristic, a hand vein characteristic, or a human ear characteristic.

Fig. 2 shows a schematic front view of an embodiment of an image acquisition module 1 for verifying the identity of a vehicle user according to the invention. The image capturing module 1 is provided toward the outside of the vehicle on the side shown in fig. 2 to capture biometrics of people around the vehicle. Fig. 2 shows a first image detection element 2 and a second image detection element 3 arranged next to one another. Here, the approximate positions of the first image pickup device 2 and the second image pickup device 3 are schematically represented by lenses of the image pickup devices. Preferably, the first image capturing device 2 is configured as a black-and-white camera, an RGB camera or an infrared camera, and the second image capturing device 3 is configured as an RGB camera, an infrared camera, a structured light camera, a binocular camera, a time-of-flight camera, a depth camera, a fingerprint scanner or an iris scanner. It is also conceivable that the first image acquisition means 2 and the second image acquisition means 3 are provided integrally.

Fig. 3 shows a schematic block diagram of another embodiment of an image acquisition module 1' for verifying the identity of a vehicle user according to the present invention. In this case, the image recording module 1' comprises, in addition to the components shown in fig. 1, a photometric element 5 for determining the lighting conditions and an infrared light source 6 for light compensation.

Fig. 4 shows a schematic front view of another embodiment of an image acquisition module 1' for verifying the identity of a vehicle user according to the invention. Here, the photometric element 5 and the infrared light source 6 are disposed between the first image capture device 2 and the second image capture device 3. Without being limited thereto, a plurality of light measuring elements 5 and/or a plurality of infrared light sources 6 may also be provided, and other arrangements of the light measuring elements 5 and the infrared light sources 6 may be considered.

Fig. 5 shows a schematic layout of an image acquisition module 1 for verifying the identity of a vehicle user on a vehicle 7 according to the invention. In fig. 5, the image capture module 1 is disposed in the B-pillar of the vehicle 7 and faces the outside of the vehicle. However, it is also conceivable to arrange the image acquisition module 1 in an a-pillar, a door outer panel, a roof side, a door handle or an exterior mirror.

Fig. 6 shows a schematic block diagram of an embodiment of an apparatus 8 for verifying the identity of a vehicle user according to the invention. The device 8 for verifying the identity of a vehicle user comprises:

an image acquisition module 1 for verifying the identity of a vehicle user according to the present invention;

a storage module 9 for storing the biometric features;

a matching module 10 for matching the biometric features acquired by the image acquisition module 1 with biometric features previously stored in the storage module 9; and

an output module 11 for outputting vehicle user authentication conclusions and/or control instructions based on the matching result of the matching module 10.

The connection between the modules in the device 8 for verifying the identity of the vehicle user and the connection of the matching module 10 to the components of the image acquisition module 1 are also shown in fig. 6 as an example. In this case, the first image capturing device 2 and the second image capturing device 3 in the image capturing module 1 may each be connected to the matching module 10 for providing the captured image or biometric characteristic to the matching module 10.

Here, the matching module 10 may be configured as a light-weight GPU, ASIC, DSP, or FPGA hardware chip into which a feature extraction, matching, or recognition algorithm (e.g., a face recognition algorithm) that is well known in the art is integrated, for example.

In particular, a particularly advantageous arrangement is shown in fig. 6. The matching module 10 may be connected with the control means 4 of the image acquisition module 1 for providing the control means 4 with a matching result between the biometric characteristic acquired by the first image acquisition means 2 and a pre-stored biometric characteristic in order for the control means 4 to enable the second image acquisition means 3 based on the matching result. Preferably, the second image acquisition means 3 of the image acquisition module 1 is arranged to be activated in case the degree of matching of the biometric characteristic acquired by the first image acquisition means 2 with a pre-stored biometric characteristic exceeds a predetermined matching threshold. The matching threshold may be set at 40%, 50% or 60%.

Fig. 7 shows a schematic block diagram of an embodiment of a vehicle 7 according to the invention. The output module 11 of the device 8 for verifying the identity of the vehicle user is connected to a door control device 12 of the vehicle 7 for outputting a control command for unlocking the door and/or a vehicle user authentication conclusion to the door control device 12. The device 8 for verifying the identity of the vehicle user thus unlocks the vehicle door for the vehicle user when the vehicle user is verified, in particular if the degree of matching of the biometric features captured by the second image capture means 3 with the previously stored biometric features exceeds a threshold value of, for example, 90%. Thus enabling biometric-based keyless entry for the vehicle user.

Fig. 8 shows a schematic block diagram of another embodiment of a vehicle according to the invention. Here, the output module 11 of the device 8 for verifying the identity of the vehicle user is connected to a central controller (ECU) 13 of the vehicle 7 for outputting a vehicle user authentication conclusion to the central controller 13. The central control unit 13 is in turn connected to the door control device 12, the drive device 14 and the personalization device 15. Thus, the central controller 13 issues an unlock instruction to the door control device 12 after receiving the vehicle user authentication conclusion. Advantageously, the central control 13 also outputs commands to the drive means 14 and to the personalisation means 15 of the vehicle. For example, a start command is output to the vehicle drive device 14, thereby enabling a biometric-based keyless start of the vehicle user. It is also possible that the central controller 13 specifically personalizes the vehicle user based on the verified vehicle user identity, such as turning on an air conditioning unit, turning on a vehicle audio, adjusting a seat, illuminating an ambience light, setting an infotainment system interface, etc.

The present invention is not limited to the embodiments shown but includes or extends to all technical equivalents that may fall within the scope and spirit of the appended claims. The positional references selected in the description, such as, for example, upper, lower, left, right, etc., refer to the direct description and to the illustrated drawings and can be transferred to new positions in the event of a change in position.

The features disclosed in the present document can be essential for the implementation of the embodiments in terms of different embodiments and can be implemented both individually and in any combination.

Although the present invention has been disclosed in the preferred embodiments, it is not intended to limit the present invention, and any person skilled in the art can use the above-mentioned method and technical contents to make possible changes and modifications to the technical solution of the present invention without departing from the spirit and scope of the present invention, therefore, any simple modification, equivalent changes and modifications made to the above embodiments by the technical substance of the present invention all belong to the protection scope of the technical solution of the present invention.

Claims (17)

1. Image acquisition module for verifying the identity of a user of a vehicle, said image acquisition module being intended to be mounted on and/or in the vehicle towards the outside of the vehicle and being intended to acquire biological characteristics of persons around the vehicle, characterized in that it comprises:

at least one low power first image capture device;

at least one high power second image capture device; and

control means for controlling the first image capturing means and the second image capturing means such that the first image capturing means continues to operate when the vehicle is in a locked state and the second image capturing means is only activated when the person is in proximity to the vehicle.

2. An image acquisition module according to claim 1, characterized in that the second image acquisition means are only activated when a person suspected to be a user of the vehicle is close to the vehicle.

3. Image acquisition module according to claim 1 or 2, characterized in that the first image acquisition device has a lower frame rate and/or resolution than the second image acquisition device.

4. An image acquisition module according to claim 1 or 2, characterized in that the first image acquisition device has a power in the order of milliwatts and the second image acquisition device has a power in the order of watts.

5. Image acquisition module according to claim 1 or 2, characterized in that the first image acquisition device has a detection distance of 3 to 10 meters and the second image acquisition device has a detection distance of 0.01 to 3 meters.

6. The image capture module of claim 1 or 2, wherein the biometric feature is a facial feature, a human iris feature, a human retina feature, a fingerprint feature, a palm print feature, a hand shape feature, a hand vein feature, or a human ear feature.

7. The image acquisition module according to claim 1 or 2, characterized in that the image acquisition module is arranged in an a-pillar, a B-pillar, an outer door panel, a roof side, a door handle or an exterior rear view mirror of a vehicle.

8. Image acquisition module according to claim 1 or 2, characterized in that the first image acquisition device has a field angle in the range of 100 ° to 120 °.

9. The image acquisition module according to claim 1 or 2, characterized in that the first image acquisition device is configured as a black-and-white camera, an RGB camera or an infrared camera and the second image acquisition device is configured as an RGB camera, an infrared camera, a structured light camera, a binocular camera, a time-of-flight camera, a depth camera, a fingerprint scanner or an iris scanner.

10. The image acquisition module according to claim 9, characterized in that it comprises a photometric element and/or an infrared light source.

11. The image capturing module of claim 1 or 2, wherein the first image capturing device and the second image capturing device are integrally provided.

12. Apparatus for verifying the identity of a vehicle user, the apparatus comprising:

image acquisition module for verifying the identity of a user of a vehicle according to one of claims 1 to 11;

a storage module for storing the biometric features;

the matching module is used for matching the biological characteristics acquired by the image acquisition module with the biological characteristics stored in the storage module in advance; and

and the output module is used for outputting a vehicle user identity verification conclusion and/or a control instruction based on the matching result of the matching module.

13. The apparatus of claim 12, wherein the second image capture device of the image capture module is configured to be enabled based on a match of the biometric characteristic captured by the first image capture device of the image capture module with a pre-stored biometric characteristic.

14. The apparatus of claim 13, wherein the second image capturing device of the image capturing module is configured to be enabled if the biometric characteristic captured by the first image capturing device matches a pre-stored biometric characteristic by more than a predetermined match threshold.

15. The apparatus of claim 14, wherein the matching threshold is 40%, 50%, or 60%.

16. An apparatus according to any one of claims 12 to 15, wherein the output module is arranged to output to a central controller or door control of the vehicle.

17. Vehicle comprising an image acquisition module for verifying the identity of a vehicle user according to one of claims 1 to 11 and/or an apparatus for verifying the identity of a vehicle user according to one of claims 12 to 16.

Images