CN111210375A - Multi-functional portable wisdom security protection all-in-one - Google Patents
Multi-functional portable wisdom security protection all-in-one Download PDFInfo
- Publication number
- CN111210375A CN111210375A CN201911184580.3A CN201911184580A CN111210375A CN 111210375 A CN111210375 A CN 111210375A CN 201911184580 A CN201911184580 A CN 201911184580A CN 111210375 A CN111210375 A CN 111210375A
- Authority
- CN
- China
- Prior art keywords
- wireless communication
- communication unit
- image
- security
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004891 communication Methods 0.000 claims abstract description 63
- 238000012545 processing Methods 0.000 claims abstract description 55
- 238000007689 inspection Methods 0.000 claims abstract description 9
- 238000012795 verification Methods 0.000 claims description 21
- 238000000605 extraction Methods 0.000 claims description 18
- 238000000034 method Methods 0.000 claims description 11
- 238000004364 calculation method Methods 0.000 claims description 10
- 238000003708 edge detection Methods 0.000 claims description 7
- 239000000284 extract Substances 0.000 claims description 6
- 239000011159 matrix material Substances 0.000 description 6
- 238000001914 filtration Methods 0.000 description 4
- 238000013473 artificial intelligence Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000009499 grossing Methods 0.000 description 2
- 241001622623 Coeliadinae Species 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 230000005764 inhibitory process Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/26—Government or public services
- G06Q50/265—Personal security, identity or safety
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F15/00—Digital computers in general; Data processing equipment in general
- G06F15/02—Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators
- G06F15/0208—Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators for combination with other devices having a different main function, e.g. watches, pens
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F15/00—Digital computers in general; Data processing equipment in general
- G06F15/02—Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators
- G06F15/025—Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators adapted to a specific application
- G06F15/0283—Digital computers in general; Data processing equipment in general manually operated with input through keyboard and computation using a built-in program, e.g. pocket calculators adapted to a specific application for data storage and retrieval
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Tourism & Hospitality (AREA)
- Educational Administration (AREA)
- Development Economics (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses a multifunctional portable intelligent security all-in-one machine, which comprises: the acquisition module and the touch display screen are arranged outside the machine body, and the central processing unit and the wireless communication unit are arranged inside the machine body; the acquisition module is arranged on the back of the machine body and is connected with the central processing unit and the wireless communication unit; the central processing unit is connected with the acquisition module and the wireless communication unit; the wireless communication unit 4 is connected with the central processing unit and the touch display screen; the touch display screen is arranged on the front surface of the machine body and connected with the acquisition module and the wireless communication unit. The system is small in size, convenient to carry and wide in application range, and public security or security personnel can hold the system to perform security and protection on-duty inspection, can immediately display and read corresponding recorded data for each shot person and vehicle, provides sufficient convenience for security and protection work, and can quickly check the identity of the person concerned, and improves the working efficiency.
Description
Technical Field
The invention relates to the technical field of intelligent security, in particular to a multifunctional portable intelligent security all-in-one machine.
Background
Public security policemen or police assistants and security guards perform security guard duty and check, terrorists or wanted criminal suspects can be prevented, and vulnerable groups such as lost old people and children can be found and assisted in time; meanwhile, irregular illegal behaviors such as parking in disorder and the like can be corrected.
However, the existing security work depends on manual inspection, observation and inquiry, and on personal memory and work experience, so that the error rate is high, a lot of bugs exist, the efficiency is low, and a lot of time and manpower are spent.
Therefore, how to improve the efficiency and accuracy of security and save the security cost is a problem to be solved urgently by practitioners of the same industry.
Disclosure of Invention
In view of the above problems, the present invention aims to solve the problems that the existing security work depends on manual inspection, observation and inquiry, depends on personal memory and work experience, has high error rate, has many bugs, is low in efficiency, and takes a lot of time and manpower.
The embodiment of the invention provides a multifunctional portable intelligent security all-in-one machine, which comprises: the acquisition module and the touch display screen are arranged outside the machine body, and the central processing unit and the wireless communication unit are arranged inside the machine body;
the acquisition module is arranged on the back of the body, connected with the central processing unit and the wireless communication unit, and used for acquiring shot video pictures, sending the video pictures to the central processing unit, acquiring a human face 3D image and figure identity information, and sending the human face 3D image and the figure identity information to the wireless communication unit;
the central processing unit is connected with the acquisition module and the wireless communication unit and is used for extracting relevant information in a video picture and sending the relevant information to the wireless communication unit;
the wireless communication unit is connected with the central processing unit, the acquisition module and the touch display screen, and is used for transmitting the related information, the 3D human face image and the person identity information to a security background server and sending the recorded data and the person identity verification result received from the security background server to the touch display screen;
the touch display screen is arranged on the front surface of the machine body, is connected with the wireless communication unit and is used for receiving and displaying the recorded data and the figure identity verification result sent by the wireless communication unit.
In one embodiment, the acquisition module includes: the system comprises a video camera, an infrared structure light emitter, an infrared receiver, an image processing chip and an identity card reader; the video camera is connected with the image processing chip and is used for shooting a face image and sending the face image to the image processing chip;
the infrared structure light emitter is used for emitting an infrared light source to the surface of the human face;
the infrared receiver is connected with the image processing chip and used for acquiring the face spatial information according to the infrared light source reflected by the face surface and sending the face spatial information to the image processing chip;
the image processing chip is connected with the video camera, the infrared receiver and the touch display screen, the face image and the face spatial information are collected, a face 3D image is generated through calculation, and the face 3D image is sent to the wireless communication unit;
the identity card swiping device is connected with the wireless communication unit and used for acquiring identity information of people and sending the identity information to the wireless communication unit.
In one embodiment, the central processor includes: the system comprises a target extraction module, a target identification module, a face identification module and a number plate identification module;
the target extraction module is connected with the video camera and used for extracting independent targets from the video pictures;
the target identification module is connected with the target extraction module and is used for judging whether the independent target belongs to a character type or a vehicle type;
the face recognition module is connected with the target recognition module and used for extracting face characteristic information of the independent target belonging to the figure type;
the number plate identification module is connected with the target identification module and used for positioning and extracting the vehicle number plate information of the independent target belonging to the vehicle type.
In one embodiment, the target extraction module includes:
and the target extraction module adopts a closed edge detection mode to extract independent targets in the video picture.
In one embodiment, the object recognition module includes:
and the target identification module judges whether the independent target belongs to the character type and the vehicle type through a matching algorithm.
In one embodiment, further comprising: a security background server;
the security background server is connected with the wireless communication unit, acquires related recorded data according to related information of the central processing unit, verifies the identity of a person according to the 3D image of the face and the identity information of the person, and sends the recorded data and the verification result of the identity of the person to the wireless communication unit.
In one embodiment, the touch display screen includes:
and the recorded data is displayed in a floating frame mode in an overlapping mode around an independent target in an actual video picture.
Based on the above purpose, in a second aspect of the present application, a method for using a multifunctional portable intelligent security all-in-one machine is further provided, including:
the video camera shoots a video picture and sends the video picture to the central processing unit;
the central processing unit extracts relevant information in the video picture and sends the relevant information to a security background server through a wireless communication unit;
the security background server calls related recorded data according to the related information and sends the recorded data to the touch display screen through the wireless communication unit;
the touch display screen displays the recorded data, and security personnel perform security inspection through the recorded data.
In one embodiment, further comprising:
shooting a face image through the video camera, and sending the face image to an image processing chip;
the infrared structure light emitter emits an infrared light source to the surface of the human face;
the infrared receiver receives the infrared light source reflected by the surface of the human face, obtains human face spatial information and sends the human face spatial information to the image processing chip;
the image processing chip calculates and generates a human face 3D image by collecting the human face image and the human face spatial information, and sends the human face 3D image to the security background server through the wireless communication unit;
the identity card of the person is subjected to card swiping verification through the identity card swiping device, identity information of the person is obtained, and the identity information of the person is sent to the security background server through the wireless communication unit;
the security background server verifies the identity of the person according to the human face 3D image and the person identity information, and sends a person identity verification result to the touch display screen through a wireless communication unit;
and the security personnel checks the character through the character authentication result displayed by the touch display screen.
In one embodiment, the central processor extracts relevant information in the video pictures, including:
extracting an independent target in the video picture through a scene object extraction module;
classifying the independent targets into object types and vehicle types through a scene object classification module;
extracting the characteristic information of a human face region by the human face recognition module of the independent target object of the character type;
the independent target of the vehicle type is positioned and the vehicle number plate information is extracted through the number plate identification module.
The technical scheme provided by the embodiment of the invention has the beneficial effects that at least:
the multifunctional portable intelligent security all-in-one machine provided by the embodiment of the invention has the advantages of small volume, convenience in carrying, wide application range and low cost. And the public security or security personnel can hold the system to perform security on-duty inspection, corresponding recorded data can be immediately displayed and read for each shot person and vehicle, sufficient convenience is provided for security work, the identity of the person concerned can be rapidly checked, and the working efficiency and the accuracy are improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a block diagram of a multifunctional portable intelligent security all-in-one machine according to an embodiment of the present invention;
FIG. 2 is a rear view of a multifunctional portable intelligent security all-in-one machine according to an embodiment of the present invention;
FIG. 3 is a front view of a multifunctional portable intelligent security all-in-one machine according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a display image of a touch display screen according to an embodiment of the present invention;
FIG. 5 is a flowchart of a method for using a multifunctional portable intelligent security all-in-one machine according to an embodiment of the present invention;
FIG. 6 is a flowchart illustrating the identity authentication of the multifunctional portable intelligent security all-in-one machine according to the embodiment of the present invention;
fig. 7 is a flowchart of step S502 according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Referring to fig. 1 to 3, an embodiment of the present invention provides a multifunctional portable intelligent security all-in-one machine, including: the device comprises an acquisition module 1 arranged outside the machine body, a touch display screen 2, a central processing unit 3 arranged inside the machine body and a wireless communication unit 4;
the acquisition module 1 is arranged on the back of the machine body, is connected with the central processing unit 3 and the wireless communication unit 4, and is used for acquiring a shot video picture (shooting a video picture in a certain space range in front of the multifunctional portable intelligent security all-in-one machine), sending the video picture to the central processing unit 3, acquiring a human face 3D image and figure identity information, and sending the human face 3D image and the figure identity information to the wireless communication unit 4;
the central processor 3 is connected with the acquisition module 1 and the wireless communication unit 4, and is used for extracting relevant information in a video picture and sending the relevant information to the wireless communication unit 4;
the wireless communication unit 4 is connected with the central processing unit 3, the acquisition module 1 and the touch display screen 2, and is used for transmitting the related information, the 3D human face image and the person identity information to the security background server 14 and sending the recorded data and the person identity verification result received from the security background server 14 to the touch display screen 2;
the touch display screen 2 is arranged on the front face of the machine body, is connected with the wireless communication unit 4, and is used for receiving and displaying the recorded data and the person identity verification result sent by the wireless communication unit 4.
Wherein the recorded data is displayed in a floating frame manner in an overlapping manner around the independent target in the actual video picture.
Specifically, within a certain picture range around each person and vehicle object, preferentially detecting an area without other objects and placing the floating frame; if the area is not available, an area with the minimum area of the overlapping area with other targets is detected, the floating frame is placed, and the floating frame adopts a semitransparent frame body. As shown in fig. 4, the region of the character target king five has the character target of which six and the character target of which three, and the overlapping area of the region of which six and the king five region is detected to be the smallest, so that the translucent floating frame of the character king five is arranged in the region close to which six.
In this embodiment, policeman, auxiliary police or security personnel can hold this system and carry out the security protection operation, and this system is small, conveniently carries, and application scope is wide, and is with low costs. And the public security or security personnel can hold the system to perform security on-duty inspection, corresponding recorded data can be immediately displayed and read for each shot person and vehicle, sufficient convenience is provided for security work, the identity of the person concerned can be rapidly checked, and the working efficiency and the accuracy are improved.
In one embodiment, the acquisition module 1 includes: the system comprises a video camera 5, an infrared structure light emitter 6, an infrared receiver 7, an image processing chip 8 and an identity card reader 9;
the video camera 5 is connected with the image processing chip 8 and is used for shooting a face image and sending the face image to the image processing chip 8; the face image shot by the video camera 5 is a 2D color image.
The infrared structure light emitter 6 is used for emitting an infrared light source to the surface of the human face.
The infrared receiver 7 is connected to the image processing chip 8, and is configured to obtain the face spatial information according to the infrared light source reflected by the face surface, and send the face spatial information to the image processing chip 8.
Specifically, the infrared structure light emitter 6 and the infrared receiver 7 work in a combined mode, the infrared structure light emitter 6 projects and sends out 3 thousands of specific coded infrared light spots to the face, the infrared light spots are reflected by the face and return to the infrared receiver 7, the infrared receiver 7 reads dot matrix patterns, the face infrared images are captured, depth of field information of the face is obtained, and the data are sent to the chip database for calculation.
The image processing chip 8 is connected to the video camera 5, the infrared receiver and the touch display screen 2, collects the face image and the face spatial information, generates a face 3D image by using an AI depth algorithm according to the face image and the face spatial information (i.e., face depth information), and sends the face 3D image to the wireless communication unit 4.
The AI depth algorithm comprises the following steps:
1. an AI dot matrix model algorithm, namely an artificial intelligence learning dot matrix model, and rapidly identifying the optimal structured light speckle pattern;
2. an AI dot matrix fault-tolerant algorithm, namely artificial intelligence learning ring dot matrix distribution, improving fault-tolerant capability, wherein the transverse resolution precision is x millimeters, and the depth resolution precision is less than 1 millimeter;
3. an AI precision self-calibration algorithm, namely, artificial intelligence learning measurement precision, and self-adaptive calibration in daily use to realize optimal precision.
The identity card reader 9 is connected with the wireless communication unit 4 and used for acquiring identity information of people and sending the identity information to the wireless communication unit 4.
In this embodiment, when the focused examination is performed on the concerned person found in the security, the concerned person may be required to present the identity card for card swiping verification, and the 3D features of the face are collected, so that the person-card integrated examination and the three-dimensional face identification are realized. And moreover, 3D structured light and AI depth algorithm is utilized, so that unlocking can be quickly performed in a dark environment, the identification accuracy is higher, quick identification can be performed, related people can be quickly checked, and the working efficiency is improved.
In one embodiment, the central processor 3 includes: the system comprises a target extraction module 10, a target recognition module 11, a face recognition module 12 and a license plate recognition module 13;
the object extraction module 10 is connected to the video camera 5, and is configured to extract an independent object from the video frame (each person, vehicle, building, tree, etc. appearing in the video frame may be an independent object).
Specifically, the target extraction module 10 extracts the independent target in the video image by using a closed edge detection method, and a specific algorithm may adopt the following method:
① edge detection using Sobel operator, the specific steps are as follows:
A. respectively moving the two directional templates from one pixel to another pixel along the image, and enabling the central pixel of the template to coincide with a certain pixel position in the image;
B. multiplying the coefficients within the template with their corresponding image pixel values;
C. adding all products;
D. assigning the maximum value of the two convolutions to a pixel corresponding to the center position of the template in the image as a new gray value of the pixel;
E. and taking a proper threshold value TH, and if the new gray value of the pixel is more than or equal to TH, judging the pixel point as an edge point.
② edge detection using LOG operator (which is an optimal filter for obtaining detected edge by using image signal-to-noise ratio), the method comprises the following steps:
A. and performing low-pass smoothing filtering on the image through a Gaussian function, wherein the Gaussian function is as follows:
wherein, σ represents the standard deviation of the Gaussian filter and is used for reflecting the smoothness degree of the image; low-pass filtering the image f (x, y) to obtain f (x, y) × G (x, y, σ);
B. high-pass filtering is performed by a Laplacia operator as follows:
wherein the content of the first and second substances,
expressing LOG operator, and obtaining the following formula through calculation:
in the above formula, x, y is-I, …, -1,0,1, … I, I ∈ [1, ∞), σ represents a scale space constant of a gaussian distribution, and the size of the LOG operator is set to be
C. Edges of the image are detected using second derivative zero crossings.
③ edge detection using Canny operator, the specific steps are as follows:
A. filtering the image f (x, y) with a gaussian function to obtain a smoothed data array, as shown in the following equation:
S(x,y)＝f(x,y)*G(x,y,σ)
wherein σ represents a dispersion parameter of the gaussian formula, reflecting the degree of smoothing;
B. for gradient calculation, the gradient of the smoothed data array S (x, y) can be approximated by a 2 × 2 first order finite difference approximation to calculate two arrays P (x, y) and Q (x, y) of x and y partial derivatives, as shown below:
P(x,y)≈(S(x,y+1)-S(x,y)+S(x+1,y+1)-S(x+1,y))/2
Q(x,y)≈(S(x,y)-S(x+1,y)+S(x,y+1)-S(x+1,y+1))/2
C. calculating the inverse partial gradients of the same point x and y in the image, wherein the amplitude and azimuth are respectively as follows:
θ(x,y)＝arctan(Q(x,y)/P(x,y))
D. and (3) carrying out non-maximum value suppression, calculating the gradient amplitude of two adjacent pixels in the pixel gradient direction for each pixel on the image M (x, y), wherein if the gradient amplitude of the current pixel is not less than the two values, the current pixel can be an edge point, otherwise, the gradient amplitude of the pixel is a non-edge pixel. Thinning the image edge into a pixel width, and obtaining an image NMS (x, y) from the gradient amplitude image M (x, y) through non-maximum value inhibition;
E. and performing double-threshold detection and edge connection, namely extracting edges by using a high threshold Th and a low threshold TI, obtaining strong edge points and weak edge points of edge images through a high threshold value and a low threshold value respectively for each pixel point of the NMS (x, y), tracking the edges in the strong edge points, searching the edge points in the corresponding positions of the weak edge points of the images to connect the breaks in the strong edge points when the edges reach a terminal point, continuously searching and tracking the edges, and connecting the breaks of the edges in the strong edge points of the high threshold value images.
The target identification module 11 is connected to the target extraction module 10, and is configured to determine whether the independent target belongs to a person type or a vehicle type.
Specifically, the target identification module 11 determines, through a matching algorithm, whether the independent target belongs to a person type or a vehicle type.
The shape of the independent object is used to perform matching calculation with the shape templates of the person and the vehicle, for example, the specific steps of performing matching calculation with the shape template of the vehicle are as follows:
(1) assume there are c vehicle types w1，w2…wcSelecting a certain number of form template samples of representative vehicles;
(2) presetting threshold values lambda and T1、T2And T3And T is1<T2<T3；
(3) Is a vehicle type w1，w2…wcRespectively defining a counting value Num1,Num2…NumcAnd is initialized to a value of zero, NumiSetting a temporary storage vector D when the value is 0;
(4) selecting a template sample xij(it isWhere i, j denote belonging to type wiThe jth sample) as the current comparison sample;
(5) calculating the position sample x and the current comparison sample xijThe specific formula of the distance between the samples of the flowers is as follows:
if d (x, x)ij)≤T1Then the decision x ∈ w1And finishing the calculation;
if T is1<d(x,xij) And d (x, x)ij)≤T3Then the vehicle type wiCount Num ofiAccumulation, i.e. Numi＝Numi+1, and d (x, x)ij) Storing the obtained product in D; otherwise, performing the step (6);
(6) if all the template samples are convenient to play, entering the step (7), otherwise, taking the next template sample as the current comparison sample, and entering the step (5);
(7) counting the distance between each class and the position sample x at a threshold value T1And T3Sample count Num in betweeniTotal number of samples satisfying the three-threshold constraint
If Num1＝max(Numi) And Num1>Num x lambda, then x belongs to w1(ii) a Otherwise, the identification is rejected.
The face recognition module 12 is connected to the target recognition module 11, and is configured to extract face feature information of the independent target belonging to the person type.
The number plate identification module 13 is connected with the target identification module 11 and is used for positioning and extracting the vehicle number plate information of the independent target belonging to the vehicle type.
In one embodiment, further comprising: a security backend server 14;
the security background server 14 is connected to the wireless communication unit 4, acquires related recorded data according to the related information of the central processing unit 3, verifies the identity of the person according to the 3D image of the face and the identity information of the person, and sends the recorded data and the verification result of the identity of the person to the wireless communication unit 4.
Specifically, the security background server 14 includes an identity database and a vehicle license plate registration database;
furthermore, an identity database is inquired according to the face feature information, and identity record data of people, such as names, addresses, telephones, identity card numbers and the like, can be obtained; and querying whether the person identity has corresponding alert information, such as a record suggesting that the person has wanted or is reported as a lost population.
As shown in fig. 4, the recorded data of person a is: "name: plum four; and (3) address: x street xx cells; telephone: 136 xxxxxxxxxx; identity card: xxxxxxxxxxxxxxxxxx; warning: the person 9 is wanted by Guangzhou police due to theft, and the recorded data is displayed in the area of the person A in the form of a floating frame a on the touch display screen 2; the recorded data of person B is: "name: and sixth; and (3) address: x street x cell; telephone: 185 xxxxxxxxxx; identity card: xxxxxxxxxxxxxxxx ″, the recorded data is displayed in the region of the person B in the form of a floating frame B on the touch panel 2.
Further, a vehicle number plate registration database is inquired according to the vehicle number plate information, and vehicle record data, such as the name and the telephone of a vehicle owner, are obtained; and inquiring whether the vehicle has corresponding warning information, such as whether the vehicle is a stolen or robbed vehicle, whether a fake-licensed vehicle record exists, whether a traffic escape illegal record exists and the like.
As shown in fig. 4, the record data of the vehicle C is: "owner of vehicle: zhang III; telephone: 136 xxxxxxxxxx; warning: when the vehicle is stolen in the alarm of 8 months and 5 days, the recorded data is displayed in the area of the vehicle C in the form of a floating frame C on the touch display screen 2.
Further, the security background server 14 queries an identity database according to the 3D image of the human face and the identity information of the person, performs matching verification on the 3D image of the human face and the identity information of the person, and sends a result of the identity verification of the person to the touch display screen 2 through the wireless communication unit for display. Wherein, the figure authentication result includes name, address, phone, ID card of the figure, still includes: whether the identity card is the identity card of the person, the original identity card information of the person and whether the person identity has corresponding warning information.
As shown in fig. 4, when the person D is authenticated, the floating frame D on the touch display screen 2 shows that the authentication result is: "name: fifthly, king; and (3) address: x street x cell; telephone: 185 xxxxxxxxxx; identity card: xxxxxxxxxxxxxxxxxx; warning: this person was reported by the Beijing police as missing population "against the presentation of the identification card.
In the embodiment, the communication between the multifunctional portable intelligent security all-in-one machine and the security background server is established through the wireless communication unit, the database in the security background server is effectively utilized, the recorded data in the database is called to quickly investigate related characters and vehicles, the characters concerned about can effectively know the related information of the characters, the identity is quickly verified, the security efficiency is improved, and security personnel can conveniently perform security on-duty inspection.
Fig. 5 is a flowchart illustrating a method for using a multifunctional portable intelligent security all-in-one machine according to an embodiment of the present application. The use method of the multifunctional portable intelligent security all-in-one machine of the embodiment may include steps S501-S504:
s501, a video camera shoots video pictures (shoots video pictures in a certain space range in front of the multifunctional portable intelligent security all-in-one machine), and the video pictures are sent to a central processing unit;
s502, the central processing unit extracts relevant information in the video picture and sends the relevant information to a security background server through a wireless communication unit;
s503, the security background server calls related recorded data according to the related information and sends the recorded data to the touch display screen through the wireless communication unit;
specifically, the security background server comprises an identity database and a vehicle license plate registration database;
furthermore, an identity database is inquired according to the face feature information, and identity record data of people, such as names, addresses, telephones, identity card numbers and the like, can be obtained; and querying whether the person identity has corresponding alert information, such as a record suggesting that the person has wanted or is reported as a lost population.
Further, a vehicle number plate registration database is inquired according to the vehicle number plate information, and vehicle record data, such as the name and the telephone of a vehicle owner, are obtained; and inquiring whether the vehicle has corresponding warning information, such as whether the vehicle is a stolen or robbed vehicle, whether a fake-licensed vehicle record exists, whether a traffic escape illegal record exists and the like.
Further, the security background server queries an identity database according to the 3D image of the human face and the identity information of the person, performs matching verification on the 3D image of the human face and the identity information of the person, and sends a person identity verification result to the touch display screen through the wireless communication unit for displaying. Wherein, the figure authentication result includes name, address, phone, ID card of the figure, still includes: whether the identity card is the identity card of the person, the original identity card information of the person and whether the person identity has corresponding warning information.
S504, the touch display screen displays recorded data, and security personnel perform security inspection through the recorded data.
Wherein the recorded data is displayed in a floating frame manner in an overlapping manner around the independent target in the actual video picture.
Specifically, within a certain picture range around each person and vehicle object, preferentially detecting an area without other objects and placing the floating frame; if the area is not available, an area with the minimum area of the overlapping area with other targets is detected, the floating frame is placed, and the floating frame adopts a semitransparent frame body.
In one embodiment, a method for using a multifunctional portable intelligent security all-in-one machine further comprises:
s601, shooting a face image through the video camera, and sending the face image to an image processing chip; the face image shot by the video camera is a 2D color picture.
S602, the infrared structure light emitter emits an infrared light source to the surface of the face;
s603, an infrared receiver receives the infrared light source reflected by the face surface, obtains face spatial information and sends the face spatial information to the image processing chip;
specifically, the infrared structure light emitter and the infrared receiver work in a combined mode, the infrared structure light emitter projects 3 thousands of specific coded infrared light spots to the face, the infrared light spots are reflected by the face and return to the infrared receiver, the infrared receiver reads dot matrix patterns, the face infrared images are captured, depth of field information of the face is obtained, and the data are sent to the chip database for calculation.
S604, the image processing chip calculates and generates a human face 3D image by collecting the human face image and the human face spatial information, and sends the human face 3D image to the security background server through the wireless communication unit;
specifically, the infrared receiver and the touch display screen collect the face image and the face spatial information, and generate a 3D face image by using an AI depth algorithm according to the face image and the face spatial information (i.e., face depth information).
S605, performing card swiping verification on the identity card of the person through an identity card swiping device, acquiring identity information of the person, and sending the identity information of the person to the security background server through the wireless communication unit;
s606, the security background server verifies the identity of the person according to the human face 3D image and the person identity information, and sends the person identity verification result to the touch display screen through a wireless communication unit;
s607, the security personnel conduct people investigation according to the people identity verification result displayed by the touch display screen.
In one embodiment, step S502 includes:
s5021, extracting independent targets in the video picture through a scene object extraction module (each person, vehicle, building, tree and the like appearing in the video picture can be used as an independent target);
specifically, the target extraction module extracts an independent target in the video picture in a closed edge detection manner.
S5022, the independent targets are classified into object types and vehicle types through a scene object classification module;
specifically, the target identification module judges whether the independent target belongs to a person type or a vehicle type through a matching algorithm. Wherein, the shape of the independent object is used for matching calculation with the shape templates of the person and the vehicle.
S5023, extracting feature information of the human face area of the independent target object of the person type through a human face recognition module;
s5024, the independent targets of the vehicle types are positioned through the license plate identification module, and the information of the vehicle license plates is extracted.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. The utility model provides a multi-functional portable wisdom security protection all-in-one which characterized in that includes: the acquisition module and the touch display screen are arranged outside the machine body, and the central processing unit and the wireless communication unit are arranged inside the machine body;
the acquisition module is arranged on the back of the body, connected with the central processing unit and the wireless communication unit, and used for acquiring shot video pictures, sending the video pictures to the central processing unit, acquiring a human face 3D image and figure identity information, and sending the human face 3D image and the figure identity information to the wireless communication unit;
the central processing unit is connected with the acquisition module and the wireless communication unit and is used for extracting relevant information in a video picture and sending the relevant information to the wireless communication unit;
the wireless communication unit is connected with the central processing unit, the acquisition module and the touch display screen, and is used for transmitting the related information, the 3D human face image and the person identity information to a security background server and sending the recorded data and the person identity verification result received from the security background server to the touch display screen;
the touch display screen is arranged on the front surface of the machine body, is connected with the wireless communication unit and is used for receiving and displaying the recorded data and the figure identity verification result sent by the wireless communication unit.
2. The multifunctional portable intelligent security all-in-one machine of claim 1, wherein the acquisition module comprises: the system comprises a video camera, an infrared structure light emitter, an infrared receiver, an image processing chip and an identity card reader;
the video camera is connected with the image processing chip and is used for shooting a face image and sending the face image to the image processing chip;
the infrared structure light emitter is used for emitting an infrared light source to the surface of the human face;
the infrared receiver is connected with the image processing chip and used for acquiring the face spatial information according to the infrared light source reflected by the face surface and sending the face spatial information to the image processing chip;
the image processing chip is connected with the video camera, the infrared receiver and the touch display screen, the face image and the face spatial information are collected, a face 3D image is generated through calculation, and the face 3D image is sent to the wireless communication unit;
the identity card swiping device is connected with the wireless communication unit and used for acquiring identity information of people and sending the identity information to the wireless communication unit.
3. The multifunctional portable intelligent security all-in-one machine of claim 1, wherein the central processing unit comprises: the system comprises a target extraction module, a target identification module, a face identification module and a number plate identification module;
the target extraction module is connected with the video camera and used for extracting independent targets from the video pictures;
the target identification module is connected with the target extraction module and is used for judging whether the independent target belongs to a character type or a vehicle type;
the face recognition module is connected with the target recognition module and used for extracting face characteristic information of the independent target belonging to the figure type;
the number plate identification module is connected with the target identification module and used for positioning and extracting the vehicle number plate information of the independent target belonging to the vehicle type.
4. The multifunctional portable intelligent security all-in-one machine of claim 3, wherein the target extraction module comprises:
and the target extraction module adopts a closed edge detection mode to extract independent targets in the video picture.
5. The multifunctional portable intelligent security all-in-one machine of claim 3, wherein the target identification module comprises:
and the target identification module judges whether the independent target belongs to the character type and the vehicle type through a matching algorithm.
6. The multifunctional portable intelligent security all-in-one machine of claim 1, further comprising: a security background server;
the security background server is connected with the wireless communication unit, acquires related recorded data according to related information of the central processing unit, verifies the identity of a person according to the 3D image of the face and the identity information of the person, and sends the recorded data and the verification result of the identity of the person to the wireless communication unit.
7. The multifunctional portable intelligent security all-in-one machine of claim 1, wherein the touch display screen comprises:
and the recorded data is displayed in a floating frame mode in an overlapping mode around an independent target in an actual video picture.
8. A use method of a multifunctional portable intelligent security all-in-one machine is characterized by comprising the following steps:
the video camera shoots a video picture and sends the video picture to the central processing unit;
the central processing unit extracts relevant information in the video picture and sends the relevant information to a security background server through a wireless communication unit;
the security background server calls related recorded data according to the related information and sends the recorded data to the touch display screen through the wireless communication unit;
the touch display screen displays the recorded data, and security personnel perform security inspection through the recorded data.
9. The method for using the multifunctional portable intelligent security all-in-one machine as claimed in claim 8, further comprising:
shooting a face image through the video camera, and sending the face image to an image processing chip;
the infrared structure light emitter emits an infrared light source to the surface of the human face;
the infrared receiver receives the infrared light source reflected by the surface of the human face, obtains human face spatial information and sends the human face spatial information to the image processing chip;
the image processing chip calculates and generates a human face 3D image by collecting the human face image and the human face spatial information, and sends the human face 3D image to the security background server through the wireless communication unit;
the identity card of the person is subjected to card swiping verification through the identity card swiping device, identity information of the person is obtained, and the identity information of the person is sent to the security background server through the wireless communication unit;
the security background server verifies the identity of the person according to the human face 3D image and the person identity information, and sends a person identity verification result to the touch display screen through a wireless communication unit;
and the security personnel checks the character through the character authentication result displayed by the touch display screen.
10. The method as claimed in claim 8, wherein the step of extracting the relevant information from the video image by the cpu comprises:
extracting an independent target in the video picture through a scene object extraction module;
classifying the independent targets into object types and vehicle types through a scene object classification module;
extracting the characteristic information of a human face region by the human face recognition module of the independent target object of the character type;
the independent target of the vehicle type is positioned and the vehicle number plate information is extracted through the number plate identification module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911184580.3A CN111210375A (en) | 2019-11-27 | 2019-11-27 | Multi-functional portable wisdom security protection all-in-one |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911184580.3A CN111210375A (en) | 2019-11-27 | 2019-11-27 | Multi-functional portable wisdom security protection all-in-one |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111210375A true CN111210375A (en) | 2020-05-29 |
Family
ID=70789723
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911184580.3A Pending CN111210375A (en) | 2019-11-27 | 2019-11-27 | Multi-functional portable wisdom security protection all-in-one |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111210375A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114640863A (en) * | 2022-03-04 | 2022-06-17 | 广州方硅信息技术有限公司 | Method, system and device for displaying character information in live broadcast room and computer equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1996346A (en) * | 2005-12-29 | 2007-07-11 | 电子科技大学 | Vehicle recognition algorithm based on contour |
| CN103165016A (en) * | 2011-12-16 | 2013-06-19 | 上海博泰悦臻电子设备制造有限公司 | Display method and display device for interest point names and navigation system |
| CN106156688A (en) * | 2015-03-10 | 2016-11-23 | 上海骏聿数码科技有限公司 | A kind of dynamic human face recognition methods and system |
| CN107027070A (en) * | 2016-02-02 | 2017-08-08 | 中国电信股份有限公司 | Method, terminal and the system of information are implanted into video |
| CN207020684U (en) * | 2017-06-05 | 2018-02-16 | 广东世纪晟科技有限公司 | Portable police individual soldier's suit based on recognition of face |
| CN108052919A (en) * | 2017-12-26 | 2018-05-18 | 北斗七星（重庆）物联网技术有限公司 | A kind of safety-protection system and method based on recognition of face |
| CN109800638A (en) * | 2018-12-14 | 2019-05-24 | 四川远鉴科技有限公司 | A kind of emphasis people's monitoring method based on face recognition technology |
| CN110399763A (en) * | 2018-04-24 | 2019-11-01 | 深圳奥比中光科技有限公司 | Face identification method and system |
-
2019
- 2019-11-27 CN CN201911184580.3A patent/CN111210375A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1996346A (en) * | 2005-12-29 | 2007-07-11 | 电子科技大学 | Vehicle recognition algorithm based on contour |
| CN103165016A (en) * | 2011-12-16 | 2013-06-19 | 上海博泰悦臻电子设备制造有限公司 | Display method and display device for interest point names and navigation system |
| CN106156688A (en) * | 2015-03-10 | 2016-11-23 | 上海骏聿数码科技有限公司 | A kind of dynamic human face recognition methods and system |
| CN107027070A (en) * | 2016-02-02 | 2017-08-08 | 中国电信股份有限公司 | Method, terminal and the system of information are implanted into video |
| CN207020684U (en) * | 2017-06-05 | 2018-02-16 | 广东世纪晟科技有限公司 | Portable police individual soldier's suit based on recognition of face |
| CN108052919A (en) * | 2017-12-26 | 2018-05-18 | 北斗七星（重庆）物联网技术有限公司 | A kind of safety-protection system and method based on recognition of face |
| CN110399763A (en) * | 2018-04-24 | 2019-11-01 | 深圳奥比中光科技有限公司 | Face identification method and system |
| CN109800638A (en) * | 2018-12-14 | 2019-05-24 | 四川远鉴科技有限公司 | A kind of emphasis people's monitoring method based on face recognition technology |
Non-Patent Citations (3)
| Title |
|---|
| 李玉山: "《数字视觉视频技术》", 31 January 2006 * |
| 李达辉: "《数字图像处理核心技术及应用》", 31 March 2019 * |
| 李长云等: "《智能感知技术及在电气工程中的应用》", 31 May 2017 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114640863A (en) * | 2022-03-04 | 2022-06-17 | 广州方硅信息技术有限公司 | Method, system and device for displaying character information in live broadcast room and computer equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109711370B (en) | Data fusion method based on WIFI detection and face clustering | |
| US10043097B2 (en) | Image abstraction system | |
| JP4970195B2 (en) | Person tracking system, person tracking apparatus, and person tracking program | |
| CN101669824B (en) | Biometrics-based device for detecting indentity of people and identification | |
| RU2431190C2 (en) | Facial prominence recognition method and device | |
| US20130163822A1 (en) | Airborne Image Capture and Recognition System | |
| EP3885982A2 (en) | Hand biometrics system and method using digital fingerprints | |
| CN108960124A (en) | The image processing method and device identified again for pedestrian | |
| CN111523352A (en) | Method for intelligently and rapidly identifying illegal modified vehicle and monitoring system thereof | |
| KR100948382B1 (en) | Security service method and system | |
| CN110969202A (en) | Portrait collection environment verification method and system based on color component and perceptual hash algorithm | |
| CN106991448A (en) | A kind of portrait compares processing method | |
| CN111767879A (en) | Living body detection method | |
| CN110852236A (en) | Target event determination method and device, storage medium and electronic device | |
| CN109492509A (en) | Personal identification method, device, computer-readable medium and system | |
| CN112528706A (en) | Personnel identification system and method thereof | |
| Ryu et al. | Feature-based pothole detection in two-dimensional images | |
| CN111210375A (en) | Multi-functional portable wisdom security protection all-in-one | |
| Krotosky et al. | Multimodal stereo image registration for pedestrian detection | |
| JP3372419B2 (en) | Object recognition method | |
| Saini et al. | DroneRTEF: development of a novel adaptive framework for railroad track extraction in drone images | |
| CN106327876A (en) | Faked plate vehicle capturing system and method based on vehicle recorder | |
| CN109815784A (en) | A kind of intelligent method for classifying based on thermal infrared imager, system and storage medium | |
| JP6577424B2 (en) | Action recognition device and action recognition method | |
| KR20110018850A (en) | System, method and program product for camera-based object analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200529 |