CN113483760A

CN113483760A - Night patrol monitoring method and device, electronic equipment and computer readable storage medium

Info

Publication number: CN113483760A
Application number: CN202110732353.0A
Authority: CN
Inventors: 周俊竹; 梁卓智; 彭浩; 凌康文; 江志鹏
Original assignee: Shenzhen Sensetime Technology Co Ltd
Current assignee: Shenzhen Sensetime Technology Co Ltd
Priority date: 2021-06-29
Filing date: 2021-06-29
Publication date: 2021-10-08
Also published as: WO2023273151A1

Abstract

The application discloses a night patrol monitoring method and device, electronic equipment and a computer readable storage medium. The method comprises the following steps: acquiring one or more first patrol records and a target patrol route of patrol personnel; determining whether the one or more first patrol records are matched with the target patrol route or not to obtain a matching result; determining that the patrol state of the patrol personnel is normal under the condition that the matching result comprises the one or more first patrol records and the target patrol route matching; and determining that the patrol state of the patrol personnel is abnormal in the case that the matching result comprises that the one or more first patrol records and the target patrol route are not matched.

Description

Night patrol monitoring method and device, electronic equipment and computer readable storage medium

Technical Field

The application relates to the technical field of security and protection, in particular to a night patrol monitoring method and device, electronic equipment and a computer readable storage medium.

Background

In order to ensure the safety of places such as hospitals, schools, factories and the like, patrol personnel can eliminate potential safety hazards by patrolling patrol points, so that the safety is ensured. Therefore, how to effectively monitor the night patrol state of night patrol personnel has very important significance.

Disclosure of Invention

The application provides a night patrol monitoring method and device, electronic equipment and a computer readable storage medium.

In a first aspect, a night patrol monitoring method is provided, which includes:

acquiring one or more first patrol records and a target patrol route of patrol personnel;

determining whether the one or more first patrol records are matched with the target patrol route or not to obtain a matching result;

determining that the patrol state of the patrol personnel is normal under the condition that the matching result comprises the one or more first patrol records and the target patrol route matching;

and determining that the patrol state of the patrol personnel is abnormal in the case that the matching result comprises that the one or more first patrol records and the target patrol route are not matched.

In combination with any embodiment of the present application, the target patrol route includes one or more target patrol points;

the determining whether the one or more first patrol records and the target patrol route are matched to obtain a matching result includes:

determining that the matching result includes that the one or more first patrol records and the target patrol route match in a case where the one or more first patrol records and the target patrol route satisfy a matching condition;

in a case where the one or more first patrol records and the target patrol route do not satisfy a matching condition, determining that the matching result includes that the one or more first patrol records and the target patrol route do not match;

the matching conditions include: the patrol points in one or more first patrol records of the patrol personnel are the same as the one or more target patrol points.

In combination with any embodiment of the present application, the matching condition further includes: the patrol order of the one or more first patrol records is the same as the patrol order in the target patrol route.

With reference to any one of the embodiments of the present application, the target patrol route includes a target patrol point to be monitored;

before the determining whether the one or more first patrol records and the target patrol route match to obtain a matching result, the method further includes:

acquiring a safety time interval of the target night patrol point to be monitored;

the matching condition further includes: and according to the one or more first night watching records, determining that the duration of the night watching personnel not appearing at the target night watching point to be monitored is less than or equal to the safety time interval.

In combination with any embodiment of the present application, in a case where the one or more first patrol records include two or more second patrol records of the first patrol point, a time difference between adjacent patrol records is smaller than the maximum stay time, and the adjacent patrol records are two second patrol records whose timestamps are adjacent to each other.

In combination with any embodiment of the present application, the acquiring one or more first patrol records of the patrol officer includes:

acquiring one or more first images to be processed, wherein the acquisition positions of the one or more first images to be processed comprise one or more night watching points to be monitored;

in the case that it is determined that the image including the night patrol person exists in the one or more first images to be processed, one or more first night patrol records of the night patrol person are obtained according to the image including the night patrol person in the one or more first images to be processed.

In combination with any embodiment of the present application, the one or more first to-be-processed images include one or more second to-be-processed images, the one or more patrol points to be monitored include a second patrol point, and the acquisition positions of the one or more second to-be-processed images are all the second patrol point;

the obtaining one or more first night watching records of the night watching personnel according to the one or more first images to be processed including the image of the night watching personnel comprises:

determining one or more first images to be selected, wherein the first images to be selected are images corresponding to the target face similarity in the one or more second images to be processed, and the target face similarity is the face similarity exceeding a face similarity threshold in the one or more face similarities;

and taking the image with the earliest acquisition time in the one or more first images to be selected as a third night watching record of the second night watching point.

With reference to any one of the embodiments of the present application, the method is applied to a night patrol monitoring device, and the acquiring one or more first images to be processed includes:

the patrol monitoring device acquires a video stream acquired by a monitoring camera in real time, and the monitoring camera is installed at the second patrol point;

one or more images in the video stream are taken as the one or more second images to be processed.

In combination with any embodiment of the present application, the taking one or more images in the video stream as the one or more second images to be processed includes:

and extracting frames from the video stream in a mode of equal time intervals to obtain the one or more second images to be processed.

In combination with any embodiment of the present application, the method further comprises: and sending warning information to a terminal under the condition that the patrol state of the patrol personnel is abnormal.

In a second aspect, there is provided a night patrol monitoring device, the device comprising:

the acquisition unit is used for acquiring one or more first patrol records and target patrol routes of patrol personnel;

the determining unit is used for determining whether the one or more first patrol records are matched with the target patrol route to obtain a matching result;

the determination unit is further configured to determine that the patrol state of the patrol personnel is normal when the matching result includes that the one or more first patrol records are matched with the target patrol route;

the determination unit is further configured to determine that the patrol status of the patrol person is abnormal if the matching result includes that the one or more first patrol records and the target patrol route do not match.

the determining unit is configured to:

the obtaining unit is further configured to obtain a safety time interval of the target patrol point to be monitored before determining whether the one or more first patrol records are matched with the target patrol route and obtaining a matching result;

With reference to any embodiment of the present application, the obtaining unit is configured to:

the determining unit is further configured to, when it is determined that an image including the night patrol person exists in the one or more first images to be processed, obtain one or more first night patrol records of the night patrol person according to the image including the night patrol person in the one or more first images to be processed.

the determining unit is configured to:

In combination with any embodiment of the present application, the obtaining unit is configured to obtain a video stream collected by a monitoring camera in real time, where the monitoring camera is installed at the second night patrol point;

In a third aspect, an electronic device is provided, which includes: a processor and a memory for storing computer program code comprising computer instructions, the electronic device performing the method of the first aspect and any one of its possible implementations as described above, if the processor executes the computer instructions.

In a fourth aspect, another electronic device is provided, including: a processor, transmitting means, input means, output means, and a memory for storing computer program code comprising computer instructions, which, when executed by the processor, cause the electronic device to perform the method of the first aspect and any one of its possible implementations.

In a fifth aspect, there is provided a computer-readable storage medium having stored therein a computer program comprising program instructions which, if executed by a processor, cause the processor to perform the method of the first aspect and any one of its possible implementations.

A sixth aspect provides a computer program product comprising a computer program or instructions which, when run on a computer, causes the computer to perform the method of the first aspect and any of its possible implementations.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments or the background art of the present application, the drawings required to be used in the embodiments or the background art of the present application will be described below.

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the application.

Fig. 1 is a schematic flowchart of a night patrol monitoring method according to an embodiment of the present disclosure;

FIG. 2 is a schematic diagram of an effective patrol route provided by an embodiment of the present application;

fig. 3 is a schematic structural diagram of a night patrol monitoring device according to an embodiment of the present application;

fig. 4 is a schematic hardware structure diagram of a night patrol monitoring device according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

It should be understood that in the present application, "at least one" means one or more, "a plurality" means two or more, "at least two" means two or three and three or more, "and/or" for describing an association relationship of associated objects, meaning that three relationships may exist, for example, "a and/or B" may mean: only A, only B and both A and B are present, wherein A and B may be singular or plural. The character "/" may indicate that the objects associated with each other are in an "or" relationship, meaning any combination of the items, including single item(s) or multiple items. For example, at least one (one) of a, b, or c, may represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", wherein a, b, c may be single or plural. The character "/" may also represent a division in a mathematical operation, e.g., a/b-a divided by b; 6/3 ═ 2. At least one of the following "or similar expressions.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The execution subject of the embodiment of the application is a night patrol monitoring device, wherein the night patrol monitoring device can be any electronic device capable of executing the technical scheme disclosed by the embodiment of the application method. Optionally, the patrol monitoring device may be one of the following: cell-phone, computer, panel computer, wearable smart machine.

It should be understood that the method embodiments of the present application may also be implemented by means of a processor executing computer program code. The embodiments of the present application will be described below with reference to the drawings. Referring to fig. 1, fig. 1 is a schematic flow chart illustrating a night patrol monitoring method according to an embodiment of the present disclosure.

101. One or more first patrol records and target patrol routes of the patrol personnel are obtained.

In the embodiment of the present application, the patrol records (including the first patrol record described above and the second patrol record and the third patrol record to be mentioned later) each contain which patrol point when the patrol person has gone round.

For example, the patrol record includes a patrol person at 9 o 'clock 15 on 25 o' clock 6/month 2021, a patrol B at 10 o 'clock 15 on 25 o' clock 6/month 2021, and a patrol a at 10 o 'clock 45 on 25 o' clock 6/month 2021.

The number of the first patrol records may be one or more than one. In one implementation of obtaining one or more first night watching records of the night watching personnel, the night watching monitoring device receives the one or more first night watching records input by the user through the input component. The above-mentioned input assembly includes: keyboard, mouse, touch screen, touch pad and audio input device.

In another implementation manner of acquiring one or more first patrol records of the patrol officer, the patrol monitoring device receives the one or more first patrol records sent by the terminal. The terminal may be any one of the following: cell-phone, computer, panel computer, server.

In the embodiment of the present application, the target patrol route includes one or more patrol points, and the patrol points in the target patrol route are hereinafter referred to as target patrol points.

In one implementation of obtaining the target patrol route, the patrol monitoring device receives the target patrol route input by the user through the input component.

In another implementation manner of obtaining the target patrol route, the patrol monitoring device receives the target patrol route sent by the terminal.

It should be understood that, in step 101, the acquiring of one or more first patrol records of the patrol officer and the acquiring of the target patrol route may be performed separately or simultaneously, which is not limited in this application.

102. And determining whether the one or more first patrol records are matched with the target patrol route or not to obtain a matching result.

In this step, the criterion for judging whether one or more first patrol records are matched with the target patrol route includes one or more of the following: whether the patrol points in the one or more first patrol records are matched with the target patrol points or not, and whether the patrol sequence of the patrol points in the one or more first patrol records is matched with the sequence of the target patrol points or not.

103. And determining that the patrol state of the patrol personnel is normal under the condition that the matching result comprises the matching of the one or more first patrol records and the target patrol route.

If the matching result comprises one or more first night watching records matched with the target night watching route, the night watching personnel can be used for night watching according to the target night watching route, and therefore the night watching monitoring device determines that the night watching state of the night watching personnel is normal.

104. And determining that the patrol state of the patrol personnel is abnormal when the matching result comprises that the one or more first patrol records are not matched with the target patrol route.

If the matching result comprises that one or more first night watching records are not matched with the target night watching route, the night watching personnel does not night watching according to the target night watching route, and therefore the night watching monitoring device determines that the night watching state of the night watching personnel is abnormal.

In this embodiment, the patrol monitoring device determines the patrol state of the patrol officer by determining whether one or more first patrol records of the patrol officer are matched with the target patrol record.

As an optional implementation, the target patrol route includes one or more target patrol points. The patrol monitoring apparatus performs one of the following steps during step 102:

1. determining that the matching result includes matching of the one or more first patrol records and the target patrol route, in a case where the one or more first patrol records and the target patrol route satisfy a matching condition;

2. determining that the matching result includes that the one or more first patrol records and the target patrol route do not match in the case where the one or more first patrol records and the target patrol route do not satisfy a matching condition;

in the present embodiment, the matching conditions include: the patrol points in one or more first patrol records of the patrol personnel are the same as the one or more target patrol points.

The patrol points in the one or more first patrol records are the same as the one or more target patrol points, which indicates that the patrol personnel has patrolled all patrol points on the target patrol route. Therefore, the patrol monitoring apparatus determines that the one or more first patrol records and the target patrol route satisfy the matching condition, i.e., determines that the one or more first patrol records and the target patrol route match. Otherwise, the patrol points in the one or more first patrol records are different from the one or more target patrol points, which indicates that the patrol personnel does not patrol all patrol points on the target patrol route. Thus, the patrol monitoring apparatus determines that the one or more first patrol records and the target patrol route do not satisfy the matching condition, i.e., determines that the one or more first patrol records and the target patrol route do not match.

For example, the target patrol route includes: patrol point 1 and patrol point 2. If one or more first night watching records comprise the night watching point 1, the night watching personnel do not carry out night watching on the night watching point 2, namely, one or more first night watching records are not matched with the target night watching route.

If the one or more first night watching records comprise night watching points 1 and night watching points 2, the night watching personnel can watch all night watching points in the target night watching route, namely, the one or more first night watching records are matched with the target night watching route.

In this embodiment, the patrol monitoring device determines that one or more first patrol records are matched with the target patrol route when determining that the patrol point in one or more first patrol records is the same as one or more target patrol points, and further determines that the patrol state of the patrol personnel is normal; and under the condition that the patrol monitoring device determines that the patrol points in one or more first patrol records are different from one or more target patrol points, the patrol monitoring device determines that one or more first patrol records are not matched with the target patrol route, and further determines that the patrol state of the patrol personnel is abnormal.

As an optional implementation, the matching condition further includes: the patrol order of the one or more first patrol records is the same as the patrol order in the target patrol route.

In this embodiment, the patrol sequence of one or more first patrol records is the patrol sequence of the patrol personnel. For example, the one or more first patrol records include: the system comprises a first patrol record 1, a first patrol record 2 and a first patrol record 3, wherein the first patrol record 1 is a record of a patrol person performing patrol on a patrol point a at the time t1, the first patrol record 2 is a record of a patrol person performing patrol on a patrol point b at the time t2, and the first patrol record 3 is a record of a patrol person performing patrol on the patrol point a at the time t 3. From one or more first night-time records, it may be determined: the patrol personnel appear at a first patrol point at time t1, a first patrol point at time t2, and a second patrol point at time t 3.

If t1 is earlier than t2 and t2 is earlier than t3, the patrol order of the patrol personnel is: patrol point a, patrol point b, patrol point a, i.e., the patrol person appears at patrol point a at t1, at patrol point b at t2, and at patrol point a at t 3.

If t1 is earlier than t3 and t3 is earlier than t2, the patrol order of the patrol personnel is: patrol point a, patrol point b, i.e., the patrol person appears at patrol point a at t1, again at patrol point a at t2, and again at patrol point b at t 3.

The patrol order of the patrol person is the same as the patrol order in the target patrol route, which means that the sequence in which the patrol person patrol the patrol points is the same as the sequence in which the target patrol points in the target patrol route.

For example, assume that the target patrol route is: night patrol point a → night patrol point b → night patrol point a. If in the patrol record of the patrol personnel, the patrol sequence of the patrol personnel is as follows: patrol point a, patrol point b and patrol point a. Then the patrol order of the patrol personnel is the same as the order of the target patrol points.

If in the patrol record of the patrol personnel, the patrol sequence of the patrol personnel is as follows: patrol point a, patrol point b and patrol point b. Then the patrol order of the patrol personnel is different from the order of the target patrol points.

In this step, the patrol monitoring device determines that one or more first patrol records are matched with the target patrol route under the condition that the patrol points in one or more first patrol records are the same as one or more target patrol points and the patrol sequence of one or more first patrol records is the same as the patrol sequence in the target patrol route, and further determines that the patrol state of the patrol personnel is normal; the patrol monitoring device determines that one or more first patrol records are not matched with the target patrol route under the condition that the patrol points in one or more first patrol records are different from one or more target patrol points, and further determines that the patrol state of the patrol personnel is abnormal; the patrol monitoring device determines that one or more first patrol records are not matched with the target patrol route under the condition that the patrol sequence of one or more first patrol records is different from the patrol sequence in the target patrol route, and further determines that the patrol state of the patrol personnel is abnormal.

As an optional implementation manner, the target patrol route includes a target patrol point to be monitored, and in this implementation manner, the target patrol point to be monitored is any one target patrol point in the target patrol route.

The patrol monitoring apparatus, before performing step 102, further performs the following steps:

3. and acquiring the safe time interval of the target night patrol point to be monitored.

In practical application, some night patrol points may be prone to safety accidents, and night patrol personnel are required to go to night patrol at intervals. If the night patrol personnel fails to night patrol the night patrol points at intervals, a safety accident may occur. Therefore, in this step, the night patrol monitoring device determines whether the night patrol personnel patrols the target night patrol task according to the safety time interval of the target night patrol task to be monitored, and night patrol is performed on the target night patrol task to be monitored at intervals.

For example, as specified by the target patrol task, patrol point 1 needs to patrol every 30 minutes, and the safe time interval for patrol point 1 is 30 minutes.

In one possible implementation, the patrol monitoring device takes the time interval input by the user through the input component as the safe time interval of the target patrol point to be monitored.

In another possible implementation manner, the patrol monitoring device receives a time interval sent by the terminal as a safety time interval of the target patrol point to be monitored.

Alternatively, in the case where the patrol monitoring apparatus performs step, and the patrol monitoring apparatus performs step 1 in the process of performing step 102, the patrol monitoring apparatus performs step 3 before performing step 1. In the case where the patrol monitoring apparatus performs step 2 in the process of performing step 102, the patrol monitoring apparatus performs step 3 before performing step 1.

In the case where the patrol monitoring apparatus has completed step 3, the matching conditions further include: and according to one or more first night watching records, determining that the duration of the night watching personnel not appearing at the target night watching point to be monitored is less than or equal to a safe time interval.

For example, from one or more first night visits, it may be determined that the night patrol personnel night visit a at t1, night visit b at t2, and night visit a at t3, wherein t1 is 20 minutes earlier than t2 and t2 is 30 minutes earlier than t 3.

Assume that the target patrol point to be monitored is patrol point a, and the safe time interval of patrol point a is 60 minutes. Since the time interval between t1 and t3 is 50 minutes, the duration of time that the patrol person is not present at patrol point a is 50 minutes. Since 50 minutes is less than 60 minutes, the duration of the night patrol personnel not being present at night patrol point a does not exceed the effective time interval of night patrol point a.

In this step, the patrol monitoring device determines that one or more first patrol records are matched with the target patrol route when determining that the patrol point in one or more first patrol records is the same as one or more target patrol points, the patrol sequence of one or more first patrol records is the same as the patrol sequence in the target patrol route, and the duration of the patrol personnel not appearing at the target patrol point to be monitored is less than or equal to the safety time interval, thereby determining that the patrol status of the patrol personnel is normal;

the patrol monitoring device determines that one or more first patrol records are not matched with the target patrol route under the condition that the patrol points in one or more first patrol records are different from one or more target patrol points, and further determines that the patrol state of the patrol personnel is abnormal;

the patrol monitoring device determines that one or more first patrol records are not matched with the target patrol route under the condition that the patrol sequence of one or more first patrol records is different from the patrol sequence in the target patrol route, and further determines that the patrol state of the patrol personnel is abnormal;

the patrol monitoring device determines that one or more first patrol records are not matched with the target patrol route under the condition that the duration time of the patrol personnel not appearing at the target patrol point to be monitored is longer than the safety time interval, and further determines that the patrol state of the patrol personnel is abnormal.

In this embodiment, the patrol monitoring device can reduce the potential safety hazard by using the time interval, in which the duration time of the patrol person not appearing at the target patrol point to be monitored is less than or equal to the safety time interval, as one of the bases for judging whether one or more first patrol records are matched with the target patrol route.

It should be understood that the target patrol points to be monitored in the embodiment are only examples, and it should not be understood that only one target patrol point in the target patrol route has a safe interval time, in practical applications, one or more target patrol points in the target patrol route may have a safe interval time, and the safe interval time of any two target patrol points may be different.

In a possible implementation manner, the patrol monitoring device can determine the patrol record matched with the target patrol route from the patrol records of the patrol personnel based on the technical scheme disclosed in the foregoing, and can obtain the effective route according to the patrol record matched with the target patrol route, thereby facilitating the related personnel to judge the patrol records of the patrol personnel.

For example, in fig. 2, the device a, the device B, and the device C are all patrol record acquisition devices deployed at a target patrol point. When the target patrol point corresponding to the device a is referred to as a point a, the target patrol point corresponding to the device B is referred to as a point B, and the target patrol point corresponding to the device C is referred to as a point C.

In fig. 2, the target round route is in the order from left to right, that is, point a → point b → point c → point b.

In fig. 2, the upper right corner of the device is provided with an "exception", which illustrates that the patrol record of the patrol person at the target patrol point corresponding to the device is abnormal, for example, the patrol person does not patrol the target patrol point, and at this time, the patrol record of the patrol person at the target patrol point is abnormal. For another example, the patrol person does not patrol the target patrol point within the time specified in the target route, and the patrol record of the patrol person at the target patrol point is abnormal. The upper right corner of the device in fig. 2 is provided with a positive, which indicates that the patrol records of the patrol personnel at the target patrol point corresponding to the device are normal.

The patrol monitoring device is determined to be between 22:00 and 22:10 based on the technical scheme disclosed in the foregoing, patrol of the point a, the point b, the point c and the point b is matched with a target patrol route in sequence, and then a patrol route for patrolling the point a, the point b, the point c and the point b in sequence is used as an effective route 1 when a patrol person is between 22:00 and 22: 10.

Therefore, when the relevant personnel study and judge the night patrol records of night patrol personnel, the night patrol personnel can be determined to be between 22:00 and 22:10, night patrol of the point a, the point b, the point c and the point b is completed in sequence according to the target night patrol route, but night patrol routes except the effective route 1 in the target night patrol route are not completed.

As an alternative embodiment, in the case where the one or more first patrol records include two or more second patrol records of the first patrol point, a time difference between adjacent patrol records is smaller than the maximum stay time, and the adjacent patrol records are two of the second patrol records having adjacent time stamps.

In order to avoid the night watching personnel to stay at night watching points for a long time and improve the monitoring effect on the night watching personnel, the duration of the night watching personnel appearing at the same night watching point is less than the longest stay time. If the duration of the night watching personnel at the same night watching point is longer than or equal to the longest stay time, the night watching personnel have two or more night watching records at the night watching point.

For example, the maximum stay time of the target patrol point a is 20 minutes. If the night patrol person is present at the target night patrol point a at 11 o 'clock 6 of 25 o' clock 6 of 2021, and stays at the target night patrol point a for 30 minutes. Then the night watching personnel has two night watching records at the target night watching point a, wherein one night watching record is that the night watching personnel watches the target night watching point a from 11 o 'clock 6 o' clock 25 o 'clock 2021, and the other night watching record is that the night watching personnel watches the target night watching point a from 11 o' clock 26 o 'clock 25 o' clock 11 o 'clock 26 o' clock 6 o 'clock 25 o' clock 2021 at 25 o 'clock 6 o' clock 2021.

In this embodiment, therefore, in the case where the one or more first night round records include two or more second night round records of the first night round, the time interval between any two second night round records adjacent to two time stamps is less than the maximum stay time. Like this, can improve the accuracy degree of patrolling personnel's the record of patrolling, and then be favorable to improving the accuracy degree of patrolling personnel's the state of patrolling.

Alternatively, the maximum residence time may be set according to actual requirements. For example, it usually takes 2 minutes for the patrol personnel to complete the patrol of the target patrol point a, and the maximum stay time of the target patrol point a may be set to 140 seconds (a time longer than 2 minutes). For another example, the target patrol route includes 3 patrol points, and the patrol person needs to complete one patrol of the target patrol route within 30 minutes. At this time, the maximum stay time of each target patrol point in the target patrol route may be set as: 30/3 min.

As an alternative embodiment, the patrol monitoring device acquires one or more first patrol records of the patrol officer by performing the following steps:

4. acquiring one or more first images to be processed, wherein the acquisition position of the one or more first images to be processed comprises one or more night watching points to be monitored.

In this embodiment, the number of first to-be-processed images may be 1, and the number of first to-be-processed images may be larger than 1. For example, the one or more first to-be-processed images include an image a. For another example, the one or more first images to be processed include image b and image c.

In this embodiment, the acquisition positions of the one or more first to-be-processed images are all to-be-monitored patrol points in the target patrol route, that is, the acquisition position of each of the one or more first to-be-processed images is the position of the to-be-monitored patrol point.

For example, assume that the target patrol route includes a patrol point a to be monitored. The position of the patrol point a to be monitored is 22 degrees 38 ' 17.54 ' north latitude and 114 degrees 05 ' 52.35 east longitude. The acquisition positions of one or more first images to be processed can be 22 degrees of north latitude 38 '17.54' and 114 degrees of east longitude 05 '52.35'.

For example, assuming that the target patrol route includes a patrol point a to be monitored and a patrol point B to be monitored, the one or more first images to be processed include an image a and an image B. The positions of the patrol points a to be monitored are 22 degrees 38 '17.54' of north latitude and 114 degrees 05 '52.35 of east longitude, and the positions of the patrol points b to be monitored are 26 degrees 38' 17.54 'of north latitude and 84 degrees 05' 52.35 of east longitude. The acquisition position of the image A can be 22 degrees of north latitude 38 ' 17.54 ' and 114 degrees of east longitude 05 ' 52.35 ', and the acquisition position of the image B can be 26 degrees of north latitude 38 ' 17.54 ' and 84 degrees of east longitude 05 ' 52.35.

In one possible implementation, the patrol monitoring apparatus takes one or more images input by the user through the input component as one or more first images to be processed.

In another possible implementation manner, the night watching monitoring device receives one or more images sent by the terminal as one or more first images to be processed.

In another possible implementation manner, the night patrol monitoring device is in communication connection with the monitoring camera, and the shooting scene of the monitoring camera includes night patrol points to be monitored. The patrol monitoring device acquires one or more images collected by the monitoring camera through the communication connection as one or more first images to be processed.

5. And under the condition that the one or more first images to be processed are determined to contain the image of the night patrol person, obtaining one or more first night patrol records of the night patrol person according to the one or more first images to be processed containing the image of the night patrol person.

The first image to be processed contains the night patrol person, and the night patrol person is shown at the night patrol point to be monitored when the first image to be processed is collected, namely the night patrol person has a night patrol record at the night patrol point to be monitored.

For example, assuming that the acquisition time of the first image to be processed a is t1, the acquisition position of the first image to be processed a is the patrol point b to be monitored, and the first image to be processed a contains a patrol person, the patrol person appears at the patrol point b to be monitored at t 1.

Therefore, in the case where it is determined that one or more first to-be-processed images include an image of the patrol person, the patrol monitoring apparatus obtains a patrol record of the patrol person, that is, a first patrol record, from the image including the patrol person.

In a possible implementation manner, the patrol monitoring device determines whether one or more first images to be processed include an image containing the patrol person by comparing the human body image of the patrol person with each first image to be processed. The human body comparison of the two images means that the similarity of human body feature data of the two images is calculated, and under the condition that the similarity exceeds a human body similarity threshold value, the people in the two images are determined to be the same person.

In another possible implementation manner, the night watching monitoring device determines whether one or more first images to be processed include an image containing the night watching person by comparing the face image of the night watching person with each first image to be processed.

In this embodiment, since the collection positions of one or more first images to be processed are the patrol points to be monitored, the patrol monitoring device determines whether the patrol person has a patrol record at the patrol point to be monitored by determining whether an image containing the patrol person exists in the one or more first images to be processed.

As an optional implementation manner, the one or more first to-be-processed images include one or more second to-be-processed images, the one or more to-be-monitored night watching points include a second night watching point, and the one or more second to-be-processed images are acquired at the second night watching point.

In this embodiment, the second night patrol point is any one of the one or more night patrol points to be monitored.

The patrol monitoring device executes the following steps under the condition that the one or more first images to be processed are determined to have the image containing the patrol person:

6. and determining one or more first images to be selected, wherein the first images to be selected are images corresponding to the similarity of the target face in the one or more second images to be processed, and the similarity of the target face is the similarity of the face exceeding a face similarity threshold in the one or more faces.

In this step, the target face similarity is one or more than one face similarity exceeding a face similarity threshold, that is, the image corresponding to the target face similarity includes the patrol person, that is, the first image to be selected is an image including the patrol person.

For example, the one or more face similarity degrees include face similarity degree 1, face similarity degree 2, and face similarity degree 3, where the face similarity degree 1 and the face similarity degree 2 are both greater than a face similarity degree threshold, i.e., the face similarity degree 1 and the face similarity degree 3 are both target face similarity degrees.

It is assumed that the face similarity 1 is a face similarity between the face a in the first image to be processed a and the face of the patrolling person, and the face similarity 2 is a face similarity between the face B in the first image to be processed B and the face of the patrolling person. The first image to be processed a and the first image to be processed B are both the first image to be selected, i.e. one or more of the first images to be selected include the first image to be processed a and the first image to be processed B.

7. And taking the image with the earliest acquisition time in the one or more first images to be selected as a third night watching record of the second night watching point.

Because the one or more first images to be selected comprise the night patrol person, each image in the one or more first images to be selected can be used as the night patrol record of the night patrol person at the second night patrol point.

In view of facilitating the relevant management personnel to check the night watching records of the night watching personnel, the night watching records of the night watching personnel need to be stored. In order to reduce the storage cost of the patrol monitoring device, the patrol monitoring device takes the image with the earliest acquisition time as a first patrol recording image, and takes the first patrol recording image as a patrol record of a patrol person at a second patrol point, namely a third patrol record. Specifically, if the acquisition time of the first night patrol recording image is t1, the third night patrol recording is that the night patrol person night patrol the second night patrol point at t 1.

It should be understood that the second night watching point in the present embodiment is only an example, and in practical applications, the night watching personnel performs steps 6 to 7 on the image acquired by any night watching point to be monitored.

In a possible application scenario, a monitoring camera is respectively installed at each night patrol point to be monitored, and communication connection is established between the monitoring camera and the night patrol monitoring device. The patrol monitoring device can further acquire the video stream acquired by the monitoring camera through the communication connection. The patrol monitoring device can determine whether the patrol personnel patrol the target patrol point according to the video stream collected by the monitoring camera.

Taking the second night patrol point as an example, as an alternative implementation manner, the night patrol monitoring device performs the following steps in the process of performing step 4:

8. and acquiring a video stream acquired by a monitoring camera in real time, wherein the monitoring camera is installed at the second night patrol point.

9. And taking one or more images in the video stream as the one or more second images to be processed.

Because the video stream that monitoring camera real-time collection was gathered can be acquireed to the monitoring devices that patrols, the monitoring devices that patrols can confirm in real time that patrols more personnel's the state of patrolling. Therefore, under the condition that the patrol state of the patrol personnel is abnormal, the patrol monitoring device can prompt relevant managers in real time so that the relevant managers can manage the patrol personnel in time.

As an alternative embodiment, the patrol monitoring apparatus performs the following steps in the process of performing step 9:

10. and extracting frames from the video stream in a mode of equal time intervals to obtain the one or more second images to be processed.

For example, the video stream includes a first frame image, a second frame image, a third frame image, a fourth frame image, and a fifth frame image, where the acquisition time interval of two adjacent frame images is t 1.

The patrol monitoring device extracts frames from the video stream at equal time intervals to obtain a first frame image, a third frame image and a fifth frame image, and at the moment, one or more second images to be processed comprise the first frame image, the third frame image and the fifth frame image.

The patrol monitoring device can also obtain a second frame image and a fourth frame image by extracting frames from the video stream in an equal time interval mode, and at the moment, one or more second images to be processed comprise the second frame image and the fourth frame image.

The patrol monitoring device extracts frames from the video stream in an equal time interval mode to obtain one or more second images to be processed, so that the data processing amount of the patrol monitoring device can be reduced, and the processing speed of the patrol monitoring device is improved.

As an alternative embodiment, the patrol monitoring device further performs the following steps: 11. and sending warning information to the terminal when the patrol state of the patrol personnel is abnormal.

The patrol monitoring device sends alarm information to the terminal under the condition that the patrol state of the patrol personnel is determined to be abnormal so as to prompt relevant personnel to timely manage and control the patrol state of the patrol personnel.

The warning message may be a voice prompt message, such as: "three Zhang appeared in patrol anomaly". The warning message may also be a text prompt message, such as: popping up a prompt window on a display interface of the terminal, wherein prompt characters are contained in the prompt window, and if: "the stay time of lee four at night patrol point a is timed out". This is not limited in this application.

Based on the technical scheme provided by the embodiment of the application, the embodiment of the application also provides a possible application scene.

In order to ensure the safety of the A park, a plurality of patrol points in the A park need patrol personnel. In order to effectively investigate and monitor the work of the night patrol personnel, the workers in the park A want to build a night patrol monitoring system.

On the one hand, the defects of the traditional patrol monitoring method are considered, on the other hand, the patrol points in the A park are provided with monitoring cameras, and a manager in the A park builds a set of patrol monitoring system based on the technical scheme provided by the embodiment of the application, so that the patrol record and patrol state of the patrol personnel can be acquired in real time, and the cost can be saved.

Specifically, the manager establishes communication connection between the server and the monitoring cameras of all the patrol points. And the manager inputs an instruction for establishing the patrol task to the server so that the server displays an interface for establishing the patrol task through the display.

In the interface, one or more of the following regions are included: the system comprises a patrol task name input area, a monitoring camera selection area, a patrol route selection area, a patrol time interval input area, a patrol task effective time input area, a patrol task execution time input area, a human face similarity threshold selection area and a patrol task remarking area.

The patrol task name input area is used for inputting the name of the patrol task. Optionally, the patrol task name input area is a text input box. And the patrol task remark area is used for inputting remark information of the patrol task. Optionally, the patrol task remark area is a text input box.

The monitoring camera selection area is used for selecting the monitoring cameras related to the patrol task, namely, the images of all patrol points in the patrol task can be collected in real time through the monitoring cameras. Optionally, the selection area is a pull-down selection area, and the administrator clicks a pull-down selection button in the pull-down selection area through a mouse, so that the server can display all selectable monitoring cameras through an interface.

The patrol route selection area is used to select the type of patrol route for the patrol task. And the manager can determine the night patrol points contained in the night patrol task by selecting the monitoring camera related to the night patrol task in the monitoring camera selection area. The manager can determine the sequence of the patrol points in the patrol route by selecting the type of patrol route of the patrol task. For example, the patrol tasks include patrol point a, patrol point B, and patrol point C. If the type of the patrol route selected by the manager through the patrol route selection area is "palindrome type", the sequence of patrol points in the patrol route is: a → B → C → B → A; if the type of the patrol route selected by the manager through the patrol route selection area is the "repeat type", the sequence of patrol points in the patrol route is: a → B → C → A → B → C.

The input area of the patrol interval is used to input the execution duration of the patrol task. For example, if the patrol task is performed for 80 minutes, the patrol person needs to perform the patrol task within 80 minutes. Optionally, the area is a text input box.

The entry area of the patrol task valid time is used to enter the valid time of the patrol task. For example, if the patrol task effective time is from 1/2021/3/27/2021, the patrol task is effective within 1/2021/3/27/2021. Optionally, the area is a text input box.

The input area of the execution time of the patrol task is used for inputting the execution time of the patrol task. For example, the effective time of the night watching task is 10: 00-16: 00, and then the night watching task is executed within 10: 00-16: 00 of the effective time. Optionally, the region is a time selection region.

The face similarity threshold selection area is used for inputting a minimum threshold of face similarity. For example, if the face similarity threshold is 90%, then, of the images acquired by the monitoring camera at the patrol point, the image whose face similarity with the face image of the patrol person exceeds 90% or 90% is the image including the patrol person. Optionally, the area is a text input area.

After the manager establishes the night patrol task through the interface for establishing the night patrol task, the server can be used as a night patrol monitoring device to monitor the night patrol personnel executing the established night patrol task.

It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.

The method of the embodiments of the present application is set forth above in detail and the apparatus of the embodiments of the present application is provided below.

Referring to fig. 3, fig. 3 is a schematic structural diagram of a patrol monitoring device according to an embodiment of the present application, where the patrol monitoring device 1 includes an obtaining unit 11 and a determining unit 12, where:

the acquiring unit 11 is used for acquiring one or more first patrol records and target patrol routes of patrol personnel;

the determining unit 12 is configured to determine whether the one or more first patrol records and the target patrol route are matched, so as to obtain a matching result;

the determining unit 12 is further configured to determine that the patrol state of the patrol person is normal if the matching result includes that the one or more first patrol records match the target patrol route;

the determining unit 12 is further configured to determine that the patrol status of the patrol person is abnormal if the matching result includes that the one or more first patrol records and the target patrol route do not match.

the determining unit 12 is configured to:

the obtaining unit 11 is further configured to obtain a safety time interval of the target patrol point to be monitored before determining whether the one or more first patrol records are matched with the target patrol route and obtaining a matching result;

With reference to any embodiment of the present application, the obtaining unit 11 is configured to:

the determining unit 12 is further configured to, when it is determined that an image including the patrol person exists in the one or more first images to be processed, obtain one or more first patrol records of the patrol person according to the image including the patrol person in the one or more first images to be processed.

the determining unit 12 is configured to:

In combination with any embodiment of the present application, the obtaining unit 11 is configured to obtain a video stream collected by a monitoring camera in real time, where the monitoring camera is installed at the second night watching point;

In some embodiments, functions of or modules included in the apparatus provided in the embodiments of the present application may be used to execute the method described in the above method embodiments, and specific implementation thereof may refer to the description of the above method embodiments, and for brevity, will not be described again here.

Fig. 4 is a schematic hardware structure diagram of a night patrol monitoring device according to an embodiment of the present application. The patrol monitoring device 2 comprises a processor 21, a memory 22, an input device 23, an output device 24. The processor 21, the memory 22, the input device 23 and the output device 24 are coupled by a connector, which includes various interfaces, transmission lines or buses, etc., and the embodiment of the present application is not limited thereto. It should be appreciated that in various embodiments of the present application, coupled refers to being interconnected in a particular manner, including being directly connected or indirectly connected through other devices, such as through various interfaces, transmission lines, buses, and the like.

The processor 21 may be one or more Graphics Processing Units (GPUs), and in the case that the processor 21 is one GPU, the GPU may be a single-core GPU or a multi-core GPU. Alternatively, the processor 21 may be a processor group composed of a plurality of GPUs, and the plurality of processors are coupled to each other through one or more buses. Alternatively, the processor may be other types of processors, and the like, and the embodiments of the present application are not limited.

Memory 22 may be used to store computer program instructions, as well as various types of computer program code for executing the program code of aspects of the present application. Alternatively, the memory includes, but is not limited to, Random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM), which is used for associated instructions and data.

The input means 23 are for inputting data and/or signals and the output means 24 are for outputting data and/or signals. The input device 23 and the output device 24 may be separate devices or may be an integral device.

It is understood that, in the embodiment of the present application, the memory 22 may be used to store not only the relevant instructions, but also relevant data, for example, the memory 22 may be used to store one or more first night-watch records obtained through the input device 23, or the memory 22 may be used to store the matching result obtained by the processor 21, and the like, and the embodiment of the present application is not limited to the data specifically stored in the memory.

It will be appreciated that figure 4 only shows a simplified design of the night patrol monitoring device. In practical applications, the night patrol monitoring device may further include other necessary components, including but not limited to any number of input/output devices, processors, memories, etc., and all night patrol monitoring devices that can implement the embodiments of the present application are within the scope of the present application.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. It is also clear to those skilled in the art that the descriptions of the various embodiments of the present application have different emphasis, and for convenience and brevity of description, the same or similar parts may not be repeated in different embodiments, so that the parts that are not described or not described in detail in a certain embodiment may refer to the descriptions of other embodiments.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in or transmitted over a computer-readable storage medium. The computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)), or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., Digital Versatile Disk (DVD)), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

One of ordinary skill in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the above method embodiments. And the aforementioned storage medium includes: various media that can store program codes, such as a read-only memory (ROM) or a Random Access Memory (RAM), a magnetic disk, or an optical disk.

Claims

1. A night patrol monitoring method, comprising:

2. The method of claim 1, wherein the target routing route comprises one or more target routing points;

3. The method of claim 2, wherein the matching condition further comprises: the patrol order of the one or more first patrol records is the same as the patrol order in the target patrol route.

4. The method according to claim 2 or 3, wherein the target patrol route includes a target patrol point to be monitored;

5. The method according to any one of claims 1 to 4, characterized in that, in a case where the one or more first patrol records include two or more second patrol records of the first patrol point, a time difference of adjacent patrol records is smaller than the maximum stay time, the adjacent patrol records being two of the second patrol records whose time stamps are adjacent.

6. The method according to any one of claims 1 to 5, wherein the obtaining one or more first patrol records of patrol officers comprises:

7. The method according to claim 6, wherein the one or more first to-be-processed images comprise one or more second to-be-processed images, the one or more night watching points comprise second night watching points, and the acquisition positions of the one or more second to-be-processed images are the second night watching points;

8. The method according to claim 7, applied to a night patrol monitoring device, wherein the acquiring one or more first to-be-processed images comprises:

9. The method of claim 8, wherein the taking one or more images in the video stream as the one or more second to-be-processed images comprises:

10. The method according to any one of claims 1 to 9, further comprising: and sending warning information to a terminal under the condition that the patrol state of the patrol personnel is abnormal.

11. A night patrol monitoring device, the device comprising:

the determination unit is further configured to determine that the patrol status of the patrol person is abnormal, if the matching result includes that the one or more first patrol records and the target patrol route do not match, the one or more first patrol records of the patrol person.

12. An electronic device, comprising: a processor and a memory for storing computer program code comprising computer instructions which, when executed by the processor, cause the electronic device to perform the method of any of claims 1 to 10.

13. A computer-readable storage medium, in which a computer program is stored, which computer program comprises program instructions which, if executed by a processor, cause the processor to carry out the method of any one of claims 1 to 10.