CN117133065A - AI intelligent voice interaction inspection method and device and storage medium - Google Patents
AI intelligent voice interaction inspection method and device and storage medium Download PDFInfo
- Publication number
- CN117133065A CN117133065A CN202311053351.4A CN202311053351A CN117133065A CN 117133065 A CN117133065 A CN 117133065A CN 202311053351 A CN202311053351 A CN 202311053351A CN 117133065 A CN117133065 A CN 117133065A
- Authority
- CN
- China
- Prior art keywords
- patrol
- inspection
- personnel
- module
- voice interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007689 inspection Methods 0.000 title claims abstract description 132
- 230000003993 interaction Effects 0.000 title claims abstract description 37
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000002159 abnormal effect Effects 0.000 claims abstract description 42
- 238000004891 communication Methods 0.000 claims abstract description 26
- 238000004458 analytical method Methods 0.000 claims abstract description 18
- 238000012544 monitoring process Methods 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 5
- 239000010813 municipal solid waste Substances 0.000 claims description 5
- 238000007726 management method Methods 0.000 abstract description 32
- 238000005516 engineering process Methods 0.000 abstract description 12
- 230000005856 abnormality Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 230000002452 interceptive effect Effects 0.000 description 4
- 230000004888 barrier function Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 3
- 239000003795 chemical substances by application Substances 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000002265 prevention Effects 0.000 description 3
- 238000012795 verification Methods 0.000 description 3
- 208000012260 Accidental injury Diseases 0.000 description 2
- 208000014674 injury Diseases 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 239000000779 smoke Substances 0.000 description 2
- 239000002689 soil Substances 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 239000002023 wood Substances 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000013439 planning Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
- 238000012384 transportation and delivery Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C1/00—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
- G07C1/20—Checking timed patrols, e.g. of watchman
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B19/00—Alarms responsive to two or more different undesired or abnormal conditions, e.g. burglary and fire, abnormal temperature and abnormal rate of flow
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Alarm Systems (AREA)
Abstract
The application discloses an AI intelligent voice interaction patrol method, an AI intelligent voice interaction patrol device and a storage medium, and relates to the field of patrol, wherein the AI intelligent voice interaction patrol method comprises the following steps: presetting a patrol area; installing an AI module to the inspection area; the AI module monitors abnormal alarm; presetting a patrol point; making a patrol content, a route and a patrol plan; verifying the identity of the patrol personnel; executing a patrol task; verifying the identity of the inspector at the inspection point; uploading GPS information of the patrol personnel; the system monitors the state of the patrol personnel and gives an abnormal alarm. The AI intelligent voice interaction inspection method realizes the intelligent analysis of abnormal situations by the AI technology, alarms in advance before problems occur, and solves the abnormal problems by management staff, and simultaneously solves the problems that the existing manual inspection has low real-time performance and low efficiency, and the personnel inspection cannot be performed in special dangerous areas; the problems of inspection replacement, inspection omission and the like in manual inspection are solved; the safety guarantee of the patrol personnel is improved, and the communication instantaneity problem with the management personnel is solved.
Description
Technical Field
The application relates to the field of inspection, in particular to an AI intelligent voice interaction inspection method and device and a storage medium.
Background
The national, social and enterprise pay more and more attention to safety management, and serious safety accidents frequently occur due to improper management, so that huge property loss is caused for the national and huge threat is formed to the life safety of people. Safety management, although annual, monthly and daily, traditional technology and management means fall behind, manual inspection and supervision work is relied on in the inspection work, real-time automatic analysis and alarm cannot be carried out on abnormal conditions of monitoring points, and problems such as out-of-range personnel, personnel aggregation, disordered garbage stacking and the like cannot be found in real time; the inspection personnel can not be found in time when the inspection personnel do not inspect according to a specified route or the non-professional inspection personnel enter a specific inspection area, and the current safety management requirement is difficult to meet.
The intelligent AI system is used for automatically identifying potential safety hazards, monitoring various working data in all weather for 24 hours in real time, meeting the requirement that professional posts must have professional people to carry out inspection and detection, comprehensively and intelligently reporting the problems at the first time, timely and effectively reducing the occurrence of safety accidents, reducing repeated and boring inspection work of manpower and comprehensively improving the working efficiency; the system collects the patrol information flatly when the patrol personnel are located at the terminal of the patrol point and patrol personnel carry out patrol along the way, analyzes the state of the patrol personnel, and is helpful for prompting the patrol work to carry out scientific and standardized management on the patrol work; alarming the abnormal state of the inspector, eliminating hidden danger in time and preventing the inspector from happening.
Disclosure of Invention
The present application aims to solve at least one of the technical problems existing in the prior art. Therefore, the embodiment of the application provides an AI intelligent voice interaction inspection method, by which abnormal situations are intelligently analyzed, and alarming is carried out in advance before problems occur, so that an administrator solves the abnormal problems, and meanwhile, the problems that the existing manual inspection is low in real-time performance and efficiency and cannot be carried out in special dangerous areas are solved; the problems of inspection replacement, inspection omission and the like in manual inspection are solved; the safety guarantee of the patrol personnel is improved, and the communication instantaneity problem with the management personnel is solved.
The embodiment of the application also provides an AI intelligent voice interaction patrol device.
The embodiment of the application also provides a computer readable storage medium.
According to an embodiment of the first aspect of the application, the AI intelligent voice interaction patrol method comprises the following steps: AI module, broadcasting module, pronunciation video call module, inspection point, system platform, the method includes:
presetting a patrol area; installing an AI module to the inspection area; the AI module monitors abnormal alarm; presetting a patrol point; making a patrol content, a route and a patrol plan; verifying the identity of the patrol personnel; uploading GPS information of the patrol personnel; executing a patrol task; verifying the identity of the patrol personnel again at the patrol point; uploading inspection content, routes and inspection plan completion conditions; the system monitors the state of the patrol personnel and gives an abnormal alarm.
The AI intelligent voice interaction routing inspection method according to the embodiment of the first aspect of the application has at least the following beneficial effects:
the AI technology is adopted, the AI module is used for monitoring and analyzing the monitoring points and the patrol personnel, the early warning is intelligently carried out, the patrol personnel are arranged at the patrol points, when the patrol personnel carry out the patrol along the way, the system platform collects the patrol information, the monitoring area information and the state of the patrol personnel are analyzed, the patrol work is promoted usefully, the completion condition of the patrol plan task is checked, and the scientific and standardized management is carried out on the patrol work; alarming the abnormal state of the inspector, eliminating hidden danger in time and preventing the inspector from happening.
Further, the method further comprises the steps of collecting GPS information of the patrol terminal, uploading GPS data information of the patrol personnel to the system platform, and determining position information of the patrol personnel in real time.
Further, the method further comprises: the voice video call module is arranged in the handheld terminal, so that the patrol personnel can carry and use the voice video call module conveniently, and meanwhile, the patrol personnel can carry out voice video interactive communication with the manager through voice video call.
Further, a preset patrol point is provided with a GPS (global positioning system) positioning, an NFC (near field communication) tag, a Bluetooth tag and a two-dimensional code tag, and the two-dimensional code tag is used for calibrating the patrol position, and a patrol inspector scans patrol point information through the patrol terminal equipment and reports the patrol inspector position information to a system platform so as to determine that the patrol inspector reaches the preset patrol point according to a management plan.
Further, through the network camera, AI camera or the terminal equipment that patrols and examines of point, gather the face information that patrols and examines personnel, compare the face information that acquires from the point of patrolling and examining and discern, confirm and patrol personnel's identity, prevent that patrol personnel from masquerading as identity agent and patrol.
Further, the AI module is an AI camera, and an AI recognition related module is built in the camera to collect videos and images in a designated area for AI intelligent analysis.
Further, the AI anomaly alarm method includes the following steps:
step one: presetting an abnormal alarm condition;
by encountering problems in routine inspection, an abnormal condition is set, and these conditions may include: personnel cross the appointed boundary line and enter the forbidden area; a large number of people are gathered within a certain area, such as an area access portal gathering a large number of people; large solid objects such as stones, soil piles, wood and the like are stored on the channel to block the traffic capacity of the channel; or other abnormal situations such as smoke, flame and other fire phenomena occur in the inflammable area.
Step two: collecting monitoring information;
image videos in the monitoring area are acquired by an AI camera,
step three: comparing the collected monitoring information with alarm conditions, and alarming if the collected monitoring information meets the conditions;
the AI module compares the image video data collected by the camera with preset conditions, performs intelligent analysis, identifies the image data with the preset conditions, and reminds and drives away related personnel through voice broadcasting; or uploading the abnormal image data to a system platform to remind a manager to treat.
Step four: and the alarm is carried out and simultaneously the voice and video communication with the patrol personnel is carried out.
When an abnormality occurs, the system platform automatically reminds patrol personnel near the area where the abnormality occurs to remind; the manager can also carry out voice and video communication with the inspector through voice and video, so that the inspector is reminded to treat abnormal events, such as out-of-range personnel or large-scale gathering personnel, and danger is prevented.
Further, setting the common problems in security management as alarm conditions includes: the situation such as personnel out of range, personnel gathering, barrier, rubbish stack, trigger alarm condition when above-mentioned situation appears promptly, carry out the voice through broadcasting module and remind, drive away or system platform reminds the night patrol personnel nearby to handle, prevent the situation further enlarges.
Further, GPS data of the inspector are collected in real time, position information of the inspector is recorded in real time, a system platform automatically compares whether the inspector performs inspection according to a preset route, meanwhile, according to the fact that the inspector stays at a certain place for too long, a manager can perform voice communication with the inspector, and the inspector is reminded of executing inspection tasks according to a plan. If the inspector falls, the manager can inform the inspector nearby to rescue the inspector, so that accidental injury of the inspector is prevented.
Furthermore, when the patrol personnel carry out patrol, the patrol personnel need to log in the system platform to carry out identity verification, and the identity of the patrol personnel is determined.
Further, the manager can preset the patrol contents, the patrol route and the patrol plan. For example, a manager sets equipment state, environment state, slope state, vegetation state and the like which need to be inspected by an inspection staff; presetting a routing inspection route according to an inspection area management requirement; and (5) making a patrol plan, and determining plan contents such as personnel, patrol time, patrol frequency and the like required by a patrol route.
Further, the manager can remind the inspector of the execution plan through the voice module.
The embodiment of the second aspect of the application also provides an AI intelligent voice interaction patrol device, which comprises:
the system comprises an AI module, a broadcasting module, a voice video call module, a patrol point, a system platform and a memory which are connected with each other, wherein the memory is used for storing a computer program, the computer program comprises program instructions, and the processor is configured for calling the program instructions.
The AI intelligent voice interaction patrol device according to the embodiment of the second aspect of the application has at least the following beneficial effects: the abnormal situation is intelligently analyzed through an AI technology, an alarm is given in advance before a problem occurs, and a manager solves the abnormal problem, and meanwhile, the problems that the existing manual inspection is low in instantaneity and efficiency, and the personnel inspection cannot be performed in a special dangerous area are solved; the problems of inspection replacement, inspection omission and the like in manual inspection are solved; the safety guarantee of the patrol personnel is improved, and the communication instantaneity problem with the management personnel is solved.
According to an embodiment of the third aspect of the present application, the storage medium stores computer-executable instructions for causing a computer to execute the AI intelligent voice interaction patrol method according to the first aspect.
The computer-readable storage medium according to the embodiment of the third aspect of the present application has at least the following advantageous effects: the abnormal situation is intelligently analyzed through an AI technology, an alarm is given in advance before a problem occurs, and a manager solves the abnormal problem, and meanwhile, the problems that the existing manual inspection is low in instantaneity and efficiency, and the personnel inspection cannot be performed in a special dangerous area are solved; the problems of inspection replacement, inspection omission and the like in manual inspection are solved; the safety guarantee of the patrol personnel is improved, and the communication instantaneity problem with the management personnel is solved.
Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.
Drawings
The foregoing and/or additional aspects and advantages of the application will become apparent and may be better understood from the following description of embodiments taken in conjunction with the accompanying drawings in which:
FIG. 1 is a schematic diagram of an AI intelligent voice interaction inspection system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of the working steps of an AI intelligent voice interaction inspection system provided by the embodiment of the application;
fig. 3 is a schematic structural diagram of an AI intelligent voice interaction patrol device according to an embodiment of the present application, where reference numerals are given to:
a patrol platform 800, an AI module 801, a voice-video module 802, a patrol module 803, a memory 804, one or more programs 805.
Detailed Description
Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are illustrative only and are not to be construed as limiting the application.
In the description of the present application, unless explicitly defined otherwise, terms such as arrangement, installation, connection, etc. should be construed broadly and the specific meaning of the terms in the present application can be reasonably determined by a person skilled in the art in combination with the specific contents of the technical scheme.
In the intelligent AI era, the conventional manual inspection and supervision work in the patrol process cannot be fully satisfied by daily patrol personnel, along with the development of artificial intelligence, the intelligent AI system automatically recognizes potential safety hazards, monitors all working data in all weather and in real time for 24 hours, meets the requirement that a professional post must have a professional person to carry out patrol detection, is fully intelligent, reports the occurrence of problems in the first time, effectively reduces the occurrence of safety accidents in time, can reduce repeated and boring patrol work of manpower, and comprehensively improves the working efficiency.
By means of the AI intelligent voice interaction patrol system, reasonable patrol routes are selected and set according to public security conditions of users through planning patrol points and traffic lanes. Thus, a patrol prevention and control network of 'electronic fixed point, point string, line band surface, point line surface combination' is formed. The patrol prevention work is more scientific and reasonable, and the prevention level tends to be balanced.
By means of the application of the AI intelligent voice interaction inspection system, inspection and night patrol are under the supervision of modern scientific technology, and the technical means and management are combined, so that the passive situation that 'inspection and not inspection are carried out by one sample, inspection is carried out by more than one sample, inspection and not inspection are not known by the person' is excited, and the work consciousness and initiative of staff are stimulated, so that various patrol precautionary measures are ensured to be practically carried out. Meanwhile, through an AI intelligent analysis technology, the inspection route and the inspection frequency are automatically set according to parameters such as basic setting, weather conditions, abnormal data analysis, historical inspection result analysis and the like.
Through the GPS position data of gathering the personnel of patrolling and examining, look over the personnel's position of patrolling and examining in real time, carry out intelligent pronunciation to the personnel of patrolling and examining and remind: reminding 10 minutes before the task starts, reminding more than 20 minutes after the inspection, and reminding 10 minutes before the inspection is finished.
Meanwhile, a manager sets a patrol area through a system platform, and when the manager leaves the patrol area in patrol time, the manager alarms the patrol area through a voice video mode; or when the patrol personnel do not carry out patrol according to the appointed route, the manager carries out voice reminding on the patrol personnel, deviates from the patrol route or leaks patrol points, and prompts the patrol personnel to execute patrol tasks according to the patrol plan.
The system platform monitors the safety of the patrol personnel by determining the GPS position information and the voice intercom mode of the patrol personnel, and if the patrol personnel fall down and stagnate for a long time to give an alarm, reminds other patrol personnel to assist in salvaging or patrol to other patrol points as soon as possible.
Meanwhile, the system platform defines a forbidden area to prevent inspectors or other personnel from deliberately or mistakenly entering the area to generate unexpected events; when the patrol personnel enter the forbidden area, the system platform gives an alarm, and drives away the personnel entering the forbidden area through voice broadcasting.
The voice video call module is arranged in the handheld terminal, so that the patrol personnel can carry and use conveniently, and when the patrol personnel need to carry out voice video communication with the patrol personnel, the patrol personnel can carry out interactive communication with the manager through voice video call.
By setting a GPS positioning, NFC label, bluetooth label and two-dimension code label at a preset inspection point for calibrating the inspection position, and the inspector scans the inspection point information through the inspection terminal equipment and reports the position information of the inspector to the system platform so as to determine that the inspector reaches a preset inspection place according to the management plan.
The face information of the patrol personnel is collected through the network camera, the AI camera or the patrol terminal equipment of the patrol point, the face information obtained from the patrol point is compared and identified, the identity of the patrol personnel is confirmed, and the patrol personnel is prevented from impersonating the identity agent for patrol.
In this embodiment, the AI subsystem is composed of an AI module and a camera, where the AI module is built in the camera and has AI functions such as video image recognition and analysis. And acquiring videos and images in the appointed area through an AI camera for AI intelligent analysis.
Further, before performing the AI identification analysis, an AI anomaly alarm method is preset, including the steps of:
step one: presetting an abnormal alarm condition;
by encountering problems in routine inspection, an abnormal condition is set, and these conditions may include: personnel cross the appointed boundary line and enter the forbidden area; a large number of people are gathered within a certain area, such as an area access portal gathering a large number of people; large solid objects such as stones, soil piles, wood and the like are stored on the channel to block the traffic capacity of the channel; or other abnormal situations such as smoke, flame and other fire phenomena occur in the inflammable area.
Step two: collecting monitoring information;
image videos in the monitoring area are acquired by an AI camera,
step three: comparing the collected monitoring information with alarm conditions, and alarming if the collected monitoring information meets the conditions;
the AI module compares the image video data collected by the camera with preset conditions, performs intelligent analysis, identifies the image data with the preset conditions, and reminds and drives away related personnel through voice broadcasting; or uploading the abnormal image data to a system platform to remind a manager to treat.
Step four: and the alarm is carried out and simultaneously the voice and video communication with the patrol personnel is carried out.
When an abnormality occurs, the system platform automatically reminds patrol personnel near the area where the abnormality occurs to remind; the manager can also carry out voice and video communication with the inspector through voice and video, so that the inspector is reminded to treat abnormal events, such as out-of-range personnel or large-scale gathering personnel, and danger is prevented.
Further, setting the common problems in security management as alarm conditions includes: the situation such as personnel out of range, personnel gathering, barrier, rubbish stack, trigger alarm condition when above-mentioned situation appears promptly, carry out the voice through broadcasting module and remind, drive away or system platform reminds the night patrol personnel nearby to handle, prevent the situation further enlarges.
Further, GPS data of the inspector are collected in real time, position information of the inspector is recorded in real time, a system platform automatically compares whether the inspector performs inspection according to a preset route, meanwhile, according to the fact that the inspector stays at a certain place for too long, a manager can perform voice communication with the inspector, and the inspector is reminded of executing inspection tasks according to a plan. If the inspector falls, the manager can inform the inspector nearby to rescue the inspector, so that accidental injury of the inspector is prevented.
Furthermore, when the patrol personnel carry out patrol, the patrol personnel need to log in the system platform to carry out identity verification, and the identity of the patrol personnel is determined.
Further, the manager can preset the patrol contents, the patrol route and the patrol plan. For example, a manager sets equipment state, environment state, slope state, vegetation state and the like which need to be inspected by an inspection staff; presetting a routing inspection route according to an inspection area management requirement; and (5) making a patrol plan, and determining plan contents such as personnel, patrol time, patrol frequency and the like required by a patrol route.
Further, the system platform analyzes the plan execution condition of the inspector, and the manager can remind the inspector of the plan execution through the voice module.
Based on the above, the embodiment of the application provides an AI intelligent voice interaction inspection method, an AI intelligent voice interaction inspection device and a storage medium, which can realize intelligent analysis of abnormal situations through an AI technology, give an alarm in advance before problems occur, solve the abnormal problems by management staff, and solve the problems that the real-time performance is low, the efficiency is low and the personnel inspection cannot be performed in special dangerous areas in the existing manual inspection; the problems of inspection replacement, inspection omission and the like in manual inspection are solved; the safety guarantee of the patrol personnel is improved, and the communication instantaneity problem with the management personnel is solved.
Referring to fig. 1, according to a method for an AI-intelligent voice interaction patrol system according to an embodiment of the first aspect of the present application, the AI-intelligent voice interaction patrol system is composed of a plurality of subsystems, including: AI subsystem, broadcasting module, inspection subsystem, inspection terminal.
Referring to fig. 2, an AI intelligent voice interaction patrol method according to an embodiment of the first aspect of the present application includes:
step 201: the inspection area is preset.
And the user presets a patrol area for the managed area according to the management requirement, such as selecting a patrol geographical area in the electronic map, and setting a coordinate position required to carry out patrol.
Step 202: installing an AI module to the inspection area;
the AI module is preset in the camera, then the AI camera is installed in a specified area to be patrolled and examined, the area is monitored by the AI camera, and the AI module has the functions of foreign matter identification, moving object detection, face recognition, personnel gathering detection and the like.
Step 203: the AI module monitors abnormal alarm;
the common abnormal bars are set through the inspection system platform, the AI module is used for monitoring, when the AI module monitors that the AI module finds the abnormal conditions which are consistent with the preset abnormal conditions, the AI module broadcasts according to the set voice and sends data to the system platform, and the system platform pops up the camera video and the alarm related data to prompt related personnel in time.
Step 204: presetting a patrol point;
in the set inspection area, according to inspection requirements, inspection points are set at intersections, important areas and the like, GPS position information points, NFC labels, bluetooth labels or Bluetooth terminals, two-dimensional code labels or two-dimensional code reading equipment are arranged on the inspection points, and the equipment can be singly set or combined according to the requirements; meanwhile, the inspection point can be provided with a camera or a face recognition device for video monitoring and face recognition. Through a preset inspection point, an inspector is required to reach the point for inspection.
Step 205: making a patrol content, a route and a patrol plan;
and a manager determines inspection contents in a system platform according to the safety management requirements, wherein the inspection contents comprise equipment state, temperature and humidity, power supply state, side slope state, fire-fighting facility state, animal and plant conditions and the like which need inspection. And setting a line to be inspected in the inspection area, and making inspection work plans such as division of workers, inspection time, frequency and the like.
Step 206: verifying the identity of the inspector, and uploading GPS position data of the inspector;
before the patrol personnel starts the patrol work, logging in the system platform for identity verification in a face recognition mode, and recording and uploading GPS position data of the patrol personnel to the system platform.
Step 207: executing a patrol task;
and the patrol personnel checks the task from the system platform or the handheld terminal and performs patrol according to the patrol plan and the content.
Step 208: verifying the identity of the inspector at the inspection point;
when the patrol personnel reach the appointed patrol place, the state confirmation is carried out again through the face recognition, other patrol personnel are prevented from patrolling for the patrol personnel, and the patrol contents corresponding to the patrol points are finished according to the prompt.
Step 209: uploading the completion situation of the inspection plan;
through the handheld terminal (the handheld machine), the system platform collects and stores GPS information of the patrol personnel in real time, and the system platform confirms whether the patrol personnel carry out patrol according to a preset route through position information analysis of the patrol personnel, and the analysis confirms whether the patrol plan is completed.
Step 210: monitoring the state of the patrol personnel by the system, and giving an abnormal alarm;
the handheld machine uploads the GPS information of the patrol personnel in a full-range mode, and when the GPS information of the patrol personnel has no change for a long time, the system platform checks whether the patrol personnel falls down or stagnates in a certain area for a long time; and confirming whether the patrol personnel enter a dangerous area or leave a designated area through the GPS information of the patrol personnel. If the abnormal condition is found, voice communication or video communication can be carried out between the system platform and the patrol personnel, and the system platform gives an alarm to inform the management personnel of carrying out treatment.
The AI intelligent voice interactive inspection method can realize the intelligent analysis of abnormal situations by the AI technology, give an alarm in advance before the occurrence of problems, solve the abnormal problems by management staff, and solve the problems that the existing manual inspection has low real-time performance and low efficiency and cannot be carried out in special dangerous areas; the problems of inspection replacement, inspection omission and the like in manual inspection are solved; the safety guarantee of the patrol personnel is improved, and the communication instantaneity problem with the management personnel is solved.
According to some embodiments of the application, the method further comprises: the voice video call module is arranged in the handheld terminal, so that the patrol personnel can carry and use the voice video call module conveniently, and meanwhile, the patrol personnel can carry out voice video interactive communication with the manager through voice video call.
According to some embodiments of the present application, a preset inspection point is set, such as a GPS location, an NFC tag, a bluetooth tag, and a two-dimensional code tag, for calibrating an inspection position, and an inspector scans inspection point information and reports the inspection personnel position information to a system platform, so as to determine that the inspector arrives at the preset inspection point according to a management plan.
According to some embodiments of the application, the face information acquired from the inspection point is compared and identified, the identity of the inspection personnel is confirmed, and the inspection personnel is prevented from masquerading as an identity agent for inspection.
According to some embodiments of the application, the AI module is an AI camera, and the AI recognition related module is built in the camera shooting device to collect video and images in a designated area for AI intelligent analysis.
According to some embodiments of the present application, the AI anomaly alarm method includes the steps of:
step one: presetting an abnormal alarm condition;
step two: collecting monitoring information;
step three: comparing the collected monitoring information with alarm conditions, and alarming if the collected monitoring information meets the conditions;
step four: and the alarm is carried out and simultaneously the voice and video communication with the patrol personnel is carried out.
According to some embodiments of the present application, setting a problem common in security management as an alarm condition includes: the situations such as personnel crossing, personnel gathering, barriers, garbage stacking and the like are avoided, the alarm condition is triggered after the situations occur, and nearby patrol personnel are reminded to treat through voice reminding and driving or a system platform, so that the situation is prevented from being further expanded.
When the voice intercom mode can not be effectively solved. The system recommends nearby patrol personnel, and the management personnel can talk back to inform the patrol personnel to the site for processing according to actual condition voice.
Referring to fig. 3, an AI-intelligent voice interaction patrol apparatus according to an embodiment of the second aspect of the present application includes:
a patrol platform 800, an AI module 801, a voice-video module 802, a patrol module 803, a memory 804, one or more programs 805. The AI module, the audio video module, the inspection module, and the memory are interconnected, wherein the memory is configured to store a computer program comprising program instructions, and the processor is configured to invoke the program instructions.
Inspection platform 800: the method is used for providing management for patrol personnel, setting a patrol route, patrol contents and a patrol plan.
AI module 801: for AI analysis.
The voice video module 802: for voice video communications.
The AI intelligent voice interaction patrol device according to the embodiment of the second aspect of the application has at least the following beneficial effects: the intelligent analysis of the abnormal situation by the AI technology can be realized, the alarm is given in advance before the problem occurs, the abnormal problem is solved by the management personnel, and meanwhile, the problems that the existing manual inspection is low in instantaneity and efficiency, and the personnel inspection cannot be performed in a special dangerous area are also solved; the problems of inspection replacement, inspection omission and the like in manual inspection are solved; the safety guarantee of the patrol personnel is improved, and the communication instantaneity problem with the management personnel is solved.
Embodiments of the third aspect of the present application also provide a computer-readable storage medium storing computer-executable instructions for: and executing the AI intelligent voice interaction routing inspection method in the embodiment of the first aspect.
In some embodiments, the storage medium stores computer-executable instructions that are executed by one or more control processors, for example, by one processor in an electronic device according to an embodiment of the third aspect, and may cause the one or more processors to perform the AI intelligent voice interaction patrol method according to the embodiment of the first aspect.
The embodiments of the present application have been described in detail with reference to the accompanying drawings, but the present application is not limited to the above embodiments, and various changes can be made within the knowledge of one of ordinary skill in the art without departing from the spirit of the present application.
The above described apparatus embodiments are merely illustrative, wherein the units illustrated as separate components may or may not be physically separate, i.e. may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
Those of ordinary skill in the art will appreciate that all or some of the steps, systems, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as known to those skilled in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Furthermore, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
In the description of the present specification, reference to the terms "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present application have been shown and described, it will be understood by those of ordinary skill in the art that: many changes, modifications, substitutions and variations may be made to the embodiments without departing from the spirit and principles of the application, the scope of which is defined by the claims and their equivalents.
Claims (9)
1. The AI intelligent voice interaction inspection method comprises an AI module, a broadcasting module, a voice video call module, an inspection point and a system platform, and is characterized by comprising the following steps:
presetting a patrol area;
installing an AI module to the inspection area;
the AI module monitors abnormal alarm;
presetting a patrol point;
making a patrol content, a route and a patrol plan;
verifying the identity of the patrol personnel and uploading GPS information of the patrol personnel;
executing a patrol task;
verifying the identity of the inspector at the inspection point;
uploading the completion situation of the inspection plan;
the system monitors the state of the patrol personnel and gives an abnormal alarm.
2. The AI intelligent voice interaction inspection method according to claim 1, wherein the voice video call module is arranged in a handheld terminal and used for voice video interaction communication.
3. The AI intelligent voice interaction routing inspection method of claim 2, wherein the routing inspection point is provided with a GPS positioning tag, an NFC tag, a bluetooth tag and a two-dimensional code tag for calibrating the routing inspection position.
4. The AI intelligent voice interaction patrol method according to claim 2, wherein the patrol point is provided with a face recognition device for the patrol personnel to recognize the face and verify the identity of the patrol personnel.
5. The AI intelligent voice interaction patrol method according to claim 1, wherein the AI module is an AI camera for AI video acquisition and analysis.
6. The AI intelligent voice interaction patrol method of claim 1, wherein the AI anomaly alarm method comprises:
presetting an abnormal alarm condition;
collecting monitoring information;
comparing the collected monitoring information with alarm conditions, and alarming if the collected monitoring information meets the conditions;
and the alarm is carried out and simultaneously the voice and video communication with the patrol personnel is carried out.
7. The AI-intelligent voice interaction patrol method of claim 5, wherein the alarm condition comprises: person out of range, person gathering, obstacle and garbage stacking.
8. AI intelligent voice interaction inspection device, its characterized in that includes:
AI module, broadcast module, voice-video call module, inspection point, system platform, memory, wherein the memory is for storing a computer program comprising program instructions, the processor is configured to invoke the program instructions to perform the method of any of claims 1-5.
9. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311053351.4A CN117133065A (en) | 2023-08-17 | 2023-08-17 | AI intelligent voice interaction inspection method and device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311053351.4A CN117133065A (en) | 2023-08-17 | 2023-08-17 | AI intelligent voice interaction inspection method and device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117133065A true CN117133065A (en) | 2023-11-28 |
Family
ID=88853943
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311053351.4A Pending CN117133065A (en) | 2023-08-17 | 2023-08-17 | AI intelligent voice interaction inspection method and device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117133065A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117314136A (en) * | 2023-11-30 | 2023-12-29 | 江苏力鼎环保装备有限公司 | Intelligent inspection system and method based on village and town scattered sewage treatment industry |
-
2023
- 2023-08-17 CN CN202311053351.4A patent/CN117133065A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117314136A (en) * | 2023-11-30 | 2023-12-29 | 江苏力鼎环保装备有限公司 | Intelligent inspection system and method based on village and town scattered sewage treatment industry |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107911653B (en) | Intelligent video monitoring module, system, method and storage medium for residence | |
| CN207301750U (en) | Power grid construction intelligence control platform system | |
| CN106454250A (en) | Intelligent recognition and early warning processing information platform | |
| CN111479089B (en) | Power grid construction monitoring method and system based on Beidou positioning | |
| CN112738468B (en) | Safety early warning method for intelligent park | |
| CN113298444A (en) | Private cloud-based intelligent power safety control platform | |
| CN112112629A (en) | Safety business management system and method in drilling operation process | |
| CN117133065A (en) | AI intelligent voice interaction inspection method and device and storage medium | |
| CN116962460B (en) | Intelligent park operation management system and method | |
| CN112004067A (en) | Video monitoring method, device and storage medium | |
| CN112800910A (en) | Communication machine room maintenance operation efficiency evaluation method and system | |
| CN114510001A (en) | Factory management system and method | |
| CN211630273U (en) | Intelligent image recognition device for railway environment | |
| CN115152732A (en) | Intelligent bird repelling system | |
| CN109949434B (en) | Community patrol management method and device, terminal equipment and storage medium | |
| CN114463873A (en) | Patrol system for community | |
| CN117081917A (en) | Intelligent gateway based on AI (advanced technology attachment) internet of things sewage treatment operation and maintenance management | |
| CN112070191A (en) | Workshop management and control system | |
| CN111556144A (en) | Inspection task processing method and device | |
| CN116437054A (en) | Video monitoring management system based on intelligent terminal | |
| CN116246445A (en) | Knowledge-graph-based warehouse safety multi-source Internet-of-things data early warning method | |
| CN110797980A (en) | Intelligent inspection method and system for power channel and equipment based on APP | |
| CN214376017U (en) | Power equipment fault inspection system | |
| CN115314675A (en) | High-level monitoring management system and method for power area | |
| CN115223078A (en) | Power behavior recognition early warning method, system and equipment based on high-level monitoring |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |