CN113645449B - Data acquisition method and system of industrial Internet and computer readable storage medium - Google Patents
Data acquisition method and system of industrial Internet and computer readable storage medium Download PDFInfo
- Publication number
- CN113645449B CN113645449B CN202110912121.3A CN202110912121A CN113645449B CN 113645449 B CN113645449 B CN 113645449B CN 202110912121 A CN202110912121 A CN 202110912121A CN 113645449 B CN113645449 B CN 113645449B
- Authority
- CN
- China
- Prior art keywords
- equipment
- monitoring
- monitoring device
- abnormal
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000012544 monitoring process Methods 0.000 claims abstract description 137
- 238000012806 monitoring device Methods 0.000 claims abstract description 125
- 230000002159 abnormal effect Effects 0.000 claims abstract description 90
- 230000003287 optical effect Effects 0.000 claims abstract description 41
- 238000013507 mapping Methods 0.000 claims abstract description 29
- 238000002372 labelling Methods 0.000 claims description 45
- 230000008859 change Effects 0.000 claims description 22
- 230000004044 response Effects 0.000 claims description 11
- 238000010276 construction Methods 0.000 claims description 6
- 238000013480 data collection Methods 0.000 claims description 5
- 238000011084 recovery Methods 0.000 claims description 3
- 230000003321 amplification Effects 0.000 abstract description 5
- 238000003199 nucleic acid amplification method Methods 0.000 abstract description 5
- 238000012545 processing Methods 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 6
- 230000005856 abnormality Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
- H04N23/675—Focus control based on electronic image sensor signals comprising setting of focusing regions
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention relates to the technical field of data acquisition, in particular to a data acquisition method, device and system of an industrial Internet and a computer readable storage medium. After the equipment is abnormal, firstly acquiring a marking frame corresponding to the position of the equipment; reconstructing an angle-equipment mapping library; adjusting the rotation of the monitoring device so as to enable the abnormal equipment to be positioned in the center of the monitoring picture; then, the center of the monitoring picture is taken as an amplifying center, and the optical zoom magnification of the monitoring device is adjusted; finally, the amplified equipment image can be acquired, and after the acquisition is completed, the optical zoom magnification and the pitch angle of the monitoring device are controlled to restore to the initial value, so that the image acquisition of the abnormal equipment is completed. The monitoring device is controlled by an algorithm to position the abnormal equipment, and then the optical zoom is utilized to carry out lossless amplification on the picture, so that a high-resolution and large-size image pickup sensor is not needed. The hardware cost can be effectively reduced, and the automatic acquisition of the images of the abnormal equipment is realized.
Description
Technical Field
The invention relates to the technical field of data acquisition, in particular to a data acquisition method, device and system of an industrial Internet and a computer readable storage medium.
Background
With the gradual maturity of intelligent unmanned factories based on industrial Internet, more and more processing enterprises give the processing process monitoring which originally needs people to supervise to a computer for completion. However, after the equipment abnormality is identified, a person is still required to further acquire a real-time monitoring image corresponding to the abnormal equipment to assist a remote employee in processing.
The existing monitoring image for monitoring the processing process is usually based on a monitoring camera to cover the whole monitoring area, and then the real-time monitoring image corresponding to the abnormal equipment is obtained by digitally zooming the area where the abnormal equipment is located in the later stage of manual work.
However, in order to ensure the picture detail and quality of the whole monitoring area, a high-specification image pickup sensor is often required, resulting in higher hardware cost. Secondly, local digital zooming of the monitored image of the whole monitored area needs to be realized manually, so that the degree of intellectualization is low.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a data acquisition method, a device and a system of the industrial Internet and a computer readable storage medium, which solve the problems of high hardware requirement and low intelligent degree of an imaging sensor in the prior art.
In order to achieve the above purpose, the invention is realized by the following technical scheme:
In a first aspect, there is provided a data acquisition method for an industrial internet, the method comprising:
acquiring a labeling frame corresponding to the equipment position based on a monitoring area of a monitoring device;
constructing an angle-equipment mapping library based on the horizontal rotation angles of the marking frame and the monitoring device;
Based on the angle-equipment mapping library and the acquired abnormal equipment information, controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment;
Based on the device position of the monitoring picture of the abnormal device at the target angle, controlling the monitoring device to longitudinally rotate so that the abnormal device is positioned at the center of the monitoring picture;
Taking the center of the monitoring picture as an amplifying center, and adjusting the optical zoom magnification of the monitoring device;
And acquiring the amplified equipment image, and controlling the optical zoom magnification and the pitch angle of the monitoring device to restore to initial values after the acquisition is completed.
Further, the obtaining, based on the monitoring area of the monitoring device, a labeling frame corresponding to the device position includes:
Acquiring a monitoring area image obtained by transverse rotation of a monitoring device at a first speed;
And acquiring the labeling frame of the equipment in the monitoring area image, and tracking the equipment to obtain the labeling frame of each equipment in the monitoring area image.
Further, the constructing an angle-device mapping library based on the horizontal rotation angles of the labeling frame and the monitoring device includes:
when the longitudinal center line of the labeling frame of any equipment is coincident with the longitudinal center line of the monitoring picture, recording the transverse rotation angle of the current monitoring device, and associating the equipment with the transverse rotation angle.
Further, the controlling and monitoring device transversely rotates to a target angle corresponding to the abnormal equipment based on the angle-equipment mapping library and the acquired abnormal equipment information, and the method comprises the following steps:
when any device is abnormal, acquiring a transverse rotation angle corresponding to the abnormal device from an angle-device mapping library as a target angle;
and controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment.
Further, the controlling the monitoring device to rotate longitudinally based on the device position of the monitoring frame of the abnormal device at the target angle, so that the abnormal device is located at the center of the monitoring frame, includes:
after rotating to a target angle, acquiring a transverse center line of a labeling frame of abnormal equipment in a monitoring picture and a transverse center line of the monitoring picture;
And controlling the monitoring device to longitudinally rotate at a second speed, so that the transverse center line of the labeling frame of the abnormal equipment is overlapped with the transverse center line of the monitoring picture.
Further, the adjusting the optical zoom magnification of the monitoring device with the center of the monitoring picture as the amplifying center includes:
Constructing a plane coordinate system based on the monitoring picture to obtain coordinate information of the boundary of the monitoring picture;
acquiring a corner coordinate set of equipment in a labeling frame of abnormal equipment;
Adjusting the optical zoom magnification of the monitoring device at a fixed magnification change rate;
when the distance between any corner point and the boundary of the monitoring picture is smaller than the preset distance, stopping adjusting the optical zoom multiplying power of the monitoring device
Further, the method for setting the preset distance includes:
Acquiring response delay of the monitoring device;
When the optical zoom magnification of the monitoring device is adjusted at a fixed magnification change rate, acquiring an average value of distances between corner points in the previous n frames of pictures and the boundary of the monitoring picture as a distance change rate;
The preset distance is set to a value greater than the product of the response delay of the monitoring device and the rate of change of the distance of the corner point relative to the boundary of the monitoring picture.
In a second aspect, there is provided an industrial internet data acquisition device, comprising:
The acquisition module is used for acquiring a labeling frame corresponding to the equipment position based on the monitoring area of the monitoring device;
The construction module is used for constructing an angle-equipment mapping library based on the horizontal rotation angles of the marking frame and the monitoring device;
the first control module is used for controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment based on the angle-equipment mapping library and the acquired abnormal equipment information;
The second control module is used for controlling the monitoring device to longitudinally rotate based on the equipment position of the monitoring picture of the abnormal equipment at the target angle so that the abnormal equipment is positioned at the center of the monitoring picture;
The adjusting module is used for adjusting the optical zoom magnification of the monitoring device by taking the center of the monitoring picture as an amplifying center;
The acquisition module is used for acquiring the amplified equipment image and controlling the optical zoom multiplying power and the pitch angle recovery initial value of the monitoring device after the acquisition is completed.
In a third aspect, a data acquisition system of an industrial internet includes at least one data acquisition terminal device, the data acquisition terminal device including:
One or more processors;
a memory; and
One or more computer readable instructions, wherein the one or more computer readable instructions are stored in the memory and configured to be executed by the one or more processors, the program comprising steps for performing the data collection method of the industrial internet described above.
In a fourth aspect, a computer-readable storage medium storing computer-readable instructions for data acquisition of an industrial internet is provided, wherein the computer-readable instructions cause a computer to perform the steps of the data acquisition method of the industrial internet as described above.
When the equipment operates normally, the monitoring device acquires images of the whole monitoring area. After the equipment is abnormal, firstly acquiring a marking frame corresponding to the position of the equipment; reconstructing an angle-equipment mapping library; and controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment; then controlling the monitoring device to longitudinally rotate, so that the abnormal equipment is positioned at the center of the monitoring picture; then, the center of the monitoring picture is taken as an amplifying center, and the optical zoom magnification of the monitoring device is adjusted; finally, the amplified equipment image can be acquired, and after the acquisition is completed, the optical zoom magnification and the pitch angle of the monitoring device are controlled to restore to the initial value, so that the image acquisition of the abnormal equipment is completed. Because the monitoring device is controlled by the algorithm to locate the abnormal equipment, and then the optical zoom is utilized to carry out lossless amplification on the picture, a high-resolution and large-size camera sensor is not needed, the hardware cost can be effectively reduced, and the automatic acquisition of the images of the abnormal equipment is realized.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a data acquisition method of an industrial Internet according to an embodiment of the invention;
FIG. 2 is a schematic diagram of the device according to the embodiment of the present invention when the longitudinal centerline of the labeling frame coincides with the longitudinal centerline of the monitoring screen;
FIG. 3 is a schematic diagram of an industrially relevant data acquisition device according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a data acquisition terminal device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention are clearly and completely described, and it is obvious that the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The embodiment of the application solves the problems of high hardware requirement and low intelligent degree of the camera sensor in the prior art by providing the data acquisition method, the device and the system of the industrial Internet and the computer readable storage medium.
In order to better understand the above technical solutions, the following detailed description will refer to the accompanying drawings and specific embodiments.
In this context, the monitoring device may use an existing monitoring camera or an array composed of a plurality of monitoring cameras, and each monitoring camera may independently rotate in a lateral direction and a longitudinal direction within a certain range.
Example 1:
the embodiment of the invention provides a data acquisition method of an industrial Internet, which is shown in FIG. 1, and specifically comprises the following steps:
s1, acquiring a labeling frame corresponding to the equipment position based on a monitoring area of a monitoring device;
s2, constructing an angle-equipment mapping library based on the horizontal rotation angles of the marking frame and the monitoring device;
s3, controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment based on the angle-equipment mapping library and the acquired abnormal equipment information;
s4, controlling the monitoring device to longitudinally rotate based on the equipment position of the monitoring picture of the abnormal equipment at the target angle so that the abnormal equipment is positioned at the center of the monitoring picture;
s5, taking the center of the monitoring picture as an amplifying center, and adjusting the optical zoom magnification of the monitoring device;
s6, acquiring the amplified equipment image, and controlling the optical zoom multiplying power and the pitch angle of the monitoring device to restore to an initial value after the acquisition is completed.
Compared with the prior art, the embodiment of the invention has the beneficial effects that:
When the equipment operates normally, the monitoring device acquires images of the whole monitoring area. After the equipment is abnormal, firstly acquiring a marking frame corresponding to the position of the equipment; reconstructing an angle-equipment mapping library; and controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment; then controlling the monitoring device to longitudinally rotate, so that the abnormal equipment is positioned at the center of the monitoring picture; then, the center of the monitoring picture is taken as an amplifying center, and the optical zoom magnification of the monitoring device is adjusted; finally, the amplified equipment image can be acquired, and after the acquisition is completed, the optical zoom magnification and the pitch angle of the monitoring device are controlled to restore to the initial value, so that the image acquisition of the abnormal equipment is completed. Because the monitoring device is controlled by the algorithm to locate the abnormal equipment, and then the optical zoom is utilized to carry out lossless amplification on the picture, a high-resolution and large-size camera sensor is not needed, the hardware cost can be effectively reduced, and the automatic acquisition of the images of the abnormal equipment is realized.
The following describes the above embodiments in detail:
s1, acquiring a labeling frame corresponding to a device position based on a monitoring area of a monitoring device, wherein the labeling frame comprises the following components:
s1.1, acquiring a monitoring area image obtained by transversely rotating a monitoring device at a first speed;
the first speed v1 is the transverse rotation speed of the monitoring device, the value of the first speed v1 is not excessively large, the field angle of the monitoring device and the size of the monitoring area are considered, and the multi-frame image of the same equipment can be obtained in 1 second; and the image of the monitoring area completely records the picture of the whole monitoring area.
For example, assuming that the horizontal field angle of the monitoring device is α°, and the angle at which the monitoring device scans across the entire monitoring area is β°, the entire monitoring device rotates in a range of β° - α°, and the first speed v1 may be set to 0.5 °/s, so that only 2x (β ° - α°) seconds are required to acquire an image of the monitoring area.
S1.2, acquiring a labeling frame of equipment in the monitoring area image, and tracking the equipment to obtain a labeling frame of each equipment in the monitoring area image;
The marking frame is a rectangular frame, when the monitoring system is built manually in the early stage of marking work, a rectangular frame capable of expressing the position of the equipment is drawn manually in the monitored image, so that the equipment can be automatically tracked by using a tracking algorithm to obtain the rectangular frame corresponding to the equipment in each frame of image, and the rough position of the equipment is expressed.
For example, for any frame of picture, with the lower left corner point of the picture as the origin of the plane coordinate system and the interval of each pixel as 1 unit distance, the labeling frame can be determined by the coordinates of four corner points (xmin, ymin, xmin, ymax), (xmax, ymin), (xmax, ymax), and similarly, the boundary of the monitoring picture can be represented by the coordinates of the upper right corner (xE, yE).
Because the position of the monitoring device and the position of the equipment are fixed, the angle and the equipment are in corresponding relation on the premise that the initial pitch angle of the monitoring device is unchanged, and therefore:
s2, constructing an angle-equipment mapping library based on the horizontal rotation angles of the marking frame and the monitoring device, wherein the method comprises the following steps:
as shown in fig. 2, when the longitudinal center line of the labeling frame of any device coincides with the longitudinal center line of the monitoring screen, the transverse rotation angle of the current monitoring device is recorded, and the device is associated with the transverse rotation angle.
Based on the above illustrated coordinate system, the longitudinal centerline may be represented as x= (xmin+xmax)/2, and when xe=xmin+xmax, it indicates that the longitudinal centerline of the labeling frame coincides with the longitudinal centerline of the monitoring screen.
At this time, the transverse rotation angle gamma of the current monitoring device can be recorded and is bound with the codes of the devices to generate a tag= (gamma, ID), and when all the devices in the monitoring area generate a unique corresponding tag, all the tags form an angle-device mapping library.
S3, controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment based on the angle-equipment mapping library and the acquired abnormal equipment information, wherein the method comprises the following steps:
When the abnormality identification module identifies that any device is abnormal, a transverse rotation angle corresponding to the abnormal device is obtained from the angle-device mapping library to serve as a target angle;
and controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment.
The equipment abnormality recognition is realized by an additional existing abnormality recognition device, and finally, the coded ID corresponding to the equipment is output after the abnormality is recognized.
After rotating to the target angle, the labeling frame of the abnormal equipment in the monitoring picture is positioned on the longitudinal middle line of the monitoring picture, and the labeling frame is required to be adjusted to the center of the monitoring picture at the moment, so that the labeling frame is adjusted to the center of the monitoring picture:
S4, controlling the monitoring device to longitudinally rotate based on the device position of the monitoring picture of the abnormal device at the target angle, so that the abnormal device is positioned at the center of the monitoring picture, and comprising the following steps:
s4.1, acquiring a transverse central line of a labeling frame of abnormal equipment in a monitoring picture and a transverse central line of the monitoring picture;
S4.2, controlling the monitoring device to longitudinally rotate at a second speed, so that the transverse center line of the labeling frame of the abnormal equipment is overlapped with the transverse center line of the monitoring picture, and the abnormal equipment is positioned in the center of the monitoring picture.
The second speed is the longitudinal rotation speed of the monitoring device, and the value of the second speed is not too large. Based on the same principle, the determination that the transverse midline of the label frame and the transverse midline of the monitoring picture coincide can refer to the content of the longitudinal midline portion.
After the abnormal equipment is adjusted to the center of the monitoring picture, the abnormal equipment can be amplified, but in order to improve the proportion of effective information in the picture, the amplification rate needs to be considered, so that the proportion of the equipment to the monitoring picture is maximized, and therefore:
S5, taking the center of the monitoring picture as an amplifying center, adjusting the optical zoom multiplying power of the monitoring device, wherein the method comprises the following steps:
S5.1, constructing a plane coordinate system based on the monitoring picture to obtain coordinate information of a boundary of the monitoring picture;
S5.2, utilizing the existing corner extraction algorithm, and acquiring a corner coordinate set of equipment in a labeling frame of the abnormal equipment;
S5.3, adjusting the optical zoom magnification of the monitoring device at a fixed magnification change rate; wherein the setting of the rate of change of magnification is required to be set according to the maximum magnification and the actual control delay, for example, the magnification is performed at a rate of change of 0.05 times/second.
S5.4, stopping adjusting the optical zoom ratio of the monitoring device when the distance between any corner point and the boundary of the monitoring picture is smaller than the preset distance due to the known coordinates of the corner point and the coordinates of the boundary of the monitoring picture.
The preset distance is taken into consideration in response delay of the monitoring device and the distance change rate of the corner point relative to the boundary of each monitoring picture, and the boundary of each monitoring picture is rectangular and comprises four sides, so that the two distance change rates of one transverse side and one longitudinal side are calculated in actual calculation. The response delay is from the moment when the distance between the arbitrary corner point and the boundary of the monitoring picture is calculated to the moment when the monitoring device stops, and comprises the time consumption of calculation, the time consumption of command transmission and the time consumption of action response.
The calculation method of the preset distance comprises the following steps:
q1, acquiring response delay of a monitoring device;
Q2, when the optical zoom magnification of the monitoring device is adjusted at a fixed magnification change rate, acquiring an average value of distances between corner points in the previous n frames of pictures and the boundary of the monitoring picture as a distance change rate (unit: pixels/second);
q3, setting the preset distance to be a value larger than the product of the response delay of the monitoring device and the distance change rate of the corner point relative to the boundary of the monitoring picture. For example, the product may be amplified by 2 times as a preset distance.
Illustrating:
The first 5 frames of pictures are acquired, the distances between the corner points and a certain transverse edge of the monitoring picture are respectively 1000, 990, 980 and 970 (unit: pixel), the change rate of each frame is-10 pixels/frame, the frame number of the monitoring video is 24 frames/second, and the distance change rate is-240 pixels/second. Thus, when set, the preset distance may be set to 500.
S6, acquiring the amplified equipment image, and after the acquisition is completed, controlling the optical zoom multiplying power and the pitch angle of the monitoring device to restore the initial value, so as to ensure the accuracy of the next acquired data.
Example 2:
the embodiment provides a data acquisition device of industrial internet, as shown in fig. 3, the data acquisition device of industrial internet includes:
the obtaining module 31 is configured to obtain a labeling frame corresponding to a device position based on a monitoring area of the monitoring device;
A construction module 32, configured to construct an angle-device mapping library based on the labeling frame and the lateral rotation angle of the monitoring device;
A first control module 33, configured to control the monitoring device to laterally rotate to a target angle corresponding to the abnormal device based on the angle-device mapping library and the obtained abnormal device information;
a second control module 34, configured to control the monitoring device to rotate longitudinally based on the device position of the monitoring frame of the abnormal device at the target angle, so that the abnormal device is located at the center of the monitoring frame;
An adjusting module 35, configured to adjust an optical zoom magnification of the monitoring device with a center of the monitoring screen as an amplifying center;
and the acquisition module 36 is used for acquiring the amplified equipment image and controlling the optical zoom magnification and the pitch angle recovery initial value of the monitoring device after the acquisition is completed.
Further, the acquisition module 31 includes:
the first acquisition unit is used for acquiring a monitoring area image obtained by transverse rotation of the monitoring device at a first speed;
The second acquisition unit is used for acquiring the labeling frames of the devices in the monitoring area image, and tracking the devices to obtain the labeling frames of each device in the monitoring area image.
Further, the building block 32 comprises:
and the record association unit is used for recording the transverse rotation angle of the current monitoring device when the longitudinal center line of the labeling frame of any equipment is overlapped with the longitudinal center line of the monitoring picture, and associating the equipment with the transverse rotation angle.
Further, the first control module 33 includes:
The transverse rotation unit is used for acquiring a transverse rotation angle corresponding to the abnormal equipment from the angle-equipment mapping library as a target angle after any equipment is abnormal;
And the control unit is used for controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment.
Further, the second control module 34 includes:
The third acquisition unit is used for acquiring the transverse midline of the labeling frame of the abnormal equipment in the monitoring picture and the transverse midline of the monitoring picture after rotating to the target angle;
And the longitudinal rotation unit is used for controlling the monitoring device to longitudinally rotate at a second speed so that the transverse center line of the labeling frame of the abnormal equipment is overlapped with the transverse center line of the monitoring picture.
Further, the adjustment module 35 includes:
The construction unit is used for constructing a plane coordinate system based on the monitoring picture to obtain coordinate information of the boundary of the monitoring picture;
a fourth obtaining unit, configured to obtain a set of corner coordinates of the device in the labeling frame of the abnormal device;
an adjusting unit for adjusting the optical zoom magnification of the monitoring device at a fixed magnification change rate;
and the judging unit is used for stopping adjusting the optical zoom multiplying power of the monitoring device when the distance between any angular point and the boundary of the monitoring picture is smaller than the preset distance.
Further, the judging unit includes:
a first acquisition subunit, configured to acquire a response delay of the monitoring device;
The second acquisition subunit is used for acquiring an average value of distances between corner points in the previous n frames of pictures and the boundary of the monitoring picture as a distance change rate when the optical zoom magnification of the monitoring device is adjusted at a fixed magnification change rate;
And the determining subunit is used for setting the preset distance to be a value larger than the product of the response delay of the monitoring device and the distance change rate of the corner point relative to the boundary of the monitoring picture.
The functional units in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in part or all of the technical solution contributing to the prior art or in the form of a software product stored in a storage medium, comprising a number of computer readable instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing computer readable instructions.
Example 3:
The present embodiment provides a data acquisition system of the industrial internet, including at least one data acquisition terminal device, as shown in fig. 4, the data acquisition terminal device 4 includes:
one or more processors 40;
A memory 41; and
One or more computer readable instructions 42, wherein the one or more computer readable instructions 42 are stored in the memory 41 and configured to be executed by the one or more processors 40, the computer readable instructions comprising steps for performing the data collection method of the industrial internet described above.
In this embodiment, the data acquisition terminal device 4 may be a mobile phone, a tablet computer, a desktop computer, a notebook computer, a palm computer, a cloud server, and other computing devices. The data acquisition terminal device 4 may include: a processor 40, a memory 41 and computer readable instructions 42 stored in said memory 41 and executable on said processor 40, for example computer readable instructions for performing the data acquisition method of the industrial internet as described above. The processor 40, when executing the computer readable instructions 42, implements the steps of the various industrial internet data collection method embodiments described above, such as steps S1 through S6 shown in fig. 1. Or the processor 40, when executing the computer-readable instructions 42, performs the functions of the modules/units of the apparatus embodiments described above, such as the functions of the modules 31-36 shown in fig. 3.
Illustratively, the computer readable instructions 42 may be partitioned into one or more modules/units that are stored in the memory 41 and executed by the processor 40 to complete the present invention. The one or more modules/units may be a series of computer readable instruction segments capable of performing specific functions describing the execution of the computer readable instructions 42 in the data acquisition terminal device 4.
The Processor 30 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (DIGITAL SIGNAL Processor, DSP), application SPECIFIC INTEGRATED Circuit (ASIC), field-Programmable gate array (Field-Programmable GATE ARRAY, FPGA) or other Programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 41 may be an internal storage unit of the semantic role analysis terminal apparatus 4, for example, a hard disk or a memory of the semantic role analysis terminal apparatus 4. The memory 41 may be an external storage device of the semantic role analysis terminal apparatus 4, for example, a plug-in hard disk, a smart memory card (SMART MEDIA CARD, SMC), a Secure Digital (SD) card, a flash memory card (FLASH CARD) or the like provided on the semantic role analysis terminal apparatus 4. Further, the memory 41 may also include both an internal memory unit and an external memory device of the semantic role analysis terminal apparatus 4. The memory 41 is used for storing the computer readable instructions and other instructions and data required by the semantic role analysis terminal device 4. The memory 41 may also be used for temporarily storing data that has been output or is to be output.
It can be understood that the data acquisition system of the industrial internet provided by the embodiment of the invention corresponds to the data acquisition method of the industrial internet, and the explanation, the examples, the beneficial effects and the like of the related content can refer to the corresponding content in the data acquisition method of the industrial internet, so that the description is omitted here.
Example 4:
A computer-readable storage medium storing computer-readable instructions for data acquisition of an industrial internet, wherein the computer-readable instructions cause a computer to perform the steps of the data acquisition method of the industrial internet described above.
In summary, compared with the prior art, the method has the following beneficial effects:
When the equipment operates normally, the monitoring device acquires images of the whole monitoring area. After the equipment is abnormal, firstly acquiring a marking frame corresponding to the position of the equipment; reconstructing an angle-equipment mapping library; and controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment; then controlling the monitoring device to longitudinally rotate, so that the abnormal equipment is positioned at the center of the monitoring picture; then, the center of the monitoring picture is taken as an amplifying center, and the optical zoom magnification of the monitoring device is adjusted; finally, the amplified equipment image can be acquired, and after the acquisition is completed, the optical zoom magnification and the pitch angle of the monitoring device are controlled to restore to the initial value, so that the image acquisition of the abnormal equipment is completed. Because the monitoring device is controlled by the algorithm to locate the abnormal equipment, and then the optical zoom is utilized to carry out lossless amplification on the picture, a high-resolution and large-size camera sensor is not needed, the hardware cost can be effectively reduced, and the automatic acquisition of the images of the abnormal equipment is realized.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (9)
1. The data acquisition method of the industrial Internet is characterized by comprising the following steps of:
when the equipment operates normally, acquiring a labeling frame corresponding to the equipment position based on a monitoring area of a monitoring device;
constructing an angle-equipment mapping library based on the horizontal rotation angles of the marking frame and the monitoring device;
Based on the angle-equipment mapping library and the acquired abnormal equipment information, controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment;
Based on the device position of the monitoring picture of the abnormal device at the target angle, controlling the monitoring device to longitudinally rotate so that the abnormal device is positioned at the center of the monitoring picture;
Taking the center of the monitoring picture as an amplifying center, and adjusting the optical zoom magnification of the monitoring device;
Collecting the amplified equipment image, and after the collection is completed, controlling the optical zoom multiplying power and the pitch angle of the monitoring device to restore to an initial value;
the construction of the angle-equipment mapping library based on the horizontal rotation angles of the marking frame and the monitoring device comprises the following steps:
recording a transverse rotation angle of a current monitoring device when the longitudinal center line of the marking frame of any equipment is coincident with the longitudinal center line of the monitoring picture, and associating the equipment with the transverse rotation angle;
The longitudinal centerline is expressed as x= (xmin+xmax)/2, and when xe=xmin+xmax, the longitudinal centerline of the labeling frame coincides with the longitudinal centerline of the monitoring picture; at the moment, the transverse rotation angle gamma of the current monitoring device is recorded and is bound with the code of the equipment to generate a label= (gamma, ID), and when all the equipment in the monitoring area generates a unique corresponding label, all the labels form an angle-equipment mapping library; the left lower corner point of the picture is taken as an origin of a plane coordinate system, the distance between each pixel is taken as 1 unit distance, the labeling frame is determined by coordinates of four corner points (xmin, ymin, ymax, xmax, ymin and xmax, ymax), and the boundary of the monitoring picture is represented by coordinates of the right upper corner (xE, yE).
2. The method for acquiring data of industrial internet according to claim 1, wherein the acquiring the labeling frame corresponding to the device position based on the monitoring area of the monitoring device comprises:
Acquiring a monitoring area image obtained by transverse rotation of a monitoring device at a first speed;
And acquiring the labeling frame of the equipment in the monitoring area image, and tracking the equipment to obtain the labeling frame of each equipment in the monitoring area image.
3. The method for acquiring data of industrial internet according to claim 1, wherein the controlling the monitoring device to rotate transversely to the target angle corresponding to the abnormal device based on the angle-device mapping library and the obtained abnormal device information comprises:
when any device is abnormal, acquiring a transverse rotation angle corresponding to the abnormal device from an angle-device mapping library as a target angle;
and controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment.
4. The method for collecting data of industrial internet according to claim 1, wherein controlling the monitoring device to rotate longitudinally based on the device position of the monitoring frame of the abnormal device at the target angle, so that the abnormal device is located at the center of the monitoring frame, comprises:
after rotating to a target angle, acquiring a transverse center line of a labeling frame of abnormal equipment in a monitoring picture and a transverse center line of the monitoring picture;
And controlling the monitoring device to longitudinally rotate at a second speed, so that the transverse center line of the labeling frame of the abnormal equipment is overlapped with the transverse center line of the monitoring picture.
5. The data collection method of the industrial internet according to claim 1, wherein the adjusting the optical zoom magnification of the monitoring device with the center of the monitoring picture as the magnification center comprises:
Constructing a plane coordinate system based on the monitoring picture to obtain coordinate information of the boundary of the monitoring picture;
acquiring a corner coordinate set of equipment in a labeling frame of abnormal equipment;
Adjusting the optical zoom magnification of the monitoring device at a fixed magnification change rate;
And stopping adjusting the optical zoom magnification of the monitoring device when the distance between any angular point and the boundary of the monitoring picture is smaller than a preset distance.
6. The method for acquiring data of industrial internet according to claim 5, wherein the method for setting the preset distance comprises:
Acquiring response delay of the monitoring device;
When the optical zoom magnification of the monitoring device is adjusted at a fixed magnification change rate, acquiring an average value of distances between corner points in the previous n frames of pictures and the boundary of the monitoring picture as a distance change rate;
The preset distance is set to a value greater than the product of the response delay of the monitoring device and the rate of change of the distance of the corner point relative to the boundary of the monitoring picture.
7. The utility model provides a data acquisition device of industry internet which characterized in that includes:
The acquisition module is used for acquiring a labeling frame corresponding to the equipment position based on the monitoring area of the monitoring device;
The construction module is used for constructing an angle-equipment mapping library based on the horizontal rotation angles of the marking frame and the monitoring device;
the first control module is used for controlling the monitoring device to transversely rotate to a target angle corresponding to the abnormal equipment based on the angle-equipment mapping library and the acquired abnormal equipment information;
The second control module is used for controlling the monitoring device to longitudinally rotate based on the equipment position of the monitoring picture of the abnormal equipment at the target angle so that the abnormal equipment is positioned at the center of the monitoring picture;
The adjusting module is used for adjusting the optical zoom magnification of the monitoring device by taking the center of the monitoring picture as an amplifying center;
the acquisition module is used for acquiring the amplified equipment image and controlling the optical zoom magnification and the pitch angle recovery initial value of the monitoring device after the acquisition is completed;
wherein, the construction module is further configured to:
recording a transverse rotation angle of a current monitoring device when the longitudinal center line of the marking frame of any equipment is coincident with the longitudinal center line of the monitoring picture, and associating the equipment with the transverse rotation angle;
The longitudinal centerline is expressed as x= (xmin+xmax)/2, and when xe=xmin+xmax, the longitudinal centerline of the labeling frame coincides with the longitudinal centerline of the monitoring picture; at the moment, the transverse rotation angle gamma of the current monitoring device is recorded and is bound with the code of the equipment to generate a label= (gamma, ID), and when all the equipment in the monitoring area generates a unique corresponding label, all the labels form an angle-equipment mapping library; the left lower corner point of the picture is taken as an origin of a plane coordinate system, the distance between each pixel is taken as 1 unit distance, the labeling frame is determined by coordinates of four corner points (xmin, ymin, ymax, xmax, ymin and xmax, ymax), and the boundary of the monitoring picture is represented by coordinates of the right upper corner (xE, yE).
8. The data acquisition system of the industrial internet is characterized by comprising at least one data acquisition terminal device, wherein the data acquisition terminal device comprises:
One or more processors;
a memory; and
One or more computer-readable instructions, wherein the one or more computer-readable instructions are stored in the memory and configured to be executed by the one or more processors, the computer-readable instructions comprising steps for performing the data collection method of the industrial internet of any of claims 1-6.
9. A computer readable storage medium storing computer readable instructions for data acquisition of the industrial internet, wherein the computer readable instructions cause a computer to perform the steps of the data acquisition method of the industrial internet according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110912121.3A CN113645449B (en) | 2021-08-10 | 2021-08-10 | Data acquisition method and system of industrial Internet and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110912121.3A CN113645449B (en) | 2021-08-10 | 2021-08-10 | Data acquisition method and system of industrial Internet and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113645449A CN113645449A (en) | 2021-11-12 |
| CN113645449B true CN113645449B (en) | 2024-05-24 |
Family
ID=78420404
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110912121.3A Active CN113645449B (en) | 2021-08-10 | 2021-08-10 | Data acquisition method and system of industrial Internet and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113645449B (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10210343A (en) * | 1997-01-24 | 1998-08-07 | Mitsubishi Heavy Ind Ltd | Automatic zoom tracking device |
| JP2007067975A (en) * | 2005-08-31 | 2007-03-15 | Toshiba Corp | Video monitoring system and video monitoring method |
| JP2011234310A (en) * | 2010-04-30 | 2011-11-17 | Olympus Corp | Imaging apparatus |
| JP2012080193A (en) * | 2010-09-30 | 2012-04-19 | Nec Casio Mobile Communications Ltd | Portable terminal, and camera magnification adjustment method and program |
| CN105574852A (en) * | 2015-12-07 | 2016-05-11 | 中国科学院合肥物质科学研究院 | Method and system for detecting plant height based on image identification |
| CN107317999A (en) * | 2017-05-24 | 2017-11-03 | 天津市亚安科技有限公司 | Method and system for realizing automatic identification of geographic name on turntable |
| CN109120904A (en) * | 2018-10-19 | 2019-01-01 | 武汉星巡智能科技有限公司 | Binocular camera monitoring method, device and computer readable storage medium |
| KR101944816B1 (en) * | 2018-04-11 | 2019-02-07 | (주)영신디엔씨 | Detection Automatic System of Excavating Work |
| CN110132274A (en) * | 2019-04-26 | 2019-08-16 | 中国铁道科学研究院集团有限公司电子计算技术研究所 | A kind of indoor orientation method, device, computer equipment and storage medium |
| CN110139037A (en) * | 2019-05-20 | 2019-08-16 | 深圳铂石空间科技有限公司 | Object monitoring method and device, storage medium and electronic equipment |
| CN111654668A (en) * | 2020-05-26 | 2020-09-11 | 李绍兵 | Monitoring equipment synchronization method and device and computer terminal |
| CN113012047A (en) * | 2021-03-26 | 2021-06-22 | 广州市赋安电子科技有限公司 | Dynamic camera coordinate mapping establishing method and device and readable storage medium |
| CN113112539A (en) * | 2021-04-13 | 2021-07-13 | 大庆安瑞达科技开发有限公司 | Oil and gas field video monitoring communication and regional communication network analysis system, method, equipment and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101058009B1 (en) * | 2004-08-06 | 2011-08-19 | 삼성전자주식회사 | Automatic focusing method in digital photographing apparatus, and digital photographing apparatus employing this method |
| KR101022476B1 (en) * | 2004-08-06 | 2011-03-15 | 삼성전자주식회사 | Method of automatic focusing within digital photographing apparatus, and digital photographing apparatus adopting the method |
| CN113286080A (en) * | 2021-05-18 | 2021-08-20 | 中国民用航空总局第二研究所 | Scene monitoring system and video linkage tracking and enhanced display method and device |
-
2021
- 2021-08-10 CN CN202110912121.3A patent/CN113645449B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10210343A (en) * | 1997-01-24 | 1998-08-07 | Mitsubishi Heavy Ind Ltd | Automatic zoom tracking device |
| JP2007067975A (en) * | 2005-08-31 | 2007-03-15 | Toshiba Corp | Video monitoring system and video monitoring method |
| JP2011234310A (en) * | 2010-04-30 | 2011-11-17 | Olympus Corp | Imaging apparatus |
| JP2012080193A (en) * | 2010-09-30 | 2012-04-19 | Nec Casio Mobile Communications Ltd | Portable terminal, and camera magnification adjustment method and program |
| CN105574852A (en) * | 2015-12-07 | 2016-05-11 | 中国科学院合肥物质科学研究院 | Method and system for detecting plant height based on image identification |
| CN107317999A (en) * | 2017-05-24 | 2017-11-03 | 天津市亚安科技有限公司 | Method and system for realizing automatic identification of geographic name on turntable |
| KR101944816B1 (en) * | 2018-04-11 | 2019-02-07 | (주)영신디엔씨 | Detection Automatic System of Excavating Work |
| CN109120904A (en) * | 2018-10-19 | 2019-01-01 | 武汉星巡智能科技有限公司 | Binocular camera monitoring method, device and computer readable storage medium |
| CN110132274A (en) * | 2019-04-26 | 2019-08-16 | 中国铁道科学研究院集团有限公司电子计算技术研究所 | A kind of indoor orientation method, device, computer equipment and storage medium |
| CN110139037A (en) * | 2019-05-20 | 2019-08-16 | 深圳铂石空间科技有限公司 | Object monitoring method and device, storage medium and electronic equipment |
| CN111654668A (en) * | 2020-05-26 | 2020-09-11 | 李绍兵 | Monitoring equipment synchronization method and device and computer terminal |
| CN113012047A (en) * | 2021-03-26 | 2021-06-22 | 广州市赋安电子科技有限公司 | Dynamic camera coordinate mapping establishing method and device and readable storage medium |
| CN113112539A (en) * | 2021-04-13 | 2021-07-13 | 大庆安瑞达科技开发有限公司 | Oil and gas field video monitoring communication and regional communication network analysis system, method, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113645449A (en) | 2021-11-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3309703B1 (en) | Method and system for decoding qr code based on weighted average grey method | |
| WO2021051885A1 (en) | Target labeling method and apparatus | |
| CN108647587B (en) | People counting method, device, terminal and storage medium | |
| CN108090908B (en) | Image segmentation method, device, terminal and storage medium | |
| WO2020151340A1 (en) | Target cell marking method and device, storage medium and terminal device | |
| CN113766209B (en) | Camera offset processing method and device | |
| CN110660102B (en) | Speaker recognition method, device and system based on artificial intelligence | |
| WO2021022698A1 (en) | Following detection method and apparatus, and electronic device and storage medium | |
| CN111552837A (en) | Animal video tag automatic generation method based on deep learning, terminal and medium | |
| CN111898610B (en) | Card unfilled corner detection method, device, computer equipment and storage medium | |
| CN112883955A (en) | Shelf layout detection method and device and computer readable storage medium | |
| CN112836631A (en) | Vehicle axle number determining method and device, electronic equipment and storage medium | |
| US11861668B2 (en) | Method, device, electronic apparatus and storage medium for generating order | |
| CN113256570A (en) | Visual information processing method, device, equipment and medium based on artificial intelligence | |
| CN110619625B (en) | Method, device and system for monitoring running state of belt and storage medium | |
| CN114708291A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN113645449B (en) | Data acquisition method and system of industrial Internet and computer readable storage medium | |
| CN111680680A (en) | Object code positioning method and device, electronic equipment and storage medium | |
| TWI796952B (en) | Object detection device and object detection method | |
| CN113379668B (en) | Photovoltaic panel splicing method and device, electronic equipment and storage medium | |
| US11871119B2 (en) | Method for calculating exposure evaluation value and imaging device | |
| CN115456988A (en) | Defect detection method, terminal device and storage medium | |
| WO2021057879A1 (en) | Data processing system and method, electronic device, and computer readable storage medium | |
| CN104077586A (en) | Real-time trapezoidal distortion correction method and system for optical fingerprint sensor | |
| CN116934863A (en) | Camera external parameter determining method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |