CN116728291A - Robot polishing system state monitoring method and device based on edge calculation - Google Patents
Robot polishing system state monitoring method and device based on edge calculation Download PDFInfo
- Publication number
- CN116728291A CN116728291A CN202311030811.1A CN202311030811A CN116728291A CN 116728291 A CN116728291 A CN 116728291A CN 202311030811 A CN202311030811 A CN 202311030811A CN 116728291 A CN116728291 A CN 116728291A
- Authority
- CN
- China
- Prior art keywords
- vibration
- signal
- polishing
- quality
- polishing system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000005498 polishing Methods 0.000 title claims abstract description 100
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000012544 monitoring process Methods 0.000 title claims abstract description 31
- 238000004364 calculation method Methods 0.000 title claims abstract description 15
- 238000003745 diagnosis Methods 0.000 claims abstract description 13
- 230000009467 reduction Effects 0.000 claims abstract description 10
- 238000007499 fusion processing Methods 0.000 claims abstract description 8
- 238000012549 training Methods 0.000 claims description 16
- 239000011159 matrix material Substances 0.000 claims description 15
- 238000003860 storage Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 13
- 230000006870 function Effects 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 9
- 238000004422 calculation algorithm Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 7
- 238000002372 labelling Methods 0.000 claims description 4
- 238000012806 monitoring device Methods 0.000 claims description 4
- 230000003321 amplification Effects 0.000 claims description 3
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 3
- 238000000227 grinding Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 10
- 230000001133 acceleration Effects 0.000 description 7
- 230000000875 corresponding effect Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000036541 health Effects 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000007517 polishing process Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000011217 control strategy Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000013136 deep learning model Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000013441 quality evaluation Methods 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B24—GRINDING; POLISHING
- B24B—MACHINES, DEVICES, OR PROCESSES FOR GRINDING OR POLISHING; DRESSING OR CONDITIONING OF ABRADING SURFACES; FEEDING OF GRINDING, POLISHING, OR LAPPING AGENTS
- B24B49/00—Measuring or gauging equipment for controlling the feed movement of the grinding tool or work; Arrangements of indicating or measuring equipment, e.g. for indicating the start of the grinding operation
- B24B49/12—Measuring or gauging equipment for controlling the feed movement of the grinding tool or work; Arrangements of indicating or measuring equipment, e.g. for indicating the start of the grinding operation involving optical means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B24—GRINDING; POLISHING
- B24B—MACHINES, DEVICES, OR PROCESSES FOR GRINDING OR POLISHING; DRESSING OR CONDITIONING OF ABRADING SURFACES; FEEDING OF GRINDING, POLISHING, OR LAPPING AGENTS
- B24B27/00—Other grinding machines or devices
- B24B27/0084—Other grinding machines or devices the grinding wheel support being angularly adjustable
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
- B25J11/005—Manipulators for mechanical processing tasks
- B25J11/0065—Polishing or grinding
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H1/00—Measuring characteristics of vibrations in solids by using direct conduction to the detector
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M13/00—Testing of machine parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
- G06N3/0455—Auto-encoder networks; Encoder-decoder networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0464—Convolutional networks [CNN, ConvNet]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
- G06F2218/02—Preprocessing
- G06F2218/04—Denoising
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
- G06F2218/12—Classification; Matching
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Evolutionary Biology (AREA)
- Databases & Information Systems (AREA)
- Bioinformatics & Computational Biology (AREA)
- Medical Informatics (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Multimedia (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Mathematical Physics (AREA)
- Robotics (AREA)
- Finish Polishing, Edge Sharpening, And Grinding By Specific Grinding Devices (AREA)
Abstract
The embodiment of the application provides a robot polishing system state monitoring method and device based on edge calculation. The method includes acquiring a current vibration signal; noise reduction and fusion processing are carried out on the vibration signals, so that a vibration image is obtained; inputting the vibration image into a pre-trained fault diagnosis model to obtain the fault type of the current polishing system; inputting the vibration image into a pre-trained quality matching model to obtain a correlation value and a force signal of a current polishing system; the force signal is used for determining the polishing quality of the current polishing system; and based on the fault type, the related value and the polishing quality, completing the monitoring of the current polishing system. In this way, the unified monitoring of faults and polishing quality can be completed by only collecting the vibration signals of the addition sensors, the number and types of the sensors are greatly reduced, and the complexity of the robot polishing system is reduced while the economic cost is reduced.
Description
Technical Field
Embodiments of the present application relate to the field of grinding monitoring, and in particular, to a method, apparatus, device, and computer readable storage medium for monitoring a state of a robot grinding system based on edge calculation.
Background
The large thin-wall parts are widely applied to aircraft skins, cabins, high-speed railway bodies and the like. In the context of intelligent manufacturing, robot polishing is one of the important manufacturing processes for large thin-walled components, and the polishing quality is directly affected by the health condition of the robot polishing system.
However, in actual working conditions, most of the polishing quality evaluation methods are offline evaluation by using a visual correlation method after polishing is completed. By the visual correlation method, although the evaluation of the grinding quality can be completed, there are two disadvantages as follows:
(1) polishing is a contact type operation, on-line real-time monitoring is difficult to realize by a vision-based method, and the cost is high;
(2) the polishing is a continuous operation process, and the loss of polishing equipment is continuous, so that the health state of the polishing equipment corresponding to the polishing quality cannot be judged, and the difficulty is brought to the subsequent process optimization.
Therefore, how to monitor the fault state and the polishing quality of the robot polishing system on line in real time and accurately match the relationship between the fault state and the polishing quality is a problem to be solved currently.
Disclosure of Invention
According to the embodiment of the application, the state monitoring scheme of the robot polishing system based on edge calculation is provided, the most state monitoring information can be obtained with the least sensor cost, the acquisition of force signals at the edge end is not needed, the polishing quality map is not needed to be shot, the unified monitoring of faults and polishing quality can be finished only by acquiring the vibration signals of the addition sensor, the number and types of the sensors are greatly reduced, the cost is saved, and the complexity of the robot polishing system is reduced.
In a first aspect of the application, a method for monitoring a state of a robot polishing system based on edge calculation is provided. The method comprises the following steps:
acquiring a current vibration signal;
noise reduction and fusion processing are carried out on the vibration signals, so that a vibration image is obtained;
inputting the vibration image into a pre-trained fault diagnosis model to obtain the fault type of the current polishing system;
inputting the vibration image into a pre-trained quality matching model to obtain a correlation value and a force signal of a current polishing system; the correlation value is used for correlating fault types and polishing quality; the force signal is used for determining the polishing quality of the current polishing system;
and based on the fault type, the related value and the polishing quality, completing the monitoring of the current polishing system.
Further, the noise reduction of the vibration signal includes:
decomposing the vibration signal through a wavelet packet algorithm to obtain a coefficient matrix;
defining wavelet packet node energy based on the coefficient matrix;
processing the wavelet packet node energy through a self-defined convolution self-encoder, and carrying out global node reconstruction;
and carrying out local signal reconstruction based on the reconstructed node energy, and completing noise reduction of the vibration signal.
Further, the convolutional self-encoder is composed of a plurality of convolutional encoders and a deconvolution decoder;
wherein, the convolution encoder is:
;
wherein H is the energy characteristic obtained after encoding;
as wavelet node energy;
for the first convolution kernel in the convolution layer;
for->A bias;
for the convolution operation;
for, activate a function;
the convolutional decoder is:
;
wherein ,for decoding the returned node energy;
for, the +.>Deconvolution kernels;
for->And a bias.
Further, the fusion process includes:
converting the noise-reduced signal into a polar coordinate space;
converting the signal converted into a polar coordinate space into a vibration pattern;
and fusing the vibration patterns into vibration images according to a preset anticlockwise interval.
Further, the converting the signal converted into the polar coordinate space into the vibration pattern includes:
converting the signal converted into the polar coordinate space into a vibration pattern by the following algorithm;
;
;
;
wherein R (k), alpha (k) and beta (k) are radius, anticlockwise rotation angle and clockwise rotation angle respectively;
、/>maximum and minimum amplitude values of the reconstructed signal, respectively;
、/>the amplitude of the signal at time point k and time point k+1, respectively, of the reconstructed new number;
for, the time interval length;
p is the angle amplification factor;
and gamma is the rotation angle of the symmetry plane.
Further, the training of the quality matching model comprises the following steps:
acquiring polishing surface images, force signals and vibration images under various faults; the force signal is used for describing the polishing force of the current polishing system;
calculating the characteristic values of the pixels of the polishing surface and the vibration image corresponding to the polishing surface under each fault state respectively to construct a characteristic value matrix of the polishing surfaceAnd matrix of vibration images->;
Based on the eigenvalue matrix and />Calculating a correlation value for correlating the fault type and the sanding quality;
labeling the vibration image based on the correlation value and the force signal;
and taking the marked vibration image as input, taking a force signal and a correlation value as output, training the quality matching model through a CNN classifier, and completing training the quality matching model when the unification ratio of the output force signal and the correlation value and the marked force signal and correlation value meets a preset threshold value.
Further, the characteristic value matrix and />Calculating a correlation value for correlating fault type and sanding quality includes:
;
wherein ,、/>x and Y are real numbers.
In a second aspect of the application, a robotic sanding system status monitoring device based on edge calculations is provided. The device comprises:
the acquisition module is used for acquiring the current vibration signal;
the processing module is used for carrying out noise reduction and fusion processing on the vibration signals to obtain vibration images;
the first training module is used for inputting the vibration image into a pre-trained fault diagnosis model to obtain the fault type of the current polishing system;
the second training module is used for inputting the vibration image into a pre-trained quality matching model to obtain a correlation value and a force signal of the current polishing system; the correlation value is used for correlating fault types and polishing quality; the force signal is used for determining the polishing quality of the current polishing system;
and the monitoring module is used for completing the monitoring of the current polishing system based on the fault type, the related value and the polishing quality.
In a third aspect of the application, an electronic device is provided. The electronic device includes: a memory and a processor, the memory having stored thereon a computer program, the processor implementing the method as described above when executing the program.
In a fourth aspect of the application, there is provided a computer readable storage medium having stored thereon a computer program which when executed by a processor implements a method as according to the first aspect of the application.
According to the robot polishing system state monitoring method based on edge calculation, the health state and polishing quality of polishing equipment are unified under the vibration signal monitoring standard form of the same acceleration sensor, and a fault diagnosis model and a quality matching model are trained based on the vibration signal and a deep learning model; and then, edge computing nodes are arranged at the edge of the robot polishing system to process vibration signals acquired in real time, the fault diagnosis model and the quality matching model established by the application are utilized at the edge to calculate the signals, and the fault state is matched with the grinding quality generated by the fault state in real time, so that the accurate monitoring of the polishing system is realized, and meanwhile, the material cost and the complexity of the robot polishing system are greatly reduced.
It should be understood that the description in this summary is not intended to limit the critical or essential features of the embodiments of the application, nor is it intended to limit the scope of the application. Other features of the present application will become apparent from the description that follows.
Drawings
The above and other features, advantages and aspects of embodiments of the present application will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, wherein like or similar reference numerals denote like or similar elements, in which:
FIG. 1 is a flow chart of a method for monitoring the status of a robotic sanding system based on edge calculations in accordance with an embodiment of the present application;
FIG. 2 is a diagram of vibration patterns and vibration images according to an embodiment of the present application;
FIG. 3 is a block diagram of a robotic sanding system status monitoring device based on edge calculations in accordance with an embodiment of the present application;
fig. 4 is a schematic diagram of a structure of a terminal device or a server suitable for implementing an embodiment of the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are some embodiments of the present disclosure, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments in this disclosure without inventive faculty, are intended to be within the scope of this disclosure.
In addition, the term "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.
Fig. 1 illustrates a flowchart of a method for monitoring a state of a robotic sanding system based on edge calculations in accordance with an embodiment of the present disclosure. The method comprises the following steps:
s110, acquiring a current vibration signal.
In some embodiments, the vibration signal may be obtained by a three-phase acceleration sensor mounted at the grinding end of a robotic arm of the robotic grinding system, and a three-phase acceleration sensor mounted on the ground workpiece. That is, the vibration signals acquired by the present disclosure are generally two sets, one acquired by the three-phase acceleration sensor mounted at the robot arm grinding end of the robot grinding system, and the other acquired by the three-phase acceleration sensor mounted on the grinding workpiece.
S120, noise reduction and fusion processing are carried out on the vibration signals, and a vibration image is obtained.
In practical application, the vibration signal directly obtained by the sensor usually has certain noise due to the influence of environmental factors, so that the vibration signal obtained in step S110 needs to be noise-reduced, so as to obtain a more accurate vibration signal, and a foundation is laid for realizing accurate monitoring.
Specifically, the obtained vibration signals (taking two as an example) are respectively subjected to three-level decomposition by using a wavelet packet algorithm to obtain 8 coefficient matrixes:
;
for the vibration signal f, it can be divided into a plurality of sub-signals f=by a sliding window that does not overlap,/>,……,;
Wherein L is the length of f;
s is the size of the sliding window;
further, based on the coefficient matrix, wavelet packet node energy definition is performed:
;
it can be seen that for one signal f, 3×l/s node energies are available, in which case each (j, 3) is referred to as a wavelet packet node.
Further, using a custom convolution self-encoder to perform lossy reconstruction on global node energy, and using the reconstructed node energy for local signal reconstruction; the custom convolutional self-encoder is typically composed of a plurality of convolutional encoders and deconvolution decoders.
Wherein the convolutional encoder may be expressed as:
;
wherein H is the energy characteristic obtained after encoding;
as wavelet node energy;
for the first convolution kernel in the convolution layer;
for->A bias;
for the convolution operation;
for, activate a function;
the convolutional decoder is:
;
wherein ,for decoding the returned node energy;
for, the +.>Deconvolution kernels;
for->And a bias.
In some embodiments, the reconstruction errors for optimizing the network parameters are:
;
in summary, the signals reconstructed with the reconstruction energyCan be expressed as:
;
in some embodiments, taking fusion of two vibration signals as an example, the obtained signals of 6 channels of 2 acceleration sensors are respectively subjected to the signal anti-noise processing (reconstruction), the reconstructed signals are converted into a polar coordinate space, and a symmetrical lattice algorithm is utilized to generate a vibration image;
the algorithm for converting the signal into the vibration pattern is as follows:
;
;
;
wherein R (k), alpha (k) and beta (k) are radius, anticlockwise rotation angle and clockwise rotation angle respectively;
、/>maximum and minimum amplitude values of the reconstructed signal, respectively;
、/>the amplitude of the signal at time point k and time point k+1, respectively, of the reconstructed new number;
for, the time interval length;
p is the angle amplification factor;
γ is the rotation angle of the symmetry plane, typically 60 ° (360 °/6=60°).
Further, the signals of 6 channels of the 2 acceleration sensors are respectively converted into 6 vibration patterns in polar coordinate space by adopting the algorithm, and the 6 SDP vibration images are fused into one vibration image at a preset anticlockwise interval by taking 0 amplitude as a center point. Wherein the counterclockwise interval is preferably γ=60°, referring to fig. 2, fig. 2 shows a schematic diagram of the fusion of 6 vibration patterns into one Zhang Zhendong pattern.
And S130, inputting the vibration image into a pre-trained fault diagnosis model to obtain the fault type of the current polishing system.
Wherein the fault diagnosis model can be trained by:
constructing a vibration image sample set; the vibration image sample set comprises vibration images of various faults;
and according to the fault type corresponding to each vibration image. Labeling the vibration image;
and training the fault diagnosis model by using the marked vibration image as input and the fault type as output through a CNN classifier, and completing the training of the fault diagnosis model when the unified rate of the output fault type and the marked fault type meets a preset threshold value.
In some embodiments, the vibration image is input to a pre-trained fault diagnosis model to obtain the fault type of the current sanding system.
S140, inputting the vibration image into a pre-trained quality matching model to obtain a correlation value and a force signal of a current polishing system; the correlation value is used for correlating fault types and polishing quality; the force signal is used to determine the sanding quality of the current sanding system.
In some embodiments, the quality matching model may be trained by:
acquiring polishing surface images, force signals and vibration images under various faults;
the force signal is used for describing the polishing force of the current polishing system, namely, the polishing force of the tail end of the mechanical arm in the polishing process of the measuring robot can be obtained through a force sensor arranged at the tail end of the mechanical arm;
the polished surface image can be obtained by means of a historical database, on-site photographing of polishing practice and the like.
Further, respectively calculating the characteristic values of the pixels of the polishing surface and the vibration image corresponding to each fault state to construct a characteristic value matrix of the polishing surfaceAnd matrix of vibration images->The calculation process is as follows:
;
wherein the center pixel value8 pixel values +.>(i=0, 1, … … 7) and generating binary 1 or 0 according to a threshold function to obtain pixel eigenvalue matrices of the ground surface map and the vibration image, respectively +.> and />。
Further, the correlation values of the two matrices are calculated:
;
wherein ,、/>x and Y are real numbers. It has been verified that for different types of faults, it generates +.>(correlation values) are different, so that by means of this value the fault type and the sanding quality can be correlated (matched).
Further, a training sample set is constructed, and the related steps of step S130 are referred to, which will not be described herein;
labeling the vibration image based on the correlation value and the force signal;
and taking the marked vibration image as input, taking a force signal and a correlation value as output, training the quality matching model through a CNN classifier, and completing training the quality matching model when the unification ratio of the output force signal and the correlation value and the marked force signal and correlation value meets a preset threshold value.
And (3) inputting the vibration image obtained in the step (S120) into a pre-trained quality matching model to obtain a correlation value and a force signal of the current polishing system.
And S150, completing monitoring of the current polishing system based on the fault type, the related value and the polishing quality.
In some embodiments, the force signal output in step S140 is processed to obtain a value for determining the sanding quality of the current sanding system by calculating the sanding removal amount to monitor the sanding quality in real time by the following formula:
;
wherein ,for, material removal rate;
c, correcting parameters in the grinding process;
the abrasive belt rotating speed is the same as that of the abrasive belt;
the workpiece feed speed;
for normal grinding force (force signal);
α、β and as a power exponential function;
the grinding correction parameters are preferably c=4.3×10-6, α=0.96, β=1.0, γ=1.3, as determined experimentally.
In some embodiments, the fault type, correlation value and sanding quality are summarized to complete monitoring of the current sanding system.
According to the embodiment of the disclosure, the following technical effects are achieved:
by the method, real-time monitoring (fault and quality) of the robot polishing process is realized, and a real-time information perception basis is provided for the follow-up robot control strategy and the rolling optimization of the process. Compared with the prior art, the method does not need to collect force signals at the edge end, does not need to shoot (acquire) a polishing quality chart, can complete unified monitoring of faults and polishing quality by collecting vibration signals of the addition sensor, greatly reduces the number and types of the sensors, and reduces the complexity of a robot polishing system while reducing the economic cost.
It should be noted that, for simplicity of description, the foregoing method embodiments are all described as a series of acts, but it should be understood by those skilled in the art that the present application is not limited by the order of acts described, as some steps may be performed in other orders or concurrently in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are alternative embodiments, and that the acts and modules referred to are not necessarily required for the present application.
The above description of the method embodiments further describes the solution of the present application by means of device embodiments.
Fig. 3 illustrates a block diagram 300 of a robotic sanding system status monitoring device based on edge calculations, including, as shown in fig. 3:
an acquisition module 310, configured to acquire a current vibration signal;
the processing module 320 is configured to perform noise reduction and fusion processing on the vibration signal to obtain a vibration image;
the first training module 330 is configured to input the vibration image to a pre-trained fault diagnosis model, so as to obtain a fault type of the current polishing system;
the second training module 340 is configured to input the vibration image to a pre-trained quality matching model, to obtain a correlation value and a force signal of the current polishing system; the correlation value is used for correlating fault types and polishing quality; the force signal is used for determining the polishing quality of the current polishing system;
and the monitoring module 350 is used for completing the monitoring of the current polishing system based on the fault type, the related value and the polishing quality.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the described modules may refer to corresponding procedures in the foregoing method embodiments, which are not described herein again.
Fig. 4 shows a schematic diagram of a structure of a terminal device or server suitable for implementing an embodiment of the application.
As shown in fig. 4, the terminal device or the server includes a Central Processing Unit (CPU) 401, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 402 or a program loaded from a storage section 408 into a Random Access Memory (RAM) 403. In the RAM403, various programs and data required for the operation of the terminal device or the server are also stored. The CPU 401, ROM 402, and RAM403 are connected to each other by a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.
The following components are connected to the I/O interface 405: an input section 406 including a keyboard, a mouse, and the like; an output portion 407 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker, and the like; a storage section 408 including a hard disk or the like; and a communication section 409 including a network interface card such as a LAN card, a modem, or the like. The communication section 409 performs communication processing via a network such as the internet. The drive 410 is also connected to the I/O interface 405 as needed. A removable medium 411 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed on the drive 410 as needed, so that a computer program read therefrom is installed into the storage section 408 as needed.
In particular, the above method flow steps may be implemented as a computer software program according to an embodiment of the application. For example, embodiments of the application include a computer program product comprising a computer program embodied on a machine-readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 409 and/or installed from the removable medium 411. The above-described functions defined in the system of the present application are performed when the computer program is executed by a Central Processing Unit (CPU) 401.
The computer readable medium shown in the present application may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present application, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units or modules involved in the embodiments of the present application may be implemented in software or in hardware. The described units or modules may also be provided in a processor. Wherein the names of the units or modules do not in some cases constitute a limitation of the units or modules themselves.
As another aspect, the present application also provides a computer-readable storage medium that may be contained in the electronic device described in the above embodiment; or may be present alone without being incorporated into the electronic device. The computer-readable storage medium stores one or more programs that when executed by one or more processors perform the methods described herein.
The above description is only illustrative of the preferred embodiments of the present application and of the principles of the technology employed. It will be appreciated by persons skilled in the art that the scope of the application is not limited to the specific combinations of the features described above, but also covers other embodiments which may be formed by any combination of the features described above or their equivalents without departing from the spirit of the application. Such as the above-mentioned features and the technical features having similar functions (but not limited to) applied for in the present application are replaced with each other.
Claims (10)
1. The method for monitoring the state of the robot polishing system based on edge calculation is characterized by comprising the following steps of:
acquiring a current vibration signal;
noise reduction and fusion processing are carried out on the vibration signals, so that a vibration image is obtained;
inputting the vibration image into a pre-trained fault diagnosis model to obtain the fault type of the current polishing system;
inputting the vibration image into a pre-trained quality matching model to obtain a correlation value and a force signal of a current polishing system; the correlation value is used for correlating fault types and polishing quality; the force signal is used for determining the polishing quality of the current polishing system;
and based on the fault type, the related value and the polishing quality, completing the monitoring of the current polishing system.
2. The method of claim 1, wherein said noise reducing the vibration signal comprises:
decomposing the vibration signal through a wavelet packet algorithm to obtain a coefficient matrix;
defining wavelet packet node energy based on the coefficient matrix;
processing the wavelet packet node energy through a self-defined convolution self-encoder, and carrying out global node reconstruction;
and carrying out local signal reconstruction based on the reconstructed node energy, and completing noise reduction of the vibration signal.
3. The method of claim 2, wherein the convolutional self-encoder consists of a plurality of convolutional encoders and a deconvolution decoder;
wherein, the convolution encoder is:
;
wherein H is the energy characteristic obtained after encoding;
as wavelet node energy;
for the first convolution kernel in the convolution layer;
for->A bias;
for the convolution operation;
for, activate a function;
the convolutional decoder is:
;
wherein ,for decoding the returned node energy;
for, the +.>Deconvolution kernels;
for->And a bias.
4. The method of claim 1, wherein the fusing process comprises:
converting the noise-reduced signal into a polar coordinate space;
converting the signal converted into a polar coordinate space into a vibration pattern;
and fusing the vibration patterns into vibration images according to a preset anticlockwise interval.
5. The method of claim 4, wherein converting the signal converted to polar coordinate space into a vibration pattern comprises:
converting the signal converted into the polar coordinate space into a vibration pattern by the following algorithm;
;
;
;
wherein R (k), alpha (k) and beta (k) are radius, anticlockwise rotation angle and clockwise rotation angle respectively;
、/>maximum and minimum amplitude values of the reconstructed signal, respectively;
、/>the amplitude of the signal at time point k and time point k+1, respectively, of the reconstructed new number;
for, the time interval length;
p is the angle amplification factor;
and gamma is the rotation angle of the symmetry plane.
6. The method of claim 1, wherein the quality matching model is trained by:
acquiring polishing surface images, force signals and vibration images under various faults; the force signal is used for describing the polishing force of the current polishing system;
calculating the characteristic values of the pixels of the polishing surface and the vibration image corresponding to the polishing surface under each fault state respectively to construct a characteristic value matrix of the polishing surfaceAnd matrix of vibration images->;
Based on the eigenvalue matrix and />Calculating a correlation value for correlating the fault type and the sanding quality;
labeling the vibration image based on the correlation value and the force signal;
and taking the marked vibration image as input, taking a force signal and a correlation value as output, training the quality matching model through a CNN classifier, and completing training the quality matching model when the unification ratio of the output force signal and the correlation value and the marked force signal and correlation value meets a preset threshold value.
7. The method of claim 6, wherein the feature value matrix is based on and />Calculating a correlation value for correlating fault type and sanding quality includes:
;
wherein ,、/>x and Y are real numbers.
8. Robot polishing system state monitoring device based on edge calculation, characterized by comprising:
the acquisition module is used for acquiring the current vibration signal;
the processing module is used for carrying out noise reduction and fusion processing on the vibration signals to obtain vibration images;
the first training module is used for inputting the vibration image into a pre-trained fault diagnosis model to obtain the fault type of the current polishing system;
the second training module is used for inputting the vibration image into a pre-trained quality matching model to obtain a correlation value and a force signal of the current polishing system; the correlation value is used for correlating fault types and polishing quality; the force signal is used for determining the polishing quality of the current polishing system;
and the monitoring module is used for completing the monitoring of the current polishing system based on the fault type, the related value and the polishing quality.
9. An electronic device comprising a memory and a processor, the memory having stored thereon a computer program, characterized in that the processor, when executing the computer program, implements the method according to any of claims 1-7.
10. A computer readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements the method according to any of claims 1-7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311030811.1A CN116728291B (en) | 2023-08-16 | 2023-08-16 | Robot polishing system state monitoring method and device based on edge calculation |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311030811.1A CN116728291B (en) | 2023-08-16 | 2023-08-16 | Robot polishing system state monitoring method and device based on edge calculation |
Publications (2)
Publication Number | Publication Date |
---|---|
CN116728291A true CN116728291A (en) | 2023-09-12 |
CN116728291B CN116728291B (en) | 2023-10-31 |
Family
ID=87917301
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202311030811.1A Active CN116728291B (en) | 2023-08-16 | 2023-08-16 | Robot polishing system state monitoring method and device based on edge calculation |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116728291B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117773666A (en) * | 2023-10-18 | 2024-03-29 | 四川交通职业技术学院 | Intelligent columnar automobile part grinding device and method |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000036966A (en) * | 1999-05-12 | 2000-02-02 | Kdd Corp | Device for detecting cut image group of moving picture |
CN108562853A (en) * | 2018-03-29 | 2018-09-21 | 上海交通大学 | Method of Motor Fault Diagnosis based on error correcting output codes support vector machines and system |
CN110057586A (en) * | 2019-04-25 | 2019-07-26 | 长江大学 | Bearing fault vibration signal Schatten improves wavelet packet and reconstructed reduced noise method |
US20200103483A1 (en) * | 2018-10-02 | 2020-04-02 | General Electric Company | System and method for sparse image reconstruction utilizing null data consistency |
CN111272428A (en) * | 2020-02-17 | 2020-06-12 | 济南大学 | Rolling bearing fault diagnosis method based on improved Chebyshev distance |
CN112098105A (en) * | 2020-08-10 | 2020-12-18 | 北京化工大学 | Gas turbine blade fault monitoring and early warning method based on casing broadband vibration signal |
CN112396109A (en) * | 2020-11-19 | 2021-02-23 | 天津大学 | Motor bearing fault diagnosis method based on recursion graph and multilayer convolution neural network |
CN113158548A (en) * | 2021-03-19 | 2021-07-23 | 东南大学 | Structural damage assessment method based on distributed vibration data and convolution self-coding deep learning |
CN113435322A (en) * | 2021-06-25 | 2021-09-24 | 西安交通大学 | Main shaft bearing fault detection method, system, equipment and readable storage medium |
CN114034481A (en) * | 2021-11-15 | 2022-02-11 | 燕山大学 | Fault diagnosis system and method for rolling mill gearbox |
WO2022077901A1 (en) * | 2020-10-13 | 2022-04-21 | 同济大学 | Bearing failure mode diagnosis method using small sample data sets, and system |
CN114659790A (en) * | 2022-03-14 | 2022-06-24 | 浙江工业大学 | Method for identifying bearing fault of variable-speed wind power high-speed shaft |
CN114758176A (en) * | 2022-04-15 | 2022-07-15 | 上海交通大学 | Polishing state online monitoring method based on industrial robot body information |
WO2022165739A1 (en) * | 2021-02-05 | 2022-08-11 | 广东工业大学 | 2d/3d visual fusion-based robot intelligent polishing method and apparatus for hardware |
WO2022228049A1 (en) * | 2021-04-27 | 2022-11-03 | 浙大城市学院 | Method for diagnosing malfunction in aero-engine on basis of 5g edge computing and deep learning |
-
2023
- 2023-08-16 CN CN202311030811.1A patent/CN116728291B/en active Active
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000036966A (en) * | 1999-05-12 | 2000-02-02 | Kdd Corp | Device for detecting cut image group of moving picture |
CN108562853A (en) * | 2018-03-29 | 2018-09-21 | 上海交通大学 | Method of Motor Fault Diagnosis based on error correcting output codes support vector machines and system |
US20200103483A1 (en) * | 2018-10-02 | 2020-04-02 | General Electric Company | System and method for sparse image reconstruction utilizing null data consistency |
CN110057586A (en) * | 2019-04-25 | 2019-07-26 | 长江大学 | Bearing fault vibration signal Schatten improves wavelet packet and reconstructed reduced noise method |
CN111272428A (en) * | 2020-02-17 | 2020-06-12 | 济南大学 | Rolling bearing fault diagnosis method based on improved Chebyshev distance |
CN112098105A (en) * | 2020-08-10 | 2020-12-18 | 北京化工大学 | Gas turbine blade fault monitoring and early warning method based on casing broadband vibration signal |
WO2022077901A1 (en) * | 2020-10-13 | 2022-04-21 | 同济大学 | Bearing failure mode diagnosis method using small sample data sets, and system |
CN112396109A (en) * | 2020-11-19 | 2021-02-23 | 天津大学 | Motor bearing fault diagnosis method based on recursion graph and multilayer convolution neural network |
WO2022165739A1 (en) * | 2021-02-05 | 2022-08-11 | 广东工业大学 | 2d/3d visual fusion-based robot intelligent polishing method and apparatus for hardware |
CN113158548A (en) * | 2021-03-19 | 2021-07-23 | 东南大学 | Structural damage assessment method based on distributed vibration data and convolution self-coding deep learning |
WO2022228049A1 (en) * | 2021-04-27 | 2022-11-03 | 浙大城市学院 | Method for diagnosing malfunction in aero-engine on basis of 5g edge computing and deep learning |
CN113435322A (en) * | 2021-06-25 | 2021-09-24 | 西安交通大学 | Main shaft bearing fault detection method, system, equipment and readable storage medium |
CN114034481A (en) * | 2021-11-15 | 2022-02-11 | 燕山大学 | Fault diagnosis system and method for rolling mill gearbox |
CN114659790A (en) * | 2022-03-14 | 2022-06-24 | 浙江工业大学 | Method for identifying bearing fault of variable-speed wind power high-speed shaft |
CN114758176A (en) * | 2022-04-15 | 2022-07-15 | 上海交通大学 | Polishing state online monitoring method based on industrial robot body information |
Non-Patent Citations (3)
Title |
---|
杨明莉;刘三明;张卫;刘琦;: "基于振动分析的风力机齿轮箱故障诊断", 电机与控制应用, no. 01 * |
潜凌;齐明侠;吴苗法;: "小波技术在机械设备故障诊断中的研究现状", 石油矿场机械, no. 02 * |
鄢腊梅;管力明;胡更生;何宏;: "基于DWT和PNN的印刷过程实时监测和故障诊断", 振动.测试与诊断, no. 03 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117773666A (en) * | 2023-10-18 | 2024-03-29 | 四川交通职业技术学院 | Intelligent columnar automobile part grinding device and method |
CN117773666B (en) * | 2023-10-18 | 2024-04-26 | 四川交通职业技术学院 | Intelligent columnar automobile part grinding device and method |
Also Published As
Publication number | Publication date |
---|---|
CN116728291B (en) | 2023-10-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN116728291B (en) | Robot polishing system state monitoring method and device based on edge calculation | |
CN108932536B (en) | Face posture reconstruction method based on deep neural network | |
CN108346133B (en) | Deep learning network training method for super-resolution reconstruction of video satellite | |
CN109300151B (en) | Image processing method and device and electronic equipment | |
CN112819876B (en) | Monocular vision depth estimation method based on deep learning | |
CN112348029B (en) | Local map adjusting method, device, equipment and computer readable medium | |
CN112767279A (en) | Underwater image enhancement method for generating countermeasure network based on discrete wavelet integration | |
US10617365B2 (en) | System and method for motion estimation using artificial intelligence in helical computed tomography | |
CN113327318B (en) | Image display method, image display device, electronic equipment and computer readable medium | |
CN113538281B (en) | Image denoising method, image denoising device, computer equipment and storage medium | |
CN113012157A (en) | Visual detection method and system for equipment defects | |
CN113160278A (en) | Scene flow estimation and training method and device of scene flow estimation model | |
CN114004766A (en) | Underwater image enhancement method, system and equipment | |
CN115631107A (en) | Edge-guided single image noise removal | |
ul Haq et al. | 3D object detection based on proposal generation network utilizing monocular images | |
Jeon et al. | Struct-MDC: Mesh-refined unsupervised depth completion leveraging structural regularities from visual SLAM | |
CN112348085B (en) | Power data monitoring system and method | |
Shit et al. | An encoder‐decoder based CNN architecture using end to end dehaze and detection network for proper image visualization and detection | |
CN108389204B (en) | Degraded image fuzzy kernel double-parameter direct estimation method for high-speed online detection | |
CN112419377B (en) | Method and device for determining registered image | |
JP2022036075A (en) | Method for training neural network to deliver viewpoints of objects using unlabeled pairs of images, and corresponding system | |
CN114120423A (en) | Face image detection method and device, electronic equipment and computer readable medium | |
EP4372696A1 (en) | Method for training a first neural network to determine the viewpoint of an object instance in an image, and associated system | |
CN114092569B (en) | Binocular camera online calibration method and system based on multi-sensor fusion | |
Han et al. | Online burr video denoising by learning sparsifying transform |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |