WO2018076053A1 - Belt inspection system and method - Google Patents
Belt inspection system and method Download PDFInfo
- Publication number
- WO2018076053A1 WO2018076053A1 PCT/AU2017/051168 AU2017051168W WO2018076053A1 WO 2018076053 A1 WO2018076053 A1 WO 2018076053A1 AU 2017051168 W AU2017051168 W AU 2017051168W WO 2018076053 A1 WO2018076053 A1 WO 2018076053A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- belt
- edge
- pulley
- processing means
- thickness
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
- G01B11/06—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness for measuring thickness ; e.g. of sheet material
- G01B11/0691—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness for measuring thickness ; e.g. of sheet material of objects while moving
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G43/00—Control devices, e.g. for safety, warning or fault-correcting
- B65G43/02—Control devices, e.g. for safety, warning or fault-correcting detecting dangerous physical condition of load carriers, e.g. for interrupting the drive in the event of overheating
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G43/00—Control devices, e.g. for safety, warning or fault-correcting
- B65G43/06—Control devices, e.g. for safety, warning or fault-correcting interrupting the drive in case of driving element breakage; Braking or stopping loose load-carriers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G15/00—Conveyors having endless load-conveying surfaces, i.e. belts and like continuous members, to which tractive effort is transmitted by means other than endless driving elements of similar configuration
Definitions
- the present invention relates to a system for monitoring systems such as conveyors.
- the invention has been devised particularly, although not necessarily solely, in relation to a system for monitoring conveyor belts.
- the present invention relates to conveyor systems for moving materials over a distance.
- Conveyor systems normally comprise one or more conveyor belts arranged such that bulk materials are moved from location to location via a belt which is laid over a number of driving pulleys to provide locomotion.
- Such conveyor belts are commonly used in the mining industry to move mineral bearing ore to ships, wherein it is transported for smelting and mineral extraction.
- Conveyor belts are commonly damaged in their normal operation, and are a constant cause of breakdown in operations involving movement of materials from one location to another. Breakdowns caused through the failure of the belt in the conveyor system are particularly difficult to deal with, as commonly the material being transported is still on the belt when the failure occurs. This makes it extremely difficult to make repairs or to replace the belt.
- Another alternative method uses a line laser and camera positioned over a flat section of the belt and determines the top surface profile by triangulation. This method does not allow for determination of absolute thickness unless a special idler pulley or similar reference surface is installed, requiring costly modifications to the conveyor design.
- Another alternative method uses non-contact ultrasonic sensors to measure the thickness of the belt. This method cannot currently produce sufficient resolution to identify instances of isolated damage on the belt.
- Another alternative method uses a plurality of discrete laser triangulation distance sensors on each side of a free-hanging section of belt to determine the thickness of the belt in narrow lines across its width. Due to the constrained number of sensors along the belt width, this method cannot currently produce sufficient resolution to identify instances of isolated damage on the belt. Furthermore this method does not capture natural images of the belt surface for visual confirmation and analysis of suspected defects.
- a system for inspecting a belt of the conveyor system comprising at least one end section having a pulley having an outer surface for the belt to move around the pulley abutting the outer surface, the system comprising processing means for receiving image data capture by at least one camera of an edge of the belt while surrounding the pulley and first and second outer edges of the pulley; wherein the processing means is adapted to measure the distance between (1 ) first and second outer edges of the edge of the belt and (2) first and second outer edges of the pulley.
- the camera is arranged overhead of an end section of the conveyor system such that the camera takes a top view of the edge of the belt and the outer edges of the pulley.
- the processing means are adapted to infer an edge of the pulley extending from the outer edges of the pulley represent the outer surface of the pulley abutted the by belt.
- the configuration of the edge of the pulley extending from the outer edges of the pulley is provided to the processing means by a source external to the system.
- the processing means are adapted to extract crest profile of the edge of the belt and a crest profile of the edge of the pulley.
- the processing means are adapted to determine the distance between the outer surface of the edge and the outer surface of the pulley along the entire width of the belt by relating the crest profile of the edge of the belt and the crest profile of the edge of the pulley.
- the processing means are adapted to measure the distance between each point of the outer surface of the belt and each counterpart point of outer surface of the pulley to provide an indication of the thickness of the belt at each point of the belt extending from one side of the belt to the other side of the belt providing the profile of the upper surface of the edge of the belt.
- the processing means are adapted to identify prominent edges in the image taken by the camera.
- the processing means are adapted to calculate the thickness of the belt along the width of the edge of the belt by: 1 . detecting the prominent edges to produce an edge image;
- the processing means are adapted to process images that depict the edge of the belt and the outer edge of the pulley in a non-orthogonal orientation with respect to the frame of the image.
- the processing means correct the non-orthogonal orientation of the edges of belt and the edges of the pulley prior the step of detecting the edges of the bels and the pulley.
- the system is adapted to collect a plurality of images of the edges of the belt and the edges of the pulley collected by the camera while the belt is moving around the pulley.
- the processing system is adapted to store the thickness of the belt along the width of each edge of the belt for each of the images of the plurality of images relating the thickness of each edge of the belt to (1 ) the time that the image was taken and (2) to the position of each edge along the length of the belt.
- the processing means are adapted to calculate the location of each edge of the belt.
- the location of each edge of the belt is determined via using the speed of the belt being provided by any one of (1 ) a system controlling the speed of the belt, (2) RFID chip sensors detecting passing by of the belt, (3) integration of the speed of the belt including appropriate error correction, (4) the time interval between images captured by the camera 18; (5) techniques of optical flow over subsequent images, and (6) use of reference points such as splices joining together the belt.
- the processing means are adapted to generate a 3D model of the belt 12 comprising an indication of the thickness of the belt at each point of the belt via concatenating the thickness of each edge of the belt.
- the processing means are adapted to generate a pictorial representation of the profile of the belt using the 3D model.
- the system is adapted to store the data collected and generated by the processing means during a particular inspection of the belt in storage means.
- the processing mean are adapted to update storage means with data collected and generated by the processing means during one or more subsequent inspections of the belt.
- the processing means will update the 3D model of the belt stored in the storage means in real time with each thickness profile extracted, and in conjunction with the position of each thickness profile extracted.
- the process of updating the 3D model with a new profile and the position of that new profile involves overwriting the data in the 3D model that represents the profile most near along the length of the belt to the position of the new profile.
- the process of updating the 3D model with a new profile and the position of that new profile involves the application of an appropriate data-fusion algorithm, which may preferably include the incorporation of any other relevant information available to the system.
- the system is adapted to retain data of 3D model representing the state of the belt that taken over a particular period time providing an historical record of the inspection processes conducted to the belt.
- the processing means are adapted provide the rate of change of a particular singularity of the belt.
- the system is adapted to adapted to store in storage means any data related to singularities that are present in the belt.
- the processing means are adapted to identify and select singularities in the belt using techniques of object recognition.
- processing means may include apply machine-learning techniques in order to determine whether the identified features represent damage.
- the processing means identifies a feature of the belt from the 3D model and categorises the feature as damage, then the footage of the section of the damaged belt is stored in storage means.
- system is adapted to provide alternative belt thickness measurements for generating the 3D model of the belt.
- alternative belt thickness measurements comprise lasers for shining laser beams onto the belt to define laser line adjacent the edge of the belt.
- a computer implemented method for inspecting a belt of the belt of the conveyor system comprising at least one end section having a pulley having an outer surface for the belt to move around the pulley abutting the outer surface, the method comprising the steps of: receiving image data capture by at least one camera of an edge of the belt while surrounding the pulley, and first and second outer edges of an edge the pulley; and executing a program for measuring a distance between (1 ) first and second outer edges of the edge of the belt and (2) first and second outer edges of the pulley.
- the processing means infer an edge of the pulley extending from the outer edges of the pulley represent the outer surface of the pulley abutted the by belt.
- the processing means infer an edge of the pulley extending from the outer edges of the pulley provided to the processing means by a source external to the system.
- the processing means measure the distance between each point of the outer surface of the belt and each counterpart point of outer surface of the pulley to provide an indication of the thickness of the belt at each point of the belt extending from one side of the belt to the other side of the belt providing the profile of the upper surface of the edge of the belt.
- the processing means identify prominent edges in the image taken by the camera.
- the prominent edges in the image comprise the edge of the belt and the outer edges of the pulley.
- the prominent edges in the image taken by the camera are identified by an operator.
- the system collects a plurality of images of the edges of the belt and the edges of the pulley collected by the camera while the belt is moving around the pulley.
- the location of each edge of the belt is determined via using the speed of the belt being provided by any one of (1 ) a system controlling the speed of the belt, (2) RFID chip sensors detecting passing by of the belt, (3) integration of the speed of the belt including appropriate error correction, (4) the time interval between images captured by the camera 18; (5) techniques of optical flow over subsequent images, and (6) use of reference points such as splices joining together the belt.
- the processing means generate a 3D model of the belt 12 comprising an indication of the thickness of the belt at each point of the belt via concatenating the thickness of each edge of the belt.
- the processing means generate a pictorial representation of the profile of the belt using the 3D model.
- the system store the data collected and generated by the processing means during a particular inspection of the belt in storage means.
- the processing mean update storage means with data collected and generated by the processing means during one or more subsequent inspections of the belt.
- the processing means updates the 3D model of the belt stored in the storage means in real time with each thickness profile extracted, and in conjunction with the position of each thickness profile extracted.
- the process of updating the 3D model with a new profile and the position of that new profile involves the application of an appropriate data-fusion algorithm, which may preferably include the incorporation of any other relevant information available to the system.
- the system is adapted to retain data of 3D model representing the state of the belt that taken over a particular period time providing an historical record of the inspection processes conducted to the belt.
- the processing means are adapted to provide the rate of change of belt thickness over particular periods of times.
- the processing means are adapted provide the rate of change of a particular singularity of the belt.
- the system is adapted to adapted to store in storage means any data related to singularities that are present in the belt.
- processing means are adapted to identify and select singularities in the belt using techniques of object recognition.
- processing means may include apply machine-learning techniques in order to determine whether the identified features represent damage.
- the processing means identifies a feature of the belt from the 3D model and categorises the feature as damage, then the footage of the section of the damaged belt is stored in storage means.
- system is adapted to provide alternative belt thickness measurements for generating the 3D model of the belt.
- alternative belt thickness measurements comprise lasers for shining laser beams onto the belt to define laser line adjacent the edge of the belt.
- Figure 1 illustrates a particular arrangement of a system, for inspecting a conveyor system in accordance with the present embodiment of the invention
- Figure 2 shows a schematic side view of an assembly of a particular arrangement for inspecting a belt of the conveyor system
- Figure 3 shows a schematic top view of the particular arrangement for the belt of a conveyor system shown in figure 2;
- Figure 4 shows a schematic top view of three successive images taken at times consecutive times;
- Figure 5 shows an enlarged view of detail A shown in figure 5
- Figure 6 is a flowchart describing the method for measuring the thickness of the belt using the images shown in figure 4;
- Figure 7 illustrates an arrangement of a register recording the profile of edges of the belt obtained by processing the images shown in figure 4;
- Figure 8a shows a pictorial representation of a 3D model of a particular section of the belt being inspected in figure 2.
- Figure 8b shows a cross section of the pictorial representation shown in figure 8a along the line 8b-8b';
- Figure 9 is a flowchart summarizing the method for generating the 3D model shown in figures 8;
- Figure 1 1 shows a schematic top perspective of the belt of the assembly shown in figure 10. DESCRIPTION OF EMBODIMENTS
- the data capturing means 14 may comprise one more digital cameras 18; in particular arrangements, the data capturing means 14 may also include lasers 26 for emitting laser beams (see figure 10) providing supplemental information to complement the information provided by the camera(s) 18 with the intention to improve the accuracy of the output of the process for determine particular characteristics of the belt 12.
- the system 10 also comprises processing means 22 operatively connected to the data capturing means 14 for processing the captured data to determine, for example, the status of the belt 12 and providing 3D models of the belt 12 permitting, for example, generation of a pictorial representation of the belt 12 as shown in figures 8.
- the processing means 22 are adapted to communicate with communication and computing devices 24a to 24c to permit, for example, operators in charge of the conveyor system 28 to view the data captured by the data capturing means 14 (the images) and the information generated by the processing means 22.
- the operators of the conveyor system 28 may also assist in processing the images as well for further processing of data resulting by the processing of the images by the processing means 22.
- the processing means 22 comprises computing means for running software for processing the images taken by the data capturing means 14 as will be described at a later stage.
- the software for example, includes particular algorithms known in the art used for (1 ) processing images (such as for, for example, algorithms used for identifying pixels representative of particular feature in images) and (2) for processing data such as data fusion techniques.
- the computing means is coupled to a communication device configured to communicate via a communication network wired or either wireless via the internet.
- the communication device may be used to communicate, for example, with one or more of the communication and computing devices 24a to 24c and the storage means 25.
- database farms may be incorporated in the processing means.
- the database farms store information required for processing the images taken by the data capturing means 14 using the software running in the computing means of the processing means.
- the processing means 22 may also store all of the information generating during capturing the image and processing them.
- the communication and computing device 24a correspond to the control room of the conveyor system 28 and thus is connected to the conveyor system 28 as shown in figure 1 . This permits operators at the control room to control the conveyor system 28.
- the communication and computing device 24a are also connected to the processing means 22 as shown in figure 1 .
- the operators may view pictorial representations of the belt 12 in real time as the belt 12 is being inspected. This permits the operators in real time to (1 ) identify the particular singularities of the belt 12 and (2) take action such as selecting the particular area of the pictorial representation where the particular singularities of the belt 12 are located with the intention to store in storage means to further analyse the particular singularities.
- the communication and computing device 24a comprises server means containing database farms for storing the data that is being processed by the processing means 22 as well as human-machine interfaces (HMI) to permit interaction with either the conveyor system or the processing means.
- HMI human-machine interfaces
- the HMI may comprise means for selecting particular regions of the images taken by the data capturing means 14 as well as for manipulating the images and the pictorial representations of the belt 12 resulting from the data processing conducted in the processing means 22
- the system 10 is adapted to permit other communication and computing devices 24b and 24c to connect to the conveyor system and/or to the processing means 22.
- one of the communication and computing devices may comprise a mobile phone 24c permitting connecting with the processing means 22 to retrieve information from the inspection process of the belt 12. This permits an operator located proximal to the conveyor system 28 to view the results of the inspection process of the belt 12.
- system 10 further comprises storage means such as a circular buffer 25 that permits storage of the data generated by the processing means 22 as well as data generated by data capturing means 14. Any of the communication and computing devices 24 may access the circular buffer 25 for retrieval of the information stored therein.
- storage means such as a circular buffer 25 that permits storage of the data generated by the processing means 22 as well as data generated by data capturing means 14. Any of the communication and computing devices 24 may access the circular buffer 25 for retrieval of the information stored therein.
- figure 2 shows an end section of a conveyor system 28 including data capturing means 14 with one camera 18.
- data capturing means 14 there may be more than one or more cameras 18; also one or more laser emitters 26 may be incorporated to the data capturing means 14 as shown in figure 10.
- the camera 18 is arranged overhead of an end section 30 of the conveyor system 28, in particular, at one of the locations where the belt 12 changes direction by moving around the pulley 16 to return to the another end section (not shown) and that is located spaced apart from the end section 30 shown in figure 2.
- the camera 18 is located at an angle with respect to the vertical.
- the angle of view of the camera 18 covers a section extending from a particular location 32 of the belt 12 adjacent to a another particular location 34 forefront of the curved end (referred to as the edge 38 of the belt 12) of the end section 30 of the conveyor system 28.
- the camera 18 may take a top view of the edge 38 of the belt 12 shown in figure 2.
- the image of the top view of the edge 38 of the belt 12 permits determination of the particular profile of the edge 38.
- this particular arrangement permits the camera 18 to capture an image of particular section 48 comprising an upper section 36 of the belt 12 and the section of the belt 12 abutting the curved surface of the pulley located forefront the end section 30 of the conveyor system 28.
- the image taken by camera 18 includes the edge 38 of the belt 12 defining the outermost location of the conveyor system 28 and the edges 40a and 40b (of the pulley 16) that extend beyond the sides of the belt 12 and are best shown in figure 3.
- the edge 38 of the belt 12 abuts the edge (of pulley 16) that is represented by the dotted line 50 and that extends between the outer edges 40a and 40b of the pulley 16.
- Figure 3 shows a top view of the end section 30 of the conveyor system 28. As shown in figure 3, the edges 40a and 40b of the pulley 16 reach from under the lower surface 42 (see figure 2) of the belt 12 extending beyond the belt 12. This is due to the fact that the belt 12 has a width that is smaller than the width of the pulley 16.
- the belt 12 surrounds the pulley 16 as the belt 12 changes direction returning to the other end of the conveyor system 28 not shown in the figures.
- the upper surface 44 of the belt 12 is spaced apart a particular distance 46 from the outer surface of the surface pulley 16.
- the distance 46 may be seen best in figure 2.
- the distance 46 may be determined by analysing the images taken by the camera 18. As will be described below determination of the distance 46 for each point of the belt 12 permits generating a pictorial representation of the belt 12 showing the upper surface of the belt 12 incorporating any singularities of the belt 12 - see figure 8a and 8b.
- the pictorial representation (or data associated with the pictorial representation) may also provide the thickness of the belt 12 at each point of the belt 12
- the system 10 at a first stage determines the distance 46 of the belt 12 at the sides of the belt 12 abutting the outer edges 40a and 40b of the pulley 16. This is done by relating the edges 40 of the pulley 16 with the upper surfaces at the sides of the belt 12 to determine the distance 46 as shown in figure 3.
- the distance 46 as calculated at the edges 40a and 40b only provides information of the thickness of the belt 12 at the sides of the belt 12 and not of the thickness of the edge 38 of the belt 12 extending between the sides of the belt 12. (even though, if the a new belt is inspected using the present system 10, it is possible to assume that the thickness of the belt at its sides is substantially the same at each point of the belt 12; except perhaps at locations where the splices of the belt 12 are located).
- distance 46 for each point of the edge 38 extending between the sides of the belt 12 is determined by calculating the spacing between the each point of the edge 38 and it corresponding counterpart point on the edge 50 of the pulley 16.
- the processing means 22 extracts the crest profile of the edge 38 of the belt 12 as well as the crest profile of the edge 50 of the pulley 16 on which the edge 38 was resting when the image was taken by the camera 18. For this, the image taken by the camera is analysed using the processing means 22 to determine the crest profile of the edge 38 and edge 50.
- the edge 38 of the belt 12 is spaced apart from the edge 50 of the pulley 16.
- the dotted lines represent the edge 50 of the pulley 16 on which the edge 38 of the belt 12 was resting when the image was taken.
- the edge 38 is spaced apart from the edge 50 by a distance X that may vary for each for point along the edge 38 of the belt 12 due to the fact that the profile of the edge 38 is irregular as shown in figure 5. Measuring the distance X for each point of the edge 38 of the belt 12 permits generating the crest profile of the edge 38.
- FIG 5 In figure 5 are shown three locations 52a to 52c as discrete measurements for clarity, but during processing of the image to generate the crest profile the measurement of the distance X are conducted for each point along the width of the edge 38.
- edge 50 of the pulley 16 on which the edge 38 rest define a straight edge.
- the edge 50 of the pulley 16 may not follow a straight line, but it may be configured as a convex, concave or even irregular line in view that the pulley 16 comprises a concave, convex or irregular outer surface.
- the processing means 22 extracts the crest profile of the edge 50 of the pulley 16 based on the particular configuration of the outer surface of the pulley 16.
- the crest profile of the edge 50 is related then to the crest profile of the edge 38 of the belt 12.
- the particular configuration (for example convex, concave or irregular) of the outer surface of the pulley 16 may be known by the operators of the conveyor system 28 and provided to the processing means 22 in order to, instead of using the crest profile of a straight line, use the crest profile of the edge 50 defined by, for example, the convex, concave or irregular surface of the outer surface of the pulley 16 on which the belt 12 rests.
- the above mentioned method determines the thickness of a particular edge 38 of the belt 12 as is shown in figures 3 to 5.
- the processing means 22 provide a two-dimensional model (2D model) of the edge 38 of the belt 12.
- This 2D model provides the thickness of the belt 12 at each point of the belt 12 extending from one side of the belt 12 to the other side of the belt 12 at the particular location along the belt 12 where the edge 38 is located.
- the 2D model provides the profile of the upper surface of a two-dimensional slice of belt 12 representing the edge 38.
- the processing means 22 processes the images to generate the 2D crest profile of the edge 38 of the belt 12.
- the crest profile refers to the set of pixels identified as representing the edge 38 (also referred to as the tangential portion of the belt 12 as seen by camera 18).
- the crest profile of the edge 38 permits measuring the thickness of the belt 12 at the edge 38 from one side of the belt 12 to the other side of the belt 12 by comparing it with the crest profile of the edge 50 of the pulley 16.
- the processing means 22 uses object recognition techniques known in the art of image processing techniques to analyse the image taken by the camera 18 to identify the edges 38 and 50.
- the processing means 22 identify the regions of interest of the image such as the most prominent edges which are for example the edge 38 of the belt 12 and the outer edges 40a and 40b of the pulley 16. [001 10] In alternative arrangements, an operator may be visually identify the regions of interest for identifying the edge 38 of the belt 12 and the edges 40a and 40b of the pulley 16 by viewing the image and (1 ) identifying the most prominent edges (which are for example the edge 38 of the belt 12 and the outer edges 40a and 40b of the pulley 16), and (2) selecting the edges via known methods using user interface devices such as mouses or touch screens to highlight the areas of interest to be used by processing means 22 to determine the distance 46 between the edge 38 of the belt 12 and the edge 50 of the pulley 16.
- user interface devices such as mouses or touch screens
- the method for calculating the distance 46 is described in figure 7.
- the digital processing means preferably applies seven stages of processing to the image taken by the camera 18, being:
- this process includes obtaining information about the configuration of the outer surface of the pulley 16; for example, the outer surface of the pulley may be configured as a convex, concave, irregular or a straight surface; and
- the system 10 permits determination of the thickness of the belt 12 by taking images while the belt 12 is moving; with this arrangement it is possible to obtain the profile of the upper surface of the belt 21 along the length of the belt 12.
- the camera 18 takes at particular times (T,) images of the belt 12 as the belt 12 passes over the pulley 16. In this manner, a plurality of images of particular regions 48 of the belt 12 are captured to determine the profile of each edge 38 located at the particular region 48. As will be described at a later stage, to determine the profile of each edge 38 along the entire length of the belt 12 it is possible to create a 3D model that will allow generation of, for example, a pictorial representation of the profile of the belt 12 as shown in figure 8a and 8b.
- figure 3 shows three regions 48a to 48c.
- the camera 18 takes one image for each region of the belt 12 moving around the pulley 16 for determining the crest profile of each edge 38 located at regions 48.
- An indication of the profile of the upper surface of the belt 12 is obtained by determining for a multitude of regions 48, that extend along the entire length of the belt 12, the crest profile of each of the edges 38 located in each region 48, This permits generation of a 3D model of the belt 12 as will be described below.
- a 3D model provides the thickness of the belt 12 along the entire length and width of the belt 12.
- the 3D model also can be used to provide a pictorial representation of the belt 12 showing the profile of the upper surface of the belt 12 - see figures 8a and 8b.
- Providing a representation of the upper surface of the belt 12 permits detection of the locations of particular singularities (such as damages or imperfections among other features) along the length of the belt 12.
- the 3D model is generated by measuring the thickness of each two- dimensional slices of belt 12 mentioned before with reference to determine the thickness of the belt at the edge 38. This is done by taking successive images of the belt 12 as the belt 12 passes around the pulley 16. Figures 3 and 4 illustrate this process for a particular section 54 comprising the three regions 48a to 48c mentioned earlier. [001 18] As shown in figure 3, successive images of the regions 48 are captured as the particular section 54 of the belt 12 passes around the pulley 14. The images of each region 48 are shown in figure 4.
- the 3D model of the particular section 54 of the belt 12 is generated by concatenating the 2D model of each region 48 together as shown in figure 3. [00121 ] The above description was limited to three discrete regions 48a to 48c to define the 3D model of a particular region 54 of the belt 12.
- each region 48 corresponds to one of the individual slices (representing an edge 38 of the belt 12) described earlier with reference to the generation of the 2D model.
- the data that represent the 3D model corresponds to data that is stored in storage means as shown in figure 7.
- Figure 7 shows a table relating each time an image has been taken to (1 ) the time T, the particular image was taken, (2) the position of the edge 38 with respect to a particular reference point and (3) the particular profile of the edge 38.
- the profile of the edge 38 stored in the register shown in figure 7 indicate the thickness of each point along the width of the particular edge 38; it also indicates the position of each point along the width of the particular edge 38 having a particular thickness.
- the camera 18 is adapted to capture images at particular periods of time in order to generate the 3D model.
- the camera 18 is adapted to capture images based on a command generated by the processing means 22.
- the processing means 22 due to generating the command that captures the image is able to relate each image taken by the camera 18 with a particular moment in time.
- the processing means 22 can relate any image of a particular edge 38 of the belt 12 with the particular time that the image of the particular edge 38 was captured.
- the crest profile of the edge 38 of the belt 12 generated by the processing means 22 may be also related to the particular time that the image of the particular region 48 was taken.
- the 3D model can provide information about the location along the belt of particular singularities; this is particular advantageous because as will be described at a later stage, the data (of the 3D model) related to a particular singularity permits further analysis of the singularity to, for example, determine whether the singularity is a potential damage to the belt 12 and that may require immediate attention.
- its location along the belt 12 need to be known so that the singularity may be found and surveyed and repaired if applicable.
- the position of the region 48 captured in a particular image can be calculated by knowing the speed that the belt 12 is traveling.
- the speed of the belt 12 may be provided by an external source such as for example a control room controlling the conveyor system 28.
- the processing means 22 and the control room 24a are adapted to communicate to each other.
- processing means 22 may apply the techniques of optical flow over subsequent frames to determine the speed of the belt 12.
- the position of the belt in each frame can be determined by integrating the speed of the belt 12.
- the processing means 22 are adapted to determine the precise location of the particular singularity along the belt at least once per cycle of the belt 12.
- the system 10 provides a 3D model of the entire belt 12.
- the belt 12 is moved one entire cycle around pulleys 16.
- the 3D model is generated with its data being stored in storage means as mentioned before. This data is useful for further analysis of the data to determine the status of the belt 12 at the time the data was collected by, for example, analysing particular singularities detected either by the processing means 22 or an operator viewing the pictorial representation of the belt 12 in display. These particular singularities may be stored in other storage means such as a circular buffer for further review at a later stage.
- the belt 12 may be periodically inspected using system 10. This is done to ensure, for example, no new damage has appeared in the belt 12 since completion of the earlier analysis and that any singularity may have deteriorated becoming a potential damage for the belt 12.
- the data collected and generated by the processing means 22 at later analysis may be stored in the same storage means used for storing the data of the earlier analysis.
- the processing means will update the 3D model of the belt 12 stored in the storage means in real time with each thickness profile extracted, and in conjunction with the position of each thickness profile extracted.
- the process of updating the 3D model with a new profile and the position of that new profile involves overwriting the data in the 3D model that represents the profile most near along the length of the belt to the position of the new profile.
- the process of updating the 3D model with a new profile and the position of that new profile involves the application of an appropriate data-fusion algorithm, which may preferably include the incorporation of any other relevant information available to the system.
- the system 10 is able to retain data of 3D model representing the state of the belt 12 that taken over a particular period time; in this, the system 10 provides a historical record of the status of the belt 12, for example, starting when the belt 12 was first installed and ending when the belt needed to be replaced.
- This historical record of the 3D model permits determining the rate of change of belt thickness over particular periods of times. Also, it permits determining the rate of change of a particular singularity detected and that is being monitored due to being a potential hazard for the operation of the belt 12.
- the historical data of the 3D model will occupy relative large areas of the storage means.
- the system 10 is adapted to store in storage means any data related to singularities that are present in the belt 12. For example, an operator may be watching a pictorial representation of the 3D model to identify singularities present in the belt 12. Once a singularity that may be relevant to the operator, it may be selected and stored in storage means such as a circular buffer for further analysis.
- the process of recognising and selecting of singularities in the belt may be conducted by the processing means 22.
- the processing means 22 may apply techniques of object recognition to identify any relevant singularity.
- the processing means 22 may include apply machine-learning techniques in order to determine whether the identified features represent damage, and if so, the type of damage.
- the digital processing means identifies a feature of the belt from the 3D model and categorises the feature as damage
- the footage of the section of the damaged belt is stored in for example a circular buffer 25 for future retrieval such that it can be presented to operators via a human machine interface (HMI)
- belt thickness measurements that are provided via external sources or determined via different techniques other than using the camera 18 may also be incorporated in the 3D belt thickness model.
- the system further comprises a laser assembly 26 arranged to irradiate the laser light onto the belt 12 at a location adjacent where the camera 12 views the belt 12 as it passes around the pulley 16.
- a laser line 56 produced by the reflecting laser light is generated extending along the width of the belt 12.
- the position and distortion of the laser line 56 in the frame provides information on the thickness of the belt 12.
- the laser line(s) 56 captured in the frame are analysed by a processing means 12 to infer a belt surface geometry, which is then incorporated into the 3D model of the belt using known techniques of data fusion.
- the distortion of the line is depicted in Figures 10 and 1 1 .
- a plurality of laser lines 56 may be emitted onto the belt 12 spaced apart with respect to each other and the digital imaging camera.
- the laser lines 56 are generated by a plurality of laser emitters oriented at different angles relative to each other.
- the different relative angles between the laser(s) and digital imaging camera will provide varying degrees of line distortion, thereby providing the digital processing means 22 with more information that permit inferred belt surface geometries of a greater accuracy when comparted to using only the images taken by the camera 18.
- the belt thickness measurements obtained via the laser lines will be used by the processing means 22 during the process of generating the 2D model of the each region 48 of the belt 12.
- the information collected by these systems may be used during the 3D model generation process.
- the system further includes a human machine interface (HMI).
- HMI human machine interface
- the HMI is arranged to display information that is generated by the system of the present invention.
- the HMI includes a plurality of displays arranged to allow an operator of the conveyor system 28 to see visualisations depicting the measured state of the conveyor belt.
- the HMI may display images taken from the digital imaging device.
- the system 10 further comprises a means of controlling the speed or throughput of the conveyor system 28 in response to a deterioration of the of the belt 12. Adjusting the overall speed of the conveyor system 28, reduces the load being placed on the belts in the conveyor and thus decreasing the rate of deterioration of the belt 12.
- the system of the present invention is able to control other associated systems which feed the affected conveyor system 28 to stop the through flow of materials. In this manner, the damaged belt can be cleared of materials prior to being shut down for repairs.
- the data capturing means 14 may comprise a plurality of cameras 18 arranged side by side overhead the end section 30e of the conveyor system 28. In this arrangement, each of the cameras 18 will take an image of a particular section of the belt 12 as the belt 12 passes around the pulley 16.
- the processing means 22 are adapted to use the plurality of images of the particular section of the belt 12 for generating the crest profile of the edge 38 of the belt 12 and the crest profile of the edge 50 of the pulley 16 to determine the profile of the edge 38.
- the data capturing means 14 not necessarily may need to be located at a pulley located at the end of the conveyor system; instead the data capturing means 14 may be located adjacent any pulley that provides at least a small deflection to the belt 12 such that the data capturing means 14 may take an tangential image of the edge 38 (formed by the at least small deflection) of the belt 12.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Abstract
Description
Claims
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
BR112019008142-9A BR112019008142B1 (en) | 2016-10-24 | 2017-10-24 | SYSTEM FOR INSPECTING A BELT OF A CONVEYOR SYSTEM AND METHOD FOR INSPECTING A BELT DEFLECTED BY A PULLEY OF THE CONVEYOR SYSTEM |
AU2017349631A AU2017349631B2 (en) | 2016-10-24 | 2017-10-24 | Belt inspection system and method |
CN201780073730.6A CN110214120B (en) | 2016-10-24 | 2017-10-24 | Belt inspection system and method |
ZA2019/03257A ZA201903257B (en) | 2016-10-24 | 2019-05-23 | Belt inspection system and method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2016904328 | 2016-10-24 | ||
AU2016904328A AU2016904328A0 (en) | 2016-10-24 | Location and measurement of belt profiles using digital image processing |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018076053A1 true WO2018076053A1 (en) | 2018-05-03 |
Family
ID=62023001
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/AU2017/051168 WO2018076053A1 (en) | 2016-10-24 | 2017-10-24 | Belt inspection system and method |
Country Status (4)
Country | Link |
---|---|
CN (1) | CN110214120B (en) |
AU (1) | AU2017349631B2 (en) |
WO (1) | WO2018076053A1 (en) |
ZA (1) | ZA201903257B (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112098368A (en) * | 2019-06-18 | 2020-12-18 | 意达股份公司 | Loom comprising optical means for monitoring the wear of the gripper belt and method for controlling said loom |
CN116135744A (en) * | 2023-03-20 | 2023-05-19 | 北京众驰自动化设备有限公司 | Method and device for detecting abrasion of conveying belt of belt conveyor |
JP7327720B1 (en) | 2022-04-11 | 2023-08-16 | Jfeスチール株式会社 | SURFACE PROFILE MEASURING DEVICE, SURFACE PROFILE MEASURING METHOD, AND BELT MANAGEMENT METHOD |
WO2023199681A1 (en) * | 2022-04-11 | 2023-10-19 | Jfeスチール株式会社 | Surface shape measuring device, surface shape measuring method, and belt management method |
WO2023199679A1 (en) * | 2022-04-11 | 2023-10-19 | Jfeスチール株式会社 | Surface shape measurement device, surface shape measurement method, and belt management method |
JP7452752B2 (en) | 2021-12-02 | 2024-03-19 | Jfeスチール株式会社 | Surface profile measurement method, surface profile measurement device, and belt management method |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111780674A (en) * | 2020-08-07 | 2020-10-16 | 清华大学天津高端装备研究院洛阳先进制造产业研发基地 | Visual detection system based on image processing and machine learning |
US20220381594A1 (en) * | 2021-05-28 | 2022-12-01 | Contitech Transportbandsysteme Gmbh | Volume flow measurement of material using 3d lidar |
CN117347372A (en) * | 2023-10-26 | 2024-01-05 | 天津华宁电子有限公司 | Belt wear detection method |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6831566B1 (en) * | 1999-10-22 | 2004-12-14 | Phoenix Ag | Device for monitoring a conveyor |
US6988610B2 (en) * | 2002-01-14 | 2006-01-24 | Carnegie Mellon University | Conveyor belt inspection system and method |
US20130058560A1 (en) * | 2011-09-06 | 2013-03-07 | Flloyd M. Sobczak | Measurement of belt wear through edge detection of a raster image |
KR101466637B1 (en) * | 2013-05-31 | 2014-12-10 | 삼성물산 주식회사 | Apparatus for the on-line belt thickness measuring system on the belt conveyor |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0750039B2 (en) * | 1988-06-08 | 1995-05-31 | 株式会社四国総合研究所 | Conveyor belt damage detector |
JP4846602B2 (en) * | 2007-01-05 | 2011-12-28 | 株式会社リコー | Endless belt thickness variation measuring apparatus, image forming apparatus manufacturing method, and image forming apparatus |
CN202279499U (en) * | 2011-10-18 | 2012-06-20 | 惠州金泽集团有限公司 | Logistics information reading system |
EP2728305B1 (en) * | 2012-10-31 | 2016-06-29 | VITRONIC Dr.-Ing. Stein Bildverarbeitungssysteme GmbH | Method and light patterns for measuring the height or the height curve of an object |
CN102910437A (en) * | 2012-11-07 | 2013-02-06 | 天津工业大学 | Machine vision-based method for obtaining image of surface of conveyor belt |
CN105783746A (en) * | 2016-05-23 | 2016-07-20 | 南京林业大学 | Wooden product thickness detection system and detection method thereof |
-
2017
- 2017-10-24 AU AU2017349631A patent/AU2017349631B2/en active Active
- 2017-10-24 WO PCT/AU2017/051168 patent/WO2018076053A1/en active Application Filing
- 2017-10-24 CN CN201780073730.6A patent/CN110214120B/en active Active
-
2019
- 2019-05-23 ZA ZA2019/03257A patent/ZA201903257B/en unknown
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6831566B1 (en) * | 1999-10-22 | 2004-12-14 | Phoenix Ag | Device for monitoring a conveyor |
US6988610B2 (en) * | 2002-01-14 | 2006-01-24 | Carnegie Mellon University | Conveyor belt inspection system and method |
US20130058560A1 (en) * | 2011-09-06 | 2013-03-07 | Flloyd M. Sobczak | Measurement of belt wear through edge detection of a raster image |
KR101466637B1 (en) * | 2013-05-31 | 2014-12-10 | 삼성물산 주식회사 | Apparatus for the on-line belt thickness measuring system on the belt conveyor |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112098368A (en) * | 2019-06-18 | 2020-12-18 | 意达股份公司 | Loom comprising optical means for monitoring the wear of the gripper belt and method for controlling said loom |
JP7452752B2 (en) | 2021-12-02 | 2024-03-19 | Jfeスチール株式会社 | Surface profile measurement method, surface profile measurement device, and belt management method |
JP7327720B1 (en) | 2022-04-11 | 2023-08-16 | Jfeスチール株式会社 | SURFACE PROFILE MEASURING DEVICE, SURFACE PROFILE MEASURING METHOD, AND BELT MANAGEMENT METHOD |
WO2023199681A1 (en) * | 2022-04-11 | 2023-10-19 | Jfeスチール株式会社 | Surface shape measuring device, surface shape measuring method, and belt management method |
WO2023199679A1 (en) * | 2022-04-11 | 2023-10-19 | Jfeスチール株式会社 | Surface shape measurement device, surface shape measurement method, and belt management method |
CN116135744A (en) * | 2023-03-20 | 2023-05-19 | 北京众驰自动化设备有限公司 | Method and device for detecting abrasion of conveying belt of belt conveyor |
CN116135744B (en) * | 2023-03-20 | 2023-12-15 | 北京众驰自动化设备有限公司 | Method and device for detecting abrasion of conveying belt of belt conveyor |
Also Published As
Publication number | Publication date |
---|---|
AU2017349631A1 (en) | 2019-06-06 |
AU2017349631B2 (en) | 2020-10-29 |
CN110214120B (en) | 2022-07-22 |
CN110214120A (en) | 2019-09-06 |
BR112019008142A2 (en) | 2019-07-02 |
ZA201903257B (en) | 2020-02-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
AU2017349631B2 (en) | Belt inspection system and method | |
US7495758B2 (en) | Apparatus and methods for two-dimensional and three-dimensional inspection of a workpiece | |
US10976262B2 (en) | Mobile and automated apparatus for the detection and classification of damages on the body of a vehicle | |
US11891261B2 (en) | Device and method for detecting flatness of sheet material | |
CN112340387A (en) | Belt conveyor intelligent control system and control method based on machine vision | |
CN114348581B (en) | Belt tearing detection method and system | |
US11029283B2 (en) | Pipe damage assessment system and method | |
US8648895B2 (en) | Method and apparatus for performing three-dimensional measurement | |
CN102884552B (en) | The method and system of the geometry of product, yardstick and the position feature of the steel products of the most original, that substantially shape, the coarse or semi-finished product that by continuous conveyor transport is detected and determined | |
CN113516660A (en) | Visual positioning and defect detection method and device suitable for train | |
Molleda et al. | A profile measurement system for rail quality assessment during manufacturing | |
CN102529019B (en) | Method for mould detection and protection as well as part detection and picking | |
CN113112501B (en) | Vehicle-mounted track inspection device and method based on deep learning | |
KR101752554B1 (en) | System and method for nuclear fuel assembly deformation measurement | |
Molleda et al. | A profile measurement system for rail manufacturing using multiple laser range finders | |
JP2016001140A (en) | Wire temperature monitoring device using image processing | |
JP4415285B1 (en) | Wire inspection apparatus, wire inspection method, and wire inspection program | |
US9172916B2 (en) | Web monitoring system | |
CN114923913A (en) | Production defect detection system and method | |
JP2023514833A (en) | System and method for three-dimensional scanning of moving objects longer than field of view | |
BR112019008142B1 (en) | SYSTEM FOR INSPECTING A BELT OF A CONVEYOR SYSTEM AND METHOD FOR INSPECTING A BELT DEFLECTED BY A PULLEY OF THE CONVEYOR SYSTEM | |
CN108181315B (en) | Image processing-based biscuit damage detection device and detection method | |
JP2008304958A (en) | Method for inspecting work defect by image processing | |
JP2006226834A (en) | Surface inspection device and surface inspection method | |
KR102592603B1 (en) | Monitoring method for vision inspection apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17864358 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112019008142 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 2017349631 Country of ref document: AU Date of ref document: 20171024 Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 112019008142 Country of ref document: BR Kind code of ref document: A2 Effective date: 20190422 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17864358 Country of ref document: EP Kind code of ref document: A1 |