EP2620269A1 - Prepreg pasting state inspection apparatus - Google Patents

Prepreg pasting state inspection apparatus Download PDF

Info

Publication number
EP2620269A1
EP2620269A1 EP13153052.9A EP13153052A EP2620269A1 EP 2620269 A1 EP2620269 A1 EP 2620269A1 EP 13153052 A EP13153052 A EP 13153052A EP 2620269 A1 EP2620269 A1 EP 2620269A1
Authority
EP
European Patent Office
Prior art keywords
unit
adjusting
prepregs
pasting
inspection apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP13153052.9A
Other languages
German (de)
French (fr)
Other versions
EP2620269B1 (en
Inventor
Shoji Abe
Katsuo Tokida
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sanyo Machine Works Ltd
Original Assignee
Sanyo Machine Works Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sanyo Machine Works Ltd filed Critical Sanyo Machine Works Ltd
Publication of EP2620269A1 publication Critical patent/EP2620269A1/en
Application granted granted Critical
Publication of EP2620269B1 publication Critical patent/EP2620269B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/02Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B29WORKING OF PLASTICS; WORKING OF SUBSTANCES IN A PLASTIC STATE IN GENERAL
    • B29CSHAPING OR JOINING OF PLASTICS; SHAPING OF MATERIAL IN A PLASTIC STATE, NOT OTHERWISE PROVIDED FOR; AFTER-TREATMENT OF THE SHAPED PRODUCTS, e.g. REPAIRING
    • B29C70/00Shaping composites, i.e. plastics material comprising reinforcements, fillers or preformed parts, e.g. inserts
    • B29C70/04Shaping composites, i.e. plastics material comprising reinforcements, fillers or preformed parts, e.g. inserts comprising reinforcements only, e.g. self-reinforcing plastics
    • B29C70/28Shaping operations therefor
    • B29C70/30Shaping by lay-up, i.e. applying fibres, tape or broadsheet on a mould, former or core; Shaping by spray-up, i.e. spraying of fibres on a mould, former or core
    • B29C70/38Automated lay-up, e.g. using robots, laying filaments according to predetermined patterns
    • B29C70/386Automated tape laying [ATL]
    • B29C70/388Tape placement heads, e.g. component parts, details or accessories

Definitions

  • the present invention relates to improvement in a technique for inspecting a prepreg pasting state.
  • laminated bodies of prepreg for example, carbon prepreg
  • fuselages of automobiles and airplanes are used in fuselages of automobiles and airplanes.
  • the prepreg laminated bodies are constituted so that a plurality of prepregs is arranged in parallel on pasting target bodies by using a laminating apparatus.
  • the pasting target bodies are usually molds or prepreg laminated bodies laminated on the molds.
  • Patent Document 1 discloses that while light is being emitted obliquely to side ends (edge portions on sides where the gaps to be inspected are formed) of adjacent fiber-reinforced plastic tapes (corresponding to prepregs), the side ends are imaged by cameras, and distances between the edges are detected based on the obtained image data, and the states of the gaps are determined.
  • Patent Document 1 JP 2011-104905 A
  • a laminating apparatus 1 is provided with a laminating head 11, and a pasting roller 12 that is integral with the laminating head 11. While the laminating head 11 is being moved along a pasting target body 3, prepregs 4 are sequentially pasted to the pasting target body 3 by the pasting roller 12.
  • the laminating apparatus 1 is provided with a pasting state inspection apparatus 2 having a laser 21 as an illumination unit and a camera 22 as an imaging unit.
  • the laser 21 and the camera 22 move integrally with the laminating head 11.
  • the inspection using the pasting state inspection apparatus 2 is carried out on a prepreg 4 which is being pasted and adjacent pasted prepreg 4.
  • the inspection may be carried out on the adjacent prepreg 4 that has been pasted.
  • the laser (the line laser) 21 emits slit light LA along an inclined plane so that a pattern X of the slit light LA are formed across the adjacent prepregs 4.
  • the projected pattern X is composed of projected lines L1 to L3.
  • a level difference facing a longitudinal direction of the prepregs is formed between the projected lines L1 and L2 formed on the prepregs 4 and the projected line L3 formed on the pasting target body 3 corresponding to the gap G.
  • the size of the level difference depends on a thickness of the prepregs 4 and an incident angle of the slit light LA.
  • a distance A of the gap G detected based on the image data is within an allowance, so that the pasting states of the prepregs 4 can be accurately inspected. For example, when the gap distance A is within the allowance, the pasting of the prepregs 4 continues, and when not, the pasting of the prepregs 4 is suspended.
  • the slit light LA is emitted so that the projected lines L1 to L3 are formed along a direction perpendicular to a longitudinal direction of the prepregs 4.
  • the pasting target body 3 is composed of not only a plane portion 31 but often of a curved portion 32 according to a shape of a tail unit of an airplane or the like as shown in Figs. 1A and 1B .
  • a shape changed portion such as the curved portion 32 is present, this causes an adverse effect on the imaging state of the camera 22, and thus the inspection accuracy in the pasting states of the prepregs 4 is deteriorated.
  • a technical problem of the present invention is to accurately inspect pasting states of prepregs even when a pasting target body to which prepregs are pasted has a shape changed portion such as a curved portion.
  • the present invention that is devised in order to solve the above problem is a prepreg pasting state inspection apparatus, for inspecting a gap between prepregs adjacent on a pasting target body having a shape changed portion, including an irradiation unit for emitting slit light along an inclined plane so that a projected pattern of the slit light is formed across the adjacent prepregs, an imaging unit for imaging an irradiation region of the irradiation unit, a determination unit for determining whether the gap between the adjacent prepregs is within an allowance based on a signal from the imaging unit, a distance measurement unit for measuring a distance between a reference position and the irradiation region, and a focus adjusting unit for adjusting a focus position of the imaging unit based on the signal from the distance measurement unit.
  • the distance measurement unit measures a distance from the reference position to the irradiation region (for example, surfaces of the prepregs, or a surface of the pasting target body corresponding to the gap between the prepregs). For this reason, when the focus adjusting unit successively adjusts the focus position of the imaging unit, even if the shape changed portion is present in the pasting target body, the projected pattern formed across the adjacent prepregs can be accurately imaged and the gap between prepregs adjacent can be accurately detected. Therefore, the pasting states of the prepregs can be accurately inspected.
  • the imaging unit may have a movable lens that is capable of moving close to or separating from the irradiation region
  • the focus adjusting unit may have a driving unit for moving the movable lens based on the signal from the distance measurement unit.
  • a focus position of the imaging unit can be easily adjusted according to movement of the movable lens.
  • the focus position of the imaging unit may be adjusted.
  • the driving unit is an ultrasonic motor.
  • the focus position of the imaging unit can be adjusted finely and quickly. Further, the apparatus can be miniaturized.
  • the above constitution has a second focus adjusting unit for adjusting a focus position of the irradiation unit based on a signal from the distance measurement unit.
  • the focus position of the irradiation unit is adjusted like the above constitution.
  • the irradiation unit is retained in a moving body that can move close to or separate from the irradiation region, and the second focus adjusting unit has a second driving unit for moving the moving body based on a signal from the distance measurement unit.
  • the second driving unit is an ultrasonic motor.
  • the focus position of the irradiation unit is adjusted finely and quickly, and the apparatus can be miniaturized.
  • the above constitution has a light amount adjusting unit for adjusting an amount of light incident on the imaging unit.
  • the imaging unit can always observe an approximately same amount of light, so-called blown out highlights (overexposed state) can be prevented from occurring on data observed by the imaging unit due to an excessive amount of light. For this reason, the gap distance between the adjacent prepregs can be stably measured.
  • a constitution is effective for the case where the shape changed portion is present in the pasting target body. This is because a direction of reflection light (for example, total reflection light) of light emitted from the irradiation unit changes on the shape changed portion, and the amount of light incident on the imaging unit is likely to fluctuate.
  • the light amount adjusting unit is composed of at least one of an output adjusting unit for adjusting an output of the slit light emitted from the irradiation unit, a shutter speed adjusting unit for adjusting a shutter speed of the imaging unit, and an iris adjusting unit for adjusting an iris of the imaging unit.
  • (1) to (3) are suitably combined so that the constitution is compatible with the fluctuation in the amount of light more securely.
  • the above constitution is provided with a depth of field adjusting unit for adjusting a depth of field of the imaging unit.
  • the depth of field adjusting unit examples include the iris of the imaging unit (for example, an electromotive iris), and a zoom mechanism (for example, electromotive zoom) if it is provided to the imaging unit.
  • the iris for example, an electromotive iris
  • a zoom mechanism for example, electromotive zoom
  • the pasting states of the prepregs can be accurately inspected.
  • a prepreg pasting state inspection apparatus 2 is provided with a laser 21 as an irradiation unit, a camera 22 as an imaging unit for imaging an irradiation region of the laser 21, a control unit 24 as a determination unit for determining whether a gap S (gap distance A) between adjacent prepregs 4 is within an allowance based on a signal from the camera 22, and a range sensor 23 as a distance measurement unit for measuring a distance from a reference position to the irradiation region.
  • the drawing for convenience, illustrates the camera 22 and the range sensor 23 being adjacent to each other in a pasting advancing direction of the prepregs 4. Actually, however, both of them are arranged adjacently in a direction perpendicular to the pasting advancing direction of the prepregs 4, in other words, a widthwise direction of the prepregs 4 as shown in Fig. 5 .
  • a light wave type or sound wave type range sensor can be employed as the range sensor 23.
  • a difference between the distance measured by the range sensor 23 and an actual distance from the camera 22 to the irradiation region is given in advance as a correction function.
  • a difference between the distance measured by the range sensor 23 and an actual distance from the laser 21 to the irradiation region is given in advance as a correction function.
  • the irradiation unit is not limited to the laser 21, and thus illumination such as LED for emitting incoherent light can be employed.
  • the control unit 24 is provided with a first focus adjusting unit 25 for adjusting a focus position of the camera 22 based on a measurement signal from the range sensor 23, and a second focus adjusting unit 26 for adjusting a focus position of the laser 21 based on the measurement signal from the range sensor 23.
  • the camera 22 contains a motor (for example, an ultrasonic motor) 27 for moving a movable lens, not shown, back and forth with respect to an optical axis direction.
  • a motor for example, an ultrasonic motor
  • the laser 21 is mounted to a moving body 29 that moves up and down on a rail 28 extending to an up-down direction.
  • the moving body 29 is driven by a motor, not shown (for example, an ultrasonic motor).
  • the moving body 29 may be supported at a forward end of a cylinder expanding and contracting in the up-down direction.
  • the first focus adjusting unit 25 drives a motor 27 built in the camera 22 based on the distance measured signal input from the range sensor 23, and moves the movable lens of the camera 22 back and forth in the optical axis direction. As a result, the focus position of the camera 22 is automatically adjusted according to the distance measured signal from the range sensor 23.
  • a second focus adjusting unit 26 drives a motor connected to the moving body 29 based on the distance measured signal input from the range sensor 23 so as to move the laser 21 back and forth integrally with the moving body 29. As a result, the focus position of the laser 21 is automatically adjusted according to the distance measured signal from the range sensor 23.
  • the prepreg pasting state inspection apparatus 2 is different from the first embodiment in that a light amount adjusting unit for adjusting an amount of light incident on the camera 22, and a depth of field adjusting unit for adjusting a depth of field of the camera 22 are provided. Only that different point will be described below.
  • the light amount adjusting unit is composed of at least one of an output adjusting unit for adjusting the output of the slit light emitted from the laser 21, a shutter speed adjusting unit for adjusting the shutter speed of the camera 22, and an iris adjusting unit for adjusting the iris of the camera.
  • the light amount adjusting unit adjusts the amount of light incident on the camera 22 so that the amount of light becomes approximately constant.
  • the depth of field adjusting unit is composed of at least one of the iris adjusting unit for adjusting the iris of the camera, and a zoom adjusting unit for adjusting a zoom of the camera. Even if the shape of the pasting target body 3 changes, the depth of field adjusting unit adjusts the depth of field of the camera 22 so that the projected lines L1 to L3 can be clearly observed.
  • the light amount adjusting unit and the depth of field adjusting unit change the adjusting amounts in the following manner, for example.
  • the adjusting amounts by means of the light amount adjusting unit and the depth of field adjusting unit are stored in advance according to a tilt angle ⁇ of the pasting target body 3.
  • the tilt angle ⁇ is set to an angle that is formed by a line segment P1P2 and a horizontal line.
  • P1 is an intersection point between a perpendicular line drawn from the camera 22 and surface of the pasting target body 3 (or the prepregs 4).
  • P2 is a lowest point on an outer periphery of the pasting roller 12.
  • M and L are known in advance.
  • becomes zero.
  • since L - L1 is more than zero, ⁇ obtains a positive value.
  • since L - L1 is less than zero, ⁇ obtains a negative value.
  • a tilting direction of the pasting target body 3 can be determined based on the positive or negative value of ⁇ .
  • the light amount adjusting unit narrows down the light amount and adjusts the amount of light so that it is approximately maintained in the same level in all the states of Figs. 6A to 6C .
  • the depth of field adjusting unit sets the depth of field as deep as possible so that the projected lines L1 to L3 (see Fig. 2 ) of the slit light can be clearly observed in the states of Figs. 6A to 6C .
  • the depth of field is constant in Figs. 6A to 6C , but the depth of field may be changed according to the change in ⁇ .
  • the prepregs 4 are pasted to the first pasting target body 3 at a low speed of, for example, about 0.5 m/s (half of the normal pasting speed).
  • a relationship between ⁇ and the adjusting amounts by means of the light amount adjusting unit and the depth of field adjusting unit is stored (recording (teaching) step).
  • the light amount adjusting unit and the depth of field adjusting unit are operated in the basis of the adjusting amounts stored in advance.
  • NC numerical value control
  • the present invention is not limited to the above embodiments and can be carried out in various forms.
  • the first embodiment describes the case where the movable lens of the camera 22 is moved, but the entire camera 22 may be slid to the optical axis direction so that the focus position is adjusted.

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Chemical & Material Sciences (AREA)
  • Composite Materials (AREA)
  • Mechanical Engineering (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Moulding By Coating Moulds (AREA)
  • Casting Or Compression Moulding Of Plastics Or The Like (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

Even when a pasting target body to which prepregs are pasted has a shape changed portion such as a curved portion, prepreg pasting states are accurately inspected. A prepreg pasting state inspection apparatus (2) for inspecting a gap G between prepregs (4) adjacent on a pasting target body (3) has a laser (21) for emitting slit light LA along an inclined plane so that a projected pattern X of the slit light is formed across the adjacent prepregs (4), a camera (22) for imaging an irradiation region of the laser (21), a control unit (24) as a determination unit for determining whether the gap G between the adjacent prepregs (4) is within an allowance based on a signal from the camera (22), a range sensor (23) for measuring a distance between a reference position and the irradiation region, and focus adjusting units (25 and 26) for adjusting focus positions of the camera (22) and the laser (21) based on the signal from the range sensor (23).

Description

    TECHNICAL FIELD
  • The present invention relates to improvement in a technique for inspecting a prepreg pasting state.
  • BACKGROUND ART
  • As publicly known, laminated bodies of prepreg (for example, carbon prepreg) that are fired are used in fuselages of automobiles and airplanes.
  • The prepreg laminated bodies are constituted so that a plurality of prepregs is arranged in parallel on pasting target bodies by using a laminating apparatus. The pasting target bodies are usually molds or prepreg laminated bodies laminated on the molds.
  • However, even when prepregs are automatically pasted by the laminating apparatus, the defect in pasting of the prepregs is occasionally occurred. For this reason, as described in Patent Document 1, for example, in parallel with the pasting of the prepregs, states of gaps between adjacent prepregs are inspected.
  • Concretely, Patent Document 1 discloses that while light is being emitted obliquely to side ends (edge portions on sides where the gaps to be inspected are formed) of adjacent fiber-reinforced plastic tapes (corresponding to prepregs), the side ends are imaged by cameras, and distances between the edges are detected based on the obtained image data, and the states of the gaps are determined.
  • PRIOR ART DOCUMENT PATENT DOCUMENT
  • Patent Document 1: JP 2011-104905 A
  • SUMMARY OF INVENTION TECHNICAL PROBLEMS
  • However, in a case of the method disclosed in Patent Document 1, since edges of prepregs should be detected with it being irradiated directly with light, if gaps between the adjacent prepregs are narrowed, accuracy in detection of the gaps is deteriorated.
  • In order to solve such a problem, therefore, the following prepreg laminating apparatus is considered.
  • Concretely, as shown in Figs. 1A to 1C, a laminating apparatus 1 is provided with a laminating head 11, and a pasting roller 12 that is integral with the laminating head 11. While the laminating head 11 is being moved along a pasting target body 3, prepregs 4 are sequentially pasted to the pasting target body 3 by the pasting roller 12.
  • As shown in Fig. 1C, the laminating apparatus 1 is provided with a pasting state inspection apparatus 2 having a laser 21 as an illumination unit and a camera 22 as an imaging unit. The laser 21 and the camera 22 move integrally with the laminating head 11. The inspection using the pasting state inspection apparatus 2 is carried out on a prepreg 4 which is being pasted and adjacent pasted prepreg 4. The inspection may be carried out on the adjacent prepreg 4 that has been pasted.
  • As shown in Fig. 2, the laser (the line laser) 21 emits slit light LA along an inclined plane so that a pattern X of the slit light LA are formed across the adjacent prepregs 4. In the case of Fig.2, the projected pattern X is composed of projected lines L1 to L3. In such a manner, when a gap G is present between the prepregs 4, a level difference facing a longitudinal direction of the prepregs (pasting advancing direction) is formed between the projected lines L1 and L2 formed on the prepregs 4 and the projected line L3 formed on the pasting target body 3 corresponding to the gap G. The size of the level difference depends on a thickness of the prepregs 4 and an incident angle of the slit light LA. For this reason, when an irradiation region formed with the projected lines L1 to L3 is imaged by the camera 22 from above, image data shown in Fig. 3 can be obtained. A determination is made whether a distance A of the gap G detected based on the image data is within an allowance, so that the pasting states of the prepregs 4 can be accurately inspected. For example, when the gap distance A is within the allowance, the pasting of the prepregs 4 continues, and when not, the pasting of the prepregs 4 is suspended. Herein, it is preferable that the slit light LA is emitted so that the projected lines L1 to L3 are formed along a direction perpendicular to a longitudinal direction of the prepregs 4.
  • However, even such a pasting state inspection apparatus 2 has the following problem.
  • That is to say, the pasting target body 3 is composed of not only a plane portion 31 but often of a curved portion 32 according to a shape of a tail unit of an airplane or the like as shown in Figs. 1A and 1B. When a shape changed portion such as the curved portion 32 is present, this causes an adverse effect on the imaging state of the camera 22, and thus the inspection accuracy in the pasting states of the prepregs 4 is deteriorated.
  • In view of the above circumstance, a technical problem of the present invention is to accurately inspect pasting states of prepregs even when a pasting target body to which prepregs are pasted has a shape changed portion such as a curved portion.
  • SOLUTION TO PROBLEM
  • The present invention that is devised in order to solve the above problem is a prepreg pasting state inspection apparatus, for inspecting a gap between prepregs adjacent on a pasting target body having a shape changed portion, including an irradiation unit for emitting slit light along an inclined plane so that a projected pattern of the slit light is formed across the adjacent prepregs, an imaging unit for imaging an irradiation region of the irradiation unit, a determination unit for determining whether the gap between the adjacent prepregs is within an allowance based on a signal from the imaging unit, a distance measurement unit for measuring a distance between a reference position and the irradiation region, and a focus adjusting unit for adjusting a focus position of the imaging unit based on the signal from the distance measurement unit.
  • With such a constitution, the distance measurement unit measures a distance from the reference position to the irradiation region (for example, surfaces of the prepregs, or a surface of the pasting target body corresponding to the gap between the prepregs). For this reason, when the focus adjusting unit successively adjusts the focus position of the imaging unit, even if the shape changed portion is present in the pasting target body, the projected pattern formed across the adjacent prepregs can be accurately imaged and the gap between prepregs adjacent can be accurately detected. Therefore, the pasting states of the prepregs can be accurately inspected.
  • With the above embodiment, the imaging unit may have a movable lens that is capable of moving close to or separating from the irradiation region, and the focus adjusting unit may have a driving unit for moving the movable lens based on the signal from the distance measurement unit.
  • In such a manner, a focus position of the imaging unit can be easily adjusted according to movement of the movable lens. When the entire imaging unit is moved close to or is separated from the irradiation region, the focus position of the imaging unit may be adjusted.
  • In this case, it is preferable that the driving unit is an ultrasonic motor.
  • In such a manner, the focus position of the imaging unit can be adjusted finely and quickly. Further, the apparatus can be miniaturized.
  • It is preferable that the above constitution has a second focus adjusting unit for adjusting a focus position of the irradiation unit based on a signal from the distance measurement unit.
  • That is to say, when the shape changed portion is present in the pasting target body, this causes an adverse effect also on irradiation conditions of the irradiation unit (a width and lightness of the projected pattern fluctuate). For this reason, it is preferable that the focus position of the irradiation unit is adjusted like the above constitution.
  • In the above constitution, it is preferable that the irradiation unit is retained in a moving body that can move close to or separate from the irradiation region, and the second focus adjusting unit has a second driving unit for moving the moving body based on a signal from the distance measurement unit.
  • In this case, it is preferable that the second driving unit is an ultrasonic motor.
  • In such a manner, the focus position of the irradiation unit is adjusted finely and quickly, and the apparatus can be miniaturized.
  • It is preferable that the above constitution has a light amount adjusting unit for adjusting an amount of light incident on the imaging unit.
  • As a result, since the imaging unit can always observe an approximately same amount of light, so-called blown out highlights (overexposed state) can be prevented from occurring on data observed by the imaging unit due to an excessive amount of light. For this reason, the gap distance between the adjacent prepregs can be stably measured. Particularly, such a constitution is effective for the case where the shape changed portion is present in the pasting target body. This is because a direction of reflection light (for example, total reflection light) of light emitted from the irradiation unit changes on the shape changed portion, and the amount of light incident on the imaging unit is likely to fluctuate.
  • In the above constitution, it is preferable that the light amount adjusting unit is composed of at least one of an output adjusting unit for adjusting an output of the slit light emitted from the irradiation unit, a shutter speed adjusting unit for adjusting a shutter speed of the imaging unit, and an iris adjusting unit for adjusting an iris of the imaging unit.
  • That is to say, (1) when the output adjusting unit adjusts the output of the slit light, an amount of reflection light that causes an adverse effect on imaging can be adjusted. For this reason, when strong reflection light is predicted, the output of the slit light may be suppressed. (2) When the shutter speed of the imaging unit is adjusted by the shutter speed adjusting unit, time at which the light is incident on the imaging unit can be adjusted. For this reason, when strong reflection light is predicted, the shutter speed may be heightened. (3) When the iris of the imaging unit is adjusted by the iris adjusting unit, an amount of light indent on the imaging unit can be adjusted according to a narrowing-down level of the iris. For this reason, when the strong reflected light is predicted, the iris may be narrowed down. When any one of (1) to (3) is employed, the constitution can cope with a fluctuation in the amount of light incident on the imaging unit. However, (1) to (3) are suitably combined so that the constitution is compatible with the fluctuation in the amount of light more securely.
  • It is preferable that the above constitution is provided with a depth of field adjusting unit for adjusting a depth of field of the imaging unit.
  • As a result, imaging accuracy of the imaging unit can be prevented from being deteriorated on a position corresponding to the shape changed portion of the pasting target body. Examples of the depth of field adjusting unit include the iris of the imaging unit (for example, an electromotive iris), and a zoom mechanism (for example, electromotive zoom) if it is provided to the imaging unit. In this case, when the iris is narrowed down or the zoom mechanism is adjusted to a wide-angle side, the depth of field is deepened (deep-focus), thereby preventing the imaging accuracy of the imaging unit from being deteriorated on the shape changed portion.
  • ADVANTAGEOUS EFFECTS OF INVENTION
  • According to the present invention, even when the pasting target body to which the prepregs are pasted has the shape changed portion such as the curved portion, the pasting states of the prepregs can be accurately inspected.
  • BRIEF DESCRIPTION OF DRAWINGS
    • Fig. 1A is a conceptual diagram illustrating one example of a prepreg laminating apparatus.
    • Fig. 1B is a conceptual diagram illustrating a condition of a prepreg pasting work using the laminating apparatus.
    • Fig. 1C is a conceptual diagram illustrating one example of a prepreg pasting state inspection apparatus mounted to the laminating apparatus.
    • Fig. 2 is a conceptual diagram illustrating a condition of the inspecting work using the pasting state inspection apparatus shown in Fig. 1.
    • Fig. 3 is a conceptual diagram illustrating one example of image data captured by an imaging unit (a camera) in the condition of Fig. 2.
    • Fig. 4 is a conceptual diagram illustrating the prepreg pasting state inspection apparatus according to a first embodiment of the present invention.
    • Fig. 5 is a perspective view illustrating the prepreg pasting state inspection apparatus according to the first embodiment of the present invention.
    • Fig. 6A is a diagram illustrating inspection conditions in an early state by means of the prepreg pasting state inspection apparatus according to a second embodiment of the present invention.
    • Fig. 6B is a diagram illustrating inspection conditions in a middle state by means of the prepreg pasting state inspection apparatus according to a second embodiment of the present invention.
    • Fig. 6C is a diagram illustrating inspection conditions in a late state by means of the prepreg pasting state inspection apparatus according to a second embodiment of the present invention.
    DESCRIPTION OF EMBODIMENTS
  • An embodiment of the present invention will be described below with reference to accompanying drawings. Since items relating to Figs. 1 to 3 described already are similar, detailed description is omitted.
  • <First Embodiment >
  • As shown in Fig. 4, a prepreg pasting state inspection apparatus 2 according to a first embodiment of the present invention is provided with a laser 21 as an irradiation unit, a camera 22 as an imaging unit for imaging an irradiation region of the laser 21, a control unit 24 as a determination unit for determining whether a gap S (gap distance A) between adjacent prepregs 4 is within an allowance based on a signal from the camera 22, and a range sensor 23 as a distance measurement unit for measuring a distance from a reference position to the irradiation region. The drawing, for convenience, illustrates the camera 22 and the range sensor 23 being adjacent to each other in a pasting advancing direction of the prepregs 4. Actually, however, both of them are arranged adjacently in a direction perpendicular to the pasting advancing direction of the prepregs 4, in other words, a widthwise direction of the prepregs 4 as shown in Fig. 5.
  • As the range sensor 23, a light wave type or sound wave type range sensor can be employed. A difference between the distance measured by the range sensor 23 and an actual distance from the camera 22 to the irradiation region is given in advance as a correction function. Similarly, a difference between the distance measured by the range sensor 23 and an actual distance from the laser 21 to the irradiation region is given in advance as a correction function. The irradiation unit is not limited to the laser 21, and thus illumination such as LED for emitting incoherent light can be employed.
  • The control unit 24 is provided with a first focus adjusting unit 25 for adjusting a focus position of the camera 22 based on a measurement signal from the range sensor 23, and a second focus adjusting unit 26 for adjusting a focus position of the laser 21 based on the measurement signal from the range sensor 23.
  • The camera 22 contains a motor (for example, an ultrasonic motor) 27 for moving a movable lens, not shown, back and forth with respect to an optical axis direction.
  • The laser 21 is mounted to a moving body 29 that moves up and down on a rail 28 extending to an up-down direction. The moving body 29 is driven by a motor, not shown (for example, an ultrasonic motor). The moving body 29 may be supported at a forward end of a cylinder expanding and contracting in the up-down direction.
  • The first focus adjusting unit 25 drives a motor 27 built in the camera 22 based on the distance measured signal input from the range sensor 23, and moves the movable lens of the camera 22 back and forth in the optical axis direction. As a result, the focus position of the camera 22 is automatically adjusted according to the distance measured signal from the range sensor 23.
  • On the other hand, a second focus adjusting unit 26 drives a motor connected to the moving body 29 based on the distance measured signal input from the range sensor 23 so as to move the laser 21 back and forth integrally with the moving body 29. As a result, the focus position of the laser 21 is automatically adjusted according to the distance measured signal from the range sensor 23.
  • Therefore, even when a shape changed portion such as a curved portion 32 is present in a pasting target body (the mold or a prepreg laminated body) 3, the focus positions of the laser 21 and the camera 22 are properly adjusted. For this reason, the image data shown in Fig. 3 can be securely obtained. Therefore, the pasting states of the prepregs 4 can be accurately inspected without being affected by the shape changed portion of the pasting target body 3.
  • <Second Embodiment>
  • The prepreg pasting state inspection apparatus 2 according to a second embodiment of the present invention is different from the first embodiment in that a light amount adjusting unit for adjusting an amount of light incident on the camera 22, and a depth of field adjusting unit for adjusting a depth of field of the camera 22 are provided. Only that different point will be described below.
  • The light amount adjusting unit is composed of at least one of an output adjusting unit for adjusting the output of the slit light emitted from the laser 21, a shutter speed adjusting unit for adjusting the shutter speed of the camera 22, and an iris adjusting unit for adjusting the iris of the camera. The light amount adjusting unit adjusts the amount of light incident on the camera 22 so that the amount of light becomes approximately constant.
  • The depth of field adjusting unit is composed of at least one of the iris adjusting unit for adjusting the iris of the camera, and a zoom adjusting unit for adjusting a zoom of the camera. Even if the shape of the pasting target body 3 changes, the depth of field adjusting unit adjusts the depth of field of the camera 22 so that the projected lines L1 to L3 can be clearly observed.
  • As a result, even when the curved portion 32 is present in the pasting target body 3, occurrence of defects such as blown out highlights and defocusing can be prevented. For this reason, the gap between the adjacent prepregs 4 can be accurately inspected.
  • The light amount adjusting unit and the depth of field adjusting unit change the adjusting amounts in the following manner, for example.
  • That is to say, as shown in Figs. 6A to 6C, the adjusting amounts by means of the light amount adjusting unit and the depth of field adjusting unit are stored in advance according to a tilt angle θ of the pasting target body 3.
  • In the second embodiment, the tilt angle θ is set to an angle that is formed by a line segment P1P2 and a horizontal line. P1 is an intersection point between a perpendicular line drawn from the camera 22 and surface of the pasting target body 3 (or the prepregs 4). P2 is a lowest point on an outer periphery of the pasting roller 12. In the drawing, since a relative position relationship between the pasting roller 12 and the camera 22 does not change, M and L are known in advance. Further, L1 is successively detected based on the measured results of the range sensor 23. Therefore, the tilt angle θ is obtained according to the following formula; θ = tan - 1 L - L 1 / M
    Figure imgb0001
  • In the case of Fig. 6B (the plane portion), since L1 is equal to L, θ becomes zero. On the other hand, in the case of Fig. 6A, since L - L1 is more than zero, θ obtains a positive value. In the case of Fig. 6C, since L - L1 is less than zero, θ obtains a negative value. A tilting direction of the pasting target body 3 can be determined based on the positive or negative value of θ.
  • While θ is being calculated in such a manner, the adjusting amounts of the light amount adjusting unit and the depth of field adjusting unit are changed according to a change in θ.
  • More concretely, in the case of Fig. 6A, since the slit light emitted from the laser 21 is incident on the surface of the pasting target body 3 (or the prepregs 4) at a shallow incident angle, reflection light R does not incident directly on the camera 22. In the case of Fig. 6B, the slit light emitted from the laser 21 is incident on the surface of the pasting target body 3 (or the prepregs 4) gradually at deeper incident angles, but the reflection light R is unlikely to be incident directly on the camera 22. On the contrary, in the case of Fig. 6C, since the slit light emitted from the laser 21 is incident on the surface of the pasting target body 3 (or the prepregs 4) at a deep incident angle, the reflection light R might be directly observed in the camera 22. For this reason, as shown in Figs. 6A to 6C, as θ changes, the light amount adjusting unit narrows down the light amount and adjusts the amount of light so that it is approximately maintained in the same level in all the states of Figs. 6A to 6C. On the other hand, the depth of field adjusting unit sets the depth of field as deep as possible so that the projected lines L1 to L3 (see Fig. 2) of the slit light can be clearly observed in the states of Figs. 6A to 6C. In the second embodiment, the depth of field is constant in Figs. 6A to 6C, but the depth of field may be changed according to the change in θ.
  • In practical use, it is occasionally requested to repeat the work for pasting the prepregs 4 to a plurality of pasting target bodies 3 belonging to the same kind at a speed of 1 m/s or more. In this case, when the adjusting amounts are tried to be changed by the light amount adjusting unit and the depth of field adjusting unit while θ is being calculated, it might be difficult to respond the request with for example, photographing of 30 frames/second (1 frame: 33 ms).
  • Therefore, in this case, when the work for pasting the prepregs 4 to one kind of the pasting target bodies 3 is repeated, the prepregs 4 are pasted to the first pasting target body 3 at a low speed of, for example, about 0.5 m/s (half of the normal pasting speed). A relationship between θ and the adjusting amounts by means of the light amount adjusting unit and the depth of field adjusting unit is stored (recording (teaching) step). As to the subsequent same kind of the pasting target bodies 3, the light amount adjusting unit and the depth of field adjusting unit are operated in the basis of the adjusting amounts stored in advance.
  • Since numerical value control (NC) data used for pasting the prepregs 4 to the pasting target body 3 is stored in a laminating apparatus 1, the NC data is used instead of θ so that the adjusting amounts of the light amount adjusting unit and the depth of field adjusting unit may be changed. That is to say, when three-dimensional data (or altitude data representing the surface) representing the surface of the pasting target body 3 is present, this may be used instead of θ.
  • The present invention is not limited to the above embodiments and can be carried out in various forms. For example, the first embodiment describes the case where the movable lens of the camera 22 is moved, but the entire camera 22 may be slid to the optical axis direction so that the focus position is adjusted.
  • The above embodiments describe the case where the pasting state inspection apparatus 2 is integral with the laminating apparatus 1, but they may be constituted separately.
  • EXPLANATIONS OF SYMBOLS
  • 1
    prepreg laminating apparatus
    11
    laminating head
    12
    pasting roller
    2
    prepreg pasting state inspection apparatus
    21
    laser
    22
    camera
    23
    range sensor
    24
    control unit
    25
    first focus adjusting unit (for a camera)
    26
    second focus adjusting unit (for a laser)
    3
    pasting target body
    4
    prepregs
    X
    projected pattern
    L1, L2, L3
    projected line
    LA
    slit light
    S
    gap
    A
    gap distance

Claims (7)

  1. A prepreg pasting state inspection apparatus for inspecting a gap between prepregs adjacent on a pasting target body having a shape changed portion, comprising:
    an irradiation unit for emitting slit light along an inclined plane so that a projected pattern of the slit light is formed across the adjacent prepregs;
    an imaging unit for imaging an irradiation region of the irradiation unit;
    a determination unit for determining whether the gap between the adjacent prepregs is within an allowance based on a signal from the imaging unit;
    a distance measurement unit for measuring a distance between a reference position and the irradiation region; and
    a focus adjusting unit for adjusting a focus position of the imaging unit based on the signal from the distance measurement unit.
  2. The prepreg pasting state inspection apparatus according to claim 1, wherein
    the imaging unit has a movable lens that is capable of moving close to or separating from the irradiation region, and
    the focus adjusting unit has a driving unit for moving the movable lens based on the signal from the distance measurement unit.
  3. The prepreg pasting state inspection apparatus according to claim 1 or 2, further comprising a second focus adjusting unit for adjusting a focus position of the irradiation unit based on a signal from the distance measurement unit are provided.
  4. The prepreg pasting state inspection apparatus according to claim 3, wherein
    the irradiation unit is retained in a moving body that can move close to or separate from the irradiation region, and
    the second focus adjusting unit has a second driving unit for moving the moving body based on the signal from the distance measurement unit.
  5. The prepreg pasting state inspection apparatus according to any one of claims 1 to 4, further comprising a light amount adjusting unit for adjusting an amount of light incident on the imaging unit is provided.
  6. The prepreg pasting state inspection apparatus according to claim 5, wherein the light amount adjusting unit is composed of at least one of an output adjusting unit for adjusting an output of the slit light emitted from the irradiation unit, a shutter speed adjusting unit for adjusting a shutter speed of the imaging unit, and an iris adjusting unit for adjusting an iris of the imaging unit.
  7. The prepreg pasting state inspection apparatus according to any one of claims 1 to 6, further comprising a depth of field adjusting unit for adjusting a depth of field of the imaging unit.
EP13153052.9A 2012-01-30 2013-01-29 Prepreg pasting state inspection apparatus Active EP2620269B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2012016944A JP5805550B2 (en) 2012-01-30 2012-01-30 Pre-preg sticking state inspection device

Publications (2)

Publication Number Publication Date
EP2620269A1 true EP2620269A1 (en) 2013-07-31
EP2620269B1 EP2620269B1 (en) 2014-07-23

Family

ID=47750417

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13153052.9A Active EP2620269B1 (en) 2012-01-30 2013-01-29 Prepreg pasting state inspection apparatus

Country Status (4)

Country Link
US (1) US9279678B2 (en)
EP (1) EP2620269B1 (en)
JP (1) JP5805550B2 (en)
CA (1) CA2803568C (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102015104612A1 (en) * 2015-03-26 2016-09-29 Deutsches Zentrum für Luft- und Raumfahrt e.V. Apparatus and method for determining the tackiness of preimpregnated semifinished fiber products
DE102015017131A1 (en) 2015-03-26 2016-09-29 Deutsches Zentrum für Luft- und Raumfahrt e.V. Apparatus and method for determining the tackiness of preimpregnated semifinished fiber products
DE102015008313A1 (en) * 2015-06-30 2017-01-05 Airbus Defence and Space GmbH Device and method
DE102015122026A1 (en) * 2015-12-16 2017-06-22 Automation Steeg & Hoffmeyer Gmbh Apparatus and method for composing fiber-plastic composites with high application rates
CN113566703A (en) * 2021-07-15 2021-10-29 上海自动化仪表有限公司 System for measuring actual position on square platform and position calculation method

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11565484B2 (en) * 2013-02-08 2023-01-31 Lm Wp Patent Holding A/S System and method for the manufacture of an article
JP6241935B2 (en) * 2014-02-12 2017-12-06 東レエンジニアリング株式会社 A device to inspect the application state of fiber reinforced plastic tape
EP3153308A1 (en) * 2015-10-07 2017-04-12 Chaei Hsin Enterprise Co., Ltd. Compression molding apparatus
GB2564708B (en) * 2017-07-21 2020-02-12 Magma Global Ltd Void volume measurement for a composite pipe
US10549491B2 (en) * 2017-09-06 2020-02-04 The Boeing Company System and method for edge length differential measurement for fiber steering in automated fiber placement
GB201916063D0 (en) * 2019-11-05 2019-12-18 Lm Wind Power As Mould system and a method for moulding a blade shell of a wind turbine blade
CN112197746B (en) * 2020-09-16 2022-06-21 上海建工四建集团有限公司 Intelligent detection device and detection method for weathering degree of wall surface of brick wall

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0655656A (en) * 1992-08-07 1994-03-01 Toshiba Mach Co Ltd Laminating device for prepreg
EP1334819A1 (en) * 2002-02-06 2003-08-13 The Boeing Company Composite material collation machine and associated method for high rate collation of composite materials
WO2009021038A1 (en) * 2007-08-09 2009-02-12 The Boeing Company Methods and systems for automated ply boundary and orientation inspection
JP2011104905A (en) 2009-11-18 2011-06-02 Mitsubishi Heavy Ind Ltd Method and apparatus for producing composite material parts and inspection apparatus
EP2385340A1 (en) * 2010-05-03 2011-11-09 Airbus Operations, S.L. Automatic system for quality control and position correction of taped parts

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6342842A (en) * 1986-08-11 1988-02-24 Toray Ind Inc Laminate sheet manufacture device
JPH05338872A (en) * 1992-06-03 1993-12-21 Kawasaki Steel Corp Guide apparatus for slit strip
JP4491968B2 (en) * 1999-03-23 2010-06-30 東レ株式会社 Composite carbon fiber substrate, preform, and method for producing carbon fiber reinforced plastic
JP2007030336A (en) * 2005-07-27 2007-02-08 Mitsubishi Heavy Ind Ltd Laminating method and apparatus for fiber-reinforced plastic
EP1947417B1 (en) * 2005-11-07 2016-05-04 Fujitsu Limited Lamination status inspecting apparatus, lamination status inspecting method and lamination status detecting program
WO2007109682A2 (en) * 2006-03-20 2007-09-27 Duetto Integrated Systems, Inc. Improved system and method for manufacturing laminated circuit boards
JP2011104906A (en) * 2009-11-18 2011-06-02 Mitsubishi Heavy Ind Ltd Inspection method, method for producing composite material parts, inspection apparatus and apparatus for producing composite material parts

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0655656A (en) * 1992-08-07 1994-03-01 Toshiba Mach Co Ltd Laminating device for prepreg
EP1334819A1 (en) * 2002-02-06 2003-08-13 The Boeing Company Composite material collation machine and associated method for high rate collation of composite materials
WO2009021038A1 (en) * 2007-08-09 2009-02-12 The Boeing Company Methods and systems for automated ply boundary and orientation inspection
JP2011104905A (en) 2009-11-18 2011-06-02 Mitsubishi Heavy Ind Ltd Method and apparatus for producing composite material parts and inspection apparatus
EP2385340A1 (en) * 2010-05-03 2011-11-09 Airbus Operations, S.L. Automatic system for quality control and position correction of taped parts

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102015104612A1 (en) * 2015-03-26 2016-09-29 Deutsches Zentrum für Luft- und Raumfahrt e.V. Apparatus and method for determining the tackiness of preimpregnated semifinished fiber products
DE102015017131A1 (en) 2015-03-26 2016-09-29 Deutsches Zentrum für Luft- und Raumfahrt e.V. Apparatus and method for determining the tackiness of preimpregnated semifinished fiber products
DE102015008313A1 (en) * 2015-06-30 2017-01-05 Airbus Defence and Space GmbH Device and method
US10434729B2 (en) 2015-06-30 2019-10-08 Airbus Defence and Space GmbH Devices and methods for depositing reinforcing fiber tapes and detecting laying errors
DE102015122026A1 (en) * 2015-12-16 2017-06-22 Automation Steeg & Hoffmeyer Gmbh Apparatus and method for composing fiber-plastic composites with high application rates
CN113566703A (en) * 2021-07-15 2021-10-29 上海自动化仪表有限公司 System for measuring actual position on square platform and position calculation method
CN113566703B (en) * 2021-07-15 2024-05-03 上海自动化仪表有限公司 Actual position measurement system and position calculation method on square platform

Also Published As

Publication number Publication date
US9279678B2 (en) 2016-03-08
EP2620269B1 (en) 2014-07-23
CA2803568C (en) 2019-08-20
JP5805550B2 (en) 2015-11-04
JP2013154541A (en) 2013-08-15
US20130194415A1 (en) 2013-08-01
CA2803568A1 (en) 2013-07-30

Similar Documents

Publication Publication Date Title
EP2620269B1 (en) Prepreg pasting state inspection apparatus
EP2502731A1 (en) Inspection method, method for producing composite material components, inspection device, and device for producing composite material components
EP1947417B1 (en) Lamination status inspecting apparatus, lamination status inspecting method and lamination status detecting program
CN111707668A (en) Tunnel detection and image processing method based on sequence image
JP2010152026A (en) Distance measuring device and object moving speed measuring device
JP6811661B2 (en) Mobile imager and mobile
JP2004276101A (en) Laser beam machining method and laser beam machining apparatus
KR101366873B1 (en) Edge detection apparatus for film attached to glass substrate and laser cutting system having the same
JP2021179441A (en) Device for inspecting runway floodlight and method for inspecting runway floodlight
US10384608B2 (en) Vehicle-mounted stereo camera device and method for correcting the same
EP2502732A1 (en) Method for producing composite material components, device for producing composite material components, and inspection device
JP2007171582A (en) Sample imaging apparatus and sample analysis apparatus provided with the same
KR101476710B1 (en) Cutting device and cutting method thereof
JP2011007633A (en) Method and apparatus for detecting shape of band-shaped member, and apparatus for measuring displacement
US9036139B2 (en) Optical characteristic measurement apparatus
WO2017042995A1 (en) In-vehicle stereo camera device and method for correcting same
WO2020080091A1 (en) Vehicle inspection device and method
TWI626421B (en) Apparatus and method of measuring straightness
JP6775389B2 (en) Visual inspection equipment and visual inspection method
WO2024014265A1 (en) Moving body, calibration method, and program
JP2013024713A (en) Device and method for observing and evaluating sheet material end
CN110382159B (en) Method for detecting a joining point of a workpiece and laser processing head
US20160103081A1 (en) Method and device for optically inspecting faults
JP6693760B2 (en) Running locus measuring system and running locus measuring method
JP2008014822A (en) Inspection device for plate body

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

17P Request for examination filed

Effective date: 20140103

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RIC1 Information provided on ipc code assigned before grant

Ipc: G01N 21/84 20060101ALI20140206BHEP

Ipc: G01C 11/02 20060101ALI20140206BHEP

Ipc: G01B 11/14 20060101ALI20140206BHEP

Ipc: B29C 70/38 20060101AFI20140206BHEP

INTG Intention to grant announced

Effective date: 20140225

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 678609

Country of ref document: AT

Kind code of ref document: T

Effective date: 20140815

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602013000128

Country of ref document: DE

Effective date: 20140904

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 678609

Country of ref document: AT

Kind code of ref document: T

Effective date: 20140723

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20140723

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141023

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141024

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141124

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141023

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141123

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602013000128

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20150424

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 4

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160131

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20130129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140723

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240124

Year of fee payment: 12

Ref country code: GB

Payment date: 20240123

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240124

Year of fee payment: 12