EP3523175A1 - Method, device, and track-bound vehicle, in particular rail vehicle, for a track-based image analysis in track-bound traffic, in particular for a rail-based image analysis in rail traffic - Google Patents
Method, device, and track-bound vehicle, in particular rail vehicle, for a track-based image analysis in track-bound traffic, in particular for a rail-based image analysis in rail trafficInfo
- Publication number
- EP3523175A1 EP3523175A1 EP17829135.7A EP17829135A EP3523175A1 EP 3523175 A1 EP3523175 A1 EP 3523175A1 EP 17829135 A EP17829135 A EP 17829135A EP 3523175 A1 EP3523175 A1 EP 3523175A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- lane
- image
- track
- fsb
- rail
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010191 image analysis Methods 0.000 title claims description 62
- 238000000034 method Methods 0.000 title claims description 15
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 19
- 238000003708 edge detection Methods 0.000 claims abstract description 12
- 238000011156 evaluation Methods 0.000 claims description 36
- 238000004364 calculation method Methods 0.000 claims description 31
- 238000001514 detection method Methods 0.000 claims description 28
- 238000004458 analytical method Methods 0.000 claims description 19
- 238000003860 storage Methods 0.000 claims description 10
- 241001465754 Metazoa Species 0.000 claims description 7
- 239000000463 material Substances 0.000 claims description 5
- 238000001931 thermography Methods 0.000 claims description 5
- 101100160781 Arabidopsis thaliana YUC8 gene Proteins 0.000 claims description 4
- 101100325773 Magnaporthe oryzae (strain 70-15 / ATCC MYA-4617 / FGSC 8958) BAS2 gene Proteins 0.000 claims description 4
- 101100325774 Magnaporthe oryzae (strain 70-15 / ATCC MYA-4617 / FGSC 8958) BAS3 gene Proteins 0.000 claims description 4
- 101100083256 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) PHO2 gene Proteins 0.000 claims description 4
- 238000009434 installation Methods 0.000 claims description 4
- 230000011664 signaling Effects 0.000 claims description 4
- 238000012937 correction Methods 0.000 claims description 3
- 238000003909 pattern recognition Methods 0.000 claims description 3
- 238000013461 design Methods 0.000 claims description 2
- 238000005259 measurement Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 claims description 2
- 239000000969 carrier Substances 0.000 claims 2
- 229940005022 metadate Drugs 0.000 claims 1
- JUMYIBMBTDDLNG-UHFFFAOYSA-N methylphenidate hydrochloride Chemical compound [Cl-].C=1C=CC=CC=1C(C(=O)OC)C1CCCC[NH2+]1 JUMYIBMBTDDLNG-UHFFFAOYSA-N 0.000 claims 1
- 238000013459 approach Methods 0.000 description 5
- 241000196324 Embryophyta Species 0.000 description 4
- 238000011161 development Methods 0.000 description 4
- 230000018109 developmental process Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 101100111953 Arabidopsis thaliana CYP734A1 gene Proteins 0.000 description 3
- 101150100308 BAS1 gene Proteins 0.000 description 3
- 101100165166 Barbarea vulgaris LUP5 gene Proteins 0.000 description 3
- 229910000831 Steel Inorganic materials 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 239000010959 steel Substances 0.000 description 3
- 238000011144 upstream manufacturing Methods 0.000 description 3
- 235000010678 Paulownia tomentosa Nutrition 0.000 description 2
- 240000002834 Paulownia tomentosa Species 0.000 description 2
- 238000011511 automated evaluation Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 238000010200 validation analysis Methods 0.000 description 2
- 101100190268 Caenorhabditis elegans pah-1 gene Proteins 0.000 description 1
- VVNCNSJFMMFHPL-VKHMYHEASA-N D-penicillamine Chemical compound CC(C)(S)[C@@H](N)C(O)=O VVNCNSJFMMFHPL-VKHMYHEASA-N 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 229940075911 depen Drugs 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 238000003703 image analysis method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000003137 locomotive effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L15/00—Indicators provided on the vehicle or train for signalling purposes
- B61L15/0072—On-board train data handling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
- B61L23/041—Obstacle detection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
- B61L23/042—Track changes detection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L25/00—Recording or indicating positions or identities of vehicles or trains or setting of track apparatus
- B61L25/02—Indicating or recording positions or identities of vehicles or trains
- B61L25/025—Absolute localisation, e.g. providing geodetic coordinates
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L25/00—Recording or indicating positions or identities of vehicles or trains or setting of track apparatus
- B61L25/02—Indicating or recording positions or identities of vehicles or trains
- B61L25/026—Relative localisation, e.g. using odometer
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L27/00—Central railway traffic control systems; Trackside control; Communication systems specially adapted therefor
- B61L27/04—Automatic systems, e.g. controlled by train; Change-over to manual control
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L27/00—Central railway traffic control systems; Trackside control; Communication systems specially adapted therefor
- B61L27/20—Trackside control of safe travel of vehicle or train, e.g. braking curve calculation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L27/00—Central railway traffic control systems; Trackside control; Communication systems specially adapted therefor
- B61L27/70—Details of trackside communication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
- G06T2207/30256—Lane; Road marking
Definitions
- the invention relates to a method for lane-based image analysis in rail traffic, in particular for track-based image analysis in rail traffic according to the preamble of patent claim 1, an apparatus for lane-based image analysis in rail traffic, especially for track-based image analysis in rail traffic according to the preamble of claim 11 and a railway vehicle for lane-based image analysis in rail traffic, in particular rail vehicle for track-based image analysis in rail traffic, according to the preamble of claim 26.
- Rail vehicles are part of a modern traffic infrastructure track-bound transport and transport, for example, rolling on or under of one or two rails (tracks), floating above or below a magnetic field or hanging on steel cables move.
- rail-bound transport and transport means are rail vehicles based on a wheel-rail system which are either pulled or pushed by their own traction drive (railcar) or by a locomotive and predominantly steel wheels with a wheel flange on two steel rails railways are the most widespread.
- the underlying the invention object is to provide a method, a device and a railway vehicle, insbesonde ⁇ re rail vehicle, to specify the lane based image analysis in rail traffic, in particular for track-based image analysis in rail transport, with or automated (autonomous) or assisted driving the railway vehicles Rail vehicles without additional infrastructure along a route is improved.
- the above-mentioned context-related object is achieved on the basis of the image analysis method defined in the preamble of patent claim 1 by the features specified in the characterizing part of patent claim 1.
- the above-mentioned contextual object is achieved on the basis of the image analysis device defined in the preamble of patent claim 11 by the features specified in the characterizing part of claim 11.
- Edge detection algorithms to recognize the course of a lane / track, which is used by the railway vehicle by a changing in the captured image portion of the lane / track to the entire picture captured and compared with stored known image metadata, these both lane-related or track ⁇ related primary metadata as well as railway-related res ⁇ pective rail-track related secondary metadata enthal ⁇ th.
- the image meta information includes feature and characteristic data of the lane / track area recorded in the images.
- the basic principle of the invention is, by means of an automated evaluation of the images, a part of the traffic lane / traffic lane that is visible in the respective image Identify tracks so that preferably (in advantageous developments) the following objectives are achieved:
- a first step (a, for example, or more Rickak- quisitions confuse such as video cameras, laser sensors, Infrarotka ⁇ ra, thermal imaging cameras, radar devices, other Rickak- quisitions confuse, etc.) with the aid of at least one image recording apparatus a plurality of images from the web ⁇ vehicle from, for example, from the perspective of the railcar driver, he ⁇ summarized or recorded.
- a first step (a, for example, or more Rickak- quisitionsetti such as video cameras, laser sensors, Infrarotka ⁇ ra, thermal imaging cameras, radar devices, other Schmak- quisitionstechnik, etc.) with the aid of at least one image recording apparatus a plurality of images from the web ⁇ vehicle from, for example, from the perspective of the railcar driver, he ⁇ summarized or recorded.
- extension of the invention but also images of several image recording devices or image acquisition devices of the same type (eg, two video cameras) for mutual validation and synthesis of the results can be used.
- extension of the invention but also images of a plurality of image recording devices and image acquisition devices of different type (eg, a video camera and a réelle brieflyka ⁇ ra) may be used for mutual validation and synthesis of the results.
- non-imaging sensors such as radar, ultrasound or laser can be used to validate the image information.
- the area at the near bottom of the screen is considered, because the lanes / tracks there are within We ⁇ sentlichen at the same location, while it is preferably the case that the image recording apparatus is fixedly mounted in the railway vehicle / rail vehicle.
- edge detection algorithms which are used in a standard image processing, the profile of the lane traveled / busy of the track can be detected on the proportions lane / the track at the bottom of starting. a.
- the maximum degree of bending of tracks / tracks can be taken into account in order to avoid false identifications of tracks).
- the traveled lane / track can also be detected across points, in which the continuous guide rail of the track is detected.
- metadata about the lane / track known is used, in particular the distance between the parallel laid rails and the width of the rail head.
- Metadata about the route which are known, are used, for example at which geo ⁇ graphical positions railroad crossings, points or signal systems are.
- Metadata about the distance of the signal system can then be used as follows.
- the busy lane / the busy track is detected from step 2).
- ii. An imaginary lane / a planned track GERADEAUS can easily be generated artificially, since the well-known busy lane / the well-known track at the bottom of the picture must be updated only linearly.
- the busy lane / track LINKS is from the imaginary "STRAIGHT SEE lane” / the imaginary "STRAIGHT SEE track”, then it is a left turn. From the Ab ⁇ state of the traffic track of the intended "straight ahead lane” / a "STRAIGHT-track” and the distance from the vehicle (imaginary be calculated from the width of the lane / the track at the lower edge and the width of the lane / the track in each relevant image section), the degree of left curvature can be calculated.
- the busy lane / track in the picture and a critical area to the left and right of the lane / track can be divided into several analysis sections with increasing distance from the vehicle.
- the critical loading can ⁇ rich depending on the environment of the lane / the track (town ⁇ area vs. Country) different be broadly defined).
- a standard for analysis section a standard for analysis section.
- Pattern algorithm used to identify persons who ⁇ is a pattern algorithm used to identify persons who ⁇ .
- the analysis sections of several consecutive images can be related to detect movement of persons and track their movement to predict potential collisions. IV. Detecting how far a railway vehicle is from an object
- the distance to the object can be calculated.
- the regular pattern of the lane / between the tracks is formed by a lane carrier / track carrier, used as a basis for the detection of irregularities. If an irregularity is detected (eg Beautyse or
- the permissibility of the irregularity can take place by comparison with an image database. For example, In an initialization run, all irregularities can be recorded over all images of a route and then provided for adjustment.
- the left or right curvature of a lane / a track can be detected.
- the distance of a railway vehicle from objects / persons on a lane / track or in the critical area to the left or next to the lane / track can be calculated.
- the following additional components - a) to c) for the image recording device may be used in relation to the image analysis device according to claim 11:
- a correction component according to claim 21, weather ⁇ and brightness data for the evaluation of the photographic material with includes.
- the evaluation of video images can be limited to the first 50 meters in front of the rail vehicle or rail vehicle and the speed of the vehicle can be throttled accordingly.
- both shooting scenes on the open road can then (need pictures from a distance to view reagie ⁇ ren due to the speed to be able to) and shooting situations in Vietnamesesbe- rich (need images with a high width) be operated suitable.
- a lighting component according to claim 23 ⁇ example, a headlight of the inside or outside of the human visible range lent operates, through which the Qua ⁇ formality of ons réelle from the image recording device or Profakquisiti- at night or in bad weather captured image material improves.
- an image analysis device is formed as a virtual machine in the sense of "Software Defined signal recognition of Rail Traffic Systems" ⁇ and working.
- FIG. 1 shows a lane-based image analysis for the recognition of route installations on a railway line and route
- FIGURE 2 is a lane-based image analysis for object detection of a residing on a lane of a railway person
- FIGURE 3 shows a basic structure of an image analysis device for the lane-based according to FIGS 1 and 2 ⁇ image analysis.
- FIG. 1 shows a lane-based image analysis for the recognition of a route system SAL, such as e.g. a railroad crossing BÜG,
- the lane ⁇ related railway line BST of the rail network BNE is a rail track SST of a rail network SNE, on which a rail vehicle SFZ on a rail GL and traveling in the rails ⁇ traffic SVK for a track-based image analysis to detect the track system SAL is the track system SAL on the track GL approaches.
- a rail vehicle SFZ on a rail GL and traveling in the rails ⁇ traffic SVK for a track-based image analysis to detect the track system SAL is the track system SAL on the track GL approaches.
- Rail network SNE moving rail vehicle SFZ is here again due to the discussion at the outset any other arbitrary short- or long-distance based rail transport system as a further embodiment of the invention conceivable and conceivable.
- a maglev system (Stw .: Transrapid, Maglev, etc.) would also have a comparable infrastructure. consisting of railway network, railway line and railway vehicle, in question.
- a picture analysis device BAV is provided in a railcar TRW of the rail vehicle SFZ with a driver's cab TFS and an integrated display device AZE, in which the workstation of the vehicle driver FZF is located, for the track-based image analysis for recognizing the route system SAL accommodated.
- the image analysis device BAV includes for this purpose a preferably as a sensor formed image on ⁇ drawing device BAZG, which for example is formed as an ordinary video camera, laser sensor, thermal imager, radar equipment, infrared camera, etc., and because of acquisition of pic- tures is also referred to as an image acquisition device.
- the rail vehicle SFZ traveling on the track GL approaches the signal system SI, AL, it starts from the rail vehicle SFZ, eg from the perspective of the railcar driver FZF in the driver's seat TFS of the railcar TRW and / or from a stationary, lane-based position in or on the vehicle SFZ, from a track of the rail vehicle SFZ, thereby preferably oriented to the speed of the rail vehicle SFZ, track area GLB a plurality of the track area GLB representing images BI GLB detectable.
- a plurality of images BI FSB representing the traffic lane area FSB can be detected by a lane area FSB which is located upstream of the rail vehicle BFZ and preferably orientates itself to the speed of the rail vehicle BFZ.
- the images BI FSB , BI GLB of the traffic lane area FSB, GLB each contain an image area BIB, in which lanes FS, GL detected in relation to the depicted traffic lane area FSB, GLB are substantially at the same location based on these portions of the detected lanes FS, GL with the aid of edge detection algorithms, the course of a lane FS, GL used by the railway vehicle BFZ, SFZ is detected by an image portion of the lane FS, GL changing in the acquired image to form the captured overall image.
- a partial picture region BTB in the images BI FSB, BI GLB is for a currently determined geographical position of the railway vehicle BFZ, SFZ, in which the signal SI of the plant AL can be seen as a striking abutment feature of the routes ⁇ plant SAL.
- this partial picture region BTB has a first image portion BAS1, by the used of the railway vehicle BFZ, SFZ lane FS, GL throughput leads, and a second image portion BAS2 wherein letz ⁇ more excellent for the route-detection, that is, the respective detecting a STRAIGHT-EAUS direction, LEFT-direction or
- GL is relevant.
- BI FSB BI glb of Fahrspurbe ⁇ richs FSB
- GLB image area contained therein BIB
- the image subregion BTB with the two image sections BAS 1, BAS 2
- the image analysis for distance system detection and the detection of the signal system SI, AL and track detection is explained below with the description of FIG.
- FIGURE 2 shows a lane-based image analysis for personnel ⁇ identifier in the rail BVK if on the off again cut as shown railway line BST of the rail network BNE the railway vehicle BFZ on the lane FS of the railway line BST at least one object OBJ, preferably a per ⁇ son, an animal, a movable or stationary object, is located in the area of the lane foreign and actually have to look for anything, so are there inadmissible.
- object OBJ preferably a per ⁇ son, an animal, a movable or stationary object
- the lane-related railway BST of the railway network BNE is here again the rail line SST of the rail network SNE, on which rail transport company SVK travels on track GL for rail-based image analysis for object recognition and approaches the object OGJ.
- rail transport SVK illustrated with the vehicle running on the railway line SST of the rail network SNE rail vehicle SFZ any other x-any short or long distance based web transport system is here also conceivable as a white ⁇ teres embodiment of the invention, because of a ⁇ gangs guided discussion and imaginable.
- a maglev system (Stw .: Transrapid, Maglev, etc.) with a correspondingly comparable infrastructure consisting of rail network, railway line and railway vehicle would also be suitable.
- the image analysis device BAV is again provided in the railcar TRW of the rail vehicle SFZ with the driver's seat TFS and the integrated display device AZE, in which the workstation of the vehicle driver FZF is located, for the track-based image analysis for object recognition accommodated.
- the image analysis apparatus includes BAV this again preferably formed as a sensor Bil ⁇ daufconces réelle BAZG which, for example as ordinary Videoka ⁇ ra, laser sensor, thermal imager, radar device Inf- rarotski etc., is formed.
- the image area BIB is again contained, in which lanes FS, GL detected in relation to the depicted traffic lane area FSB, GLB lie substantially at the same location and starting from these proportions of the detected lanes FS, GL using the Kantenerkennungsalgo ⁇ algorithms of the course of the loading took advantage of the railway vehicle BFZ, SFZ lane FS, GL is detected by a changing in the captured image image portion of the lane FS, GL to the detected picture ,
- a third image section BAS3 is contained in the images BI FSB , BI GLB , in which the object OBJ is ⁇ .
- FIGURE 3 shows the basic structure of the Consul analysesvor- direction BAV for the lane-based image analysis for Stre ⁇ ckenstrom- and route-detection according to the FIGURE 1 and for object recognition according to the FIGURE 2, when the rail vehicle BFZ, SFZ, which on the lane FS , GL is on the road, according to the FIGURE 1 of the track system SAL or the signal giving or leading system AL on the railway line
- the image recording device BAZG is preferably designed to be pivotable for alignment with the image object.
- image recording devices BAZG the same design, eg multiple video cameras, or devices un ⁇ ferent type, eg multiple video cameras, laser sensors, RADAR-based, based on radio-based location and distance ⁇ measurement sensors, infrared cameras and / or thermal imaging cameras, are included in the image analysis device BAV, which receive the images BI FSB, BI GLB.
- Such a multiple execution of the image recording or Profakquirie- tion may be relevant for redundancy purposes, among others.
- a correction component KOK be included with the weather and Hellig ⁇ keitschal for the evaluation of the photographic material.
- this component it is possible, for example, to limit the evaluation of video images to the first 50 meters in front of the rail vehicle in heavy fog and to throttle the speed of the rail vehicle accordingly.
- a focal length variation component BVK in depen ⁇ dependence on the environment (eg station, city, country, etc.) and the speed chooses the right angle, so the evaluation of the image optimally under support alarm ⁇ zen.
- ⁇ to additionally particularly interesting areas along the railway track in the rail network SST SNE can be focused by fusion of image data and link data, such as a railway crossing.
- a lighting component BLK which is formed for example as a spotlight operating inside or outside the human visual range, and by which the quality of the captured from the image recording device or the image acquisition apparatus BAZG at night or in bad Witte ⁇ tion picture material improves .
- the images thus captured are stored by the image recording device BAZG in an image storage device BSPE.
- This image storage device BSPE is either connected according to option "A" as a component of the image analysis device BAV with the image recording device BAZG or according to option "B" outside the image analysis device BAV, eg as a storage database, in the railcar or in a data cloud associated with the image recording device BAZG or .with this connectable.
- the image recorder BAZG is connected to a calculation / evaluation BAWE, which is also a component of the image analysis device BAV is.
- the calculation / Ausenseeinrich- tung BAWE as the image recording apparatus BAZG either ge ⁇ Telss with said image memory means BSPE option "A" connected to or assigned according to option "B” of the image memory means BSPE or connectable therewith.
- an information database IDB For the formation of a complete functional unit, in which the subunits involved functionally cooperate, said functional subunit is extended by a further subunit, an information database IDB.
- the information database IDB can thereby be beispielswei ⁇ se integrated with the image storage device BSPE as a structural unit in a common storage device.
- memory ⁇ apparatus may in turn, as the image storage device BSPE, either in accordance with option "A” as a component of the image analysis device BAV with the image recording apparatus BAZG and the calculation / evaluation BAWE connected accordingly or in accordance with option " B "outside the image analysis device BAV in the railcar or in a data cloud the image recording device BAZG and the calculation / evaluation device BAWE assigned to or be connected to this.
- option "A" a component of the image analysis device BAV with the image recording apparatus BAZG and the calculation / evaluation BAWE connected accordingly
- option " B outside the image analysis device BAV in the railcar or in a data cloud the image recording device BAZG and the calculation / evaluation device BAWE assigned to or be connected to this.
- image meta information BMI which in the literal sense includes feature and property data of the traffic lane area FSB, GLB detected in the images BI FSB , BI GLB , is stored.
- the Informationsda ⁇ tenbank IDB of the image analysis apparatus BAV is assigned in such a way and with this connected, as the calculation / evaluation BAWE ausensegeSysteme for the calculation / and lane-based image analysis for Streckenstrom- / Streckenverlauf- / Obj ect recognition accesses the image meta information BMI stored in the information database IDB.
- the information database IDB is preferably outside the Marsh analysesvorrich ⁇ tion BAV, eg as a database, arranged in the railcar or is designed as a data cloud.
- the calculation / evaluation device BAWE preferably has a non-volatile, readable memory SP in which processor-readable control program instructions of a picture analysis for route / route / Obj ect recognition-controlling program module PGM are stored, and a processor PZ, which executes the control program commands of the program module PGM for the calculation / evaluation-based and lane-based image analysis for track / route / Obj ekt recognition performs.
- the processor accesses in addition - in addition to the accesses to the image-BMI meta information in the information database IDB - for control purposes and for reading out data to the image recording device and the image BAZG spoke pure Rich ⁇ tung BSPE to.
- the lane-based image analysis in the calculation / evaluation BAWE advantageously such that in the image BI FSB , BI GLB is recognized where the Signaling system SI, AL or the track system SAL can be found by
- BI FSB BI GLB is identified, in which a distinctive Anlagenmerk ⁇ times the track system SAL or the signal SI of the system AL can be seen, 2) the first image section BAS1 is determined in the image subregion BTB, through which the traffic lane FS, GL used by the railway vehicle BFZ, SFZ performs,
- Meta information BMI and a standard edge detection algorithm is attempted to detect the outer edges of the track system SAL or the signal system SI, AL in the distance 3) determined by the lane FS, GL until the known and recognized outer edge substantially überde ⁇ bridges ,
- the calculation / evaluation device BAWE in the lane-based image analysis continues to be such in an advantageous manner designed that in the image BI FSB / BI GLB is detected, in which direction, in particular LEFT, RIGHT or STRAIGHT ⁇ OFF, the railway vehicle BFZ, SFZ drives by for the detected from the detected course lane FS, GL
- a pseudo-GERADEAUS lane in particular a pseudo-GERADEAUS track, is artificially generated by linear updating of the lane FS, GL used by the railway vehicle BFZ, SFZ in accordance with the image area BIB,
- a LEFT direction eg a LEFT curve, is recognized when the used lane FS, GL is to the left of the pseudo-GERADEAUS lane,
- a RIGHT direction e.g. a right-hand turn, is recognized when the used lane FS, GL is to the right of the pseudo-straight lane.
- calculation / evaluation device BAWE in the case of lane-based image analysis is furthermore advantageously designed in such a way that in the image
- BI FSB BI GLB is detected, whether at least one object OBJ, which may be, for example, a person, an animal, a movable or stationary object on the used lane FS, GL by
- the calculation / evaluation device BAWE designed accordingly that in the image BI ⁇ SB ⁇ BI GLB is detected, how far the railway vehicle BFZ, SFZ is spaced from the object OBJ on the used lane FS, GL has been recognized by the one of a pixel width of the lane FS, G) in the image area BIB and a pixel width of the lane FS, GL in the third
- Image section BAS3, in which the object OBJ is located are set in relation to each other, from this ratio and the obtained from the known third metadata width of the lane FS, GL of said distance is calculated.
- image analyzing device BAV an automated (autonomous) or assisted driving of the railway vehicle or the railway vehicle BFZ SFZ without additional infrastructure along a route as may ⁇ be suspended or even realized. This is especially true if the image analysis device BAV is realized as a virtual machine which is designed and functions in the sense of a " software- defined signal recognition of rail traffic system".
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Quality & Reliability (AREA)
- Multimedia (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
- Train Traffic Observation, Control, And Security (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102016224331 | 2016-12-07 | ||
PCT/EP2017/081845 WO2018104462A1 (en) | 2016-12-07 | 2017-12-07 | Method, device, and track-bound vehicle, in particular rail vehicle, for a track-based image analysis in track-bound traffic, in particular for a rail-based image analysis in rail traffic |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3523175A1 true EP3523175A1 (en) | 2019-08-14 |
Family
ID=60972170
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17829135.7A Pending EP3523175A1 (en) | 2016-12-07 | 2017-12-07 | Method, device, and track-bound vehicle, in particular rail vehicle, for a track-based image analysis in track-bound traffic, in particular for a rail-based image analysis in rail traffic |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP3523175A1 (en) |
CN (1) | CN110248858A (en) |
RU (1) | RU2720303C1 (en) |
WO (1) | WO2018104462A1 (en) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102018215697A1 (en) * | 2018-09-14 | 2020-03-19 | Siemens Mobility GmbH | Automated on-board control system for a rail vehicle |
WO2020066223A1 (en) * | 2018-09-26 | 2020-04-02 | 株式会社日立製作所 | Train control device and train control system |
CN109720381A (en) * | 2018-12-28 | 2019-05-07 | 深圳华侨城卡乐技术有限公司 | A kind of railcar avoiding collision and its system |
DE102019206348A1 (en) * | 2019-05-03 | 2020-07-23 | Siemens Mobility GmbH | Method and computer program product for recognizing signal signs for traffic control of track-bound vehicles as well as signal sign recognition system and track-bound vehicle, in particular rail vehicle |
US10919546B1 (en) | 2020-04-22 | 2021-02-16 | Bnsf Railway Company | Systems and methods for detecting tanks in railway environments |
CN112810669A (en) * | 2020-07-17 | 2021-05-18 | 周慧 | Intercity train operation control platform and method |
CN112319552A (en) * | 2020-11-13 | 2021-02-05 | 中国铁路哈尔滨局集团有限公司 | Rail car operation detection early warning system |
RU2766936C1 (en) * | 2021-10-19 | 2022-03-16 | Акционерное общество «Научно-исследовательский и проектно-конструкторский институт информатизации, автоматизации и связи на железнодорожном транспорте» | Locomotive control and driver vigilance control device |
CN115610479B (en) * | 2022-09-23 | 2023-09-15 | 北京京天威科技发展有限公司 | Railway line state inspection system and method |
CN118071832B (en) * | 2024-04-19 | 2024-07-05 | 湖南蓝天机器人科技有限公司 | RGV trolley visual positioning method and system based on laser identification |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2779518B1 (en) * | 1998-06-09 | 2000-08-18 | Thomson Csf | OPTICAL METHOD FOR RECONSTRUCTING THE TRACK OF A TRACK ALONG WHICH A GUIDED VEHICLE MOVES |
DE102006007788A1 (en) * | 2006-02-20 | 2007-08-30 | Siemens Ag | Computer-assisted driverless railway train monitoring system, to show its travel behavior, has train-mounted sensors and track position markers for position data to be compared with a stored model |
CN101108627A (en) * | 2007-08-30 | 2008-01-23 | 桂林市思奇通信设备有限公司 | Automatic monitored control system for railway driving safety and operation method thereof |
US8605947B2 (en) * | 2008-04-24 | 2013-12-10 | GM Global Technology Operations LLC | Method for detecting a clear path of travel for a vehicle enhanced by object detection |
US9810533B2 (en) * | 2011-04-27 | 2017-11-07 | Trimble Inc. | Railway track monitoring |
DE102014217954B4 (en) * | 2014-09-09 | 2016-09-29 | Robert Bosch Gmbh | Method and device for determining a desired inclination angle of a rail vehicle |
CN104386092B (en) * | 2014-10-21 | 2017-02-22 | 卡斯柯信号有限公司 | Automatic train protection system and method based on image identification and multi- perception fusion |
CN105701844B (en) * | 2016-01-15 | 2018-11-27 | 苏州大学 | Barrier or shadow detection method based on color characteristic |
CN109415071A (en) | 2016-04-08 | 2019-03-01 | 西门子移动有限责任公司 | For the method, apparatus and rail vehicle of the signal identification in rail traffic, particularly railway traffic, especially rolling stock |
-
2017
- 2017-12-07 WO PCT/EP2017/081845 patent/WO2018104462A1/en active Application Filing
- 2017-12-07 EP EP17829135.7A patent/EP3523175A1/en active Pending
- 2017-12-07 RU RU2019117748A patent/RU2720303C1/en active
- 2017-12-07 CN CN201780075716.XA patent/CN110248858A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
WO2018104462A1 (en) | 2018-06-14 |
CN110248858A (en) | 2019-09-17 |
RU2720303C1 (en) | 2020-04-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018104462A1 (en) | Method, device, and track-bound vehicle, in particular rail vehicle, for a track-based image analysis in track-bound traffic, in particular for a rail-based image analysis in rail traffic | |
EP3523177A2 (en) | Method, system and track-bound vehicle, in particular rail vehicle, for recognizing obstacles in track-bound traffic, in particular in rail traffic | |
EP1176569B1 (en) | Method for monitoring the condition of traffic for a traffic network comprising effective narrow points | |
DE69731009T2 (en) | System for detecting obstacles | |
DE19529986C2 (en) | Procedure for locating track-guided vehicles and devices for carrying out the procedure | |
EP3526097A1 (en) | Method, device and track-bound vehicle, particularly a rail vehicle, for lane identification in a track-bound traffic system, particularly for rail identification in a railway traffic system | |
WO2017174155A1 (en) | Method, device, and track-bound vehicle, in particular rail vehicle, for detecting signals in the track-bound traffic, in particular railway traffic | |
DE102005024558A1 (en) | Method for determining the geometry of a section of road | |
DE102012024873A1 (en) | Method and control device for providing a road ahead | |
DE102015207123A1 (en) | Driving assistance apparatus and method | |
DE102012107918A1 (en) | Rail vehicle location system for rail vehicle, has digital data base with route data of rail vehicle of traveling track section, where evaluation device is adapted to current location of rail vehicle using current data of ambient sensor | |
DE102013104088A1 (en) | Method for automatically detecting characteristic elements, in particular a level crossing, and device therefor | |
EP1297309B1 (en) | Method for detecting travel information | |
EP3052963A1 (en) | Method for correcting position data, and motor vehicle | |
DE102011106345B4 (en) | path validation | |
EP0795455B1 (en) | Method for determining the position of a railborne vehicle and device for carrying out the method | |
EP3787950B1 (en) | Method and device for detecting vehicles travelling behind | |
DE102007028325A1 (en) | Positioning device for drive-bound vehicle i.e. railway traction vehicle, has evaluation unit equipped for determining position of drive-bound vehicle depending on image information containing draw chainage elements | |
EP3938266A1 (en) | Method and computer program product for identifying signal signs for the traffic control of track-guided vehicles, signal-sign identification system, and track-guided vehicle, in particular rail vehicle | |
DE102021101958B3 (en) | Method and system for determining the distance or the current relative speed of at least two route-bound, in particular rail-bound, mobile objects | |
AT520261B1 (en) | Collision protection for rail vehicles | |
DE10018562C1 (en) | Traffic data provision method for traffic network uses data signaling vehicles which circulate with traffic flow for providing data for each regulated network node | |
DE102006029845B4 (en) | Device and method for securing track sections of a segmented track for a rail-bound vehicle body | |
WO2018104427A1 (en) | Method, system and rail vehicle for localization in rail traffic | |
EP3781906A1 (en) | Method and device for determining a highly precise position of a vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20190509 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20211025 |