CN113240742A - Train reversing auxiliary detection method based on visual pixel link straight line detection - Google Patents

Train reversing auxiliary detection method based on visual pixel link straight line detection Download PDF

Info

Publication number
CN113240742A
CN113240742A CN202110540225.6A CN202110540225A CN113240742A CN 113240742 A CN113240742 A CN 113240742A CN 202110540225 A CN202110540225 A CN 202110540225A CN 113240742 A CN113240742 A CN 113240742A
Authority
CN
China
Prior art keywords
image
camera
method based
line detection
train
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110540225.6A
Other languages
Chinese (zh)
Inventor
陈立强
杨韵霓
武智勇
贾向东
王波
杨志强
马凌宇
张玉成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inner Mongolia Longtu Intelligent Technology Co ltd
Southwest Jiaotong University
China Railway Hohhot Group Co Ltd
Original Assignee
Inner Mongolia Longtu Intelligent Technology Co ltd
Southwest Jiaotong University
China Railway Hohhot Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inner Mongolia Longtu Intelligent Technology Co ltd, Southwest Jiaotong University, China Railway Hohhot Group Co Ltd filed Critical Inner Mongolia Longtu Intelligent Technology Co ltd
Priority to CN202110540225.6A priority Critical patent/CN113240742A/en
Publication of CN113240742A publication Critical patent/CN113240742A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/80Geometric correction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • G06T2207/20032Median filtering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a train reversing auxiliary detection method based on visual pixel link line detection, which comprises a line detection algorithm and a distance measurement algorithm, wherein the line detection algorithm is used for detecting a track based on a pixel link method, the principle of the pixel link algorithm is that the relation between each pixel on an image and the neighborhood of the surrounding pixels is judged, the core of the algorithm is to detect the similarity of each pixel of one picture, and if the pixel similarity threshold condition is set and meets the condition of the threshold value z, the algorithm can be used for detecting an iron rail line.

Description

Train reversing auxiliary detection method based on visual pixel link straight line detection
Technical Field
The invention relates to the technical field of visual detection, in particular to a train reversing auxiliary detection method based on visual pixel link straight line detection.
Background
Railways dominate the field of transportation in China, and bear a great mission to drive the development of national economy. The railway line in China has long distance and complex passing environment, foreign matter invasion is caused in front of a high-speed running train by random foreign matters such as landslides, detained people and the like caused by natural disasters, and the running safety is seriously influenced. Today, the demand of society for realizing automation cannot be met only by manual detection and fixed point installation of monitoring points in the rapid development of high-speed railways. With the realization of full-automatic driving in rail transit and the research and application of detection technology based on machine vision, how to realize intelligent detection of foreign matters in front of a high-speed train becomes a new trend of railway operation, and has irreplaceable practical significance. On the basis of the existing railway obstacle detection technology research at home and abroad, the invention realizes the obstacle detection by adopting a mode based on vehicle-mounted monocular machine vision. By analyzing the image of the acquired video frame, the segmentation algorithm of the railway track obstacle image is mainly researched, the algorithm is improved so as to achieve the purpose of improving the real-time property and the robustness, the improved algorithm is applied to a comprehensive judgment system to detect the obstacle, and whether the obstacle exists is judged according to two detection steps.
Disclosure of Invention
The invention aims to provide a train reversing auxiliary detection method based on visual pixel link line detection, which aims to solve the problems in the background technology.
In order to achieve the purpose, the invention provides the following technical scheme: a train reversing auxiliary detection method based on visual pixel link line detection comprises the following steps:
A. graying the original image;
B. carrying out denoising and filtering processing on the image of the gray level image, and processing the image polluted by noise by adopting a filtering method;
C. drawing an interest area in a picture to perform linear detection, so that a required linear line can be acquired more accurately;
D. detecting straight lines in an ROI area of the picture, filtering out horizontal straight lines and shorter straight lines, and taking only the longest line segment on each track;
E. extracting two detected paths and fitting the paths to an original image;
F. and detecting the distance between the obstacle and the lens.
Preferably, the image graying method in the step a is as follows:
a. respectively acquiring the energy of each color channel of the color image;
b. obtaining the optimal coefficient of each color channel according to the energy of each color channel;
c. and obtaining the gray level image corresponding to the color image according to the optimal coefficient of each color channel.
Preferably, an adaptive median filter is adopted in the step B to filter out noise.
Preferably, the specific method of step F is as follows:
a. calibrating and correcting the distortion of the camera;
b. deducing the corresponding relation between an image coordinate system and a physical coordinate system according to the imaging principle of the optical lens of the camera;
c. and shooting an image, and realizing accurate distance measurement between the train and the obstacle according to the relative position of the number on the image and the camera and the deflection angle.
Preferably, the distance measurement formula in step c is as follows:
Figure BDA0003071328740000021
preferably, α is a pitch angle, H is a camera height, θ is a vertical viewing field, a horizontal viewing angle is β, Dmin is an actual distance from a bottom edge of the image to the camera, Dmax is an actual distance from a top edge of the image to the camera, height is an image height, and coordinate points X and Y are a horizontal distance and a vertical distance from the camera.
Compared with the prior art, the invention has the beneficial effects that: the method can be used for detecting the iron rail line, the algorithm comprises image preprocessing, line detection, line fitting and distance prediction, and experiments show that the line detection based on the visual pixel linking method has wide applicability.
Drawings
FIG. 1 is a flow chart of the present invention;
FIG. 2 is a schematic diagram of an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the present invention provides a technical solution: a train reversing auxiliary detection method based on visual pixel link line detection comprises the following steps:
A. graying the original image;
B. carrying out denoising and filtering processing on the image of the gray level image, and processing the image polluted by noise by adopting a filtering method;
C. drawing an interested region in a picture for linear detection, so that the required linear can be more accurately acquired, and the problem of low processing speed can be effectively solved by only detecting the ROI region;
D. detecting straight lines in an ROI area of the picture, filtering out horizontal straight lines and shorter straight lines, and taking only the longest line segment on each track;
E. extracting two detected paths and fitting the paths to an original image;
F. and detecting the distance between the obstacle and the lens.
In the invention, the image graying method in the step A is as follows:
a. respectively acquiring the energy of each color channel of the color image;
b. obtaining the optimal coefficient of each color channel according to the energy of each color channel;
c. and obtaining the gray level image corresponding to the color image according to the optimal coefficient of each color channel.
In the step B, the image of the gray level image is subjected to denoising and filtering treatment, and the image polluted by noise can be treated by adopting a filtering method, but many linear filters have low flux, so that the edge is blurred while denoising, and the median filtering can remove the noise and protect the edge of the image under certain conditions, so that the method is a nonlinear noise removing method.
The median filtering is implemented by replacing the value of a point in the digital image by the median of the values of the points of a region of the point. We refer to a neighborhood of a certain length or shape of a point as a window, and for median filtering of two-dimensional images, a 3 x 3 or 5 x 5 window is typically used for filtering, but the speed of median filtering is slow.
The extreme value median filtering can know which points are noise points and which points are signal points, the noise points can be processed and the signal points are reserved, corresponding values are given to the noise points according to neighborhood correlation, such as neighborhood median, and the signal points are kept unchanged, so that image blurring can be reduced, the filtering process does not affect signals, and only the noise removing effect is achieved, and the method has the defect that the performance is greatly reduced when the noise is large.
In the case where the noise density is not so large, the effect of using median filtering is good. However, when the probability of noise occurrence is high, the original median filtering algorithm is not very effective. Only increasing the filter window size, although blurring the image. The purpose of using the adaptive median filter is to dynamically change the window size of the median filter according to preset conditions, so as to simultaneously take the effects of denoising and detail protection into consideration, and ensure real-time performance. And B, adopting adaptive median filtering to filter noise.
In the invention, the specific method of the step F is as follows:
a. calibrating and correcting the distortion of the camera;
b. deducing the corresponding relation between an image coordinate system and a physical coordinate system according to the imaging principle of the optical lens of the camera;
c. and shooting an image, and realizing accurate distance measurement between the train and the obstacle according to the relative position of the number on the image and the camera and the deflection angle.
In the invention, the distance measurement formula in step c is as follows:
Figure BDA0003071328740000051
wherein, alpha is the pitch angle, H is the camera height, theta is the vertical visual angle field, and the horizontal visual angle is beta, and Dmin is the image base and is apart from camera actual distance, and Dmax image topside is apart from camera actual distance, and height is the image height, and coordinate point X, Y are the horizontal distance and the vertical distance apart from the camera.
Example (b):
as shown in fig. 2, according to the above flow: reading in an image, graying the image, image adaptive median filtering, linear detection, distance prediction, detecting an actual track, reading in a video image from a camera, and detecting two tracks on the left side in the image as shown in a first image shown in fig. 2; firstly, preprocessing an image, graying the image, and obtaining a second picture according to an arrow; then, the grayed image containing noise is subjected to adaptive median filtering, as shown in the third diagram of fig. 2; further defining a region of interest in the image, as shown in the fourth diagram of fig. 2; performing pixel-based line detection on the region of interest, as shown in the fifth diagram of fig. 2; two straight lines are fitted and superimposed on the original as shown in the sixth diagram of fig. 2.
In conclusion, the method can be used for detecting the iron rail line, the algorithm comprises image preprocessing, line detection, line fitting and distance prediction, and experiments show that the line detection based on the visual pixel linking method has wide applicability.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.

Claims (6)

1. A train reversing auxiliary detection method based on visual pixel link line detection is characterized in that: the method comprises the following steps:
A. graying the original image;
B. carrying out denoising and filtering processing on the image of the gray level image, and processing the image polluted by noise by adopting a filtering method;
C. drawing an interest area in a picture to perform linear detection, so that a required linear line can be acquired more accurately;
D. detecting straight lines in an ROI area of the picture, filtering out horizontal straight lines and shorter straight lines, and taking only the longest line segment on each track;
E. extracting two detected paths and fitting the paths to an original image;
F. and detecting the distance between the obstacle and the lens.
2. A train reversing auxiliary detection method based on visual pixel link line detection is characterized in that: the image graying method in the step A is as follows:
a. respectively acquiring the energy of each color channel of the color image;
b. obtaining the optimal coefficient of each color channel according to the energy of each color channel;
c. and obtaining the gray level image corresponding to the color image according to the optimal coefficient of each color channel.
3. The train reversing auxiliary detection method based on the visual pixel link line detection according to claim 1, characterized in that: and in the step B, adaptive median filtering is adopted to filter out noise.
4. The train reversing auxiliary detection method based on the visual pixel link line detection according to claim 1, characterized in that: the specific method of the step F is as follows:
a. calibrating and correcting the distortion of the camera;
b. deducing the corresponding relation between an image coordinate system and a physical coordinate system according to the imaging principle of the optical lens of the camera;
c. and shooting an image, and realizing accurate distance measurement between the train and the obstacle according to the relative position of the number on the image and the camera and the deflection angle.
5. The train reversing auxiliary detection method based on the visual pixel link line detection according to claim 4, characterized in that: the distance measurement formula in the step c is as follows:
Figure FDA0003071328730000021
6. the train reversing auxiliary detection method based on the visual pixel link line detection according to claim 5, characterized in that:
wherein, alpha is the pitch angle, H is the camera height, theta is the vertical visual angle field, and the horizontal visual angle is beta, and Dmin is the image base and is apart from camera actual distance, and Dmax image topside is apart from camera actual distance, and height is the image height, and coordinate point X, Y are the horizontal distance and the vertical distance apart from the camera.
CN202110540225.6A 2021-05-18 2021-05-18 Train reversing auxiliary detection method based on visual pixel link straight line detection Pending CN113240742A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110540225.6A CN113240742A (en) 2021-05-18 2021-05-18 Train reversing auxiliary detection method based on visual pixel link straight line detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110540225.6A CN113240742A (en) 2021-05-18 2021-05-18 Train reversing auxiliary detection method based on visual pixel link straight line detection

Publications (1)

Publication Number Publication Date
CN113240742A true CN113240742A (en) 2021-08-10

Family

ID=77134907

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110540225.6A Pending CN113240742A (en) 2021-05-18 2021-05-18 Train reversing auxiliary detection method based on visual pixel link straight line detection

Country Status (1)

Country Link
CN (1) CN113240742A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010002688A1 (en) * 1999-12-04 2001-06-07 Helmut Uebel Method of detecting obstacles on railroad lines
JP2016000598A (en) * 2014-06-12 2016-01-07 西日本旅客鉄道株式会社 Railway track space obstacle detection system
CN107993488A (en) * 2017-12-13 2018-05-04 深圳市航盛电子股份有限公司 A kind of parking stall recognition methods, system and medium based on fisheye camera
CN110688903A (en) * 2019-08-30 2020-01-14 陕西九域通创轨道***技术有限责任公司 Obstacle extraction method based on camera data of train AEB system
CN111488808A (en) * 2020-03-31 2020-08-04 杭州诚道科技股份有限公司 Lane line detection method based on traffic violation image data
CN111860113A (en) * 2020-06-01 2020-10-30 安徽奇点智能新能源汽车有限公司 Lane line detection method and system
CN112488056A (en) * 2020-12-17 2021-03-12 上海媒智科技有限公司 Linear track foreign matter intrusion detection method and device based on computer vision
CN112800974A (en) * 2021-01-29 2021-05-14 南京理工大学 Subway rail obstacle detection system and method based on machine vision

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010002688A1 (en) * 1999-12-04 2001-06-07 Helmut Uebel Method of detecting obstacles on railroad lines
JP2016000598A (en) * 2014-06-12 2016-01-07 西日本旅客鉄道株式会社 Railway track space obstacle detection system
CN107993488A (en) * 2017-12-13 2018-05-04 深圳市航盛电子股份有限公司 A kind of parking stall recognition methods, system and medium based on fisheye camera
CN110688903A (en) * 2019-08-30 2020-01-14 陕西九域通创轨道***技术有限责任公司 Obstacle extraction method based on camera data of train AEB system
CN111488808A (en) * 2020-03-31 2020-08-04 杭州诚道科技股份有限公司 Lane line detection method based on traffic violation image data
CN111860113A (en) * 2020-06-01 2020-10-30 安徽奇点智能新能源汽车有限公司 Lane line detection method and system
CN112488056A (en) * 2020-12-17 2021-03-12 上海媒智科技有限公司 Linear track foreign matter intrusion detection method and device based on computer vision
CN112800974A (en) * 2021-01-29 2021-05-14 南京理工大学 Subway rail obstacle detection system and method based on machine vision

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王云泽: "列车前方轨道识别算法的设计与实现" *

Similar Documents

Publication Publication Date Title
CN110310255B (en) Point switch notch detection method based on target detection and image processing
CN112036254B (en) Moving vehicle foreground detection method based on video image
CN106780486B (en) Steel plate surface defect image extraction method
CN115272334A (en) Method for detecting micro defects on surface of steel rail under complex background
CN109978874B (en) Visual detection device and identification method for surface defects of steel rail
CN111738342B (en) Pantograph foreign matter detection method, storage medium and computer equipment
CN112800974A (en) Subway rail obstacle detection system and method based on machine vision
CN102479383A (en) Method and device for removing salt and pepper noise
CN116433666B (en) Board card line defect online identification method, system, electronic equipment and storage medium
CN110009633B (en) Steel rail surface defect detection method based on reverse Gaussian difference
CN116630813B (en) Highway road surface construction quality intelligent detection system
CN112287888B (en) Track turning recognition method based on predictive weight
CN117542003B (en) Freight train model judging method based on image feature analysis
CN111080650A (en) Method for detecting looseness and loss faults of small part bearing blocking key nut of railway wagon
CN115035000B (en) Road dust image identification method and system
CN117094914A (en) Smart city road monitoring system based on computer vision
CN113724167A (en) Self-adaptive acquisition and image processing method for high-definition video information
CN113240742A (en) Train reversing auxiliary detection method based on visual pixel link straight line detection
CN112001908B (en) Railway freight car sleeper beam hole carried foreign matter detection method
CN116958120A (en) Weak target signal extraction method based on gradient distribution characteristics
CN114299278A (en) Train backing auxiliary method based on visual pixel link straight line detection
CN111242051A (en) Vehicle identification optimization method and device and storage medium
CN103236157B (en) A kind of parking event detecting method of the state evolution process analysis procedure analysis based on image block
CN100555329C (en) Based on multi-scale wavelet transform video foreground moving Object Segmentation method
JP3886573B2 (en) Rainfall and snow detection method and apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination